I: pbuilder: network access will be disabled during build I: Current time: Sun Sep 14 03:21:59 +14 2025 I: pbuilder-time-stamp: 1757769719 I: Building the build Environment I: extracting base tarball [/var/cache/pbuilder/experimental-reproducible-base.tgz] I: copying local configuration W: --override-config is not set; not updating apt.conf Read the manpage for details. I: mounting /proc filesystem I: mounting /sys filesystem I: creating /{dev,run}/shm I: mounting /dev/pts filesystem I: redirecting /dev/ptmx to /dev/pts/ptmx I: policy-rc.d already exists I: Copying source file I: copying [swift_2.36.0-2.dsc] I: copying [./swift_2.36.0.orig.tar.xz] I: copying [./swift_2.36.0-2.debian.tar.xz] I: Extracting source dpkg-source: warning: cannot verify inline signature for ./swift_2.36.0-2.dsc: no acceptable signature found dpkg-source: info: extracting swift in swift-2.36.0 dpkg-source: info: unpacking swift_2.36.0.orig.tar.xz dpkg-source: info: unpacking swift_2.36.0-2.debian.tar.xz dpkg-source: info: using patch list from debian/patches/series dpkg-source: info: applying syslog_log_name.patch dpkg-source: info: applying disable_sphinxcontrib_rsvgconverter.patch dpkg-source: info: applying set-default-workers-value.patch dpkg-source: info: applying Add_tempurl_path_prefix_configuration_option.patch dpkg-source: info: applying swift-recon-only-query-object-servers-once.patch dpkg-source: info: applying drive-full-checker.patch I: Not using root during the build. I: Installing the build-deps I: user script /srv/workspace/pbuilder/1784759/tmp/hooks/D01_modify_environment starting debug: Running on codethink04-arm64. I: Changing host+domainname to test build reproducibility I: Adding a custom variable just for the fun of it... I: Changing /bin/sh to bash '/bin/sh' -> '/bin/bash' lrwxrwxrwx 1 root root 9 Sep 13 13:22 /bin/sh -> /bin/bash I: Setting pbuilder2's login shell to /bin/bash I: Setting pbuilder2's GECOS to second user,second room,second work-phone,second home-phone,second other I: user script /srv/workspace/pbuilder/1784759/tmp/hooks/D01_modify_environment finished I: user script /srv/workspace/pbuilder/1784759/tmp/hooks/D02_print_environment starting I: set BASH=/bin/sh BASHOPTS=checkwinsize:cmdhist:complete_fullquote:extquote:force_fignore:globasciiranges:globskipdots:hostcomplete:interactive_comments:patsub_replacement:progcomp:promptvars:sourcepath BASH_ALIASES=() BASH_ARGC=() BASH_ARGV=() BASH_CMDS=() BASH_LINENO=([0]="12" [1]="0") BASH_LOADABLES_PATH=/usr/local/lib/bash:/usr/lib/bash:/opt/local/lib/bash:/usr/pkg/lib/bash:/opt/pkg/lib/bash:. BASH_SOURCE=([0]="/tmp/hooks/D02_print_environment" [1]="/tmp/hooks/D02_print_environment") BASH_VERSINFO=([0]="5" [1]="3" [2]="3" [3]="1" [4]="release" [5]="aarch64-unknown-linux-gnu") BASH_VERSION='5.3.3(1)-release' BUILDDIR=/build/reproducible-path BUILDUSERGECOS='second user,second room,second work-phone,second home-phone,second other' BUILDUSERNAME=pbuilder2 BUILD_ARCH=arm64 DEBIAN_FRONTEND=noninteractive DEB_BUILD_OPTIONS='buildinfo=+all reproducible=+all parallel=12 ' DIRSTACK=() DISTRIBUTION=experimental EUID=0 FUNCNAME=([0]="Echo" [1]="main") GROUPS=() HOME=/root HOSTNAME=i-capture-the-hostname HOSTTYPE=aarch64 HOST_ARCH=arm64 IFS=' ' INVOCATION_ID=fc0cfbf6c26a42bb8075100ae0a07e67 LANG=C LANGUAGE=nl_BE:nl LC_ALL=C MACHTYPE=aarch64-unknown-linux-gnu MAIL=/var/mail/root OPTERR=1 OPTIND=1 OSTYPE=linux-gnu PATH=/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path PBCURRENTCOMMANDLINEOPERATION=build PBUILDER_OPERATION=build PBUILDER_PKGDATADIR=/usr/share/pbuilder PBUILDER_PKGLIBDIR=/usr/lib/pbuilder PBUILDER_SYSCONFDIR=/etc PIPESTATUS=([0]="0") POSIXLY_CORRECT=y PPID=1784759 PS4='+ ' PWD=/ SHELL=/bin/bash SHELLOPTS=braceexpand:errexit:hashall:interactive-comments:posix SHLVL=3 SUDO_COMMAND='/usr/bin/timeout -k 24.1h 24h /usr/bin/ionice -c 3 /usr/bin/nice -n 11 /usr/bin/unshare --uts -- /usr/sbin/pbuilder --build --configfile /srv/reproducible-results/rbuild-debian/r-b-build.eqJJdAi6/pbuilderrc_4TDs --distribution experimental --hookdir /etc/pbuilder/rebuild-hooks --debbuildopts -b --basetgz /var/cache/pbuilder/experimental-reproducible-base.tgz --buildresult /srv/reproducible-results/rbuild-debian/r-b-build.eqJJdAi6/b2 --logfile b2/build.log swift_2.36.0-2.dsc' SUDO_GID=109 SUDO_HOME=/var/lib/jenkins SUDO_UID=104 SUDO_USER=jenkins TERM=unknown TZ=/usr/share/zoneinfo/Etc/GMT-14 UID=0 USER=root _='I: set' http_proxy=http://192.168.101.4:3128 I: uname -a Linux i-capture-the-hostname 6.12.43+deb13-cloud-arm64 #1 SMP Debian 6.12.43-1 (2025-08-27) aarch64 GNU/Linux I: ls -l /bin lrwxrwxrwx 1 root root 7 Aug 10 12:30 /bin -> usr/bin I: user script /srv/workspace/pbuilder/1784759/tmp/hooks/D02_print_environment finished -> Attempting to satisfy build-dependencies -> Creating pbuilder-satisfydepends-dummy package Package: pbuilder-satisfydepends-dummy Version: 0.invalid.0 Architecture: arm64 Maintainer: Debian Pbuilder Team Description: Dummy package to satisfy dependencies with aptitude - created by pbuilder This package was created automatically by pbuilder to satisfy the build-dependencies of the package being currently built. Depends: debhelper-compat (= 12), dh-exec, dh-python, openstack-pkg-tools, python3-all, python3-pbr, python3-setuptools, python3-sphinx, python3-boto3, python3-cffi, python3-coverage, python3-cryptography, python3-dnspython, python3-eventlet, python3-fixtures, python3-greenlet, python3-keystoneclient, python3-keystonemiddleware, python3-lxml, python3-mock, python3-openssl, python3-openstackclient, python3-openstackdocstheme, python3-os-api-ref, python3-os-testr, python3-oslo.config, python3-oslo.log, python3-oslosphinx, python3-pastedeploy, python3-pyeclib, python3-requests, python3-requests-mock, python3-stestr, python3-swiftclient, python3-xattr, subunit dpkg-deb: building package 'pbuilder-satisfydepends-dummy' in '/tmp/satisfydepends-aptitude/pbuilder-satisfydepends-dummy.deb'. Selecting previously unselected package pbuilder-satisfydepends-dummy. (Reading database ... 20020 files and directories currently installed.) Preparing to unpack .../pbuilder-satisfydepends-dummy.deb ... Unpacking pbuilder-satisfydepends-dummy (0.invalid.0) ... dpkg: pbuilder-satisfydepends-dummy: dependency problems, but configuring anyway as you requested: pbuilder-satisfydepends-dummy depends on debhelper-compat (= 12); however: Package debhelper-compat is not installed. pbuilder-satisfydepends-dummy depends on dh-exec; however: Package dh-exec is not installed. pbuilder-satisfydepends-dummy depends on dh-python; however: Package dh-python is not installed. pbuilder-satisfydepends-dummy depends on openstack-pkg-tools; however: Package openstack-pkg-tools is not installed. pbuilder-satisfydepends-dummy depends on python3-all; however: Package python3-all is not installed. pbuilder-satisfydepends-dummy depends on python3-pbr; however: Package python3-pbr is not installed. pbuilder-satisfydepends-dummy depends on python3-setuptools; however: Package python3-setuptools is not installed. pbuilder-satisfydepends-dummy depends on python3-sphinx; however: Package python3-sphinx is not installed. pbuilder-satisfydepends-dummy depends on python3-boto3; however: Package python3-boto3 is not installed. pbuilder-satisfydepends-dummy depends on python3-cffi; however: Package python3-cffi is not installed. pbuilder-satisfydepends-dummy depends on python3-coverage; however: Package python3-coverage is not installed. pbuilder-satisfydepends-dummy depends on python3-cryptography; however: Package python3-cryptography is not installed. pbuilder-satisfydepends-dummy depends on python3-dnspython; however: Package python3-dnspython is not installed. pbuilder-satisfydepends-dummy depends on python3-eventlet; however: Package python3-eventlet is not installed. pbuilder-satisfydepends-dummy depends on python3-fixtures; however: Package python3-fixtures is not installed. pbuilder-satisfydepends-dummy depends on python3-greenlet; however: Package python3-greenlet is not installed. pbuilder-satisfydepends-dummy depends on python3-keystoneclient; however: Package python3-keystoneclient is not installed. pbuilder-satisfydepends-dummy depends on python3-keystonemiddleware; however: Package python3-keystonemiddleware is not installed. pbuilder-satisfydepends-dummy depends on python3-lxml; however: Package python3-lxml is not installed. pbuilder-satisfydepends-dummy depends on python3-mock; however: Package python3-mock is not installed. pbuilder-satisfydepends-dummy depends on python3-openssl; however: Package python3-openssl is not installed. pbuilder-satisfydepends-dummy depends on python3-openstackclient; however: Package python3-openstackclient is not installed. pbuilder-satisfydepends-dummy depends on python3-openstackdocstheme; however: Package python3-openstackdocstheme is not installed. pbuilder-satisfydepends-dummy depends on python3-os-api-ref; however: Package python3-os-api-ref is not installed. pbuilder-satisfydepends-dummy depends on python3-os-testr; however: Package python3-os-testr is not installed. pbuilder-satisfydepends-dummy depends on python3-oslo.config; however: Package python3-oslo.config is not installed. pbuilder-satisfydepends-dummy depends on python3-oslo.log; however: Package python3-oslo.log is not installed. pbuilder-satisfydepends-dummy depends on python3-oslosphinx; however: Package python3-oslosphinx is not installed. pbuilder-satisfydepends-dummy depends on python3-pastedeploy; however: Package python3-pastedeploy is not installed. pbuilder-satisfydepends-dummy depends on python3-pyeclib; however: Package python3-pyeclib is not installed. pbuilder-satisfydepends-dummy depends on python3-requests; however: Package python3-requests is not installed. pbuilder-satisfydepends-dummy depends on python3-requests-mock; however: Package python3-requests-mock is not installed. pbuilder-satisfydepends-dummy depends on python3-stestr; however: Package python3-stestr is not installed. pbuilder-satisfydepends-dummy depends on python3-swiftclient; however: Package python3-swiftclient is not installed. pbuilder-satisfydepends-dummy depends on python3-xattr; however: Package python3-xattr is not installed. pbuilder-satisfydepends-dummy depends on subunit; however: Package subunit is not installed. Setting up pbuilder-satisfydepends-dummy (0.invalid.0) ... Reading package lists... Building dependency tree... Reading state information... Initializing package states... Writing extended state information... Building tag database... pbuilder-satisfydepends-dummy is already installed at the requested version (0.invalid.0) pbuilder-satisfydepends-dummy is already installed at the requested version (0.invalid.0) The following NEW packages will be installed: autoconf{a} automake{a} autopoint{a} autotools-dev{a} bsdextrautils{a} ca-certificates{a} debhelper{a} dh-autoreconf{a} dh-exec{a} dh-python{a} dh-strip-nondeterminism{a} docutils-common{a} dwz{a} file{a} fonts-font-awesome{a} fonts-glyphicons-halflings{a} gettext{a} gettext-base{a} groff-base{a} ieee-data{a} intltool-debian{a} jq{a} libarchive-zip-perl{a} libdebhelper-perl{a} libelf1t64{a} liberasurecode1{a} libexpat1{a} libffi8{a} libfile-stripnondeterminism-perl{a} libgcrypt20{a} libgnutls30t64{a} libgpg-error0{a} libice6{a} libidn2-0{a} libjq1{a} libjs-bootstrap5{a} libjs-sphinxdoc{a} libjson-perl{a} libmagic-mgc{a} libmagic1t64{a} libonig5{a} libp11-kit0{a} libpipeline1{a} libpsl5t64{a} libpython3-stdlib{a} libpython3.13-minimal{a} libpython3.13-stdlib{a} libreadline8t64{a} libsm6{a} libsubunit-perl{a} libtasn1-6{a} libtool{a} libuchardet0{a} libunistring5{a} libx11-6{a} libx11-data{a} libxau6{a} libxcb1{a} libxdmcp6{a} libxext6{a} libxml2-16{a} libxmu6{a} libxslt1.1{a} libxt6t64{a} libyaml-0-2{a} m4{a} man-db{a} media-types{a} netbase{a} node-popper2{a} openssl{a} openstack-pkg-tools{a} po-debconf{a} pycadf-common{a} python-babel-localedata{a} python-os-api-ref-common{a} python-oslosphinx-common{a} python3{a} python3-alabaster{a} python3-all{a} python3-attr{a} python3-autocommand{a} python3-autopage{a} python3-babel{a} python3-bcrypt{a} python3-binary-memcached{a} python3-blinker{a} python3-boto3{a} python3-botocore{a} python3-certifi{a} python3-cffi{a} python3-cffi-backend{a} python3-chardet{a} python3-charset-normalizer{a} python3-cinderclient{a} python3-cliff{a} python3-cmd2{a} python3-coverage{a} python3-cryptography{a} python3-dateutil{a} python3-debtcollector{a} python3-decorator{a} python3-defusedxml{a} python3-deprecation{a} python3-dnspython{a} python3-docutils{a} python3-dogpile.cache{a} python3-dulwich{a} python3-eventlet{a} python3-extras{a} python3-fixtures{a} python3-glanceclient{a} python3-greenlet{a} python3-idna{a} python3-imagesize{a} python3-inflect{a} python3-iso8601{a} python3-jaraco.classes{a} python3-jaraco.context{a} python3-jaraco.functools{a} python3-jaraco.text{a} python3-jeepney{a} python3-jinja2{a} python3-jmespath{a} python3-json-pointer{a} python3-jsonpatch{a} python3-jsonschema{a} python3-jsonschema-specifications{a} python3-jwt{a} python3-keyring{a} python3-keystoneauth1{a} python3-keystoneclient{a} python3-keystonemiddleware{a} python3-legacy-cgi{a} python3-lxml{a} python3-mako{a} python3-markupsafe{a} python3-memcache{a} python3-minimal{a} python3-mock{a} python3-more-itertools{a} python3-msgpack{a} python3-netaddr{a} python3-neutronclient{a} python3-oauthlib{a} python3-openssl{a} python3-openstackclient{a} python3-openstackdocstheme{a} python3-openstacksdk{a} python3-os-api-ref{a} python3-os-client-config{a} python3-os-service-types{a} python3-os-testr{a} python3-osc-lib{a} python3-oslo.cache{a} python3-oslo.config{a} python3-oslo.context{a} python3-oslo.i18n{a} python3-oslo.log{a} python3-oslo.serialization{a} python3-oslo.utils{a} python3-oslosphinx{a} python3-packaging{a} python3-paste{a} python3-pastedeploy{a} python3-pastedeploy-tpl{a} python3-pbr{a} python3-pip{a} python3-pkg-resources{a} python3-platformdirs{a} python3-ply{a} python3-prettytable{a} python3-psutil{a} python3-pyasyncore{a} python3-pycadf{a} python3-pycparser{a} python3-pyeclib{a} python3-pygments{a} python3-pyparsing{a} python3-pyperclip{a} python3-pytz{a} python3-referencing{a} python3-requests{a} python3-requests-mock{a} python3-requestsexceptions{a} python3-rfc3986{a} python3-roman{a} python3-roman-numerals{a} python3-rpds-py{a} python3-s3transfer{a} python3-secretstorage{a} python3-setuptools{a} python3-simplejson{a} python3-six{a} python3-snowballstemmer{a} python3-sphinx{a} python3-stestr{a} python3-stevedore{a} python3-subunit{a} python3-swiftclient{a} python3-tempita{a} python3-testtools{a} python3-tomlkit{a} python3-typeguard{a} python3-typing-extensions{a} python3-tz{a} python3-uhashring{a} python3-urllib3{a} python3-voluptuous{a} python3-warlock{a} python3-wcwidth{a} python3-webob{a} python3-wheel{a} python3-wrapt{a} python3-xattr{a} python3-yaml{a} python3-zipp{a} python3.13{a} python3.13-minimal{a} readline-common{a} sensible-utils{a} sgml-base{a} sphinx-common{a} subunit{a} tzdata{a} wget{a} x11-common{a} xclip{a} xml-core{a} The following packages are RECOMMENDED but will NOT be installed: autopkgtest libarchive-cpio-perl libgpg-error-l10n libjson-xs-perl libltdl-dev libmail-sendmail-perl libpaper-utils madison-lite pristine-tar publicsuffix python-openstackclient-doc python3-bs4 python3-cssselect python3-dev python3-fastimport python3-fqdn python3-h2 python3-html5lib python3-httpcore python3-httpx python3-isoduration python3-pastescript python3-pil python3-rfc3339-validator python3-rfc3986-validator python3-rfc3987 python3-uritemplate python3-webcolors xauth 0 packages upgraded, 229 newly installed, 0 to remove and 0 not upgraded. Need to get 59.5 MB of archives. After unpacking 356 MB will be used. Writing extended state information... Get: 1 http://deb.debian.org/debian unstable/main arm64 libexpat1 arm64 2.7.1-2 [93.3 kB] Get: 2 http://deb.debian.org/debian unstable/main arm64 libpython3.13-minimal arm64 3.13.7-1 [857 kB] Get: 3 http://deb.debian.org/debian unstable/main arm64 python3.13-minimal arm64 3.13.7-1 [2001 kB] Get: 4 http://deb.debian.org/debian unstable/main arm64 python3-minimal arm64 3.13.7-1 [27.2 kB] Get: 5 http://deb.debian.org/debian unstable/main arm64 media-types all 13.0.0 [29.3 kB] Get: 6 http://deb.debian.org/debian unstable/main arm64 netbase all 6.5 [12.4 kB] Get: 7 http://deb.debian.org/debian unstable/main arm64 tzdata all 2025b-5 [260 kB] Get: 8 http://deb.debian.org/debian unstable/main arm64 libffi8 arm64 3.5.2-2 [21.5 kB] Get: 9 http://deb.debian.org/debian unstable/main arm64 readline-common all 8.3-3 [74.8 kB] Get: 10 http://deb.debian.org/debian unstable/main arm64 libreadline8t64 arm64 8.3-3 [169 kB] Get: 11 http://deb.debian.org/debian unstable/main arm64 libpython3.13-stdlib arm64 3.13.7-1 [1895 kB] Get: 12 http://deb.debian.org/debian unstable/main arm64 python3.13 arm64 3.13.7-1 [761 kB] Get: 13 http://deb.debian.org/debian unstable/main arm64 libpython3-stdlib arm64 3.13.7-1 [10.2 kB] Get: 14 http://deb.debian.org/debian unstable/main arm64 python3 arm64 3.13.7-1 [28.3 kB] Get: 15 http://deb.debian.org/debian unstable/main arm64 sensible-utils all 0.0.26 [27.0 kB] Get: 16 http://deb.debian.org/debian unstable/main arm64 openssl arm64 3.5.2-1 [1457 kB] Get: 17 http://deb.debian.org/debian unstable/main arm64 ca-certificates all 20250419 [162 kB] Get: 18 http://deb.debian.org/debian unstable/main arm64 libmagic-mgc arm64 1:5.46-5 [338 kB] Get: 19 http://deb.debian.org/debian unstable/main arm64 libmagic1t64 arm64 1:5.46-5 [103 kB] Get: 20 http://deb.debian.org/debian unstable/main arm64 file arm64 1:5.46-5 [43.7 kB] Get: 21 http://deb.debian.org/debian unstable/main arm64 gettext-base arm64 0.23.1-2+b1 [241 kB] Get: 22 http://deb.debian.org/debian unstable/main arm64 libuchardet0 arm64 0.0.8-2 [69.0 kB] Get: 23 http://deb.debian.org/debian unstable/main arm64 groff-base arm64 1.23.0-9 [1130 kB] Get: 24 http://deb.debian.org/debian unstable/main arm64 bsdextrautils arm64 2.41.1-3 [98.1 kB] Get: 25 http://deb.debian.org/debian unstable/main arm64 libpipeline1 arm64 1.5.8-1 [40.2 kB] Get: 26 http://deb.debian.org/debian unstable/main arm64 man-db arm64 2.13.1-1 [1453 kB] Get: 27 http://deb.debian.org/debian unstable/main arm64 libunistring5 arm64 1.3-2 [453 kB] Get: 28 http://deb.debian.org/debian unstable/main arm64 libidn2-0 arm64 2.3.8-4 [108 kB] Get: 29 http://deb.debian.org/debian unstable/main arm64 libp11-kit0 arm64 0.25.5-3 [409 kB] Get: 30 http://deb.debian.org/debian unstable/main arm64 libtasn1-6 arm64 4.20.0-2 [47.3 kB] Get: 31 http://deb.debian.org/debian unstable/main arm64 libgnutls30t64 arm64 3.8.10-2 [1395 kB] Get: 32 http://deb.debian.org/debian unstable/main arm64 libpsl5t64 arm64 0.21.2-1.1+b1 [57.1 kB] Get: 33 http://deb.debian.org/debian unstable/main arm64 wget arm64 1.25.0-2 [970 kB] Get: 34 http://deb.debian.org/debian unstable/main arm64 m4 arm64 1.4.20-1 [316 kB] Get: 35 http://deb.debian.org/debian unstable/main arm64 autoconf all 2.72-3.1 [494 kB] Get: 36 http://deb.debian.org/debian unstable/main arm64 autotools-dev all 20240727.1 [60.2 kB] Get: 37 http://deb.debian.org/debian unstable/main arm64 automake all 1:1.17-4 [862 kB] Get: 38 http://deb.debian.org/debian unstable/main arm64 autopoint all 0.23.1-2 [770 kB] Get: 39 http://deb.debian.org/debian unstable/main arm64 libdebhelper-perl all 13.26 [91.8 kB] Get: 40 http://deb.debian.org/debian unstable/main arm64 libtool all 2.5.4-5 [540 kB] Get: 41 http://deb.debian.org/debian unstable/main arm64 dh-autoreconf all 20 [17.1 kB] Get: 42 http://deb.debian.org/debian unstable/main arm64 libarchive-zip-perl all 1.68-1 [104 kB] Get: 43 http://deb.debian.org/debian unstable/main arm64 libfile-stripnondeterminism-perl all 1.15.0-1 [19.9 kB] Get: 44 http://deb.debian.org/debian unstable/main arm64 dh-strip-nondeterminism all 1.15.0-1 [8812 B] Get: 45 http://deb.debian.org/debian unstable/main arm64 libelf1t64 arm64 0.193-3 [189 kB] Get: 46 http://deb.debian.org/debian unstable/main arm64 dwz arm64 0.16-2 [100 kB] Get: 47 http://deb.debian.org/debian unstable/main arm64 libxml2-16 arm64 2.14.5+dfsg-0.2 [582 kB] Get: 48 http://deb.debian.org/debian unstable/main arm64 gettext arm64 0.23.1-2+b1 [1612 kB] Get: 49 http://deb.debian.org/debian unstable/main arm64 intltool-debian all 0.35.0+20060710.6 [22.9 kB] Get: 50 http://deb.debian.org/debian unstable/main arm64 po-debconf all 1.0.21+nmu1 [248 kB] Get: 51 http://deb.debian.org/debian unstable/main arm64 debhelper all 13.26 [939 kB] Get: 52 http://deb.debian.org/debian unstable/main arm64 dh-exec arm64 0.30+b1 [25.8 kB] Get: 53 http://deb.debian.org/debian unstable/main arm64 dh-python all 6.20250414 [116 kB] Get: 54 http://deb.debian.org/debian unstable/main arm64 sgml-base all 1.31+nmu1 [10.9 kB] Get: 55 http://deb.debian.org/debian unstable/main arm64 xml-core all 0.19 [20.1 kB] Get: 56 http://deb.debian.org/debian unstable/main arm64 docutils-common all 0.21.2+dfsg-2 [128 kB] Get: 57 http://deb.debian.org/debian unstable/main arm64 fonts-font-awesome all 5.0.10+really4.7.0~dfsg-4.1 [517 kB] Get: 58 http://deb.debian.org/debian unstable/main arm64 fonts-glyphicons-halflings all 1.009~3.4.1+dfsg-6 [163 kB] Get: 59 http://deb.debian.org/debian unstable/main arm64 ieee-data all 20240722 [2221 kB] Get: 60 http://deb.debian.org/debian unstable/main arm64 libonig5 arm64 6.9.10-1 [187 kB] Get: 61 http://deb.debian.org/debian unstable/main arm64 libjq1 arm64 1.8.1-3 [151 kB] Get: 62 http://deb.debian.org/debian unstable/main arm64 jq arm64 1.8.1-3 [84.6 kB] Get: 63 http://deb.debian.org/debian unstable/main arm64 liberasurecode1 arm64 1.6.3-1+b1 [40.8 kB] Get: 64 http://deb.debian.org/debian unstable/main arm64 libgpg-error0 arm64 1.55-2 [83.9 kB] Get: 65 http://deb.debian.org/debian unstable/main arm64 libgcrypt20 arm64 1.11.2-2 [772 kB] Get: 66 http://deb.debian.org/debian unstable/main arm64 x11-common all 1:7.7+25 [217 kB] Get: 67 http://deb.debian.org/debian unstable/main arm64 libice6 arm64 2:1.1.1-1 [62.1 kB] Get: 68 http://deb.debian.org/debian unstable/main arm64 node-popper2 all 2.11.2-8 [100.0 kB] Get: 69 http://deb.debian.org/debian unstable/main arm64 libjs-bootstrap5 all 5.3.8+dfsg-1 [460 kB] Get: 70 http://deb.debian.org/debian unstable/main arm64 libjs-sphinxdoc all 8.2.3-6 [27.5 kB] Get: 71 http://deb.debian.org/debian unstable/main arm64 libjson-perl all 4.10000-1 [87.5 kB] Get: 72 http://deb.debian.org/debian unstable/main arm64 libsm6 arm64 2:1.2.6-1 [36.4 kB] Get: 73 http://deb.debian.org/debian unstable/main arm64 libsubunit-perl all 1.4.2-3 [5724 B] Get: 74 http://deb.debian.org/debian unstable/main arm64 libxau6 arm64 1:1.0.11-1 [20.6 kB] Get: 75 http://deb.debian.org/debian unstable/main arm64 libxdmcp6 arm64 1:1.1.5-1 [27.8 kB] Get: 76 http://deb.debian.org/debian unstable/main arm64 libxcb1 arm64 1.17.0-2+b1 [143 kB] Get: 77 http://deb.debian.org/debian unstable/main arm64 libx11-data all 2:1.8.12-1 [343 kB] Get: 78 http://deb.debian.org/debian unstable/main arm64 libx11-6 arm64 2:1.8.12-1 [795 kB] Get: 79 http://deb.debian.org/debian unstable/main arm64 libxext6 arm64 2:1.3.4-1+b3 [49.2 kB] Get: 80 http://deb.debian.org/debian unstable/main arm64 libxt6t64 arm64 1:1.2.1-1.3 [182 kB] Get: 81 http://deb.debian.org/debian unstable/main arm64 libxmu6 arm64 2:1.1.3-3+b4 [55.7 kB] Get: 82 http://deb.debian.org/debian unstable/main arm64 libxslt1.1 arm64 1.1.43-0.2 [145 kB] Get: 83 http://deb.debian.org/debian unstable/main arm64 libyaml-0-2 arm64 0.2.5-2 [49.2 kB] Get: 84 http://deb.debian.org/debian unstable/main arm64 python3-packaging all 25.0-1 [56.6 kB] Get: 85 http://deb.debian.org/debian unstable/main arm64 python3-wheel all 0.46.1-2 [21.7 kB] Get: 86 http://deb.debian.org/debian unstable/main arm64 python3-pip all 25.2+dfsg-1 [1386 kB] Get: 87 http://deb.debian.org/debian unstable/main arm64 openstack-pkg-tools all 135 [98.7 kB] Get: 88 http://deb.debian.org/debian unstable/main arm64 pycadf-common all 4.0.1-1 [4496 B] Get: 89 http://deb.debian.org/debian unstable/main arm64 python-babel-localedata all 2.17.0-1 [6050 kB] Get: 90 http://deb.debian.org/debian unstable/main arm64 python-os-api-ref-common all 2.3.0+ds1-4 [9604 B] Get: 91 http://deb.debian.org/debian unstable/main arm64 python-oslosphinx-common all 4.18.0-6 [28.4 kB] Get: 92 http://deb.debian.org/debian unstable/main arm64 python3-alabaster all 0.7.16-0.1 [27.9 kB] Get: 93 http://deb.debian.org/debian unstable/main arm64 python3-all arm64 3.13.7-1 [1044 B] Get: 94 http://deb.debian.org/debian unstable/main arm64 python3-attr all 25.3.0-1 [69.5 kB] Get: 95 http://deb.debian.org/debian unstable/main arm64 python3-autocommand all 2.2.2-3 [13.6 kB] Get: 96 http://deb.debian.org/debian unstable/main arm64 python3-autopage all 0.4.0-4 [12.9 kB] Get: 97 http://deb.debian.org/debian unstable/main arm64 python3-babel all 2.17.0-1 [117 kB] Get: 98 http://deb.debian.org/debian unstable/main arm64 python3-bcrypt arm64 4.3.0-1 [189 kB] Get: 99 http://deb.debian.org/debian unstable/main arm64 python3-six all 1.17.0-1 [16.5 kB] Get: 100 http://deb.debian.org/debian unstable/main arm64 python3-memcache all 1.62-3 [26.0 kB] Get: 101 http://deb.debian.org/debian unstable/main arm64 python3-uhashring all 2.3-2 [12.3 kB] Get: 102 http://deb.debian.org/debian unstable/main arm64 python3-binary-memcached all 0.31.2+dfsg1-4 [13.9 kB] Get: 103 http://deb.debian.org/debian unstable/main arm64 python3-blinker all 1.9.0-2 [12.7 kB] Get: 104 http://deb.debian.org/debian unstable/main arm64 python3-dateutil all 2.9.0-4 [79.4 kB] Get: 105 http://deb.debian.org/debian unstable/main arm64 python3-jmespath all 1.0.1-1 [21.1 kB] Get: 106 http://deb.debian.org/debian unstable/main arm64 python3-urllib3 all 2.5.0-1 [116 kB] Get: 107 http://deb.debian.org/debian unstable/main arm64 python3-certifi all 2025.1.31+ds-1 [9652 B] Get: 108 http://deb.debian.org/debian unstable/main arm64 python3-charset-normalizer arm64 3.4.3-1 [123 kB] Get: 109 http://deb.debian.org/debian unstable/main arm64 python3-idna all 3.10-1 [42.0 kB] Get: 110 http://deb.debian.org/debian unstable/main arm64 python3-chardet all 5.2.0+dfsg-2 [108 kB] Get: 111 http://deb.debian.org/debian unstable/main arm64 python3-requests all 2.32.5+dfsg-1 [72.4 kB] Get: 112 http://deb.debian.org/debian unstable/main arm64 python3-botocore all 1.37.9+repack-1 [7311 kB] Get: 113 http://deb.debian.org/debian unstable/main arm64 python3-s3transfer all 0.11.4-1 [57.7 kB] Get: 114 http://deb.debian.org/debian unstable/main arm64 python3-boto3 all 1.37.9-1 [339 kB] Get: 115 http://deb.debian.org/debian unstable/main arm64 python3-cffi-backend arm64 2.0.0~b1-1 [93.6 kB] Get: 116 http://deb.debian.org/debian unstable/main arm64 python3-ply all 3.11-9 [62.9 kB] Get: 117 http://deb.debian.org/debian unstable/main arm64 python3-pycparser all 2.22-2 [78.0 kB] Get: 118 http://deb.debian.org/debian unstable/main arm64 python3-cffi all 2.0.0~b1-1 [90.3 kB] Get: 119 http://deb.debian.org/debian unstable/main arm64 python3-iso8601 all 2.1.0-2 [12.1 kB] Get: 120 http://deb.debian.org/debian unstable/main arm64 python3-lxml arm64 6.0.1-1 [1265 kB] Get: 121 http://deb.debian.org/debian unstable/main arm64 python3-cryptography arm64 43.0.0-3 [835 kB] Get: 122 http://deb.debian.org/debian unstable/main arm64 python3-jwt all 2.10.1-3 [31.3 kB] Get: 123 http://deb.debian.org/debian unstable/main arm64 python3-oauthlib all 3.3.1-1 [99.5 kB] Get: 124 http://deb.debian.org/debian unstable/main arm64 python3-more-itertools all 10.8.0-1 [71.7 kB] Get: 125 http://deb.debian.org/debian unstable/main arm64 python3-typing-extensions all 4.15.0-1 [92.4 kB] Get: 126 http://deb.debian.org/debian unstable/main arm64 python3-typeguard all 4.4.4-1 [37.1 kB] Get: 127 http://deb.debian.org/debian unstable/main arm64 python3-inflect all 7.5.0-1 [33.0 kB] Get: 128 http://deb.debian.org/debian unstable/main arm64 python3-jaraco.context all 6.0.1-1 [8276 B] Get: 129 http://deb.debian.org/debian unstable/main arm64 python3-jaraco.functools all 4.1.0-1 [12.0 kB] Get: 130 http://deb.debian.org/debian unstable/main arm64 python3-pkg-resources all 78.1.1-0.1 [224 kB] Get: 131 http://deb.debian.org/debian unstable/main arm64 python3-jaraco.text all 4.0.0-1 [11.4 kB] Get: 132 http://deb.debian.org/debian unstable/main arm64 python3-zipp all 3.23.0-1 [11.0 kB] Get: 133 http://deb.debian.org/debian unstable/main arm64 python3-setuptools all 78.1.1-0.1 [738 kB] Get: 134 http://deb.debian.org/debian unstable/main arm64 python3-pbr all 6.1.1-2 [57.1 kB] Get: 135 http://deb.debian.org/debian unstable/main arm64 python3-os-service-types all 1.7.0-5 [12.6 kB] Get: 136 http://deb.debian.org/debian unstable/main arm64 python3-stevedore all 5.4.1-2 [20.9 kB] Get: 137 http://deb.debian.org/debian unstable/main arm64 python3-keystoneauth1 all 5.10.0-2 [164 kB] Get: 138 http://deb.debian.org/debian unstable/main arm64 python3-oslo.i18n all 6.5.1-3 [19.2 kB] Get: 139 http://deb.debian.org/debian unstable/main arm64 python3-wrapt arm64 1.15.0-4+b1 [42.7 kB] Get: 140 http://deb.debian.org/debian unstable/main arm64 python3-debtcollector all 3.0.0-5 [13.2 kB] Get: 141 http://deb.debian.org/debian unstable/main arm64 python3-netaddr all 1.3.0-1 [356 kB] Get: 142 http://deb.debian.org/debian unstable/main arm64 python3-psutil arm64 7.0.0-2 [220 kB] Get: 143 http://deb.debian.org/debian unstable/main arm64 python3-pyparsing all 3.1.2-1 [146 kB] Get: 144 http://deb.debian.org/debian unstable/main arm64 python3-pytz all 2025.2-3 [152 kB] Get: 145 http://deb.debian.org/debian unstable/main arm64 python3-tz all 2025.2-3 [4280 B] Get: 146 http://deb.debian.org/debian unstable/main arm64 python3-yaml arm64 6.0.2-2 [122 kB] Get: 147 http://deb.debian.org/debian unstable/main arm64 python3-oslo.utils all 8.2.0-4 [83.9 kB] Get: 148 http://deb.debian.org/debian unstable/main arm64 python3-wcwidth all 0.2.13+dfsg1-1 [24.9 kB] Get: 149 http://deb.debian.org/debian unstable/main arm64 python3-prettytable all 3.15.1-1 [41.8 kB] Get: 150 http://deb.debian.org/debian unstable/main arm64 python3-cinderclient all 1:9.7.0-2 [134 kB] Get: 151 http://deb.debian.org/debian unstable/main arm64 xclip arm64 0.13-4+b2 [21.1 kB] Get: 152 http://deb.debian.org/debian unstable/main arm64 python3-pyperclip all 1.8.2-2 [13.2 kB] Get: 153 http://deb.debian.org/debian unstable/main arm64 python3-cmd2 all 2.5.11+ds-1 [150 kB] Get: 154 http://deb.debian.org/debian unstable/main arm64 python3-roman all 5.1-1 [11.0 kB] Get: 155 http://deb.debian.org/debian unstable/main arm64 python3-docutils all 0.21.2+dfsg-2 [403 kB] Get: 156 http://deb.debian.org/debian unstable/main arm64 python3-cliff all 4.9.1-2 [44.2 kB] Get: 157 http://deb.debian.org/debian unstable/main arm64 python3-coverage arm64 7.8.2+dfsg1-1 [182 kB] Get: 158 http://deb.debian.org/debian unstable/main arm64 python3-decorator all 5.2.1-2 [33.0 kB] Get: 159 http://deb.debian.org/debian unstable/main arm64 python3-defusedxml all 0.7.1-3 [43.4 kB] Get: 160 http://deb.debian.org/debian unstable/main arm64 python3-deprecation all 2.1.0-4 [14.7 kB] Get: 161 http://deb.debian.org/debian unstable/main arm64 python3-dnspython all 2.7.0-1 [164 kB] Get: 162 http://deb.debian.org/debian unstable/main arm64 python3-markupsafe arm64 2.1.5-1+b4 [14.1 kB] Get: 163 http://deb.debian.org/debian unstable/main arm64 python3-mako all 1.3.9-1 [83.6 kB] Get: 164 http://deb.debian.org/debian unstable/main arm64 python3-dogpile.cache all 1.3.3-1 [46.0 kB] Get: 165 http://deb.debian.org/debian unstable/main arm64 python3-dulwich arm64 0.22.7-2 [205 kB] Get: 166 http://deb.debian.org/debian unstable/main arm64 python3-greenlet arm64 3.1.0-1+b2 [162 kB] Get: 167 http://deb.debian.org/debian unstable/main arm64 python3-eventlet all 0.40.1-3 [311 kB] Get: 168 http://deb.debian.org/debian unstable/main arm64 python3-extras all 1.0.0-6 [7528 B] Get: 169 http://deb.debian.org/debian unstable/main arm64 python3-testtools all 2.7.2-5 [123 kB] Get: 170 http://deb.debian.org/debian unstable/main arm64 python3-fixtures all 4.1.0-3 [34.2 kB] Get: 171 http://deb.debian.org/debian unstable/main arm64 python3-openssl all 25.1.0-1 [52.6 kB] Get: 172 http://deb.debian.org/debian unstable/main arm64 python3-json-pointer all 2.4-3 [14.6 kB] Get: 173 http://deb.debian.org/debian unstable/main arm64 python3-jsonpatch all 1.32-5 [12.1 kB] Get: 174 http://deb.debian.org/debian unstable/main arm64 python3-rpds-py arm64 0.21.0-2+b1 [226 kB] Get: 175 http://deb.debian.org/debian unstable/main arm64 python3-referencing all 0.36.2-1 [23.7 kB] Get: 176 http://deb.debian.org/debian unstable/main arm64 python3-jsonschema-specifications all 2023.12.1-2 [9020 B] Get: 177 http://deb.debian.org/debian unstable/main arm64 python3-jsonschema all 4.19.2-6 [71.4 kB] Get: 178 http://deb.debian.org/debian unstable/main arm64 python3-warlock all 2.0.1-4 [9224 B] Get: 179 http://deb.debian.org/debian unstable/main arm64 python3-glanceclient all 1:4.8.0-2 [131 kB] Get: 180 http://deb.debian.org/debian unstable/main arm64 python3-imagesize all 1.4.1-1 [6688 B] Get: 181 http://deb.debian.org/debian unstable/main arm64 python3-jaraco.classes all 3.4.0-1 [7728 B] Get: 182 http://deb.debian.org/debian unstable/main arm64 python3-jeepney all 0.9.0-1 [33.4 kB] Get: 183 http://deb.debian.org/debian unstable/main arm64 python3-jinja2 all 3.1.6-1 [107 kB] Get: 184 http://deb.debian.org/debian unstable/main arm64 python3-secretstorage all 3.4.0-1 [16.5 kB] Get: 185 http://deb.debian.org/debian unstable/main arm64 python3-keyring all 25.6.0-3 [54.9 kB] Get: 186 http://deb.debian.org/debian unstable/main arm64 python3-oslo.context all 5.7.1-3 [13.4 kB] Get: 187 http://deb.debian.org/debian unstable/main arm64 python3-msgpack arm64 1.0.3-3+b5 [77.4 kB] Get: 188 http://deb.debian.org/debian unstable/main arm64 python3-oslo.serialization all 5.7.0-3 [14.7 kB] Get: 189 http://deb.debian.org/debian unstable/main arm64 python3-pyasyncore all 1.0.2-3 [10.1 kB] Get: 190 http://deb.debian.org/debian unstable/main arm64 python3-oslo.log all 7.1.0-4 [43.0 kB] Get: 191 http://deb.debian.org/debian unstable/main arm64 python3-rfc3986 all 2.0.0-3 [21.6 kB] Get: 192 http://deb.debian.org/debian unstable/main arm64 python3-oslo.config all 1:9.7.1-3 [108 kB] Get: 193 http://deb.debian.org/debian unstable/main arm64 python3-keystoneclient all 1:5.6.0-2 [200 kB] Get: 194 http://deb.debian.org/debian unstable/main arm64 python3-oslo.cache all 3.10.1-3 [35.6 kB] Get: 195 http://deb.debian.org/debian unstable/main arm64 python3-pycadf all 4.0.1-1 [18.1 kB] Get: 196 http://deb.debian.org/debian unstable/main arm64 python3-legacy-cgi all 2.6.3-1 [16.5 kB] Get: 197 http://deb.debian.org/debian unstable/main arm64 python3-webob all 1:1.8.9-1 [89.1 kB] Get: 198 http://deb.debian.org/debian unstable/main arm64 python3-keystonemiddleware all 10.9.0-2 [79.6 kB] Get: 199 http://deb.debian.org/debian unstable/main arm64 python3-mock all 5.2.0-1 [72.9 kB] Get: 200 http://deb.debian.org/debian unstable/main arm64 python3-platformdirs all 4.4.0-1 [16.7 kB] Get: 201 http://deb.debian.org/debian unstable/main arm64 python3-requestsexceptions all 1.4.0-5 [3860 B] Get: 202 http://deb.debian.org/debian unstable/main arm64 python3-openstacksdk all 4.4.0-5 [681 kB] Get: 203 http://deb.debian.org/debian unstable/main arm64 python3-osc-lib all 3.2.0-2 [52.7 kB] Get: 204 http://deb.debian.org/debian unstable/main arm64 python3-simplejson arm64 3.20.1-1 [61.5 kB] Get: 205 http://deb.debian.org/debian unstable/main arm64 python3-openstackclient all 7.4.0-3 [498 kB] Get: 206 http://deb.debian.org/debian unstable/main arm64 python3-os-client-config all 2.1.0-3 [17.5 kB] Get: 207 http://deb.debian.org/debian unstable/main arm64 python3-neutronclient all 1:11.4.0-2 [120 kB] Get: 208 http://deb.debian.org/debian unstable/main arm64 sphinx-common all 8.2.3-6 [619 kB] Get: 209 http://deb.debian.org/debian unstable/main arm64 python3-pygments all 2.18.0+dfsg-2 [836 kB] Get: 210 http://deb.debian.org/debian unstable/main arm64 python3-roman-numerals all 3.1.0-2 [8740 B] Get: 211 http://deb.debian.org/debian unstable/main arm64 python3-snowballstemmer all 3.0.1-1 [63.5 kB] Get: 212 http://deb.debian.org/debian unstable/main arm64 python3-sphinx all 8.2.3-6 [477 kB] Get: 213 http://deb.debian.org/debian unstable/main arm64 python3-openstackdocstheme all 3.2.0-3 [684 kB] Get: 214 http://deb.debian.org/debian unstable/main arm64 python3-oslosphinx all 4.18.0-6 [33.0 kB] Get: 215 http://deb.debian.org/debian unstable/main arm64 python3-os-api-ref all 2.3.0+ds1-4 [17.0 kB] Get: 216 http://deb.debian.org/debian unstable/main arm64 python3-tomlkit all 0.13.2-1 [42.7 kB] Get: 217 http://deb.debian.org/debian unstable/main arm64 python3-voluptuous all 0.14.2-1 [45.8 kB] Get: 218 http://deb.debian.org/debian unstable/main arm64 python3-subunit all 1.4.2-3 [66.4 kB] Get: 219 http://deb.debian.org/debian unstable/main arm64 subunit all 1.4.2-3 [5248 B] Get: 220 http://deb.debian.org/debian unstable/main arm64 python3-stestr all 4.1.0-3 [56.9 kB] Get: 221 http://deb.debian.org/debian unstable/main arm64 python3-os-testr all 3.0.0-4 [18.0 kB] Get: 222 http://deb.debian.org/debian unstable/main arm64 python3-tempita all 0.6.0-1 [14.6 kB] Get: 223 http://deb.debian.org/debian unstable/main arm64 python3-paste all 3.10.1-1 [222 kB] Get: 224 http://deb.debian.org/debian unstable/main arm64 python3-pastedeploy-tpl all 3.1-1 [8268 B] Get: 225 http://deb.debian.org/debian unstable/main arm64 python3-pastedeploy all 3.1-1 [18.3 kB] Get: 226 http://deb.debian.org/debian unstable/main arm64 python3-pyeclib arm64 1.6.1-2+b1 [29.2 kB] Get: 227 http://deb.debian.org/debian unstable/main arm64 python3-requests-mock all 1.12.1-3 [17.6 kB] Get: 228 http://deb.debian.org/debian unstable/main arm64 python3-swiftclient all 1:4.7.0-2 [76.5 kB] Get: 229 http://deb.debian.org/debian unstable/main arm64 python3-xattr arm64 0.10.1-1+b1 [16.6 kB] Fetched 59.5 MB in 0s (178 MB/s) Preconfiguring packages ... Selecting previously unselected package libexpat1:arm64. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 20020 files and directories currently installed.) Preparing to unpack .../libexpat1_2.7.1-2_arm64.deb ... Unpacking libexpat1:arm64 (2.7.1-2) ... Selecting previously unselected package libpython3.13-minimal:arm64. Preparing to unpack .../libpython3.13-minimal_3.13.7-1_arm64.deb ... Unpacking libpython3.13-minimal:arm64 (3.13.7-1) ... Selecting previously unselected package python3.13-minimal. Preparing to unpack .../python3.13-minimal_3.13.7-1_arm64.deb ... Unpacking python3.13-minimal (3.13.7-1) ... Setting up libpython3.13-minimal:arm64 (3.13.7-1) ... Setting up libexpat1:arm64 (2.7.1-2) ... Setting up python3.13-minimal (3.13.7-1) ... Selecting previously unselected package python3-minimal. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 20354 files and directories currently installed.) Preparing to unpack .../0-python3-minimal_3.13.7-1_arm64.deb ... Unpacking python3-minimal (3.13.7-1) ... Selecting previously unselected package media-types. Preparing to unpack .../1-media-types_13.0.0_all.deb ... Unpacking media-types (13.0.0) ... Selecting previously unselected package netbase. Preparing to unpack .../2-netbase_6.5_all.deb ... Unpacking netbase (6.5) ... Selecting previously unselected package tzdata. Preparing to unpack .../3-tzdata_2025b-5_all.deb ... Unpacking tzdata (2025b-5) ... Selecting previously unselected package libffi8:arm64. Preparing to unpack .../4-libffi8_3.5.2-2_arm64.deb ... Unpacking libffi8:arm64 (3.5.2-2) ... Selecting previously unselected package readline-common. Preparing to unpack .../5-readline-common_8.3-3_all.deb ... Unpacking readline-common (8.3-3) ... Selecting previously unselected package libreadline8t64:arm64. Preparing to unpack .../6-libreadline8t64_8.3-3_arm64.deb ... Adding 'diversion of /lib/aarch64-linux-gnu/libhistory.so.8 to /lib/aarch64-linux-gnu/libhistory.so.8.usr-is-merged by libreadline8t64' Adding 'diversion of /lib/aarch64-linux-gnu/libhistory.so.8.2 to /lib/aarch64-linux-gnu/libhistory.so.8.2.usr-is-merged by libreadline8t64' Adding 'diversion of /lib/aarch64-linux-gnu/libreadline.so.8 to /lib/aarch64-linux-gnu/libreadline.so.8.usr-is-merged by libreadline8t64' Adding 'diversion of /lib/aarch64-linux-gnu/libreadline.so.8.2 to /lib/aarch64-linux-gnu/libreadline.so.8.2.usr-is-merged by libreadline8t64' Unpacking libreadline8t64:arm64 (8.3-3) ... Selecting previously unselected package libpython3.13-stdlib:arm64. Preparing to unpack .../7-libpython3.13-stdlib_3.13.7-1_arm64.deb ... Unpacking libpython3.13-stdlib:arm64 (3.13.7-1) ... Selecting previously unselected package python3.13. Preparing to unpack .../8-python3.13_3.13.7-1_arm64.deb ... Unpacking python3.13 (3.13.7-1) ... Selecting previously unselected package libpython3-stdlib:arm64. Preparing to unpack .../9-libpython3-stdlib_3.13.7-1_arm64.deb ... Unpacking libpython3-stdlib:arm64 (3.13.7-1) ... Setting up python3-minimal (3.13.7-1) ... Selecting previously unselected package python3. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 21369 files and directories currently installed.) Preparing to unpack .../000-python3_3.13.7-1_arm64.deb ... Unpacking python3 (3.13.7-1) ... Selecting previously unselected package sensible-utils. Preparing to unpack .../001-sensible-utils_0.0.26_all.deb ... Unpacking sensible-utils (0.0.26) ... Selecting previously unselected package openssl. Preparing to unpack .../002-openssl_3.5.2-1_arm64.deb ... Unpacking openssl (3.5.2-1) ... Selecting previously unselected package ca-certificates. Preparing to unpack .../003-ca-certificates_20250419_all.deb ... Unpacking ca-certificates (20250419) ... Selecting previously unselected package libmagic-mgc. Preparing to unpack .../004-libmagic-mgc_1%3a5.46-5_arm64.deb ... Unpacking libmagic-mgc (1:5.46-5) ... Selecting previously unselected package libmagic1t64:arm64. Preparing to unpack .../005-libmagic1t64_1%3a5.46-5_arm64.deb ... Unpacking libmagic1t64:arm64 (1:5.46-5) ... Selecting previously unselected package file. Preparing to unpack .../006-file_1%3a5.46-5_arm64.deb ... Unpacking file (1:5.46-5) ... Selecting previously unselected package gettext-base. Preparing to unpack .../007-gettext-base_0.23.1-2+b1_arm64.deb ... Unpacking gettext-base (0.23.1-2+b1) ... Selecting previously unselected package libuchardet0:arm64. Preparing to unpack .../008-libuchardet0_0.0.8-2_arm64.deb ... Unpacking libuchardet0:arm64 (0.0.8-2) ... Selecting previously unselected package groff-base. Preparing to unpack .../009-groff-base_1.23.0-9_arm64.deb ... Unpacking groff-base (1.23.0-9) ... Selecting previously unselected package bsdextrautils. Preparing to unpack .../010-bsdextrautils_2.41.1-3_arm64.deb ... Unpacking bsdextrautils (2.41.1-3) ... Selecting previously unselected package libpipeline1:arm64. Preparing to unpack .../011-libpipeline1_1.5.8-1_arm64.deb ... Unpacking libpipeline1:arm64 (1.5.8-1) ... Selecting previously unselected package man-db. Preparing to unpack .../012-man-db_2.13.1-1_arm64.deb ... Unpacking man-db (2.13.1-1) ... Selecting previously unselected package libunistring5:arm64. Preparing to unpack .../013-libunistring5_1.3-2_arm64.deb ... Unpacking libunistring5:arm64 (1.3-2) ... Selecting previously unselected package libidn2-0:arm64. Preparing to unpack .../014-libidn2-0_2.3.8-4_arm64.deb ... Unpacking libidn2-0:arm64 (2.3.8-4) ... Selecting previously unselected package libp11-kit0:arm64. Preparing to unpack .../015-libp11-kit0_0.25.5-3_arm64.deb ... Unpacking libp11-kit0:arm64 (0.25.5-3) ... Selecting previously unselected package libtasn1-6:arm64. Preparing to unpack .../016-libtasn1-6_4.20.0-2_arm64.deb ... Unpacking libtasn1-6:arm64 (4.20.0-2) ... Selecting previously unselected package libgnutls30t64:arm64. Preparing to unpack .../017-libgnutls30t64_3.8.10-2_arm64.deb ... Unpacking libgnutls30t64:arm64 (3.8.10-2) ... Selecting previously unselected package libpsl5t64:arm64. Preparing to unpack .../018-libpsl5t64_0.21.2-1.1+b1_arm64.deb ... Unpacking libpsl5t64:arm64 (0.21.2-1.1+b1) ... Selecting previously unselected package wget. Preparing to unpack .../019-wget_1.25.0-2_arm64.deb ... Unpacking wget (1.25.0-2) ... Selecting previously unselected package m4. Preparing to unpack .../020-m4_1.4.20-1_arm64.deb ... Unpacking m4 (1.4.20-1) ... Selecting previously unselected package autoconf. Preparing to unpack .../021-autoconf_2.72-3.1_all.deb ... Unpacking autoconf (2.72-3.1) ... Selecting previously unselected package autotools-dev. Preparing to unpack .../022-autotools-dev_20240727.1_all.deb ... Unpacking autotools-dev (20240727.1) ... Selecting previously unselected package automake. Preparing to unpack .../023-automake_1%3a1.17-4_all.deb ... Unpacking automake (1:1.17-4) ... Selecting previously unselected package autopoint. Preparing to unpack .../024-autopoint_0.23.1-2_all.deb ... Unpacking autopoint (0.23.1-2) ... Selecting previously unselected package libdebhelper-perl. Preparing to unpack .../025-libdebhelper-perl_13.26_all.deb ... Unpacking libdebhelper-perl (13.26) ... Selecting previously unselected package libtool. Preparing to unpack .../026-libtool_2.5.4-5_all.deb ... Unpacking libtool (2.5.4-5) ... Selecting previously unselected package dh-autoreconf. Preparing to unpack .../027-dh-autoreconf_20_all.deb ... Unpacking dh-autoreconf (20) ... Selecting previously unselected package libarchive-zip-perl. Preparing to unpack .../028-libarchive-zip-perl_1.68-1_all.deb ... Unpacking libarchive-zip-perl (1.68-1) ... Selecting previously unselected package libfile-stripnondeterminism-perl. Preparing to unpack .../029-libfile-stripnondeterminism-perl_1.15.0-1_all.deb ... Unpacking libfile-stripnondeterminism-perl (1.15.0-1) ... Selecting previously unselected package dh-strip-nondeterminism. Preparing to unpack .../030-dh-strip-nondeterminism_1.15.0-1_all.deb ... Unpacking dh-strip-nondeterminism (1.15.0-1) ... Selecting previously unselected package libelf1t64:arm64. Preparing to unpack .../031-libelf1t64_0.193-3_arm64.deb ... Unpacking libelf1t64:arm64 (0.193-3) ... Selecting previously unselected package dwz. Preparing to unpack .../032-dwz_0.16-2_arm64.deb ... Unpacking dwz (0.16-2) ... Selecting previously unselected package libxml2-16:arm64. Preparing to unpack .../033-libxml2-16_2.14.5+dfsg-0.2_arm64.deb ... Unpacking libxml2-16:arm64 (2.14.5+dfsg-0.2) ... Selecting previously unselected package gettext. Preparing to unpack .../034-gettext_0.23.1-2+b1_arm64.deb ... Unpacking gettext (0.23.1-2+b1) ... Selecting previously unselected package intltool-debian. Preparing to unpack .../035-intltool-debian_0.35.0+20060710.6_all.deb ... Unpacking intltool-debian (0.35.0+20060710.6) ... Selecting previously unselected package po-debconf. Preparing to unpack .../036-po-debconf_1.0.21+nmu1_all.deb ... Unpacking po-debconf (1.0.21+nmu1) ... Selecting previously unselected package debhelper. Preparing to unpack .../037-debhelper_13.26_all.deb ... Unpacking debhelper (13.26) ... Selecting previously unselected package dh-exec. Preparing to unpack .../038-dh-exec_0.30+b1_arm64.deb ... Unpacking dh-exec (0.30+b1) ... Selecting previously unselected package dh-python. Preparing to unpack .../039-dh-python_6.20250414_all.deb ... Unpacking dh-python (6.20250414) ... Selecting previously unselected package sgml-base. Preparing to unpack .../040-sgml-base_1.31+nmu1_all.deb ... Unpacking sgml-base (1.31+nmu1) ... Selecting previously unselected package xml-core. Preparing to unpack .../041-xml-core_0.19_all.deb ... Unpacking xml-core (0.19) ... Selecting previously unselected package docutils-common. Preparing to unpack .../042-docutils-common_0.21.2+dfsg-2_all.deb ... Unpacking docutils-common (0.21.2+dfsg-2) ... Selecting previously unselected package fonts-font-awesome. Preparing to unpack .../043-fonts-font-awesome_5.0.10+really4.7.0~dfsg-4.1_all.deb ... Unpacking fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... Selecting previously unselected package fonts-glyphicons-halflings. Preparing to unpack .../044-fonts-glyphicons-halflings_1.009~3.4.1+dfsg-6_all.deb ... Unpacking fonts-glyphicons-halflings (1.009~3.4.1+dfsg-6) ... Selecting previously unselected package ieee-data. Preparing to unpack .../045-ieee-data_20240722_all.deb ... Unpacking ieee-data (20240722) ... Selecting previously unselected package libonig5:arm64. Preparing to unpack .../046-libonig5_6.9.10-1_arm64.deb ... Unpacking libonig5:arm64 (6.9.10-1) ... Selecting previously unselected package libjq1:arm64. Preparing to unpack .../047-libjq1_1.8.1-3_arm64.deb ... Unpacking libjq1:arm64 (1.8.1-3) ... Selecting previously unselected package jq. Preparing to unpack .../048-jq_1.8.1-3_arm64.deb ... Unpacking jq (1.8.1-3) ... Selecting previously unselected package liberasurecode1:arm64. Preparing to unpack .../049-liberasurecode1_1.6.3-1+b1_arm64.deb ... Unpacking liberasurecode1:arm64 (1.6.3-1+b1) ... Selecting previously unselected package libgpg-error0:arm64. Preparing to unpack .../050-libgpg-error0_1.55-2_arm64.deb ... Unpacking libgpg-error0:arm64 (1.55-2) ... Selecting previously unselected package libgcrypt20:arm64. Preparing to unpack .../051-libgcrypt20_1.11.2-2_arm64.deb ... Unpacking libgcrypt20:arm64 (1.11.2-2) ... Selecting previously unselected package x11-common. Preparing to unpack .../052-x11-common_1%3a7.7+25_all.deb ... Unpacking x11-common (1:7.7+25) ... Selecting previously unselected package libice6:arm64. Preparing to unpack .../053-libice6_2%3a1.1.1-1_arm64.deb ... Unpacking libice6:arm64 (2:1.1.1-1) ... Selecting previously unselected package node-popper2. Preparing to unpack .../054-node-popper2_2.11.2-8_all.deb ... Unpacking node-popper2 (2.11.2-8) ... Selecting previously unselected package libjs-bootstrap5. Preparing to unpack .../055-libjs-bootstrap5_5.3.8+dfsg-1_all.deb ... Unpacking libjs-bootstrap5 (5.3.8+dfsg-1) ... Selecting previously unselected package libjs-sphinxdoc. Preparing to unpack .../056-libjs-sphinxdoc_8.2.3-6_all.deb ... Unpacking libjs-sphinxdoc (8.2.3-6) ... Selecting previously unselected package libjson-perl. Preparing to unpack .../057-libjson-perl_4.10000-1_all.deb ... Unpacking libjson-perl (4.10000-1) ... Selecting previously unselected package libsm6:arm64. Preparing to unpack .../058-libsm6_2%3a1.2.6-1_arm64.deb ... Unpacking libsm6:arm64 (2:1.2.6-1) ... Selecting previously unselected package libsubunit-perl. Preparing to unpack .../059-libsubunit-perl_1.4.2-3_all.deb ... Unpacking libsubunit-perl (1.4.2-3) ... Selecting previously unselected package libxau6:arm64. Preparing to unpack .../060-libxau6_1%3a1.0.11-1_arm64.deb ... Unpacking libxau6:arm64 (1:1.0.11-1) ... Selecting previously unselected package libxdmcp6:arm64. Preparing to unpack .../061-libxdmcp6_1%3a1.1.5-1_arm64.deb ... Unpacking libxdmcp6:arm64 (1:1.1.5-1) ... Selecting previously unselected package libxcb1:arm64. Preparing to unpack .../062-libxcb1_1.17.0-2+b1_arm64.deb ... Unpacking libxcb1:arm64 (1.17.0-2+b1) ... Selecting previously unselected package libx11-data. Preparing to unpack .../063-libx11-data_2%3a1.8.12-1_all.deb ... Unpacking libx11-data (2:1.8.12-1) ... Selecting previously unselected package libx11-6:arm64. Preparing to unpack .../064-libx11-6_2%3a1.8.12-1_arm64.deb ... Unpacking libx11-6:arm64 (2:1.8.12-1) ... Selecting previously unselected package libxext6:arm64. Preparing to unpack .../065-libxext6_2%3a1.3.4-1+b3_arm64.deb ... Unpacking libxext6:arm64 (2:1.3.4-1+b3) ... Selecting previously unselected package libxt6t64:arm64. Preparing to unpack .../066-libxt6t64_1%3a1.2.1-1.3_arm64.deb ... Unpacking libxt6t64:arm64 (1:1.2.1-1.3) ... Selecting previously unselected package libxmu6:arm64. Preparing to unpack .../067-libxmu6_2%3a1.1.3-3+b4_arm64.deb ... Unpacking libxmu6:arm64 (2:1.1.3-3+b4) ... Selecting previously unselected package libxslt1.1:arm64. Preparing to unpack .../068-libxslt1.1_1.1.43-0.2_arm64.deb ... Unpacking libxslt1.1:arm64 (1.1.43-0.2) ... Selecting previously unselected package libyaml-0-2:arm64. Preparing to unpack .../069-libyaml-0-2_0.2.5-2_arm64.deb ... Unpacking libyaml-0-2:arm64 (0.2.5-2) ... Selecting previously unselected package python3-packaging. Preparing to unpack .../070-python3-packaging_25.0-1_all.deb ... Unpacking python3-packaging (25.0-1) ... Selecting previously unselected package python3-wheel. Preparing to unpack .../071-python3-wheel_0.46.1-2_all.deb ... Unpacking python3-wheel (0.46.1-2) ... Selecting previously unselected package python3-pip. Preparing to unpack .../072-python3-pip_25.2+dfsg-1_all.deb ... Unpacking python3-pip (25.2+dfsg-1) ... Selecting previously unselected package openstack-pkg-tools. Preparing to unpack .../073-openstack-pkg-tools_135_all.deb ... Unpacking openstack-pkg-tools (135) ... Selecting previously unselected package pycadf-common. Preparing to unpack .../074-pycadf-common_4.0.1-1_all.deb ... Unpacking pycadf-common (4.0.1-1) ... Selecting previously unselected package python-babel-localedata. Preparing to unpack .../075-python-babel-localedata_2.17.0-1_all.deb ... Unpacking python-babel-localedata (2.17.0-1) ... Selecting previously unselected package python-os-api-ref-common. Preparing to unpack .../076-python-os-api-ref-common_2.3.0+ds1-4_all.deb ... Unpacking python-os-api-ref-common (2.3.0+ds1-4) ... Selecting previously unselected package python-oslosphinx-common. Preparing to unpack .../077-python-oslosphinx-common_4.18.0-6_all.deb ... Unpacking python-oslosphinx-common (4.18.0-6) ... Selecting previously unselected package python3-alabaster. Preparing to unpack .../078-python3-alabaster_0.7.16-0.1_all.deb ... Unpacking python3-alabaster (0.7.16-0.1) ... Selecting previously unselected package python3-all. Preparing to unpack .../079-python3-all_3.13.7-1_arm64.deb ... Unpacking python3-all (3.13.7-1) ... Selecting previously unselected package python3-attr. Preparing to unpack .../080-python3-attr_25.3.0-1_all.deb ... Unpacking python3-attr (25.3.0-1) ... Selecting previously unselected package python3-autocommand. Preparing to unpack .../081-python3-autocommand_2.2.2-3_all.deb ... Unpacking python3-autocommand (2.2.2-3) ... Selecting previously unselected package python3-autopage. Preparing to unpack .../082-python3-autopage_0.4.0-4_all.deb ... Unpacking python3-autopage (0.4.0-4) ... Selecting previously unselected package python3-babel. Preparing to unpack .../083-python3-babel_2.17.0-1_all.deb ... Unpacking python3-babel (2.17.0-1) ... Selecting previously unselected package python3-bcrypt. Preparing to unpack .../084-python3-bcrypt_4.3.0-1_arm64.deb ... Unpacking python3-bcrypt (4.3.0-1) ... Selecting previously unselected package python3-six. Preparing to unpack .../085-python3-six_1.17.0-1_all.deb ... Unpacking python3-six (1.17.0-1) ... Selecting previously unselected package python3-memcache. Preparing to unpack .../086-python3-memcache_1.62-3_all.deb ... Unpacking python3-memcache (1.62-3) ... Selecting previously unselected package python3-uhashring. Preparing to unpack .../087-python3-uhashring_2.3-2_all.deb ... Unpacking python3-uhashring (2.3-2) ... Selecting previously unselected package python3-binary-memcached. Preparing to unpack .../088-python3-binary-memcached_0.31.2+dfsg1-4_all.deb ... Unpacking python3-binary-memcached (0.31.2+dfsg1-4) ... Selecting previously unselected package python3-blinker. Preparing to unpack .../089-python3-blinker_1.9.0-2_all.deb ... Unpacking python3-blinker (1.9.0-2) ... Selecting previously unselected package python3-dateutil. Preparing to unpack .../090-python3-dateutil_2.9.0-4_all.deb ... Unpacking python3-dateutil (2.9.0-4) ... Selecting previously unselected package python3-jmespath. Preparing to unpack .../091-python3-jmespath_1.0.1-1_all.deb ... Unpacking python3-jmespath (1.0.1-1) ... Selecting previously unselected package python3-urllib3. Preparing to unpack .../092-python3-urllib3_2.5.0-1_all.deb ... Unpacking python3-urllib3 (2.5.0-1) ... Selecting previously unselected package python3-certifi. Preparing to unpack .../093-python3-certifi_2025.1.31+ds-1_all.deb ... Unpacking python3-certifi (2025.1.31+ds-1) ... Selecting previously unselected package python3-charset-normalizer. Preparing to unpack .../094-python3-charset-normalizer_3.4.3-1_arm64.deb ... Unpacking python3-charset-normalizer (3.4.3-1) ... Selecting previously unselected package python3-idna. Preparing to unpack .../095-python3-idna_3.10-1_all.deb ... Unpacking python3-idna (3.10-1) ... Selecting previously unselected package python3-chardet. Preparing to unpack .../096-python3-chardet_5.2.0+dfsg-2_all.deb ... Unpacking python3-chardet (5.2.0+dfsg-2) ... Selecting previously unselected package python3-requests. Preparing to unpack .../097-python3-requests_2.32.5+dfsg-1_all.deb ... Unpacking python3-requests (2.32.5+dfsg-1) ... Selecting previously unselected package python3-botocore. Preparing to unpack .../098-python3-botocore_1.37.9+repack-1_all.deb ... Unpacking python3-botocore (1.37.9+repack-1) ... Selecting previously unselected package python3-s3transfer. Preparing to unpack .../099-python3-s3transfer_0.11.4-1_all.deb ... Unpacking python3-s3transfer (0.11.4-1) ... Selecting previously unselected package python3-boto3. Preparing to unpack .../100-python3-boto3_1.37.9-1_all.deb ... Unpacking python3-boto3 (1.37.9-1) ... Selecting previously unselected package python3-cffi-backend:arm64. Preparing to unpack .../101-python3-cffi-backend_2.0.0~b1-1_arm64.deb ... Unpacking python3-cffi-backend:arm64 (2.0.0~b1-1) ... Selecting previously unselected package python3-ply. Preparing to unpack .../102-python3-ply_3.11-9_all.deb ... Unpacking python3-ply (3.11-9) ... Selecting previously unselected package python3-pycparser. Preparing to unpack .../103-python3-pycparser_2.22-2_all.deb ... Unpacking python3-pycparser (2.22-2) ... Selecting previously unselected package python3-cffi. Preparing to unpack .../104-python3-cffi_2.0.0~b1-1_all.deb ... Unpacking python3-cffi (2.0.0~b1-1) ... Selecting previously unselected package python3-iso8601. Preparing to unpack .../105-python3-iso8601_2.1.0-2_all.deb ... Unpacking python3-iso8601 (2.1.0-2) ... Selecting previously unselected package python3-lxml:arm64. Preparing to unpack .../106-python3-lxml_6.0.1-1_arm64.deb ... Unpacking python3-lxml:arm64 (6.0.1-1) ... Selecting previously unselected package python3-cryptography. Preparing to unpack .../107-python3-cryptography_43.0.0-3_arm64.deb ... Unpacking python3-cryptography (43.0.0-3) ... Selecting previously unselected package python3-jwt. Preparing to unpack .../108-python3-jwt_2.10.1-3_all.deb ... Unpacking python3-jwt (2.10.1-3) ... Selecting previously unselected package python3-oauthlib. Preparing to unpack .../109-python3-oauthlib_3.3.1-1_all.deb ... Unpacking python3-oauthlib (3.3.1-1) ... Selecting previously unselected package python3-more-itertools. Preparing to unpack .../110-python3-more-itertools_10.8.0-1_all.deb ... Unpacking python3-more-itertools (10.8.0-1) ... Selecting previously unselected package python3-typing-extensions. Preparing to unpack .../111-python3-typing-extensions_4.15.0-1_all.deb ... Unpacking python3-typing-extensions (4.15.0-1) ... Selecting previously unselected package python3-typeguard. Preparing to unpack .../112-python3-typeguard_4.4.4-1_all.deb ... Unpacking python3-typeguard (4.4.4-1) ... Selecting previously unselected package python3-inflect. Preparing to unpack .../113-python3-inflect_7.5.0-1_all.deb ... Unpacking python3-inflect (7.5.0-1) ... Selecting previously unselected package python3-jaraco.context. Preparing to unpack .../114-python3-jaraco.context_6.0.1-1_all.deb ... Unpacking python3-jaraco.context (6.0.1-1) ... Selecting previously unselected package python3-jaraco.functools. Preparing to unpack .../115-python3-jaraco.functools_4.1.0-1_all.deb ... Unpacking python3-jaraco.functools (4.1.0-1) ... Selecting previously unselected package python3-pkg-resources. Preparing to unpack .../116-python3-pkg-resources_78.1.1-0.1_all.deb ... Unpacking python3-pkg-resources (78.1.1-0.1) ... Selecting previously unselected package python3-jaraco.text. Preparing to unpack .../117-python3-jaraco.text_4.0.0-1_all.deb ... Unpacking python3-jaraco.text (4.0.0-1) ... Selecting previously unselected package python3-zipp. Preparing to unpack .../118-python3-zipp_3.23.0-1_all.deb ... Unpacking python3-zipp (3.23.0-1) ... Selecting previously unselected package python3-setuptools. Preparing to unpack .../119-python3-setuptools_78.1.1-0.1_all.deb ... Unpacking python3-setuptools (78.1.1-0.1) ... Selecting previously unselected package python3-pbr. Preparing to unpack .../120-python3-pbr_6.1.1-2_all.deb ... Unpacking python3-pbr (6.1.1-2) ... Selecting previously unselected package python3-os-service-types. Preparing to unpack .../121-python3-os-service-types_1.7.0-5_all.deb ... Unpacking python3-os-service-types (1.7.0-5) ... Selecting previously unselected package python3-stevedore. Preparing to unpack .../122-python3-stevedore_5.4.1-2_all.deb ... Unpacking python3-stevedore (5.4.1-2) ... Selecting previously unselected package python3-keystoneauth1. Preparing to unpack .../123-python3-keystoneauth1_5.10.0-2_all.deb ... Unpacking python3-keystoneauth1 (5.10.0-2) ... Selecting previously unselected package python3-oslo.i18n. Preparing to unpack .../124-python3-oslo.i18n_6.5.1-3_all.deb ... Unpacking python3-oslo.i18n (6.5.1-3) ... Selecting previously unselected package python3-wrapt. Preparing to unpack .../125-python3-wrapt_1.15.0-4+b1_arm64.deb ... Unpacking python3-wrapt (1.15.0-4+b1) ... Selecting previously unselected package python3-debtcollector. Preparing to unpack .../126-python3-debtcollector_3.0.0-5_all.deb ... Unpacking python3-debtcollector (3.0.0-5) ... Selecting previously unselected package python3-netaddr. Preparing to unpack .../127-python3-netaddr_1.3.0-1_all.deb ... Unpacking python3-netaddr (1.3.0-1) ... Selecting previously unselected package python3-psutil. Preparing to unpack .../128-python3-psutil_7.0.0-2_arm64.deb ... Unpacking python3-psutil (7.0.0-2) ... Selecting previously unselected package python3-pyparsing. Preparing to unpack .../129-python3-pyparsing_3.1.2-1_all.deb ... Unpacking python3-pyparsing (3.1.2-1) ... Selecting previously unselected package python3-pytz. Preparing to unpack .../130-python3-pytz_2025.2-3_all.deb ... Unpacking python3-pytz (2025.2-3) ... Selecting previously unselected package python3-tz. Preparing to unpack .../131-python3-tz_2025.2-3_all.deb ... Unpacking python3-tz (2025.2-3) ... Selecting previously unselected package python3-yaml. Preparing to unpack .../132-python3-yaml_6.0.2-2_arm64.deb ... Unpacking python3-yaml (6.0.2-2) ... Selecting previously unselected package python3-oslo.utils. Preparing to unpack .../133-python3-oslo.utils_8.2.0-4_all.deb ... Unpacking python3-oslo.utils (8.2.0-4) ... Selecting previously unselected package python3-wcwidth. Preparing to unpack .../134-python3-wcwidth_0.2.13+dfsg1-1_all.deb ... Unpacking python3-wcwidth (0.2.13+dfsg1-1) ... Selecting previously unselected package python3-prettytable. Preparing to unpack .../135-python3-prettytable_3.15.1-1_all.deb ... Unpacking python3-prettytable (3.15.1-1) ... Selecting previously unselected package python3-cinderclient. Preparing to unpack .../136-python3-cinderclient_1%3a9.7.0-2_all.deb ... Unpacking python3-cinderclient (1:9.7.0-2) ... Selecting previously unselected package xclip. Preparing to unpack .../137-xclip_0.13-4+b2_arm64.deb ... Unpacking xclip (0.13-4+b2) ... Selecting previously unselected package python3-pyperclip. Preparing to unpack .../138-python3-pyperclip_1.8.2-2_all.deb ... Unpacking python3-pyperclip (1.8.2-2) ... Selecting previously unselected package python3-cmd2. Preparing to unpack .../139-python3-cmd2_2.5.11+ds-1_all.deb ... Unpacking python3-cmd2 (2.5.11+ds-1) ... Selecting previously unselected package python3-roman. Preparing to unpack .../140-python3-roman_5.1-1_all.deb ... Unpacking python3-roman (5.1-1) ... Selecting previously unselected package python3-docutils. Preparing to unpack .../141-python3-docutils_0.21.2+dfsg-2_all.deb ... Unpacking python3-docutils (0.21.2+dfsg-2) ... Selecting previously unselected package python3-cliff. Preparing to unpack .../142-python3-cliff_4.9.1-2_all.deb ... Unpacking python3-cliff (4.9.1-2) ... Selecting previously unselected package python3-coverage. Preparing to unpack .../143-python3-coverage_7.8.2+dfsg1-1_arm64.deb ... Unpacking python3-coverage (7.8.2+dfsg1-1) ... Selecting previously unselected package python3-decorator. Preparing to unpack .../144-python3-decorator_5.2.1-2_all.deb ... Unpacking python3-decorator (5.2.1-2) ... Selecting previously unselected package python3-defusedxml. Preparing to unpack .../145-python3-defusedxml_0.7.1-3_all.deb ... Unpacking python3-defusedxml (0.7.1-3) ... Selecting previously unselected package python3-deprecation. Preparing to unpack .../146-python3-deprecation_2.1.0-4_all.deb ... Unpacking python3-deprecation (2.1.0-4) ... Selecting previously unselected package python3-dnspython. Preparing to unpack .../147-python3-dnspython_2.7.0-1_all.deb ... Unpacking python3-dnspython (2.7.0-1) ... Selecting previously unselected package python3-markupsafe. Preparing to unpack .../148-python3-markupsafe_2.1.5-1+b4_arm64.deb ... Unpacking python3-markupsafe (2.1.5-1+b4) ... Selecting previously unselected package python3-mako. Preparing to unpack .../149-python3-mako_1.3.9-1_all.deb ... Unpacking python3-mako (1.3.9-1) ... Selecting previously unselected package python3-dogpile.cache. Preparing to unpack .../150-python3-dogpile.cache_1.3.3-1_all.deb ... Unpacking python3-dogpile.cache (1.3.3-1) ... Selecting previously unselected package python3-dulwich. Preparing to unpack .../151-python3-dulwich_0.22.7-2_arm64.deb ... Unpacking python3-dulwich (0.22.7-2) ... Selecting previously unselected package python3-greenlet. Preparing to unpack .../152-python3-greenlet_3.1.0-1+b2_arm64.deb ... Unpacking python3-greenlet (3.1.0-1+b2) ... Selecting previously unselected package python3-eventlet. Preparing to unpack .../153-python3-eventlet_0.40.1-3_all.deb ... Unpacking python3-eventlet (0.40.1-3) ... Selecting previously unselected package python3-extras. Preparing to unpack .../154-python3-extras_1.0.0-6_all.deb ... Unpacking python3-extras (1.0.0-6) ... Selecting previously unselected package python3-testtools. Preparing to unpack .../155-python3-testtools_2.7.2-5_all.deb ... Unpacking python3-testtools (2.7.2-5) ... Selecting previously unselected package python3-fixtures. Preparing to unpack .../156-python3-fixtures_4.1.0-3_all.deb ... Unpacking python3-fixtures (4.1.0-3) ... Selecting previously unselected package python3-openssl. Preparing to unpack .../157-python3-openssl_25.1.0-1_all.deb ... Unpacking python3-openssl (25.1.0-1) ... Selecting previously unselected package python3-json-pointer. Preparing to unpack .../158-python3-json-pointer_2.4-3_all.deb ... Unpacking python3-json-pointer (2.4-3) ... Selecting previously unselected package python3-jsonpatch. Preparing to unpack .../159-python3-jsonpatch_1.32-5_all.deb ... Unpacking python3-jsonpatch (1.32-5) ... Selecting previously unselected package python3-rpds-py. Preparing to unpack .../160-python3-rpds-py_0.21.0-2+b1_arm64.deb ... Unpacking python3-rpds-py (0.21.0-2+b1) ... Selecting previously unselected package python3-referencing. Preparing to unpack .../161-python3-referencing_0.36.2-1_all.deb ... Unpacking python3-referencing (0.36.2-1) ... Selecting previously unselected package python3-jsonschema-specifications. Preparing to unpack .../162-python3-jsonschema-specifications_2023.12.1-2_all.deb ... Unpacking python3-jsonschema-specifications (2023.12.1-2) ... Selecting previously unselected package python3-jsonschema. Preparing to unpack .../163-python3-jsonschema_4.19.2-6_all.deb ... Unpacking python3-jsonschema (4.19.2-6) ... Selecting previously unselected package python3-warlock. Preparing to unpack .../164-python3-warlock_2.0.1-4_all.deb ... Unpacking python3-warlock (2.0.1-4) ... Selecting previously unselected package python3-glanceclient. Preparing to unpack .../165-python3-glanceclient_1%3a4.8.0-2_all.deb ... Unpacking python3-glanceclient (1:4.8.0-2) ... Selecting previously unselected package python3-imagesize. Preparing to unpack .../166-python3-imagesize_1.4.1-1_all.deb ... Unpacking python3-imagesize (1.4.1-1) ... Selecting previously unselected package python3-jaraco.classes. Preparing to unpack .../167-python3-jaraco.classes_3.4.0-1_all.deb ... Unpacking python3-jaraco.classes (3.4.0-1) ... Selecting previously unselected package python3-jeepney. Preparing to unpack .../168-python3-jeepney_0.9.0-1_all.deb ... Unpacking python3-jeepney (0.9.0-1) ... Selecting previously unselected package python3-jinja2. Preparing to unpack .../169-python3-jinja2_3.1.6-1_all.deb ... Unpacking python3-jinja2 (3.1.6-1) ... Selecting previously unselected package python3-secretstorage. Preparing to unpack .../170-python3-secretstorage_3.4.0-1_all.deb ... Unpacking python3-secretstorage (3.4.0-1) ... Selecting previously unselected package python3-keyring. Preparing to unpack .../171-python3-keyring_25.6.0-3_all.deb ... Unpacking python3-keyring (25.6.0-3) ... Selecting previously unselected package python3-oslo.context. Preparing to unpack .../172-python3-oslo.context_5.7.1-3_all.deb ... Unpacking python3-oslo.context (5.7.1-3) ... Selecting previously unselected package python3-msgpack. Preparing to unpack .../173-python3-msgpack_1.0.3-3+b5_arm64.deb ... Unpacking python3-msgpack (1.0.3-3+b5) ... Selecting previously unselected package python3-oslo.serialization. Preparing to unpack .../174-python3-oslo.serialization_5.7.0-3_all.deb ... Unpacking python3-oslo.serialization (5.7.0-3) ... Selecting previously unselected package python3-pyasyncore. Preparing to unpack .../175-python3-pyasyncore_1.0.2-3_all.deb ... Unpacking python3-pyasyncore (1.0.2-3) ... Selecting previously unselected package python3-oslo.log. Preparing to unpack .../176-python3-oslo.log_7.1.0-4_all.deb ... Unpacking python3-oslo.log (7.1.0-4) ... Selecting previously unselected package python3-rfc3986. Preparing to unpack .../177-python3-rfc3986_2.0.0-3_all.deb ... Unpacking python3-rfc3986 (2.0.0-3) ... Selecting previously unselected package python3-oslo.config. Preparing to unpack .../178-python3-oslo.config_1%3a9.7.1-3_all.deb ... Unpacking python3-oslo.config (1:9.7.1-3) ... Selecting previously unselected package python3-keystoneclient. Preparing to unpack .../179-python3-keystoneclient_1%3a5.6.0-2_all.deb ... Unpacking python3-keystoneclient (1:5.6.0-2) ... Selecting previously unselected package python3-oslo.cache. Preparing to unpack .../180-python3-oslo.cache_3.10.1-3_all.deb ... Unpacking python3-oslo.cache (3.10.1-3) ... Selecting previously unselected package python3-pycadf. Preparing to unpack .../181-python3-pycadf_4.0.1-1_all.deb ... Unpacking python3-pycadf (4.0.1-1) ... Selecting previously unselected package python3-legacy-cgi. Preparing to unpack .../182-python3-legacy-cgi_2.6.3-1_all.deb ... Unpacking python3-legacy-cgi (2.6.3-1) ... Selecting previously unselected package python3-webob. Preparing to unpack .../183-python3-webob_1%3a1.8.9-1_all.deb ... Unpacking python3-webob (1:1.8.9-1) ... Selecting previously unselected package python3-keystonemiddleware. Preparing to unpack .../184-python3-keystonemiddleware_10.9.0-2_all.deb ... Unpacking python3-keystonemiddleware (10.9.0-2) ... Selecting previously unselected package python3-mock. Preparing to unpack .../185-python3-mock_5.2.0-1_all.deb ... Unpacking python3-mock (5.2.0-1) ... Selecting previously unselected package python3-platformdirs. Preparing to unpack .../186-python3-platformdirs_4.4.0-1_all.deb ... Unpacking python3-platformdirs (4.4.0-1) ... Selecting previously unselected package python3-requestsexceptions. Preparing to unpack .../187-python3-requestsexceptions_1.4.0-5_all.deb ... Unpacking python3-requestsexceptions (1.4.0-5) ... Selecting previously unselected package python3-openstacksdk. Preparing to unpack .../188-python3-openstacksdk_4.4.0-5_all.deb ... Unpacking python3-openstacksdk (4.4.0-5) ... Selecting previously unselected package python3-osc-lib. Preparing to unpack .../189-python3-osc-lib_3.2.0-2_all.deb ... Unpacking python3-osc-lib (3.2.0-2) ... Selecting previously unselected package python3-simplejson. Preparing to unpack .../190-python3-simplejson_3.20.1-1_arm64.deb ... Unpacking python3-simplejson (3.20.1-1) ... Selecting previously unselected package python3-openstackclient. Preparing to unpack .../191-python3-openstackclient_7.4.0-3_all.deb ... Unpacking python3-openstackclient (7.4.0-3) ... Selecting previously unselected package python3-os-client-config. Preparing to unpack .../192-python3-os-client-config_2.1.0-3_all.deb ... Unpacking python3-os-client-config (2.1.0-3) ... Selecting previously unselected package python3-neutronclient. Preparing to unpack .../193-python3-neutronclient_1%3a11.4.0-2_all.deb ... Unpacking python3-neutronclient (1:11.4.0-2) ... Selecting previously unselected package sphinx-common. Preparing to unpack .../194-sphinx-common_8.2.3-6_all.deb ... Unpacking sphinx-common (8.2.3-6) ... Selecting previously unselected package python3-pygments. Preparing to unpack .../195-python3-pygments_2.18.0+dfsg-2_all.deb ... Unpacking python3-pygments (2.18.0+dfsg-2) ... Selecting previously unselected package python3-roman-numerals. Preparing to unpack .../196-python3-roman-numerals_3.1.0-2_all.deb ... Unpacking python3-roman-numerals (3.1.0-2) ... Selecting previously unselected package python3-snowballstemmer. Preparing to unpack .../197-python3-snowballstemmer_3.0.1-1_all.deb ... Unpacking python3-snowballstemmer (3.0.1-1) ... Selecting previously unselected package python3-sphinx. Preparing to unpack .../198-python3-sphinx_8.2.3-6_all.deb ... Unpacking python3-sphinx (8.2.3-6) ... Selecting previously unselected package python3-openstackdocstheme. Preparing to unpack .../199-python3-openstackdocstheme_3.2.0-3_all.deb ... Unpacking python3-openstackdocstheme (3.2.0-3) ... Selecting previously unselected package python3-oslosphinx. Preparing to unpack .../200-python3-oslosphinx_4.18.0-6_all.deb ... Unpacking python3-oslosphinx (4.18.0-6) ... Selecting previously unselected package python3-os-api-ref. Preparing to unpack .../201-python3-os-api-ref_2.3.0+ds1-4_all.deb ... Unpacking python3-os-api-ref (2.3.0+ds1-4) ... Selecting previously unselected package python3-tomlkit. Preparing to unpack .../202-python3-tomlkit_0.13.2-1_all.deb ... Unpacking python3-tomlkit (0.13.2-1) ... Selecting previously unselected package python3-voluptuous. Preparing to unpack .../203-python3-voluptuous_0.14.2-1_all.deb ... Unpacking python3-voluptuous (0.14.2-1) ... Selecting previously unselected package python3-subunit. Preparing to unpack .../204-python3-subunit_1.4.2-3_all.deb ... Unpacking python3-subunit (1.4.2-3) ... Selecting previously unselected package subunit. Preparing to unpack .../205-subunit_1.4.2-3_all.deb ... Unpacking subunit (1.4.2-3) ... Selecting previously unselected package python3-stestr. Preparing to unpack .../206-python3-stestr_4.1.0-3_all.deb ... Unpacking python3-stestr (4.1.0-3) ... Selecting previously unselected package python3-os-testr. Preparing to unpack .../207-python3-os-testr_3.0.0-4_all.deb ... Unpacking python3-os-testr (3.0.0-4) ... Selecting previously unselected package python3-tempita. Preparing to unpack .../208-python3-tempita_0.6.0-1_all.deb ... Unpacking python3-tempita (0.6.0-1) ... Selecting previously unselected package python3-paste. Preparing to unpack .../209-python3-paste_3.10.1-1_all.deb ... Unpacking python3-paste (3.10.1-1) ... Selecting previously unselected package python3-pastedeploy-tpl. Preparing to unpack .../210-python3-pastedeploy-tpl_3.1-1_all.deb ... Unpacking python3-pastedeploy-tpl (3.1-1) ... Selecting previously unselected package python3-pastedeploy. Preparing to unpack .../211-python3-pastedeploy_3.1-1_all.deb ... Unpacking python3-pastedeploy (3.1-1) ... Selecting previously unselected package python3-pyeclib. Preparing to unpack .../212-python3-pyeclib_1.6.1-2+b1_arm64.deb ... Unpacking python3-pyeclib (1.6.1-2+b1) ... Selecting previously unselected package python3-requests-mock. Preparing to unpack .../213-python3-requests-mock_1.12.1-3_all.deb ... Unpacking python3-requests-mock (1.12.1-3) ... Selecting previously unselected package python3-swiftclient. Preparing to unpack .../214-python3-swiftclient_1%3a4.7.0-2_all.deb ... Unpacking python3-swiftclient (1:4.7.0-2) ... Selecting previously unselected package python3-xattr. Preparing to unpack .../215-python3-xattr_0.10.1-1+b1_arm64.deb ... Unpacking python3-xattr (0.10.1-1+b1) ... Setting up media-types (13.0.0) ... Setting up libpipeline1:arm64 (1.5.8-1) ... Setting up libxau6:arm64 (1:1.0.11-1) ... Setting up libxdmcp6:arm64 (1:1.1.5-1) ... Setting up libsubunit-perl (1.4.2-3) ... Setting up libxcb1:arm64 (1.17.0-2+b1) ... Setting up bsdextrautils (2.41.1-3) ... Setting up libgpg-error0:arm64 (1.55-2) ... Setting up libmagic-mgc (1:5.46-5) ... Setting up libarchive-zip-perl (1.68-1) ... Setting up libyaml-0-2:arm64 (0.2.5-2) ... Setting up fonts-glyphicons-halflings (1.009~3.4.1+dfsg-6) ... Setting up libxml2-16:arm64 (2.14.5+dfsg-0.2) ... Setting up libdebhelper-perl (13.26) ... Setting up libmagic1t64:arm64 (1:5.46-5) ... Setting up x11-common (1:7.7+25) ... invoke-rc.d: could not determine current runlevel Setting up X socket directories... /tmp/.X11-unix /tmp/.ICE-unix. Setting up gettext-base (0.23.1-2+b1) ... Setting up m4 (1.4.20-1) ... Setting up libgcrypt20:arm64 (1.11.2-2) ... Setting up file (1:5.46-5) ... Setting up libelf1t64:arm64 (0.193-3) ... Setting up python-babel-localedata (2.17.0-1) ... Setting up tzdata (2025b-5) ... Current default time zone: 'Etc/UTC' Local time is now: Sat Sep 13 13:22:28 UTC 2025. Universal Time is now: Sat Sep 13 13:22:28 UTC 2025. Run 'dpkg-reconfigure tzdata' if you wish to change it. Setting up autotools-dev (20240727.1) ... Setting up libx11-data (2:1.8.12-1) ... Setting up python3-pastedeploy-tpl (3.1-1) ... Setting up libunistring5:arm64 (1.3-2) ... Setting up autopoint (0.23.1-2) ... Setting up libjs-sphinxdoc (8.2.3-6) ... Setting up autoconf (2.72-3.1) ... Setting up liberasurecode1:arm64 (1.6.3-1+b1) ... Setting up pycadf-common (4.0.1-1) ... Setting up libffi8:arm64 (3.5.2-2) ... Setting up dwz (0.16-2) ... Setting up node-popper2 (2.11.2-8) ... Setting up sensible-utils (0.0.26) ... Setting up libuchardet0:arm64 (0.0.8-2) ... Setting up python-oslosphinx-common (4.18.0-6) ... Setting up libjson-perl (4.10000-1) ... Setting up libxslt1.1:arm64 (1.1.43-0.2) ... Setting up libtasn1-6:arm64 (4.20.0-2) ... Setting up libx11-6:arm64 (2:1.8.12-1) ... Setting up netbase (6.5) ... Setting up sgml-base (1.31+nmu1) ... Setting up openssl (3.5.2-1) ... Setting up libjs-bootstrap5 (5.3.8+dfsg-1) ... Setting up readline-common (8.3-3) ... Setting up fonts-font-awesome (5.0.10+really4.7.0~dfsg-4.1) ... Setting up libonig5:arm64 (6.9.10-1) ... Setting up automake (1:1.17-4) ... update-alternatives: using /usr/bin/automake-1.17 to provide /usr/bin/automake (automake) in auto mode Setting up libfile-stripnondeterminism-perl (1.15.0-1) ... Setting up libice6:arm64 (2:1.1.1-1) ... Setting up gettext (0.23.1-2+b1) ... Setting up libtool (2.5.4-5) ... Setting up libjq1:arm64 (1.8.1-3) ... Setting up libxext6:arm64 (2:1.3.4-1+b3) ... Setting up libidn2-0:arm64 (2.3.8-4) ... Setting up intltool-debian (0.35.0+20060710.6) ... Setting up dh-autoreconf (20) ... Setting up ca-certificates (20250419) ... Updating certificates in /etc/ssl/certs... 150 added, 0 removed; done. Setting up sphinx-common (8.2.3-6) ... Setting up libp11-kit0:arm64 (0.25.5-3) ... Setting up python-os-api-ref-common (2.3.0+ds1-4) ... Setting up libreadline8t64:arm64 (8.3-3) ... Setting up dh-strip-nondeterminism (1.15.0-1) ... Setting up groff-base (1.23.0-9) ... Setting up xml-core (0.19) ... Setting up jq (1.8.1-3) ... Setting up libsm6:arm64 (2:1.2.6-1) ... Setting up libpython3.13-stdlib:arm64 (3.13.7-1) ... Setting up libpython3-stdlib:arm64 (3.13.7-1) ... Setting up libgnutls30t64:arm64 (3.8.10-2) ... Setting up python3.13 (3.13.7-1) ... Setting up po-debconf (1.0.21+nmu1) ... Setting up libpsl5t64:arm64 (0.21.2-1.1+b1) ... Setting up python3 (3.13.7-1) ... Setting up python3-zipp (3.23.0-1) ... Setting up python3-autocommand (2.2.2-3) ... Setting up man-db (2.13.1-1) ... Not building database; man-db/auto-update is not 'true'. Setting up python3-markupsafe (2.1.5-1+b4) ... Setting up python3-platformdirs (4.4.0-1) ... Setting up python3-psutil (7.0.0-2) ... Setting up python3-mock (5.2.0-1) ... Setting up python3-six (1.17.0-1) ... Setting up python3-simplejson (3.20.1-1) ... Setting up python3-roman (5.1-1) ... Setting up python3-decorator (5.2.1-2) ... Setting up python3-jinja2 (3.1.6-1) ... Setting up python3-pygments (2.18.0+dfsg-2) ... Setting up python3-tempita (0.6.0-1) ... Setting up python3-packaging (25.0-1) ... Setting up python3-iso8601 (2.1.0-2) ... Setting up python3-chardet (5.2.0+dfsg-2) ... Setting up python3-wcwidth (0.2.13+dfsg1-1) ... Setting up python3-pyparsing (3.1.2-1) ... Setting up python3-certifi (2025.1.31+ds-1) ... Setting up python3-snowballstemmer (3.0.1-1) ... Setting up python3-pyeclib (1.6.1-2+b1) ... Setting up python3-jmespath (1.0.1-1) ... Setting up python3-greenlet (3.1.0-1+b2) ... Setting up libxt6t64:arm64 (1:1.2.1-1.3) ... Setting up python3-idna (3.10-1) ... Setting up python3-wrapt (1.15.0-4+b1) ... Setting up python3-deprecation (2.1.0-4) ... Setting up python3-typing-extensions (4.15.0-1) ... Setting up python3-jeepney (0.9.0-1) ... Setting up python3-urllib3 (2.5.0-1) ... Setting up python3-rpds-py (0.21.0-2+b1) ... Setting up python3-legacy-cgi (2.6.3-1) ... Setting up python3-json-pointer (2.4-3) ... Setting up python3-lxml:arm64 (6.0.1-1) ... Setting up python3-dnspython (2.7.0-1) ... Setting up python3-dulwich (0.22.7-2) ... Setting up python3-roman-numerals (3.1.0-2) ... Setting up python3-dateutil (2.9.0-4) ... Setting up python3-msgpack (1.0.3-3+b5) ... Setting up python3-voluptuous (0.14.2-1) ... Setting up python3-pyasyncore (1.0.2-3) ... Setting up python3-prettytable (3.15.1-1) ... Setting up python3-tomlkit (0.13.2-1) ... Setting up python3-cffi-backend:arm64 (2.0.0~b1-1) ... Setting up python3-mako (1.3.9-1) ... Setting up python3-webob (1:1.8.9-1) ... Setting up python3-imagesize (1.4.1-1) ... Setting up python3-blinker (1.9.0-2) ... Setting up dh-python (6.20250414) ... Setting up python3-more-itertools (10.8.0-1) ... Setting up python3-attr (25.3.0-1) ... Setting up libxmu6:arm64 (2:1.1.3-3+b4) ... Setting up python3-jaraco.classes (3.4.0-1) ... Setting up python3-jaraco.functools (4.1.0-1) ... Setting up wget (1.25.0-2) ... Setting up python3-jaraco.context (6.0.1-1) ... Setting up python3-jwt (2.10.1-3) ... Setting up python3-babel (2.17.0-1) ... update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode Setting up python3-defusedxml (0.7.1-3) ... Setting up python3-charset-normalizer (3.4.3-1) ... Setting up python3-alabaster (0.7.16-0.1) ... Setting up python3-jsonpatch (1.32-5) ... update-alternatives: using /usr/bin/json-patch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode Setting up python3-bcrypt (4.3.0-1) ... Setting up python3-ply (3.11-9) ... Setting up python3-autopage (0.4.0-4) ... Setting up python3-typeguard (4.4.4-1) ... Setting up python3-extras (1.0.0-6) ... Setting up python3-memcache (1.62-3) ... Setting up python3-all (3.13.7-1) ... Setting up python3-coverage (7.8.2+dfsg1-1) ... Setting up python3-yaml (6.0.2-2) ... Setting up debhelper (13.26) ... Setting up python3-pytz (2025.2-3) ... Setting up dh-exec (0.30+b1) ... Setting up python3-wheel (0.46.1-2) ... Setting up python3-tz (2025.2-3) ... Setting up python3-pycparser (2.22-2) ... Setting up python3-inflect (7.5.0-1) ... Setting up python3-eventlet (0.40.1-3) ... Setting up python3-rfc3986 (2.0.0-3) ... Setting up python3-jaraco.text (4.0.0-1) ... Setting up python3-cryptography (43.0.0-3) ... Setting up python3-requests (2.32.5+dfsg-1) ... Setting up xclip (0.13-4+b2) ... Setting up python3-uhashring (2.3-2) ... Setting up python3-xattr (0.10.1-1+b1) ... Setting up python3-pip (25.2+dfsg-1) ... Setting up ieee-data (20240722) ... Setting up python3-swiftclient (1:4.7.0-2) ... Setting up python3-binary-memcached (0.31.2+dfsg1-4) ... Setting up python3-referencing (0.36.2-1) ... Setting up python3-pkg-resources (78.1.1-0.1) ... Setting up python3-setuptools (78.1.1-0.1) ... Setting up python3-pbr (6.1.1-2) ... Setting up python3-openssl (25.1.0-1) ... Setting up python3-cffi (2.0.0~b1-1) ... Setting up python3-requestsexceptions (1.4.0-5) ... Setting up python3-pyperclip (1.8.2-2) ... Setting up python3-debtcollector (3.0.0-5) ... Setting up openstack-pkg-tools (135) ... Setting up python3-oauthlib (3.3.1-1) ... Setting up python3-secretstorage (3.4.0-1) ... Setting up python3-paste (3.10.1-1) ... Setting up python3-cmd2 (2.5.11+ds-1) ... Setting up python3-requests-mock (1.12.1-3) ... Setting up python3-botocore (1.37.9+repack-1) ... Setting up python3-oslosphinx (4.18.0-6) ... Setting up python3-oslo.context (5.7.1-3) ... Setting up python3-netaddr (1.3.0-1) ... Setting up python3-keyring (25.6.0-3) ... Setting up python3-os-service-types (1.7.0-5) ... Setting up python3-stevedore (5.4.1-2) ... Setting up python3-jsonschema-specifications (2023.12.1-2) ... Setting up python3-oslo.i18n (6.5.1-3) ... Setting up python3-keystoneauth1 (5.10.0-2) ... Setting up python3-testtools (2.7.2-5) ... Setting up python3-pastedeploy (3.1-1) ... Setting up python3-s3transfer (0.11.4-1) ... Setting up python3-oslo.utils (8.2.0-4) ... Setting up python3-dogpile.cache (1.3.3-1) ... Setting up python3-subunit (1.4.2-3) ... Setting up python3-jsonschema (4.19.2-6) ... Setting up python3-boto3 (1.37.9-1) ... Setting up python3-fixtures (4.1.0-3) ... Setting up python3-openstacksdk (4.4.0-5) ... Setting up python3-cinderclient (1:9.7.0-2) ... Setting up python3-os-client-config (2.1.0-3) ... Setting up python3-warlock (2.0.1-4) ... Setting up subunit (1.4.2-3) ... Setting up python3-oslo.serialization (5.7.0-3) ... Setting up python3-glanceclient (1:4.8.0-2) ... Processing triggers for libc-bin (2.41-12) ... Processing triggers for sgml-base (1.31+nmu1) ... Setting up docutils-common (0.21.2+dfsg-2) ... Processing triggers for sgml-base (1.31+nmu1) ... Setting up python3-docutils (0.21.2+dfsg-2) ... Setting up python3-cliff (4.9.1-2) ... Setting up python3-oslo.config (1:9.7.1-3) ... Setting up python3-keystoneclient (1:5.6.0-2) ... Setting up python3-osc-lib (3.2.0-2) ... Setting up python3-sphinx (8.2.3-6) ... Setting up python3-oslo.log (7.1.0-4) ... Setting up python3-pycadf (4.0.1-1) ... Setting up python3-stestr (4.1.0-3) ... Setting up python3-openstackclient (7.4.0-3) ... Setting up python3-openstackdocstheme (3.2.0-3) ... Setting up python3-neutronclient (1:11.4.0-2) ... Setting up python3-oslo.cache (3.10.1-3) ... Setting up python3-os-testr (3.0.0-4) ... Setting up python3-keystonemiddleware (10.9.0-2) ... Setting up python3-os-api-ref (2.3.0+ds1-4) ... Processing triggers for ca-certificates (20250419) ... Updating certificates in /etc/ssl/certs... 0 added, 0 removed; done. Running hooks in /etc/ca-certificates/update.d... done. Reading package lists... Building dependency tree... Reading state information... Reading extended state information... Initializing package states... Writing extended state information... Building tag database... -> Finished parsing the build-deps I: Building the package I: user script /srv/workspace/pbuilder/1784759/tmp/hooks/A99_set_merged_usr starting Not re-configuring usrmerge for experimental I: user script /srv/workspace/pbuilder/1784759/tmp/hooks/A99_set_merged_usr finished hostname: Name or service not known I: Running cd /build/reproducible-path/swift-2.36.0/ && env PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path" HOME="/nonexistent/second-build" dpkg-buildpackage -us -uc -b && env PATH="/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/i/capture/the/path" HOME="/nonexistent/second-build" dpkg-genchanges -S > ../swift_2.36.0-2_source.changes dpkg-buildpackage: info: source package swift dpkg-buildpackage: info: source version 2.36.0-2 dpkg-buildpackage: info: source distribution experimental dpkg-buildpackage: info: source changed by Thomas Goirand dpkg-source --before-build . dpkg-buildpackage: info: host architecture arm64 dpkg-source: info: using options from swift-2.36.0/debian/source/options: --extend-diff-ignore=^[^/]*[.]egg-info/ --extend-diff-ignore=^[.]gitreview$ debian/rules clean make: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' dh clean --buildsystem=pybuild --with python3,sphinxdoc debian/rules override_dh_auto_clean make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' rm -rf build .stestr *.egg-info .pybuild find . -iname '*.pyc' -delete for i in $(find . -type d -iname __pycache__) ; do rm -rf $i ; done make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' dh_autoreconf_clean -O--buildsystem=pybuild dh_clean -O--buildsystem=pybuild debian/rules binary make: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' dh binary --buildsystem=pybuild --with python3,sphinxdoc dh_update_autotools_config -O--buildsystem=pybuild dh_autoreconf -O--buildsystem=pybuild dh_auto_configure -O--buildsystem=pybuild I: pybuild base:311: python3.13 setup.py config /usr/lib/python3/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: Apache Software License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() /usr/lib/python3/dist-packages/setuptools/__init__.py:94: _DeprecatedInstaller: setuptools.installer and fetch_build_eggs are deprecated. !! ******************************************************************************** Requirements should be satisfied by a PEP 517 installer. If you are using pip, you can try `pip install --use-pep517`. ******************************************************************************** !! dist.fetch_build_eggs(dist.setup_requires) /usr/lib/python3/dist-packages/setuptools/command/develop.py:41: EasyInstallDeprecationWarning: easy_install command is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` and ``easy_install``. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://github.com/pypa/setuptools/issues/917 for details. ******************************************************************************** !! easy_install.initialize_options(self) /usr/lib/python3/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() /usr/lib/python3/dist-packages/pbr/core.py:140: UserWarning: Unknown distribution option: 'tests_require' warnings.warn(msg) /usr/lib/python3/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: Apache Software License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() running config debian/rules override_dh_auto_build make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' dh_auto_build I: pybuild base:311: /usr/bin/python3 setup.py build /usr/lib/python3/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: Apache Software License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() /usr/lib/python3/dist-packages/setuptools/__init__.py:94: _DeprecatedInstaller: setuptools.installer and fetch_build_eggs are deprecated. !! ******************************************************************************** Requirements should be satisfied by a PEP 517 installer. If you are using pip, you can try `pip install --use-pep517`. ******************************************************************************** !! dist.fetch_build_eggs(dist.setup_requires) /usr/lib/python3/dist-packages/setuptools/command/develop.py:41: EasyInstallDeprecationWarning: easy_install command is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` and ``easy_install``. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://github.com/pypa/setuptools/issues/917 for details. ******************************************************************************** !! easy_install.initialize_options(self) /usr/lib/python3/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() /usr/lib/python3/dist-packages/pbr/core.py:140: UserWarning: Unknown distribution option: 'tests_require' warnings.warn(msg) /usr/lib/python3/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: Apache Software License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() running build running build_py creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/updater.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/sync_store.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/sync.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/sharder.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/server.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/replicator.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/reconciler.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/backend.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/auditor.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container copying swift/container/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/container creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy copying swift/proxy/server.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy copying swift/proxy/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj/watchers copying swift/obj/watchers/dark_data.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj/watchers copying swift/obj/watchers/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj/watchers creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy/controllers copying swift/proxy/controllers/obj.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy/controllers copying swift/proxy/controllers/info.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy/controllers copying swift/proxy/controllers/container.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy/controllers copying swift/proxy/controllers/base.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy/controllers copying swift/proxy/controllers/account.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy/controllers copying swift/proxy/controllers/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/proxy/controllers creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/x_profile copying swift/common/middleware/x_profile/profile_model.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/x_profile copying swift/common/middleware/x_profile/html_viewer.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/x_profile copying swift/common/middleware/x_profile/exceptions.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/x_profile copying swift/common/middleware/x_profile/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/x_profile creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/ring copying swift/common/ring/utils.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/ring copying swift/common/ring/ring.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/ring copying swift/common/ring/io.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/ring copying swift/common/ring/composite_builder.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/ring copying swift/common/ring/builder.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/ring copying swift/common/ring/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/ring creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/drive_full_checker.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/recon.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/shard-info.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/ringcomposer.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/ringbuilder.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/ring_builder_analyzer.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/reload.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/relinker.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/reconciler_enqueue.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/recon_cron.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/orphans.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/oldies.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/manage_shard_ranges.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/info.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/get_nodes.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/form_signature.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/drive_audit.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/dispersion_report.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/dispersion_populate.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/container_deleter.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/config.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/account_audit.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/cli/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/cli copying swift/common/wsgi.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/swob.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/storage_policy.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/statsd_client.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/splice.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/request_helpers.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/registry.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/recon.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/memcached.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/manager.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/linkat.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/internal_client.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/http_protocol.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/http.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/header_key_dict.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/exceptions.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/error_limiter.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/direct_client.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/digest.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/db_replicator.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/db_auditor.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/db.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/daemon.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/container_sync_realms.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/constraints.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/bufferedhttp.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/base_storage_server.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common copying swift/common/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/utils copying swift/common/utils/timestamp.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/utils copying swift/common/utils/logs.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/utils copying swift/common/utils/libc.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/utils copying swift/common/utils/ipaddrs.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/utils copying swift/common/utils/config.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/utils copying swift/common/utils/checksum.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/utils copying swift/common/utils/base.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/utils copying swift/common/utils/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/utils creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/versioning.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/tagging.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/service.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/s3_acl.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/object_lock.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/obj.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/multi_upload.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/multi_delete.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/logging.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/location.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/bucket.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/base.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/acl.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/controllers copying swift/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift copying swift/common/middleware/s3api/utils.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/subresource.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/s3token.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/s3response.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/s3request.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/s3api.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/exception.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/etree.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/acl_utils.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/acl_handlers.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api copying swift/common/middleware/s3api/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/crypto copying swift/common/middleware/crypto/kms_keymaster.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/crypto copying swift/common/middleware/crypto/kmip_keymaster.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/crypto copying swift/common/middleware/crypto/keymaster.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/crypto copying swift/common/middleware/crypto/encrypter.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/crypto copying swift/common/middleware/crypto/decrypter.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/crypto copying swift/common/middleware/crypto/crypto_utils.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/crypto copying swift/common/middleware/crypto/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/crypto creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/account copying swift/account/utils.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/account copying swift/account/server.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/account copying swift/account/replicator.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/account copying swift/account/reaper.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/account copying swift/account/backend.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/account copying swift/account/auditor.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/account copying swift/account/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/account creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/versioned_writes copying swift/common/middleware/versioned_writes/object_versioning.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/versioned_writes copying swift/common/middleware/versioned_writes/legacy.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/versioned_writes copying swift/common/middleware/versioned_writes/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/versioned_writes copying swift/common/middleware/tempurl.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/xprofile.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/tempauth.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/symlink.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/staticweb.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/slo.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/recon.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/read_only.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/ratelimit.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/proxy_logging.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/name_check.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/memcache.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/listing_formats.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/list_endpoints.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/keystoneauth.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/healthcheck.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/gatekeeper.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/formpost.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/etag_quoter.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/domain_remap.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/dlo.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/crossdomain.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/copy.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/container_sync.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/container_quotas.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/cname_lookup.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/catch_errors.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/bulk.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/backend_ratelimit.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/acl.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/account_quotas.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/common/middleware/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware copying swift/obj/updater.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/ssync_sender.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/ssync_receiver.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/server.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/replicator.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/reconstructor.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/mem_server.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/mem_diskfile.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/expirer.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/diskfile.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/auditor.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj copying swift/obj/__init__.py -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/obj running egg_info creating swift.egg-info writing swift.egg-info/PKG-INFO writing dependency_links to swift.egg-info/dependency_links.txt writing entry points to swift.egg-info/entry_points.txt writing requirements to swift.egg-info/requires.txt writing top-level names to swift.egg-info/top_level.txt [pbr] Processing SOURCES.txt writing manifest file 'swift.egg-info/SOURCES.txt' warning: no files found matching 'ChangeLog' warning: no previously-included files found matching '.gitignore' warning: no previously-included files found matching '.gitreview' warning: no previously-included files matching '*.pyc' found anywhere in distribution reading manifest template 'MANIFEST.in' warning: no files found matching 'babel.cfg' warning: no directories found matching 'swift/locale' adding license file 'LICENSE' adding license file 'AUTHORS' writing manifest file 'swift.egg-info/SOURCES.txt' /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'swift.common.middleware.s3api.schema' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'swift.common.middleware.s3api.schema' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'swift.common.middleware.s3api.schema' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'swift.common.middleware.s3api.schema' to be distributed and are already explicitly excluding 'swift.common.middleware.s3api.schema' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) creating /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/access_control_policy.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/bucket_logging_status.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/common.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/complete_multipart_upload.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/complete_multipart_upload_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/copy_object_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/copy_part_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/create_bucket_configuration.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/delete.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/delete_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/error.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/initiate_multipart_upload_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/lifecycle_configuration.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_all_my_buckets_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_bucket_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_multipart_uploads_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_parts_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_versions_result.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/location_constraint.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/versioning_configuration.rng -> /build/reproducible-path/swift-2.36.0/.pybuild/cpython3_3.13/build/swift/common/middleware/s3api/schema /usr/share/openstack-pkg-tools/pkgos_insert_include pkgos_func python3-swift.postinst set -e ; set -x ; \ for i in debian/swift-account.swift-account-auditor.init.in \ debian/swift-account.swift-account-reaper.init.in \ debian/swift-account.swift-account-replicator.init.in \ debian/swift-container.swift-container-auditor.init.in \ debian/swift-container.swift-container-reconciler.init.in \ debian/swift-container.swift-container-replicator.init.in \ debian/swift-container.swift-container-sharder.init.in \ debian/swift-container.swift-container-sync.init.in \ debian/swift-container.swift-container-updater.init.in \ debian/swift-object-expirer.swift-object-expirer.init.in \ debian/swift-object.swift-object-auditor.init.in \ debian/swift-object.swift-object.init.in \ debian/swift-object.swift-object-reconstructor.init.in \ debian/swift-object.swift-object-replicator.init.in \ debian/swift-object.swift-object-updater.init.in \ ; do \ debian/gen-init $i ; \ done + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-account.swift-account-auditor.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-account.swift-account-reaper.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-account.swift-account-replicator.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-container.swift-container-auditor.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-container.swift-container-reconciler.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-container.swift-container-replicator.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-container.swift-container-sharder.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-container.swift-container-sync.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-container.swift-container-updater.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-object-expirer.swift-object-expirer.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-object.swift-object-auditor.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-object.swift-object.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-object.swift-object-reconstructor.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-object.swift-object-replicator.init.in + for i in debian/swift-account.swift-account-auditor.init.in debian/swift-account.swift-account-reaper.init.in debian/swift-account.swift-account-replicator.init.in debian/swift-container.swift-container-auditor.init.in debian/swift-container.swift-container-reconciler.init.in debian/swift-container.swift-container-replicator.init.in debian/swift-container.swift-container-sharder.init.in debian/swift-container.swift-container-sync.init.in debian/swift-container.swift-container-updater.init.in debian/swift-object-expirer.swift-object-expirer.init.in debian/swift-object.swift-object-auditor.init.in debian/swift-object.swift-object.init.in debian/swift-object.swift-object-reconstructor.init.in debian/swift-object.swift-object-replicator.init.in debian/swift-object.swift-object-updater.init.in + debian/gen-init debian/swift-object.swift-object-updater.init.in set -e ; set -x ; \ for i in debian/swift-proxy.swift-proxy.init \ debian/swift-account.swift-account.init \ debian/swift-container.swift-container.init \ ; do \ if [ $DEB_USE_UWSGI = "yes" ] ; then \ cp $i.in $i ; \ cat /usr/share/openstack-pkg-tools/init-script-template >>$i ; \ pkgos-gen-systemd-unit $i.in ; \ else \ CONFIG=`echo $i | cut -d/ -f2 | cut -d. -f1 | sed -e s/swift-//`-server debian/gen-init $i.in ; \ fi ; \ done + for i in debian/swift-proxy.swift-proxy.init debian/swift-account.swift-account.init debian/swift-container.swift-container.init + '[' no = yes ']' ++ echo debian/swift-proxy.swift-proxy.init ++ sed -e s/swift-// ++ cut -d. -f1 ++ cut -d/ -f2 + CONFIG=proxy-server + debian/gen-init debian/swift-proxy.swift-proxy.init.in + for i in debian/swift-proxy.swift-proxy.init debian/swift-account.swift-account.init debian/swift-container.swift-container.init + '[' no = yes ']' ++ echo debian/swift-account.swift-account.init ++ cut -d/ -f2 ++ cut -d. -f1 ++ sed -e s/swift-// + CONFIG=account-server + debian/gen-init debian/swift-account.swift-account.init.in + for i in debian/swift-proxy.swift-proxy.init debian/swift-account.swift-account.init debian/swift-container.swift-container.init + '[' no = yes ']' ++ cut -d. -f1 ++ sed -e s/swift-// ++ echo debian/swift-container.swift-container.init ++ cut -d/ -f2 + CONFIG=container-server + debian/gen-init debian/swift-container.swift-container.init.in make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' debian/rules override_dh_auto_test make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' echo "Do nothing..." Do nothing... make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' create-stamp debian/debhelper-build-stamp dh_testroot -O--buildsystem=pybuild dh_prep -O--buildsystem=pybuild debian/rules override_dh_auto_install make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' pkgos-dh_auto_install --no-py2 --in-tmp + PKGOS_IN_TMP=no + for i in $@ + case "${1}" in + echo 'WARNING: --no-py2 is deprecated and always on.' WARNING: --no-py2 is deprecated and always on. + shift + for i in $@ + case "${1}" in + PKGOS_IN_TMP=yes + shift ++ dpkg-parsechangelog -SSource + SRC_PKG_NAME=swift ++ sed s/python-// ++ echo swift + PY_MODULE_NAME=swift ++ py3versions -vr + PYTHON3S=3.13 + '[' yes = yes ']' + TARGET_DIR=tmp + for pyvers in ${PYTHON3S} ++ pwd + python3.13 setup.py install --install-layout=deb --root /build/reproducible-path/swift-2.36.0/debian/tmp /usr/lib/python3/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: Apache Software License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() /usr/lib/python3/dist-packages/setuptools/__init__.py:94: _DeprecatedInstaller: setuptools.installer and fetch_build_eggs are deprecated. !! ******************************************************************************** Requirements should be satisfied by a PEP 517 installer. If you are using pip, you can try `pip install --use-pep517`. ******************************************************************************** !! dist.fetch_build_eggs(dist.setup_requires) /usr/lib/python3/dist-packages/setuptools/command/develop.py:41: EasyInstallDeprecationWarning: easy_install command is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` and ``easy_install``. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://github.com/pypa/setuptools/issues/917 for details. ******************************************************************************** !! easy_install.initialize_options(self) /usr/lib/python3/dist-packages/setuptools/_distutils/cmd.py:90: SetuptoolsDeprecationWarning: setup.py install is deprecated. !! ******************************************************************************** Please avoid running ``setup.py`` directly. Instead, use pypa/build, pypa/installer or other standards-based tools. See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details. ******************************************************************************** !! self.initialize_options() /usr/lib/python3/dist-packages/pbr/core.py:140: UserWarning: Unknown distribution option: 'tests_require' warnings.warn(msg) /usr/lib/python3/dist-packages/setuptools/dist.py:759: SetuptoolsDeprecationWarning: License classifiers are deprecated. !! ******************************************************************************** Please consider removing the following classifiers in favor of a SPDX license expression: License :: OSI Approved :: Apache Software License See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. ******************************************************************************** !! self._finalize_license_expression() running install running build running build_py creating build/lib/swift/common/middleware/versioned_writes copying swift/common/middleware/versioned_writes/object_versioning.py -> build/lib/swift/common/middleware/versioned_writes copying swift/common/middleware/versioned_writes/legacy.py -> build/lib/swift/common/middleware/versioned_writes copying swift/common/middleware/versioned_writes/__init__.py -> build/lib/swift/common/middleware/versioned_writes creating build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/utils.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/subresource.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/s3token.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/s3response.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/s3request.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/s3api.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/exception.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/etree.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/acl_utils.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/acl_handlers.py -> build/lib/swift/common/middleware/s3api copying swift/common/middleware/s3api/__init__.py -> build/lib/swift/common/middleware/s3api creating build/lib/swift/common/utils copying swift/common/utils/timestamp.py -> build/lib/swift/common/utils copying swift/common/utils/logs.py -> build/lib/swift/common/utils copying swift/common/utils/libc.py -> build/lib/swift/common/utils copying swift/common/utils/ipaddrs.py -> build/lib/swift/common/utils copying swift/common/utils/config.py -> build/lib/swift/common/utils copying swift/common/utils/checksum.py -> build/lib/swift/common/utils copying swift/common/utils/base.py -> build/lib/swift/common/utils copying swift/common/utils/__init__.py -> build/lib/swift/common/utils creating build/lib/swift/proxy copying swift/proxy/server.py -> build/lib/swift/proxy copying swift/proxy/__init__.py -> build/lib/swift/proxy copying swift/__init__.py -> build/lib/swift copying swift/common/wsgi.py -> build/lib/swift/common copying swift/common/swob.py -> build/lib/swift/common copying swift/common/storage_policy.py -> build/lib/swift/common copying swift/common/statsd_client.py -> build/lib/swift/common copying swift/common/splice.py -> build/lib/swift/common copying swift/common/request_helpers.py -> build/lib/swift/common copying swift/common/registry.py -> build/lib/swift/common copying swift/common/recon.py -> build/lib/swift/common copying swift/common/memcached.py -> build/lib/swift/common copying swift/common/manager.py -> build/lib/swift/common copying swift/common/linkat.py -> build/lib/swift/common copying swift/common/internal_client.py -> build/lib/swift/common copying swift/common/http_protocol.py -> build/lib/swift/common copying swift/common/http.py -> build/lib/swift/common copying swift/common/header_key_dict.py -> build/lib/swift/common copying swift/common/exceptions.py -> build/lib/swift/common copying swift/common/error_limiter.py -> build/lib/swift/common copying swift/common/direct_client.py -> build/lib/swift/common copying swift/common/digest.py -> build/lib/swift/common copying swift/common/db_replicator.py -> build/lib/swift/common copying swift/common/db_auditor.py -> build/lib/swift/common copying swift/common/db.py -> build/lib/swift/common copying swift/common/daemon.py -> build/lib/swift/common copying swift/common/container_sync_realms.py -> build/lib/swift/common copying swift/common/constraints.py -> build/lib/swift/common copying swift/common/bufferedhttp.py -> build/lib/swift/common copying swift/common/base_storage_server.py -> build/lib/swift/common copying swift/common/__init__.py -> build/lib/swift/common creating build/lib/swift/common/ring copying swift/common/ring/utils.py -> build/lib/swift/common/ring copying swift/common/ring/ring.py -> build/lib/swift/common/ring copying swift/common/ring/io.py -> build/lib/swift/common/ring copying swift/common/ring/composite_builder.py -> build/lib/swift/common/ring copying swift/common/ring/builder.py -> build/lib/swift/common/ring copying swift/common/ring/__init__.py -> build/lib/swift/common/ring creating build/lib/swift/cli copying swift/cli/drive_full_checker.py -> build/lib/swift/cli copying swift/cli/recon.py -> build/lib/swift/cli copying swift/cli/shard-info.py -> build/lib/swift/cli copying swift/cli/ringcomposer.py -> build/lib/swift/cli copying swift/cli/ringbuilder.py -> build/lib/swift/cli copying swift/cli/ring_builder_analyzer.py -> build/lib/swift/cli copying swift/cli/reload.py -> build/lib/swift/cli copying swift/cli/relinker.py -> build/lib/swift/cli copying swift/cli/reconciler_enqueue.py -> build/lib/swift/cli copying swift/cli/recon_cron.py -> build/lib/swift/cli copying swift/cli/orphans.py -> build/lib/swift/cli copying swift/cli/oldies.py -> build/lib/swift/cli copying swift/cli/manage_shard_ranges.py -> build/lib/swift/cli copying swift/cli/info.py -> build/lib/swift/cli copying swift/cli/get_nodes.py -> build/lib/swift/cli copying swift/cli/form_signature.py -> build/lib/swift/cli copying swift/cli/drive_audit.py -> build/lib/swift/cli copying swift/cli/dispersion_report.py -> build/lib/swift/cli copying swift/cli/dispersion_populate.py -> build/lib/swift/cli copying swift/cli/container_deleter.py -> build/lib/swift/cli copying swift/cli/config.py -> build/lib/swift/cli copying swift/cli/account_audit.py -> build/lib/swift/cli copying swift/cli/__init__.py -> build/lib/swift/cli creating build/lib/swift/obj/watchers copying swift/obj/watchers/dark_data.py -> build/lib/swift/obj/watchers copying swift/obj/watchers/__init__.py -> build/lib/swift/obj/watchers creating build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/versioning.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/tagging.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/service.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/s3_acl.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/object_lock.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/obj.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/multi_upload.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/multi_delete.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/logging.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/location.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/bucket.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/base.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/acl.py -> build/lib/swift/common/middleware/s3api/controllers copying swift/common/middleware/s3api/controllers/__init__.py -> build/lib/swift/common/middleware/s3api/controllers creating build/lib/swift/common/middleware/crypto copying swift/common/middleware/crypto/kms_keymaster.py -> build/lib/swift/common/middleware/crypto copying swift/common/middleware/crypto/kmip_keymaster.py -> build/lib/swift/common/middleware/crypto copying swift/common/middleware/crypto/keymaster.py -> build/lib/swift/common/middleware/crypto copying swift/common/middleware/crypto/encrypter.py -> build/lib/swift/common/middleware/crypto copying swift/common/middleware/crypto/decrypter.py -> build/lib/swift/common/middleware/crypto copying swift/common/middleware/crypto/crypto_utils.py -> build/lib/swift/common/middleware/crypto copying swift/common/middleware/crypto/__init__.py -> build/lib/swift/common/middleware/crypto creating build/lib/swift/container copying swift/container/updater.py -> build/lib/swift/container copying swift/container/sync_store.py -> build/lib/swift/container copying swift/container/sync.py -> build/lib/swift/container copying swift/container/sharder.py -> build/lib/swift/container copying swift/container/server.py -> build/lib/swift/container copying swift/container/replicator.py -> build/lib/swift/container copying swift/container/reconciler.py -> build/lib/swift/container copying swift/container/backend.py -> build/lib/swift/container copying swift/container/auditor.py -> build/lib/swift/container copying swift/container/__init__.py -> build/lib/swift/container creating build/lib/swift/common/middleware/x_profile copying swift/common/middleware/x_profile/profile_model.py -> build/lib/swift/common/middleware/x_profile copying swift/common/middleware/x_profile/html_viewer.py -> build/lib/swift/common/middleware/x_profile copying swift/common/middleware/x_profile/exceptions.py -> build/lib/swift/common/middleware/x_profile copying swift/common/middleware/x_profile/__init__.py -> build/lib/swift/common/middleware/x_profile creating build/lib/swift/proxy/controllers copying swift/proxy/controllers/obj.py -> build/lib/swift/proxy/controllers copying swift/proxy/controllers/info.py -> build/lib/swift/proxy/controllers copying swift/proxy/controllers/container.py -> build/lib/swift/proxy/controllers copying swift/proxy/controllers/base.py -> build/lib/swift/proxy/controllers copying swift/proxy/controllers/account.py -> build/lib/swift/proxy/controllers copying swift/proxy/controllers/__init__.py -> build/lib/swift/proxy/controllers copying swift/obj/updater.py -> build/lib/swift/obj copying swift/obj/ssync_sender.py -> build/lib/swift/obj copying swift/obj/ssync_receiver.py -> build/lib/swift/obj copying swift/obj/server.py -> build/lib/swift/obj copying swift/obj/replicator.py -> build/lib/swift/obj copying swift/obj/reconstructor.py -> build/lib/swift/obj copying swift/obj/mem_server.py -> build/lib/swift/obj copying swift/obj/mem_diskfile.py -> build/lib/swift/obj copying swift/obj/expirer.py -> build/lib/swift/obj copying swift/obj/diskfile.py -> build/lib/swift/obj copying swift/obj/auditor.py -> build/lib/swift/obj copying swift/obj/__init__.py -> build/lib/swift/obj creating build/lib/swift/account copying swift/account/utils.py -> build/lib/swift/account copying swift/account/server.py -> build/lib/swift/account copying swift/account/replicator.py -> build/lib/swift/account copying swift/account/reaper.py -> build/lib/swift/account copying swift/account/backend.py -> build/lib/swift/account copying swift/account/auditor.py -> build/lib/swift/account copying swift/account/__init__.py -> build/lib/swift/account copying swift/common/middleware/tempurl.py -> build/lib/swift/common/middleware copying swift/common/middleware/xprofile.py -> build/lib/swift/common/middleware copying swift/common/middleware/tempauth.py -> build/lib/swift/common/middleware copying swift/common/middleware/symlink.py -> build/lib/swift/common/middleware copying swift/common/middleware/staticweb.py -> build/lib/swift/common/middleware copying swift/common/middleware/slo.py -> build/lib/swift/common/middleware copying swift/common/middleware/recon.py -> build/lib/swift/common/middleware copying swift/common/middleware/read_only.py -> build/lib/swift/common/middleware copying swift/common/middleware/ratelimit.py -> build/lib/swift/common/middleware copying swift/common/middleware/proxy_logging.py -> build/lib/swift/common/middleware copying swift/common/middleware/name_check.py -> build/lib/swift/common/middleware copying swift/common/middleware/memcache.py -> build/lib/swift/common/middleware copying swift/common/middleware/listing_formats.py -> build/lib/swift/common/middleware copying swift/common/middleware/list_endpoints.py -> build/lib/swift/common/middleware copying swift/common/middleware/keystoneauth.py -> build/lib/swift/common/middleware copying swift/common/middleware/healthcheck.py -> build/lib/swift/common/middleware copying swift/common/middleware/gatekeeper.py -> build/lib/swift/common/middleware copying swift/common/middleware/formpost.py -> build/lib/swift/common/middleware copying swift/common/middleware/etag_quoter.py -> build/lib/swift/common/middleware copying swift/common/middleware/domain_remap.py -> build/lib/swift/common/middleware copying swift/common/middleware/dlo.py -> build/lib/swift/common/middleware copying swift/common/middleware/crossdomain.py -> build/lib/swift/common/middleware copying swift/common/middleware/copy.py -> build/lib/swift/common/middleware copying swift/common/middleware/container_sync.py -> build/lib/swift/common/middleware copying swift/common/middleware/container_quotas.py -> build/lib/swift/common/middleware copying swift/common/middleware/cname_lookup.py -> build/lib/swift/common/middleware copying swift/common/middleware/catch_errors.py -> build/lib/swift/common/middleware copying swift/common/middleware/bulk.py -> build/lib/swift/common/middleware copying swift/common/middleware/backend_ratelimit.py -> build/lib/swift/common/middleware copying swift/common/middleware/acl.py -> build/lib/swift/common/middleware copying swift/common/middleware/account_quotas.py -> build/lib/swift/common/middleware copying swift/common/middleware/__init__.py -> build/lib/swift/common/middleware running egg_info writing swift.egg-info/PKG-INFO writing dependency_links to swift.egg-info/dependency_links.txt writing entry points to swift.egg-info/entry_points.txt writing requirements to swift.egg-info/requires.txt writing top-level names to swift.egg-info/top_level.txt [pbr] Reusing existing SOURCES.txt /usr/lib/python3/dist-packages/setuptools/command/build_py.py:212: _Warning: Package 'swift.common.middleware.s3api.schema' is absent from the `packages` configuration. !! ******************************************************************************** ############################ # Package would be ignored # ############################ Python recognizes 'swift.common.middleware.s3api.schema' as an importable package[^1], but it is absent from setuptools' `packages` configuration. This leads to an ambiguous overall configuration. If you want to distribute this package, please make sure that 'swift.common.middleware.s3api.schema' is explicitly added to the `packages` configuration field. Alternatively, you can also rely on setuptools' discovery methods (for example by using `find_namespace_packages(...)`/`find_namespace:` instead of `find_packages(...)`/`find:`). You can read more about "package discovery" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/package_discovery.html If you don't want 'swift.common.middleware.s3api.schema' to be distributed and are already explicitly excluding 'swift.common.middleware.s3api.schema' via `find_namespace_packages(...)/find_namespace` or `find_packages(...)/find`, you can try to use `exclude_package_data`, or `include-package-data=False` in combination with a more fine grained `package-data` configuration. You can read more about "package data files" on setuptools documentation page: - https://setuptools.pypa.io/en/latest/userguide/datafiles.html [^1]: For Python, any directory (with suitable naming) can be imported, even if it does not contain any `.py` files. On the other hand, currently there is no concept of package data directory, all directories are treated like packages. ******************************************************************************** !! check.warn(importable) creating build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/access_control_policy.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/bucket_logging_status.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/common.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/complete_multipart_upload.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/complete_multipart_upload_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/copy_object_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/copy_part_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/create_bucket_configuration.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/delete.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/delete_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/error.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/initiate_multipart_upload_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/lifecycle_configuration.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_all_my_buckets_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_bucket_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_multipart_uploads_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_parts_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/list_versions_result.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/location_constraint.rng -> build/lib/swift/common/middleware/s3api/schema copying swift/common/middleware/s3api/schema/versioning_configuration.rng -> build/lib/swift/common/middleware/s3api/schema running install_lib creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account copying build/lib/swift/account/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account copying build/lib/swift/account/auditor.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account copying build/lib/swift/account/backend.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account copying build/lib/swift/account/reaper.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account copying build/lib/swift/account/replicator.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account copying build/lib/swift/account/server.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account copying build/lib/swift/account/utils.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/auditor.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/backend.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/reconciler.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/replicator.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/server.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/sharder.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/sync.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/sync_store.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container copying build/lib/swift/container/updater.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/auditor.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/diskfile.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/expirer.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/mem_diskfile.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/mem_server.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/reconstructor.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/replicator.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/server.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/ssync_receiver.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/ssync_sender.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj copying build/lib/swift/obj/updater.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/watchers copying build/lib/swift/obj/watchers/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/watchers copying build/lib/swift/obj/watchers/dark_data.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/watchers creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/account_audit.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/config.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/container_deleter.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/dispersion_populate.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/dispersion_report.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/drive_audit.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/form_signature.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/get_nodes.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/info.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/manage_shard_ranges.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/oldies.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/orphans.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/recon_cron.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/reconciler_enqueue.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/relinker.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/reload.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/ring_builder_analyzer.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/ringbuilder.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/ringcomposer.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/shard-info.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/recon.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/cli/drive_full_checker.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli copying build/lib/swift/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers copying build/lib/swift/proxy/controllers/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers copying build/lib/swift/proxy/controllers/account.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers copying build/lib/swift/proxy/controllers/base.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers copying build/lib/swift/proxy/controllers/container.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers copying build/lib/swift/proxy/controllers/info.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers copying build/lib/swift/proxy/controllers/obj.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers copying build/lib/swift/proxy/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy copying build/lib/swift/proxy/server.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring copying build/lib/swift/common/ring/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring copying build/lib/swift/common/ring/builder.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring copying build/lib/swift/common/ring/composite_builder.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring copying build/lib/swift/common/ring/io.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring copying build/lib/swift/common/ring/ring.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring copying build/lib/swift/common/ring/utils.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring copying build/lib/swift/common/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/base_storage_server.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/bufferedhttp.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/constraints.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/container_sync_realms.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/daemon.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/db.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/db_auditor.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/db_replicator.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/digest.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/direct_client.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/error_limiter.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/exceptions.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/header_key_dict.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/http.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/http_protocol.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/internal_client.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/linkat.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/manager.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/memcached.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/recon.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/registry.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/request_helpers.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/splice.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/statsd_client.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/storage_policy.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/swob.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common copying build/lib/swift/common/wsgi.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils copying build/lib/swift/common/utils/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils copying build/lib/swift/common/utils/base.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils copying build/lib/swift/common/utils/checksum.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils copying build/lib/swift/common/utils/config.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils copying build/lib/swift/common/utils/ipaddrs.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils copying build/lib/swift/common/utils/libc.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils copying build/lib/swift/common/utils/logs.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils copying build/lib/swift/common/utils/timestamp.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/account_quotas.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/acl.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/backend_ratelimit.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/bulk.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/catch_errors.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/cname_lookup.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/container_quotas.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/container_sync.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/copy.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/crossdomain.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/dlo.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/domain_remap.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/etag_quoter.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/formpost.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/gatekeeper.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/healthcheck.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/keystoneauth.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/list_endpoints.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/listing_formats.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/memcache.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/name_check.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/proxy_logging.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/ratelimit.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/read_only.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/recon.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/slo.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/staticweb.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/symlink.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/tempauth.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/xprofile.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware copying build/lib/swift/common/middleware/tempurl.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/x_profile copying build/lib/swift/common/middleware/x_profile/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/x_profile copying build/lib/swift/common/middleware/x_profile/exceptions.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/x_profile copying build/lib/swift/common/middleware/x_profile/html_viewer.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/x_profile copying build/lib/swift/common/middleware/x_profile/profile_model.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/x_profile creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto copying build/lib/swift/common/middleware/crypto/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto copying build/lib/swift/common/middleware/crypto/crypto_utils.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto copying build/lib/swift/common/middleware/crypto/decrypter.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto copying build/lib/swift/common/middleware/crypto/encrypter.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto copying build/lib/swift/common/middleware/crypto/keymaster.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto copying build/lib/swift/common/middleware/crypto/kmip_keymaster.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto copying build/lib/swift/common/middleware/crypto/kms_keymaster.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/versioning_configuration.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/location_constraint.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/list_versions_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/list_parts_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/list_multipart_uploads_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/list_bucket_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/list_all_my_buckets_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/lifecycle_configuration.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/initiate_multipart_upload_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/error.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/delete_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/delete.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/create_bucket_configuration.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/copy_part_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/copy_object_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/complete_multipart_upload_result.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/complete_multipart_upload.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/common.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/bucket_logging_status.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema copying build/lib/swift/common/middleware/s3api/schema/access_control_policy.rng -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/schema creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/acl.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/base.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/bucket.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/location.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/logging.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/multi_delete.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/multi_upload.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/obj.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/object_lock.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/s3_acl.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/service.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/tagging.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/controllers/versioning.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers copying build/lib/swift/common/middleware/s3api/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/acl_handlers.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/acl_utils.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/etree.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/exception.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/s3api.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/s3request.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/s3response.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/s3token.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/subresource.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api copying build/lib/swift/common/middleware/s3api/utils.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api creating /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/versioned_writes copying build/lib/swift/common/middleware/versioned_writes/__init__.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/versioned_writes copying build/lib/swift/common/middleware/versioned_writes/legacy.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/versioned_writes copying build/lib/swift/common/middleware/versioned_writes/object_versioning.py -> /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/versioned_writes byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account/auditor.py to auditor.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account/backend.py to backend.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account/reaper.py to reaper.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account/replicator.py to replicator.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account/server.py to server.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/account/utils.py to utils.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/auditor.py to auditor.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/backend.py to backend.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/reconciler.py to reconciler.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/replicator.py to replicator.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/server.py to server.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/sharder.py to sharder.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/sync.py to sync.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/sync_store.py to sync_store.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/container/updater.py to updater.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/auditor.py to auditor.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/diskfile.py to diskfile.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/expirer.py to expirer.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/mem_diskfile.py to mem_diskfile.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/mem_server.py to mem_server.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/reconstructor.py to reconstructor.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/replicator.py to replicator.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/server.py to server.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/ssync_receiver.py to ssync_receiver.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/ssync_sender.py to ssync_sender.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/updater.py to updater.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/watchers/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/obj/watchers/dark_data.py to dark_data.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/account_audit.py to account_audit.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/config.py to config.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/container_deleter.py to container_deleter.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/dispersion_populate.py to dispersion_populate.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/dispersion_report.py to dispersion_report.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/drive_audit.py to drive_audit.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/form_signature.py to form_signature.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/get_nodes.py to get_nodes.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/info.py to info.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/manage_shard_ranges.py to manage_shard_ranges.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/oldies.py to oldies.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/orphans.py to orphans.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/recon_cron.py to recon_cron.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/reconciler_enqueue.py to reconciler_enqueue.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/relinker.py to relinker.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/reload.py to reload.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/ring_builder_analyzer.py to ring_builder_analyzer.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/ringbuilder.py to ringbuilder.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/ringcomposer.py to ringcomposer.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/shard-info.py to shard-info.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/recon.py to recon.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/cli/drive_full_checker.py to drive_full_checker.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers/account.py to account.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers/base.py to base.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers/container.py to container.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers/info.py to info.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/controllers/obj.py to obj.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/proxy/server.py to server.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring/builder.py to builder.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring/composite_builder.py to composite_builder.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring/io.py to io.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring/ring.py to ring.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/ring/utils.py to utils.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/base_storage_server.py to base_storage_server.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/bufferedhttp.py to bufferedhttp.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/constraints.py to constraints.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/container_sync_realms.py to container_sync_realms.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/daemon.py to daemon.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/db.py to db.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/db_auditor.py to db_auditor.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/db_replicator.py to db_replicator.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/digest.py to digest.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/direct_client.py to direct_client.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/error_limiter.py to error_limiter.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/exceptions.py to exceptions.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/header_key_dict.py to header_key_dict.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/http.py to http.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/http_protocol.py to http_protocol.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/internal_client.py to internal_client.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/linkat.py to linkat.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/manager.py to manager.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/memcached.py to memcached.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/recon.py to recon.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/registry.py to registry.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/request_helpers.py to request_helpers.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/splice.py to splice.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/statsd_client.py to statsd_client.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/storage_policy.py to storage_policy.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/swob.py to swob.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/wsgi.py to wsgi.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils/base.py to base.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils/checksum.py to checksum.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils/config.py to config.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils/ipaddrs.py to ipaddrs.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils/libc.py to libc.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils/logs.py to logs.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/utils/timestamp.py to timestamp.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/account_quotas.py to account_quotas.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/acl.py to acl.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/backend_ratelimit.py to backend_ratelimit.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/bulk.py to bulk.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/catch_errors.py to catch_errors.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/cname_lookup.py to cname_lookup.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/container_quotas.py to container_quotas.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/container_sync.py to container_sync.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/copy.py to copy.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crossdomain.py to crossdomain.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/dlo.py to dlo.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/domain_remap.py to domain_remap.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/etag_quoter.py to etag_quoter.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/formpost.py to formpost.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/gatekeeper.py to gatekeeper.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/healthcheck.py to healthcheck.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/keystoneauth.py to keystoneauth.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/list_endpoints.py to list_endpoints.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/listing_formats.py to listing_formats.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/memcache.py to memcache.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/name_check.py to name_check.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/proxy_logging.py to proxy_logging.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/ratelimit.py to ratelimit.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/read_only.py to read_only.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/recon.py to recon.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/slo.py to slo.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/staticweb.py to staticweb.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/symlink.py to symlink.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/tempauth.py to tempauth.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/xprofile.py to xprofile.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/tempurl.py to tempurl.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/x_profile/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/x_profile/exceptions.py to exceptions.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/x_profile/html_viewer.py to html_viewer.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/x_profile/profile_model.py to profile_model.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto/crypto_utils.py to crypto_utils.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto/decrypter.py to decrypter.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto/encrypter.py to encrypter.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto/keymaster.py to keymaster.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto/kmip_keymaster.py to kmip_keymaster.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/crypto/kms_keymaster.py to kms_keymaster.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/acl.py to acl.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/base.py to base.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/bucket.py to bucket.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/location.py to location.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/logging.py to logging.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/multi_delete.py to multi_delete.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/multi_upload.py to multi_upload.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/obj.py to obj.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/object_lock.py to object_lock.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/s3_acl.py to s3_acl.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/service.py to service.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/tagging.py to tagging.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/controllers/versioning.py to versioning.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/acl_handlers.py to acl_handlers.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/acl_utils.py to acl_utils.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/etree.py to etree.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/exception.py to exception.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/s3api.py to s3api.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/s3request.py to s3request.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/s3response.py to s3response.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/s3token.py to s3token.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/subresource.py to subresource.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/s3api/utils.py to utils.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/versioned_writes/__init__.py to __init__.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/versioned_writes/legacy.py to legacy.cpython-313.pyc byte-compiling /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift/common/middleware/versioned_writes/object_versioning.py to object_versioning.cpython-313.pyc running install_egg_info Copying swift.egg-info to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages/swift-2.36.0.egg-info Skipping SOURCES.txt running install_scripts Installing swift-account-audit script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-account-auditor script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-account-info script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-account-reaper script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-account-replicator script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-account-server script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-config script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-container-auditor script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-container-deleter script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-container-info script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-container-reconciler script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-container-replicator script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-container-server script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-container-sharder script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-container-sync script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-container-updater script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-dispersion-populate script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-dispersion-report script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-drive-audit script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-drive-full-checker script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-form-signature script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-get-nodes script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-init script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-manage-shard-ranges script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-object-auditor script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-object-expirer script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-object-info script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-object-reconstructor script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-object-relinker script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-object-replicator script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-object-server script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-object-updater script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-oldies script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-orphans script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-proxy-server script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-recon script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-recon-cron script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-reconciler-enqueue script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-reload script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-ring-builder script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-ring-builder-analyzer script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin Installing swift-ring-composer script to /build/reproducible-path/swift-2.36.0/debian/tmp/usr/bin ++ pwd + rm -rf '/build/reproducible-path/swift-2.36.0/debian/python*/usr/lib/python*/dist-packages/*.pth' ++ pwd + rm -rf '/build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python*/dist-packages/*.pth' rm debian/tmp/usr/bin/swift-init pkgos-dh_auto_test --no-py2 --test-path test/unit 'test\.unit\.(?!common\.test_utils\.TestUtils\.test_get_logger_sysloghandler_plumbing|common\.middleware\.test_cname_lookup\.TestCNAMELookup.*|common\.test_db\.TestDatabaseBroker\.test_get.*|container\.test_sync\.TestContainerSync\.test_init.*|common\.test_utils\.TestPunchHoleReally\.test_punch_a_hole.*|common\.test_utils\.Test_LibcWrapper\.test_argument_plumbing.*|common\.test_utils\.TestUtils\.test_load_pkg_resource_importlib.*|common\.test_db_replicator\.TestHandoffsOnly.*|common\.ring\.test_builder\.TestGetRequiredOverload\.test_perfect_four_zone_four_replica_bad_placement|common\.test_wsgi\.TestWSGI.*|obj\.test_expirer\.TestObjectExpirer\.test_delete_actual_object|common\.test_memcached\.TestMemcached\.test_get_conns_hostname6|common\.test_memcached\.TestMemcached\.test_get_conns_v6|common\.test_memcached\.TestMemcached\.test_get_conns_v6_default|obj\.test_reconstructor\.TestWorkerReconstructor\.test_run_forever_recon_aggregation|proxy\.controllers\.test_obj\.TestECObjController\.test_GET_with_duplicate_but_sufficient_frag_indexes|proxy\.test_mem_server\.TestProxyServer\.test_statsd_prefix|proxy\.controllers\.test_obj\.TestECObjController\.test_GET_read_timeout|proxy\.controllers\.test_base\.TestGetOrHeadHandler\.test_disconnected_logging|obj\.test_expirer\.TestObjectExpirer\.test_failed_delete_continues_on|obj\.test_replicator\.TestObjectReplicator\.test_update|obj\.test_ssync_receiver\.TestReceiver\.test_UPDATES_timeout|obj\.test_ssync_receiver\.TestReceiver\.test_UPDATES_no_problems_no_hard_disconnect|common\.test_memcached\.TestMemcached\.test_operations_timing_stats_with_incr_timeout|obj\.test_expirer\.TestExpirerHelpers\.test_embed_expirer_bytes_from_diskfile_metadata|common\.middleware\.test_proxy_logging\.TestProxyLogging\.test_init_statsd_options_access_log_prefix|common\.middleware\.test_proxy_logging\.TestProxyLogging\.test_init_statsd_options_log_prefix|common\.test_wsgi\.TestServersPerPortStrategy\.test_stale_pid_loading|common\.test_wsgi\.TestWorkersStrategy\.test_stale_pid_loading|common\.utils\.test_logs\.TestUtilsLogs\.test_LoggerFileObject_recursion|container\.test_server\.TestNonLegacyDefaultStoragePolicy\.test_PUT_account_update|common\.middleware\.s3api\.test_s3request\.TestRequest\.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_unsupported|common\.middleware\.s3api\.test_s3request\.TestModuleFunctions\.test_get_checksum_hasher|common\.middleware\.test_proxy_logging\.TestProxyLogging\.test_init_logger_and_legacy_statsd_options_access_log_prefix|common\.middleware\.test_proxy_logging\.TestProxyLogging\.test_init_logger_and_legacy_statsd_options_log_prefix)' + PKGOS_TEST_PARALLEL=yes + PKGOS_TEST_SERIAL=no + PYTHONS=disabled + PYTHON3S=disabled + TEST_PARALLEL_OPT=--parallel + TEST_SERIAL_OPT= + for i in $@ + case "${1}" in + echo 'WARNING: --no-py2 is deprecated, and always on.' WARNING: --no-py2 is deprecated, and always on. + shift + for i in $@ + case "${1}" in + for i in $@ + case "${1}" in + for i in $@ + case "${1}" in ++ py3versions -vr + PYTHON3S=3.13 + '[' yes = no ']' + '[' no = yes ']' + for pyvers in ${PYTHON3S} + '[' 3.13 = disabled ']' ++ echo 3.13 ++ cut -d. -f1 + PYMAJOR=3 + echo '===> Testing with python (python3)' ===> Testing with python (python3) ++ pwd + '[' -d /build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages ']' + '[' -z '' ']' ++ pwd + echo 'Implicitly adding PYTHONPATH=/build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages' Implicitly adding PYTHONPATH=/build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages ++ pwd + export PYTHONPATH=/build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages + PYTHONPATH=/build/reproducible-path/swift-2.36.0/debian/tmp/usr/lib/python3/dist-packages + '[' -e .stestr.conf ']' + '[' -x /usr/bin/python3-stestr ']' + STESTR=stestr + rm -rf .stestr + PYTHON=python3.13 + stestr run --parallel --subunit --test-path test/unit 'test\.unit\.(?!common\.test_utils\.TestUtils\.test_get_logger_sysloghandler_plumbing|common\.middleware\.test_cname_lookup\.TestCNAMELookup.*|common\.test_db\.TestDatabaseBroker\.test_get.*|container\.test_sync\.TestContainerSync\.test_init.*|common\.test_utils\.TestPunchHoleReally\.test_punch_a_hole.*|common\.test_utils\.Test_LibcWrapper\.test_argument_plumbing.*|common\.test_utils\.TestUtils\.test_load_pkg_resource_importlib.*|common\.test_db_replicator\.TestHandoffsOnly.*|common\.ring\.test_builder\.TestGetRequiredOverload\.test_perfect_four_zone_four_replica_bad_placement|common\.test_wsgi\.TestWSGI.*|obj\.test_expirer\.TestObjectExpirer\.test_delete_actual_object|common\.test_memcached\.TestMemcached\.test_get_conns_hostname6|common\.test_memcached\.TestMemcached\.test_get_conns_v6|common\.test_memcached\.TestMemcached\.test_get_conns_v6_default|obj\.test_reconstructor\.TestWorkerReconstructor\.test_run_forever_recon_aggregation|proxy\.controllers\.test_obj\.TestECObjController\.test_GET_with_duplicate_but_sufficient_frag_indexes|proxy\.test_mem_server\.TestProxyServer\.test_statsd_prefix|proxy\.controllers\.test_obj\.TestECObjController\.test_GET_read_timeout|proxy\.controllers\.test_base\.TestGetOrHeadHandler\.test_disconnected_logging|obj\.test_expirer\.TestObjectExpirer\.test_failed_delete_continues_on|obj\.test_replicator\.TestObjectReplicator\.test_update|obj\.test_ssync_receiver\.TestReceiver\.test_UPDATES_timeout|obj\.test_ssync_receiver\.TestReceiver\.test_UPDATES_no_problems_no_hard_disconnect|common\.test_memcached\.TestMemcached\.test_operations_timing_stats_with_incr_timeout|obj\.test_expirer\.TestExpirerHelpers\.test_embed_expirer_bytes_from_diskfile_metadata|common\.middleware\.test_proxy_logging\.TestProxyLogging\.test_init_statsd_options_access_log_prefix|common\.middleware\.test_proxy_logging\.TestProxyLogging\.test_init_statsd_options_log_prefix|common\.test_wsgi\.TestServersPerPortStrategy\.test_stale_pid_loading|common\.test_wsgi\.TestWorkersStrategy\.test_stale_pid_loading|common\.utils\.test_logs\.TestUtilsLogs\.test_LoggerFileObject_recursion|container\.test_server\.TestNonLegacyDefaultStoragePolicy\.test_PUT_account_update|common\.middleware\.s3api\.test_s3request\.TestRequest\.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_unsupported|common\.middleware\.s3api\.test_s3request\.TestModuleFunctions\.test_get_checksum_hasher|common\.middleware\.test_proxy_logging\.TestProxyLogging\.test_init_logger_and_legacy_statsd_options_access_log_prefix|common\.middleware\.test_proxy_logging\.TestProxyLogging\.test_init_logger_and_legacy_statsd_options_log_prefix)' + subunit2pyunit /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.account.test_auditor.TestAuditorRealBroker.test_db_validate_fails test.unit.account.test_auditor.TestAuditorRealBroker.test_db_validate_fails ... ok test.unit.account.test_reaper.TestReaper.test_basic_reap_account test.unit.account.test_reaper.TestReaper.test_basic_reap_account ... ok test.unit.account.test_reaper.TestReaper.test_creation test.unit.account.test_reaper.TestReaper.test_creation ... ok test.unit.account.test_reaper.TestReaper.test_delay_reaping_conf_bad_value test.unit.account.test_reaper.TestReaper.test_delay_reaping_conf_bad_value ... ok test.unit.account.test_reaper.TestReaper.test_delay_reaping_conf_default test.unit.account.test_reaper.TestReaper.test_delay_reaping_conf_default ... ok test.unit.account.test_reaper.TestReaper.test_delay_reaping_conf_set test.unit.account.test_reaper.TestReaper.test_delay_reaping_conf_set ... ok test.unit.account.test_reaper.TestReaper.test_reap_account test.unit.account.test_reaper.TestReaper.test_reap_account ... ok test.unit.account.test_reaper.TestReaper.test_reap_account_no_container test.unit.account.test_reaper.TestReaper.test_reap_account_no_container ... ok test.unit.account.test_reaper.TestReaper.test_reap_account_with_sharding test.unit.account.test_reaper.TestReaper.test_reap_account_with_sharding ... ok test.unit.account.test_reaper.TestReaper.test_reap_container test.unit.account.test_reaper.TestReaper.test_reap_container ... ok test INFO: Begin account audit "once" mode test ERROR: Audit Failed for /tmp/tmp82y_ro5t/sda/accounts/0/0/0/test.db: The total container_count for the account a (3) does not match the sum of container_count across policies (2) test INFO: Account audit "once" mode completed: 0.01s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, elapsed: 0.00s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, 1 containers deleted, 1 objects deleted, 1 containers remaining, 1 objects remaining, 1 containers possibly remaining, 1 objects possibly remaining, return codes: 1 2xxs, elapsed: 0.00s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, 1 containers deleted, 1 objects deleted, 1 containers remaining, 1 objects remaining, 1 containers possibly remaining, 1 objects possibly remaining, return codes: 1 2xxs, elapsed: 0.00s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, 1 containers deleted, 1 objects deleted, 1 containers remaining, 1 objects remaining, 1 containers possibly remaining, 1 objects possibly remaining, return codes: 1 2xxs, elapsed: 0.00s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, 1 containers deleted, 1 objects deleted, 1 containers remaining, 1 objects remaining, 1 containers possibly remaining, 1 objects possibly remaining, return codes: 1 2xxs, elapsed: 0.00s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, elapsed: 0.00s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, elapsed: 0.01s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, elapsed: 0.00s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, elapsed: 0.00s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, elapsed: 0.00s test-reaper INFO: Beginning pass on account a test-reaper INFO: Completed pass on account a, elapsed: 0.00s test-reaper ERROR: Exception with objects for container c for account a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 391, in reap_container policy_index = headers.get('X-Backend-Storage-Policy-Index', 0) ^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' test-reaper ERROR: Exception with 10.10.10.1:6202/sda1: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp swift.common.exceptions.ClientException: : 404 test-reaper ERROR: Exception with 10.10.10.2:6202/sda1: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp swift.common.exceptions.ClientException: : 404 test-reaper ERROR: Exception with 10.10.10.3:6202/None: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp swift.common.exceptions.ClientException: : 404 test-reaper ERROR: Exception with 10.10.10.1:6202/sda2: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp swift.common.exceptions.ClientException: : 404test.unit.account.test_reaper.TestReaper.test_reap_container_full_fail test.unit.account.test_reaper.TestReaper.test_reap_container_full_fail ... ok test.unit.account.test_reaper.TestReaper.test_reap_container_get_object_fail test.unit.account.test_reaper.TestReaper.test_reap_container_get_object_fail ... ok test.unit.account.test_reaper.TestReaper.test_reap_container_get_object_timeout test.unit.account.test_reaper.TestReaper.test_reap_container_get_object_timeout ... ok test.unit.account.test_reaper.TestReaper.test_reap_container_non_exist_policy_index test.unit.account.test_reaper.TestReaper.test_reap_container_non_exist_policy_index ... ok test-reaper ERROR: Exception with 10.10.10.1:6202/sda3: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp swift.common.exceptions.ClientException: : 404 test-reaper ERROR: Exception with 10.10.10.1:6202/sda3: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 368, in reap_container headers, objects = direct_get_container( ~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<2 lines>... response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers={USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 171, in fake_direct_get_container raise self.myexp swift.common.exceptions.ClientException: : 404 test-reaper ERROR: Timeout Exception with 10.10.10.1:6202/sda3 test-reaper ERROR: ERROR: invalid storage policy index: 2 test-reaper ERROR: Exception with objects for container c for account a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 391, in reap_container policy_index = headers.get('X-Backend-Storage-Policy-Index', 0) ^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'get' test-reaper ERROR: Exception with 10.10.10.1:6202/sda1: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp swift.common.exceptions.ClientException: : 404 test-reaper ERROR: Exception with 10.10.10.2:6202/sda1: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp swift.common.exceptions.ClientException: : 404 test-reaper ERROR: Exception with 10.10.10.3:6202/None: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp swift.common.exceptions.ClientException: : 404test.unit.account.test_reaper.TestReaper.test_reap_container_partial_fail test.unit.account.test_reaper.TestReaper.test_reap_container_partial_fail ... ok test.unit.account.test_reaper.TestReaper.test_reap_delay test.unit.account.test_reaper.TestReaper.test_reap_delay ... ok test.unit.account.test_reaper.TestReaper.test_reap_device test.unit.account.test_reaper.TestReaper.test_reap_device ... ok test.unit.account.test_reaper.TestReaper.test_reap_device_with_not_my_ip test.unit.account.test_reaper.TestReaper.test_reap_device_with_not_my_ip ... ok test.unit.account.test_reaper.TestReaper.test_reap_device_with_sharding test.unit.account.test_reaper.TestReaper.test_reap_device_with_sharding ... ok test.unit.account.test_reaper.TestReaper.test_reap_device_with_sharding_and_various_devices test.unit.account.test_reaper.TestReaper.test_reap_device_with_sharding_and_various_devices ... ok test.unit.account.test_reaper.TestReaper.test_reap_device_with_ts test.unit.account.test_reaper.TestReaper.test_reap_device_with_ts ... ok test.unit.account.test_reaper.TestReaper.test_reap_object test.unit.account.test_reaper.TestReaper.test_reap_object ... ok test.unit.account.test_reaper.TestReaper.test_reap_object_fail test.unit.account.test_reaper.TestReaper.test_reap_object_fail ... ok test.unit.account.test_reaper.TestReaper.test_reap_object_non_exist_policy_index test.unit.account.test_reaper.TestReaper.test_reap_object_non_exist_policy_index ... ok test.unit.account.test_reaper.TestReaper.test_reap_object_timeout test.unit.account.test_reaper.TestReaper.test_reap_object_timeout ... ok test.unit.account.test_reaper.TestReaper.test_reap_warn_after_conf_bad_value test.unit.account.test_reaper.TestReaper.test_reap_warn_after_conf_bad_value ... ok test.unit.account.test_reaper.TestReaper.test_reap_warn_after_conf_set test.unit.account.test_reaper.TestReaper.test_reap_warn_after_conf_set ... ok test.unit.account.test_reaper.TestReaper.test_reset_stats test.unit.account.test_reaper.TestReaper.test_reset_stats ... ok test.unit.account.test_reaper.TestReaper.test_run_forever test.unit.account.test_reaper.TestReaper.test_run_forever ... ok test.unit.account.test_reaper.TestReaper.test_run_once test.unit.account.test_reaper.TestReaper.test_run_once ... ok test.unit.cli.test_container_deleter.TestContainerDeleter.test_init_internal_client_log_name test.unit.cli.test_container_deleter.TestContainerDeleter.test_init_internal_client_log_name ... ok test.unit.cli.test_container_deleter.TestContainerDeleter.test_make_delete_jobs test.unit.cli.test_container_deleter.TestContainerDeleter.test_make_delete_jobs ... ok test.unit.cli.test_container_deleter.TestContainerDeleter.test_make_delete_jobs_native_utf8 test.unit.cli.test_container_deleter.TestContainerDeleter.test_make_delete_jobs_native_utf8 ... ok test.unit.cli.test_container_deleter.TestContainerDeleter.test_make_delete_jobs_unicode_utf8 test.unit.cli.test_container_deleter.TestContainerDeleter.test_make_delete_jobs_unicode_utf8 ... ok test.unit.cli.test_container_deleter.TestContainerDeleter.test_mark_for_deletion_empty_no_yield test.unit.cli.test_container_deleter.TestContainerDeleter.test_mark_for_deletion_empty_no_yield ... ok test.unit.cli.test_container_deleter.TestContainerDeleter.test_mark_for_deletion_empty_with_yield test.unit.cli.test_container_deleter.TestContainerDeleter.test_mark_for_deletion_empty_with_yield ... ok test.unit.cli.test_container_deleter.TestContainerDeleter.test_mark_for_deletion_one_update_no_yield test.unit.cli.test_container_deleter.TestContainerDeleter.test_mark_for_deletion_one_update_no_yield ... ok test.unit.cli.test_container_deleter.TestContainerDeleter.test_mark_for_deletion_two_updates_with_yield test.unit.cli.test_container_deleter.TestContainerDeleter.test_mark_for_deletion_two_updates_with_yield ... ok test.unit.cli.test_form_signature.TestFormSignature.test_invalid_filecount_arg test.unit.cli.test_form_signature.TestFormSignature.test_invalid_filecount_arg ... ok test.unit.cli.test_form_signature.TestFormSignature.test_invalid_filesize_arg test.unit.cli.test_form_signature.TestFormSignature.test_invalid_filesize_arg ... ok test.unit.cli.test_form_signature.TestFormSignature.test_invalid_path_arg test.unit.cli.test_form_signature.TestFormSignature.test_invalid_path_arg ... ok test.unit.cli.test_form_signature.TestFormSignature.test_invalid_seconds_arg test.unit.cli.test_form_signature.TestFormSignature.test_invalid_seconds_arg ... ok test.unit.cli.test_form_signature.TestFormSignature.test_prints_signature test.unit.cli.test_form_signature.TestFormSignature.test_prints_signature ... ok test.unit.cli.test_form_signature.TestFormSignature.test_too_few_args test.unit.cli.test_form_signature.TestFormSignature.test_too_few_args ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_append_crypto_meta test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_append_crypto_meta ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_append_then_extract_crypto_meta test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_append_then_extract_crypto_meta ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_dump_crypto_meta test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_dump_crypto_meta ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_dump_then_load_crypto_meta test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_dump_then_load_crypto_meta ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_extract_crypto_meta test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_extract_crypto_meta ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_load_crypto_meta test.unit.common.middleware.crypto.test_crypto_utils.TestModuleMethods.test_load_crypto_meta ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_etag_is_at_not_duplicated test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_etag_is_at_not_duplicated ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_if_match test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_if_match ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_if_match_with_existing_etag_is_at_header test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_if_match_with_existing_etag_is_at_header ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_if_none_match test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_if_none_match ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_if_none_match_with_existing_etag_is_at_header test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_GET_if_none_match_with_existing_etag_is_at_header ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_etag_is_at_not_duplicated test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_etag_is_at_not_duplicated ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_if_match test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_if_match ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_if_match_with_existing_etag_is_at_header test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_if_match_with_existing_etag_is_at_header ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_if_none_match test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_if_none_match ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_if_none_match_with_existing_etag_is_at_header test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_HEAD_if_none_match_with_existing_etag_is_at_header ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_POST_constraints_checking test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_POST_constraints_checking ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_POST_no_user_metadata test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_POST_no_user_metadata ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_POST_req test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_POST_req ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_app_exception test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_app_exception ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_constraints_checking test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_constraints_checking ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_encryption_override test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_encryption_override ... ok test.unit.account.test_replicator.TestReplicatorSync.test_clean_up_after_deleted_brokers test.unit.account.test_replicator.TestReplicatorSync.test_clean_up_after_deleted_brokers ... ok test.unit.account.test_replicator.TestReplicatorSync.test_local_ids test.unit.account.test_replicator.TestReplicatorSync.test_local_ids ... ok test.unit.account.test_replicator.TestReplicatorSync.test_replicator_sync test.unit.account.test_replicator.TestReplicatorSync.test_replicator_sync ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_error_in_key_callback test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_error_in_key_callback ... ok test.unit.account.test_replicator.TestReplicatorSync.test_rsync_then_merge test.unit.account.test_replicator.TestReplicatorSync.test_rsync_then_merge ... ok test.unit.account.test_replicator.TestReplicatorSync.test_sync test.unit.account.test_replicator.TestReplicatorSync.test_sync ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_missing_key_callback test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_missing_key_callback ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_multiseg_bad_client_etag test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_multiseg_bad_client_etag ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_multiseg_good_client_etag test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_multiseg_good_client_etag ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_multiseg_no_client_etag test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_multiseg_no_client_etag ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_no_user_metadata test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_no_user_metadata ... ok test.unit.account.test_replicator.TestReplicatorSync.test_sync_remote_missing test.unit.account.test_replicator.TestReplicatorSync.test_sync_remote_missing ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_nothing_read test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_nothing_read ... ok test.unit.account.test_replicator.TestReplicatorSync.test_sync_remote_missing_most_rows test.unit.account.test_replicator.TestReplicatorSync.test_sync_remote_missing_most_rows ... ok test.unit.account.test_replicator.TestReplicatorSync.test_sync_remote_missing_one_rows test.unit.account.test_replicator.TestReplicatorSync.test_sync_remote_missing_one_rows ... ok test.unit.cli.test_reload.TestValidateManagerPid.test_good test.unit.cli.test_reload.TestValidateManagerPid.test_good ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.cli.test_reload.TestValidateManagerPid.test_non_python test.unit.cli.test_reload.TestValidateManagerPid.test_non_python ... ok test.unit.cli.test_reload.TestValidateManagerPid.test_non_server test.unit.cli.test_reload.TestValidateManagerPid.test_non_server ... ok test.unit.cli.test_reload.TestValidateManagerPid.test_non_swift test.unit.cli.test_reload.TestValidateManagerPid.test_non_swift ... ok test.unit.cli.test_reload.TestValidateManagerPid.test_open_error test.unit.cli.test_reload.TestValidateManagerPid.test_open_error ... ok test.unit.cli.test_reload.TestValidateManagerPid.test_worker test.unit.cli.test_reload.TestValidateManagerPid.test_worker ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_404_response test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_404_response ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_412_response test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_412_response ... ok test.unit.cli.test_info.TestCliInfo.test_parse_get_node_args test.unit.cli.test_info.TestCliInfo.test_parse_get_node_args ... ok test.unit.cli.test_info.TestCliInfo.test_print_db_info_metadata test.unit.cli.test_info.TestCliInfo.test_print_db_info_metadata ... ok test.unit.cli.test_info.TestCliInfo.test_print_db_info_metadata_with_many_shard_ranges test.unit.cli.test_info.TestCliInfo.test_print_db_info_metadata_with_many_shard_ranges ... ok test.unit.cli.test_info.TestCliInfo.test_print_db_info_metadata_with_shard_ranges test.unit.cli.test_info.TestCliInfo.test_print_db_info_metadata_with_shard_ranges ... ok test.unit.cli.test_info.TestCliInfo.test_print_db_info_metadata_with_shard_ranges_bis test.unit.cli.test_info.TestCliInfo.test_print_db_info_metadata_with_shard_ranges_bis ... ok test.unit.cli.test_info.TestCliInfo.test_print_db_syncs test.unit.cli.test_info.TestCliInfo.test_print_db_syncs ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_cipher_mismatch_for_body test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_cipher_mismatch_for_body ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_cipher_mismatch_for_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_cipher_mismatch_for_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_decryption_override test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_decryption_override ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_different_keys_for_data_and_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_different_keys_for_data_and_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_encrypted_data_and_unencrypted_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_encrypted_data_and_unencrypted_metadata ... ok test.unit.cli.test_info.TestCliInfo.test_print_info test.unit.cli.test_info.TestCliInfo.test_print_info ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_container_no_ring test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_container_no_ring ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_error_in_key_callback test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_error_in_key_callback ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_metadata_not_encrypted test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_metadata_not_encrypted ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_container_object_dashed_ring test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_container_object_dashed_ring ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_container_object_ring test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_container_object_ring ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_container_ring test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_container_ring ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_no_ring test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_no_ring ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_with_ring test.unit.cli.test_info.TestCliInfo.test_print_item_locations_account_with_ring ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_missing_etag_crypto_meta test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_missing_etag_crypto_meta ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_missing_key_callback test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_missing_key_callback ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_bad_body_cipher test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_bad_body_cipher ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_dashed_ring_name_partition test.unit.cli.test_info.TestCliInfo.test_print_item_locations_dashed_ring_name_partition ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_invalid_args test.unit.cli.test_info.TestCliInfo.test_print_item_locations_invalid_args ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_invalid_policy_no_target test.unit.cli.test_info.TestCliInfo.test_print_item_locations_invalid_policy_no_target ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_policy_object test.unit.cli.test_info.TestCliInfo.test_print_item_locations_policy_object ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_ciphertext test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_ciphertext ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_content_type test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_content_type ... ok test.unit.cli.test_info.TestCliInfo.test_print_item_locations_ring_policy_mismatch_no_target test.unit.cli.test_info.TestCliInfo.test_print_item_locations_ring_policy_mismatch_no_target ... ok test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_account test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_account ... ok test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_container test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_container ... ok test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_invalid_args test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_invalid_args ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_batched_reclaim test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_batched_reclaim ... ok test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_obj test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_obj ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_chexor test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_chexor ... ok test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_partition_number test.unit.cli.test_info.TestCliInfo.test_print_ring_locations_partition_number ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_creation test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_creation ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_req test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_req ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_response_inconsistent_etag_is_not_replaced test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_response_inconsistent_etag_is_not_replaced ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_bad_etag_in_headers_and_other_footers test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_bad_etag_in_headers_and_other_footers ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_bad_etag_in_other_footers test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_bad_etag_in_other_footers ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_empty_etag_override_in_footers test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_empty_etag_override_in_footers ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_commit_pending test.unit.account.test_backend.TestCommonAccountBroker.test_commit_pending ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_delete_db test.unit.account.test_backend.TestCommonAccountBroker.test_delete_db ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_get_info test.unit.account.test_backend.TestCommonAccountBroker.test_get_info ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_delete_container test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_delete_container ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_empty_etag_override_in_footers_no_body test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_empty_etag_override_in_footers_no_body ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_empty_etag_override_in_headers test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_empty_etag_override_in_headers ... ok test.unit.account.test_auditor.TestAuditorRealBrokerMigration.test_db_migration test.unit.account.test_auditor.TestAuditorRealBrokerMigration.test_db_migration ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_get_max_row test.unit.account.test_backend.TestCommonAccountBroker.test_get_max_row ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_get_raw_metadata test.unit.account.test_backend.TestCommonAccountBroker.test_get_raw_metadata ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_empty_etag_override_in_headers_no_body test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_empty_etag_override_in_headers_no_body ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_etag_of_empty_body_override_in_headers test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_etag_of_empty_body_override_in_headers ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_get_syncs test.unit.account.test_backend.TestCommonAccountBroker.test_get_syncs ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_delete_db_status test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_delete_db_status ... ok test.unit.account.test_utils.TestAccountUtils.test_account_listing_reserved_names test.unit.account.test_utils.TestAccountUtils.test_account_listing_reserved_names ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_etag_override_in_headers test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_etag_override_in_headers ... ok test.unit.account.test_utils.TestAccountUtils.test_account_listing_response test.unit.account.test_utils.TestAccountUtils.test_account_listing_response ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_maybe_get test.unit.account.test_backend.TestCommonAccountBroker.test_maybe_get ... ok Unrecognized DB type: internal error DB file doesn't exist No target specified Need a ring or policy No account specified No policy named 'xyz' No container specified Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.account.test_utils.TestAccountUtils.test_account_listing_with_containers test.unit.account.test_utils.TestAccountUtils.test_account_listing_with_containers ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_other_footers test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_other_footers ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' No policy found to increase the partition power. Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_delete_with_objects test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_delete_with_objects ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_other_footers_and_etag_of_empty_body test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_with_other_footers_and_etag_of_empty_body ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_missing_body_cipher test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_missing_body_cipher ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_missing_body_iv test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_missing_body_iv ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_no_body_crypto_meta test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_no_body_crypto_meta ... ok test.unit.account.test_utils.TestAccountUtils.test_get_response_headers_empty_memory_broker test.unit.account.test_utils.TestAccountUtils.test_get_response_headers_empty_memory_broker ... ok test.unit.account.test_utils.TestAccountUtils.test_get_response_headers_fake_broker test.unit.account.test_utils.TestAccountUtils.test_get_response_headers_fake_broker ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_double_check_trailing_delimiter test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_double_check_trailing_delimiter ... ok test.unit.account.test_utils.TestAccountUtils.test_get_response_headers_with_data test.unit.account.test_utils.TestAccountUtils.test_get_response_headers_with_data ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_too_long_body_iv test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_too_long_body_iv ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_zero_size_object test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_PUT_zero_size_object ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_recreate_with_objects test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_recreate_with_objects ... ok test.unit.account.test_utils.TestAccountUtils.test_get_response_headers_with_legacy_data test.unit.account.test_utils.TestAccountUtils.test_get_response_headers_with_legacy_data ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_too_short_body_iv test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multipart_too_short_body_iv ... ok Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' No policy found to increase the partition power. Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_recon.TestHelpers.test_seconds2timeunit test.unit.cli.test_recon.TestHelpers.test_seconds2timeunit ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multiseg test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multiseg ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_config_true_value_on_disable_encryption test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_config_true_value_on_disable_encryption ... ok test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_encrypt_header_val test.unit.common.middleware.crypto.test_encrypter.TestEncrypter.test_encrypt_header_val ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_empty test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_empty ... ok test.unit.cli.test_recon.TestHelpers.test_size_suffix test.unit.cli.test_recon.TestHelpers.test_size_suffix ... ok test.unit.cli.test_reload.TestMain.test_check_failed test.unit.cli.test_reload.TestMain.test_check_failed ... ok test.unit.cli.test_reload.TestMain.test_good test.unit.cli.test_reload.TestMain.test_good ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_simple_delete test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_simple_delete ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multiseg_with_range test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_multiseg_with_range ... ok test.unit.cli.test_reload.TestMain.test_needs_pid test.unit.cli.test_reload.TestMain.test_needs_pid ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypter.test_app_exception test.unit.common.middleware.crypto.test_decrypter.TestDecrypter.test_app_exception ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypter.test_invalid_swift_path test.unit.common.middleware.crypto.test_decrypter.TestDecrypter.test_invalid_swift_path ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypter.test_non_swift_path test.unit.common.middleware.crypto.test_decrypter.TestDecrypter.test_non_swift_path ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_simple_recreate test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_simple_recreate ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_override_etag_bad_cipher test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_override_etag_bad_cipher ... ok test.unit.cli.test_reload.TestMain.test_timeout test.unit.cli.test_reload.TestMain.test_timeout ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_override_etag_bad_iv test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_override_etag_bad_iv ... ok test.unit.common.middleware.s3api.test_etree.TestS3ApiEtree.test_fromstring_with_nonascii_text test.unit.common.middleware.s3api.test_etree.TestS3ApiEtree.test_fromstring_with_nonascii_text ... ok test.unit.common.middleware.s3api.test_etree.TestS3ApiEtree.test_tostring_with_nonascii_text test.unit.common.middleware.s3api.test_etree.TestS3ApiEtree.test_tostring_with_nonascii_text ... ok test.unit.common.middleware.s3api.test_etree.TestS3ApiEtree.test_xml_namespace test.unit.common.middleware.s3api.test_etree.TestS3ApiEtree.test_xml_namespace ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_update_delete_no_status_change test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_update_delete_no_status_change ... ok test.unit.common.middleware.s3api.test_etree.TestS3ApiEtree.test_xml_with_comments test.unit.common.middleware.s3api.test_etree.TestS3ApiEtree.test_xml_with_comments ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestDeferredAuth.test_bad_reply test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestDeferredAuth.test_bad_reply ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestDeferredAuth.test_fail_to_connect_to_keystone test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestDeferredAuth.test_fail_to_connect_to_keystone ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_update_put_no_status_change test.unit.account.test_backend.TestCommonAccountBroker.test_merge_timestamps_update_put_no_status_change ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_success test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_success ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_unencrypted_data test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_unencrypted_data ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_exception test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_exception ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_put_timestamp test.unit.account.test_backend.TestCommonAccountBroker.test_put_timestamp ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestDeferredAuth.test_unauthorized_token test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestDeferredAuth.test_unauthorized_token ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_500_resp test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_500_resp ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_bad_content_type test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_bad_content_type ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_bad_file_over_twice_max_length test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_bad_file_over_twice_max_length ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_disappears_appears_logging test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_disappears_appears_logging ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_unencrypted_data_and_encrypted_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_unencrypted_data_and_encrypted_metadata ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_clears_all_limits test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_clears_all_limits ... ok test.unit.account.test_backend.TestCommonAccountBroker.test_status_changed_at test.unit.account.test_backend.TestCommonAccountBroker.test_status_changed_at ... ok test.unit.account.test_utils.TestFakeAccountBroker.test_fake_broker_get_info test.unit.account.test_utils.TestFakeAccountBroker.test_fake_broker_get_info ... ok test.unit.account.test_utils.TestFakeAccountBroker.test_fake_broker_get_policy_stats test.unit.account.test_utils.TestFakeAccountBroker.test_fake_broker_get_policy_stats ... ok test.unit.account.test_utils.TestFakeAccountBroker.test_fake_broker_list_containers_iter test.unit.account.test_utils.TestFakeAccountBroker.test_fake_broker_list_containers_iter ... ok test.unit.account.test_utils.TestFakeAccountBroker.test_fake_broker_metadata test.unit.account.test_utils.TestFakeAccountBroker.test_fake_broker_metadata ... ok test.unit.cli.test_dispersion_report.TestDispersionReport.test_placeholder test.unit.cli.test_dispersion_report.TestDispersionReport.test_placeholder ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_bad_body_key_for_object_body test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_bad_body_key_for_object_body ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_bad_file_too_long test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_bad_file_too_long ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_bad_path test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_bad_path ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_call_and_content_type test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_call_and_content_type ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_container_delete test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_container_delete ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_container_delete_retry_and_fails test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_container_delete_retry_and_fails ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_bad_iv_for_object_body test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_bad_iv_for_object_body ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_bad_iv_for_user_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_bad_iv_for_user_metadata ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_analyze_stdin test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_analyze_stdin ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_get_info test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_get_info ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_container_delete_retry_and_success test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_container_delete_retry_and_success ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_custom_interval test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_custom_interval ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_bad_key test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_bad_key ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_get_objs test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_get_objs ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_max_failures test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_max_failures ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_no_body test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_no_body ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_no_files_in_body test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_no_files_in_body ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_default_interval test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_default_interval ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_batched_reclaim test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_batched_reclaim ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_chexor test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_chexor ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_disabled test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_disabled ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_get_info_no_stale_reads test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_get_info_no_stale_reads ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_analyze_stdin_with_overlaps test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_analyze_stdin_with_overlaps ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_empty_section test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_empty_section ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_error test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_error ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_logging test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_logging ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_get_info_stale_read_ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_get_info_stale_read_ok ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_set_and_missing test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_set_and_missing ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_creation test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_creation ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_all_donors_shrink_to_root test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_all_donors_shrink_to_root ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_too_many_newlines test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_too_many_newlines ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_invalid_etag test.unit.cli.test_info.TestPrintObjFullMeta.test_invalid_etag ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_crypto_metadata test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_crypto_metadata ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_curl_command_ipv4 test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_curl_command_ipv4 ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_curl_command_ipv6 test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_curl_command_ipv6 ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_meta_and_ts_files test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_meta_and_ts_files ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_metadata test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_metadata ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_no_ring test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_no_ring ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_policy_index test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_policy_index ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_unauth test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_unauth ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_uses_predefined_object_errors test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_uses_predefined_object_errors ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_works_extra_newlines_extra_quoting test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_works_extra_newlines_extra_quoting ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_works_unicode test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_works_unicode ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_works_with_DELETE_verb test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_works_with_DELETE_verb ... ok test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_works_with_POST_verb test.unit.common.middleware.test_bulk.TestDelete.test_bulk_delete_works_with_POST_verb ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_allow_full_urls_setting test.unit.common.middleware.test_container_sync.TestContainerSync.test_allow_full_urls_setting ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_bad_args test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_bad_args ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_unset_and_missing test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_file_reload_unset_and_missing ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_reload_does_not_override_reload_options test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_config_reload_does_not_override_reload_options ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_conf_path test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_conf_path ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_delete_container test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_delete_container ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_conf_reload_interval test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_conf_reload_interval ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_at_configured_path_overrides_filter_conf test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_at_configured_path_overrides_filter_conf ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_policy_name_mismatch test.unit.cli.test_info.TestPrintObjFullMeta.test_print_obj_policy_name_mismatch ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_get_policy_stats test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_get_policy_stats ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_initialize_fail test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_initialize_fail ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_at_default_path_overrides_filter_conf test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_at_default_path_overrides_filter_conf ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_unchecked_etag test.unit.cli.test_info.TestPrintObjFullMeta.test_unchecked_etag ... ok test.unit.cli.test_info.TestPrintObjFullMeta.test_valid_etag test.unit.cli.test_info.TestPrintObjFullMeta.test_valid_etag ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_delete_db_status test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_delete_db_status ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_no_section test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_no_section ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_set_and_missing test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_set_and_missing ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_unset_and_missing test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_init_config_file_unset_and_missing ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_current_in_realms_conf test.unit.common.middleware.test_container_sync.TestContainerSync.test_current_in_realms_conf ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_is_status_deleted test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_is_status_deleted ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_device_already_exists test.unit.cli.test_ringbuilder.TestCommands.test_add_device_already_exists ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_current_invalid test.unit.common.middleware.test_container_sync.TestContainerSync.test_current_invalid ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_current_not_set test.unit.common.middleware.test_container_sync.TestContainerSync.test_current_not_set ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_filter test.unit.common.middleware.test_container_sync.TestContainerSync.test_filter ... ok test.unit.cli.test_drive_full_checker.TestContainerDeleter.test_drive_full test.unit.cli.test_drive_full_checker.TestContainerDeleter.test_drive_full ... ok test.unit.cli.test_drive_full_checker.TestContainerDeleter.test_drive_with_space test.unit.cli.test_drive_full_checker.TestContainerDeleter.test_drive_with_space ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_invalid_etag test.unit.cli.test_info.TestPrintObjWeirdPath.test_invalid_etag ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_crypto_metadata test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_crypto_metadata ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_curl_command_ipv4 test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_curl_command_ipv4 ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_curl_command_ipv6 test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_curl_command_ipv6 ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_meta_and_ts_files test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_meta_and_ts_files ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_metadata test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_metadata ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_no_ring test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_no_ring ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_policy_index test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_policy_index ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_policy_name_mismatch test.unit.cli.test_info.TestPrintObjWeirdPath.test_print_obj_policy_name_mismatch ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_unchecked_etag test.unit.cli.test_info.TestPrintObjWeirdPath.test_unchecked_etag ... ok test.unit.cli.test_info.TestPrintObjWeirdPath.test_valid_etag test.unit.cli.test_info.TestPrintObjWeirdPath.test_valid_etag ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_info test.unit.common.middleware.test_container_sync.TestContainerSync.test_info ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_info_always_fresh test.unit.common.middleware.test_container_sync.TestContainerSync.test_info_always_fresh ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_invalid_sig test.unit.common.middleware.test_container_sync.TestContainerSync.test_invalid_sig ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_device_domain_new_format test.unit.cli.test_ringbuilder.TestCommands.test_add_device_domain_new_format ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_missing_from_realms_conf test.unit.common.middleware.test_container_sync.TestContainerSync.test_missing_from_realms_conf ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_list_container_iter_with_reserved_name test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_list_container_iter_with_reserved_name ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_donors_but_no_suitable_acceptor test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_donors_but_no_suitable_acceptor ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_device_ipv4_new_format test.unit.cli.test_ringbuilder.TestCommands.test_add_device_ipv4_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_device_ipv4_old_format test.unit.cli.test_ringbuilder.TestCommands.test_add_device_ipv4_old_format ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_not_enough_args test.unit.common.middleware.test_container_sync.TestContainerSync.test_not_enough_args ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_pass_through test.unit.common.middleware.test_container_sync.TestContainerSync.test_pass_through ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_realm_miss test.unit.common.middleware.test_container_sync.TestContainerSync.test_realm_miss ... ok Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' No policy found to increase the partition power. Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' No policy found to increase the partition power. Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' No policy found to increase the partition power. Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_ringcomposer.TestCommands.test_bad_composite_builder_file test.unit.cli.test_ringcomposer.TestCommands.test_bad_composite_builder_file ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_all_policies test.unit.cli.test_relinker.TestRelinker.test_cleanup_all_policies ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_data_file test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_data_file ... ok test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00035 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpv0r8soyv/sda/accounts/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01428 seconds (70.02362/s) test INFO: Removed 1 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00028 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00023 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00018 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 REPLICATE: /sda/0/7e85f39cfbd92b74b0b21a19f4188cca, sync, (-1, '00000000000000000000000000000000', 'd0713b00-b496-4c17-afa2-8e479071c38e-sda', '1757769835.97762', '1757769835.97608', '0', '') test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpktyj2_zd/sda/accounts/0/cca/7e85f39cfbd92b74b0b21a19f4188cca/7e85f39cfbd92b74b0b21a19f4188cca.db REPLICATE: /sdb/0/7e85f39cfbd92b74b0b21a19f4188cca, sync, (-1, '00000000000000000000000000000000', 'c43d485b-99e0-49fc-8854-ff1943c76693-sda', '1757769836.00074', '1757769835.99921', '0', '') REPLICATE: /sdb/0/7e85f39cfbd92b74b0b21a19f4188cca, complete_rsync, ('c43d485b-99e0-49fc-8854-ff1943c76693-sda', '7e85f39cfbd92b74b0b21a19f4188cca.db') REPLICATE: /sdc/0/7e85f39cfbd92b74b0b21a19f4188cca, sync, (-1, '00000000000000000000000000000000', 'c43d485b-99e0-49fc-8854-ff1943c76693-sda', '1757769836.00074', '1757769835.99921', '0', '') REPLICATE: /sdc/0/7e85f39cfbd92b74b0b21a19f4188cca, complete_rsync, ('c43d485b-99e0-49fc-8854-ff1943c76693-sda', '7e85f39cfbd92b74b0b21a19f4188cca.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02193 seconds (45.60244/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:2 ts_repl:0 REPLICATE: /sdb/0/7e85f39cfbd92b74b0b21a19f4188cca, sync, (1, '81ac7570d13b631c1214950cffbe6d3a', '5f4ad1c4-3ebf-4c5b-b603-e9016d7d38d0-sda', '1757769836.04112', '1757769836.03438', '0', '') REPLICATE: /sdb/0/7e85f39cfbd92b74b0b21a19f4188cca, rsync_then_merge, ('5f4ad1c4-3ebf-4c5b-b603-e9016d7d38d0-sda', '7e85f39cfbd92b74b0b21a19f4188cca.db') REPLICATE: /sdb/0/7e85f39cfbd92b74b0b21a19f4188cca, sync, (11, 'd7c54fe4309ce006a02ed28a2dc19bf3', '0261e914-7c43-43b0-886f-0be1e6d29172-sda', '1757769836.06921', '1757769836.06776', '0', '') REPLICATE: /sdb/0/7e85f39cfbd92b74b0b21a19f4188cca, merge_items, ([{'ROWID': 1, 'name': '/a/c_0', 'put_timestamp': '1757769836.07385', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 2, 'name': '/a/c_1', 'put_timestamp': '1757769836.07409', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 3, 'name': '/a/c_2', 'put_timestamp': '1757769836.07418', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 4, 'name': '/a/c_3', 'put_timestamp': '1757769836.07426', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 5, 'name': '/a/c_4', 'put_timestamp': '1757769836.07434', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 6, 'name': '/a/c_5', 'put_timestamp': '1757769836.07441', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 7, 'name': '/a/c_6', 'put_timestamp': '1757769836.07448', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 8, 'name': '/a/c_7', 'put_timestamp': '1757769836.07455', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 9, 'name': '/a/c_8', 'put_timestamp': '1757769836.07462', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 10, 'name': '/a/c_9', 'put_timestamp': '1757769836.07486', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 11, 'name': '/a/c_missing', 'put_timestamp': '1757769836.07494', 'delete_timestamp': '0', 'object_count': 0, 'bytes_used': 0, 'deleted': 0, 'storage_policy_index': 0}], '0261e914-7c43-43b0-886f-0be1e6d29172-sda') REPLICATE: /sdb/0/7e85f39cfbd92b74b0b21a19f4188cca, merge_syncs, ([],) test ERROR: Error decrypting object: Bad crypto meta: Cipher must be AES_CTR_256 test ERROR: Error decrypting header X-Object-Transient-Sysmeta-Crypto-Meta-Test: Bad crypto meta: Cipher must be AES_CTR_256 test DEBUG: No decryption is necessary because of override test DEBUG: No decryption is necessary because of override test ERROR: get_keys(): from callback: Testing: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 166, in get_keys keys = fetch_crypto_keys(key_id=key_id) File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/crypto/test_decrypter.py", line 902, in raise_exc raise Exception('Testing') Exception: Testing test ERROR: Error decrypting header X-Object-Sysmeta-Crypto-Etag: Missing crypto meta in value fgBd78GL6kACmfmuAxTz9B7eJCFTfjxotcr7trw/5Qo= test ERROR: ERROR get_keys() missing callback: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 158, in get_keys fetch_crypto_keys = env[CRYPTO_KEY_CALLBACK] ~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: 'swift.callback.fetch_crypto_keys' test ERROR: Error decrypting object: Bad crypto meta: Cipher must be AES_CTR_256 test ERROR: Error decrypting object: Bad crypto meta: Missing 'cipher' test ERROR: Error decrypting object: Bad crypto meta: Missing 'iv' test ERROR: Error decrypting object: Bad crypto meta: IV must be length 16 bytes test ERROR: Error decrypting object: Bad crypto meta: IV must be length 16 bytes test ERROR: Error decrypting header X-Object-Sysmeta-Container-Update-Override-Etag: Bad crypto meta: Cipher must be AES_CTR_256 test ERROR: Error decrypting header X-Object-Sysmeta-Container-Update-Override-Etag: Bad crypto meta: IV must be length 16 bytes test ERROR: Error decrypting object: Key must be length 32 bytes test ERROR: Error decrypting object: Bad crypto meta: IV must be length 16 bytes test ERROR: Error decrypting header X-Object-Transient-Sysmeta-Crypto-Meta-Test: Bad crypto meta: IV must be length 16 bytes test ERROR: Bad key for 'object': Key must be length 32 bytes: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 178, in get_keys self.crypto.check_key(key) ~~~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 141, in check_key raise ValueError("Key must be length %s bytes" % self.key_length) ValueError: Key must be length 32 bytes test ERROR: Error decrypting object: Missing 'body_key'test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_missing_body_key_for_object_body test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_missing_body_key_for_object_body ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_missing_crypto_meta_for_user_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_missing_crypto_meta_for_user_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_missing_iv_for_object_body test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_missing_iv_for_object_body ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_missing_iv_for_user_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_GET_with_missing_iv_for_user_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_404_response test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_404_response ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_412_response test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_412_response ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_different_keys_for_data_and_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_different_keys_for_data_and_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_encrypted_data_and_unencrypted_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_encrypted_data_and_unencrypted_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_metadata_not_encrypted test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_metadata_not_encrypted ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_method_not_ratelimited test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_method_not_ratelimited ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_override_etag_bad_cipher test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_override_etag_bad_cipher ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_override_etag_bad_iv test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_override_etag_bad_iv ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_success test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_success ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_unencrypted_data_and_encrypted_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_unencrypted_data_and_encrypted_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_with_bad_iv_for_user_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_with_bad_iv_for_user_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_with_bad_key test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_with_bad_key ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_with_missing_crypto_meta_for_user_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_with_missing_crypto_meta_for_user_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_with_missing_iv_for_user_metadata test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_HEAD_with_missing_iv_for_user_metadata ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_headers_case test.unit.common.middleware.crypto.test_decrypter.TestDecrypterObjectRequests.test_headers_case ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_double_check_trailing_delimiter test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_double_check_trailing_delimiter ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_device_ipv6_new_format test.unit.cli.test_ringbuilder.TestCommands.test_add_device_ipv6_new_format ... ok test.unit.common.middleware.s3api.test_acl_utils.TestS3ApiAclUtils.test_canned_acl_header test.unit.common.middleware.s3api.test_acl_utils.TestS3ApiAclUtils.test_canned_acl_header ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_data_file_conflicting_meta_file test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_data_file_conflicting_meta_file ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_expansion_limit test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_expansion_limit ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_device_ipv6_old_format test.unit.cli.test_ringbuilder.TestCommands.test_add_device_ipv6_old_format ... ok test.unit.cli.test_ringcomposer.TestCommands.test_compose test.unit.cli.test_ringcomposer.TestCommands.test_compose ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_abort_multipart_upload_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_abort_multipart_upload_acl_with_fullcontrol_permission ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_empty test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_empty ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_device_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_add_device_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_device_old_missing_region test.unit.cli.test_ringbuilder.TestCommands.test_add_device_old_missing_region ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_device_part_power_increase test.unit.cli.test_ringbuilder.TestCommands.test_add_device_part_power_increase ... ok test.unit.cli.test_ringbuilder.TestCommands.test_add_duplicate_devices test.unit.cli.test_ringbuilder.TestCommands.test_add_duplicate_devices ... ok test.unit.cli.test_ringbuilder.TestCommands.test_create_ring test.unit.cli.test_ringbuilder.TestCommands.test_create_ring ... ok test.unit.cli.test_ringbuilder.TestCommands.test_create_ring_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_create_ring_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_default test.unit.cli.test_ringbuilder.TestCommands.test_default ... ok test.unit.cli.test_ringbuilder.TestCommands.test_default_no_device_ring_without_exception test.unit.cli.test_ringbuilder.TestCommands.test_default_no_device_ring_without_exception ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_expansion_limit_less_than_shrink_threshold test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_expansion_limit_less_than_shrink_threshold ... ok test.unit.cli.test_ringbuilder.TestCommands.test_default_output test.unit.cli.test_ringbuilder.TestCommands.test_default_output ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.cli.test_ringbuilder.TestCommands.test_default_output_id_assigned test.unit.cli.test_ringbuilder.TestCommands.test_default_output_id_assigned ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_exception test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_exception ... ok test.unit.cli.test_ringcomposer.TestCommands.test_compose_existing test.unit.cli.test_ringcomposer.TestCommands.test_compose_existing ... ok test.unit.cli.test_ringbuilder.TestCommands.test_default_ringfile_check test.unit.cli.test_ringbuilder.TestCommands.test_default_ringfile_check ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_data_file_existing_meta_file test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_data_file_existing_meta_file ... ok test.unit.account.test_backend.TestAccountBroker.test_batched_reclaim test.unit.account.test_backend.TestAccountBroker.test_batched_reclaim ... ok test.unit.account.test_backend.TestAccountBroker.test_chexor test.unit.account.test_backend.TestAccountBroker.test_chexor ... ok test.unit.cli.test_ringbuilder.TestCommands.test_default_show_removed test.unit.cli.test_ringbuilder.TestCommands.test_default_show_removed ... ok test.unit.account.test_backend.TestAccountBroker.test_creation test.unit.account.test_backend.TestAccountBroker.test_creation ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_four_donors_two_acceptors test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_four_donors_two_acceptors ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_get_info test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_get_info ... ok test.unit.account.test_backend.TestAccountBroker.test_delete_container test.unit.account.test_backend.TestAccountBroker.test_delete_container ... ok test.unit.cli.test_ringbuilder.TestCommands.test_default_sorted_output test.unit.cli.test_ringbuilder.TestCommands.test_default_sorted_output ... ok test.unit.account.test_backend.TestAccountBroker.test_delete_db_status test.unit.account.test_backend.TestAccountBroker.test_delete_db_status ... ok test.unit.cli.test_ringcomposer.TestCommands.test_compose_fails_to_write_composite_builder_file test.unit.cli.test_ringcomposer.TestCommands.test_compose_fails_to_write_composite_builder_file ... ok test.unit.cli.test_ringbuilder.TestCommands.test_dispersion_command test.unit.cli.test_ringbuilder.TestCommands.test_dispersion_command ... ok test ERROR: Error decrypting header X-Object-Transient-Sysmeta-Crypto-Meta-Test: Missing crypto meta in value LwwJqI3L+FBfmg== test ERROR: Error decrypting object: Bad crypto meta: Missing 'iv' test ERROR: Error decrypting header X-Object-Transient-Sysmeta-Crypto-Meta-Test: Bad crypto meta: Missing 'iv' test ERROR: Error decrypting header X-Object-Sysmeta-Container-Update-Override-Etag: Bad crypto meta: Cipher must be AES_CTR_256 test ERROR: Error decrypting header X-Object-Sysmeta-Container-Update-Override-Etag: Bad crypto meta: IV must be length 16 bytes test ERROR: Error decrypting header X-Object-Transient-Sysmeta-Crypto-Meta-Test: Bad crypto meta: IV must be length 16 bytes test ERROR: Bad key for 'object': Key must be length 32 bytes: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 178, in get_keys self.crypto.check_key(key) ~~~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 141, in check_key raise ValueError("Key must be length %s bytes" % self.key_length) ValueError: Key must be length 32 bytes test ERROR: Error decrypting header X-Object-Transient-Sysmeta-Crypto-Meta-Test: Missing crypto meta in value LwwJqI3L+FBfmg== test ERROR: Error decrypting header X-Object-Transient-Sysmeta-Crypto-Meta-Test: Bad crypto meta: Missing 'iv' fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:56 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:56 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:56 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:56 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:56 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_abort_multipart_upload_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_abort_multipart_upload_acl_with_write_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_abort_multipart_upload_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_abort_multipart_upload_acl_without_permission ... ok test.unit.account.test_backend.TestAccountBroker.test_double_check_trailing_delimiter test.unit.account.test_backend.TestAccountBroker.test_double_check_trailing_delimiter ... ok test.unit.cli.test_info.TestPrintObj.test_missing_etag test.unit.cli.test_info.TestPrintObj.test_missing_etag ... ok test.unit.cli.test_info.TestPrintObj.test_print_obj_invalid test.unit.cli.test_info.TestPrintObj.test_print_obj_invalid ... ok test.unit.cli.test_info.TestPrintObj.test_print_obj_valid test.unit.cli.test_info.TestPrintObj.test_print_obj_valid ... ok test.unit.cli.test_info.TestPrintObj.test_print_obj_with_policy test.unit.cli.test_info.TestPrintObj.test_print_obj_with_policy ... ok test.unit.cli.test_recon.TestReconCommands.test_disk_usage test.unit.cli.test_recon.TestReconCommands.test_disk_usage ... ok test.unit.cli.test_recon.TestReconCommands.test_get_swiftconfmd5 test.unit.cli.test_recon.TestReconCommands.test_get_swiftconfmd5 ... ok test.unit.cli.test_recon.TestReconCommands.test_get_swiftconfmd5_mismatch test.unit.cli.test_recon.TestReconCommands.test_get_swiftconfmd5_mismatch ... ok test.unit.cli.test_recon.TestReconCommands.test_load_check test.unit.cli.test_recon.TestReconCommands.test_load_check ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_get_info_no_stale_reads test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_get_info_no_stale_reads ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_older_data_file test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_older_data_file ... ok test.unit.cli.test_ringbuilder.TestCommands.test_dispersion_command_recalculate test.unit.cli.test_ringbuilder.TestCommands.test_dispersion_command_recalculate ... ok test.unit.account.test_backend.TestAccountBroker.test_empty test.unit.account.test_backend.TestAccountBroker.test_empty ... ok test.unit.cli.test_recon.TestReconCommands.test_multiple_server_types test.unit.cli.test_recon.TestReconCommands.test_multiple_server_types ... ok test.unit.cli.test_recon.TestReconCommands.test_object_auditor_check test.unit.cli.test_recon.TestReconCommands.test_object_auditor_check ... ok test.unit.cli.test_recon.TestReconCommands.test_reconstruction_check test.unit.cli.test_recon.TestReconCommands.test_reconstruction_check ... ok test.unit.cli.test_recon.TestReconCommands.test_replication_check test.unit.cli.test_recon.TestReconCommands.test_replication_check ... ok test.unit.cli.test_recon.TestReconCommands.test_server_type_check test.unit.cli.test_recon.TestReconCommands.test_server_type_check ... ok test.unit.cli.test_recon.TestReconCommands.test_sharding_check test.unit.cli.test_recon.TestReconCommands.test_sharding_check ... ok test.unit.cli.test_recon.TestReconCommands.test_time_check test.unit.cli.test_recon.TestReconCommands.test_time_check ... ok test.unit.cli.test_recon.TestReconCommands.test_time_check_jitter test.unit.cli.test_recon.TestReconCommands.test_time_check_jitter ... ok test.unit.cli.test_recon.TestReconCommands.test_time_check_jitter_mismatch test.unit.cli.test_recon.TestReconCommands.test_time_check_jitter_mismatch ... ok test.unit.cli.test_recon.TestReconCommands.test_time_check_mismatch test.unit.cli.test_recon.TestReconCommands.test_time_check_mismatch ... ok test.unit.cli.test_recon.TestReconCommands.test_version_check test.unit.cli.test_recon.TestReconCommands.test_version_check ... ok test.unit.cli.test_recon.TestReconCommands.test_version_check_differs test.unit.cli.test_recon.TestReconCommands.test_version_check_differs ... ok test.unit.account.test_backend.TestAccountBroker.test_exception test.unit.account.test_backend.TestAccountBroker.test_exception ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_max_expanding test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_max_expanding ... ok proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmpmcskxvju/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpmcskxvju/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmpmcskxvju/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpmcskxvju/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0033 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0112 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0117 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0029 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa2e6fa2456834b4f85b39-0068c5706c" "proxy-server 1824514" 0.0013 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:40941/sda1/1/a/c" "txa2e6fa2456834b4f85b39-0068c5706c" "container-server 1824514" 0.0133 "-" 1824514 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:60751/sdb1/1/a/c" "txa2e6fa2456834b4f85b39-0068c5706c" "container-server 1824514" 0.0105 "-" 1824514 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "txa2e6fa2456834b4f85b39-0068c5706c" "proxy-server 1824514" 0.0507 "-" 1824514 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "txa2e6fa2456834b4f85b39-0068c5706c" "proxy-server 1824514" 0.0308 "-" 1824514 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/23/56 PUT /v1/a/c HTTP/1.0 201 - - t - - - txa2e6fa2456834b4f85b39-0068c5706c - 0.0710 - - 1757769836.710941553 1757769836.781906128 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "HEAD /sdb1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx1dbe843910db4635a01b5-0068c5706c" "proxy-server 1824514" 0.0011 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:40941/sda1/1/a1/c1" "tx1dbe843910db4635a01b5-0068c5706c" "container-server 1824514" 0.0053 "-" 1824514 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:60751/sdb1/1/a1/c1" "tx1dbe843910db4635a01b5-0068c5706c" "container-server 1824514" 0.0010 "-" 1824514 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx1dbe843910db4635a01b5-0068c5706c" "proxy-server 1824514" 0.0341 "-" 1824514 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx1dbe843910db4635a01b5-0068c5706c" "proxy-server 1824514" 0.0184 "-" 1824514 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/23/56 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx1dbe843910db4635a01b5-0068c5706c - 0.0539 - - 1757769836.783410549 1757769836.837277889 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe51650a28b3b4d00a72ad-0068c5706c" "proxy-server 1824514" 0.0061 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/c1" "txe51650a28b3b4d00a72ad-0068c5706c" "container-server 1824514" 0.0058 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/c1" "txe51650a28b3b4d00a72ad-0068c5706c" "container-server 1824514" 0.0010 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txe51650a28b3b4d00a72ad-0068c5706c" "proxy-server 1824514" 0.0221 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txe51650a28b3b4d00a72ad-0068c5706c" "proxy-server 1824514" 0.0177 "-" 1824514 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/23/56 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - txe51650a28b3b4d00a72ad-0068c5706c - 0.0455 - - 1757769836.838563919 1757769836.884061098 1 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfd1c14efe5044696b859b-0068c5706c" "proxy-server 1824514" 0.0019 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:60751/sdb1/1/a/c2" "txfd1c14efe5044696b859b-0068c5706c" "container-server 1824514" 0.0122 "-" 1824514 2 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:40941/sda1/1/a/c2" "txfd1c14efe5044696b859b-0068c5706c" "container-server 1824514" 0.0097 "-" 1824514 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txfd1c14efe5044696b859b-0068c5706c" "proxy-server 1824514" 0.0480 "-" 1824514 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txfd1c14efe5044696b859b-0068c5706c" "proxy-server 1824514" 0.0406 "-" 1824514 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/23/56 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txfd1c14efe5044696b859b-0068c5706c - 0.0645 - - 1757769836.885427475 1757769836.949976921 2 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:56 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx512a5e5c9d424fc789b18-0068c5706c" "proxy-server 1824514" 0.0100 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdb1/1/a/c04c047ff60c48cf8f112ea896e83ff7" 201 - "PUT http://127.0.0.1:40941/sda1/1/a/c04c047ff60c48cf8f112ea896e83ff7" "tx512a5e5c9d424fc789b18-0068c5706c" "container-server 1824514" 0.0016 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/1/a/c04c047ff60c48cf8f112ea896e83ff7" 201 - "PUT http://127.0.0.1:60751/sdb1/1/a/c04c047ff60c48cf8f112ea896e83ff7" "tx512a5e5c9d424fc789b18-0068c5706c" "container-server 1824514" 0.0091 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/1/a/c04c047ff60c48cf8f112ea896e83ff7" 201 - "PUT http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7" "tx512a5e5c9d424fc789b18-0068c5706c" "proxy-server 1824514" 0.0487 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdb1/1/a/c04c047ff60c48cf8f112ea896e83ff7" 201 - "PUT http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7" "tx512a5e5c9d424fc789b18-0068c5706c" "proxy-server 1824514" 0.0293 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2285f59aeeb24dbfa54e5-0068c5706d" "proxy-server 1824514" 0.0018 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a/c04c047ff60c48cf8f112ea896e83ff7" 204 - "HEAD http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7" "tx2285f59aeeb24dbfa54e5-0068c5706d" "proxy-server 1824514" 0.0013 "-" 1824514 3test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_get_info_stale_read_ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_get_info_stale_read_ok ... ok test.unit.cli.test_ringbuilder.TestCommands.test_empty_ring test.unit.cli.test_ringbuilder.TestCommands.test_empty_ring ... ok test.unit.cli.test_ringcomposer.TestCommands.test_compose_fails_to_write_composite_ring_file test.unit.cli.test_ringcomposer.TestCommands.test_compose_fails_to_write_composite_ring_file ... ok test.unit.common.middleware.crypto.test_crypto.TestCrypto.test_filter_factory test.unit.common.middleware.crypto.test_crypto.TestCrypto.test_filter_factory ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_user_key_miss test.unit.common.middleware.test_container_sync.TestContainerSync.test_user_key_miss ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_valid_sig test.unit.common.middleware.test_container_sync.TestContainerSync.test_valid_sig ... ok test.unit.common.middleware.test_container_sync.TestContainerSync.test_valid_sig2 test.unit.common.middleware.test_container_sync.TestContainerSync.test_valid_sig2 ... ok test.unit.account.test_backend.TestAccountBroker.test_get_info test.unit.account.test_backend.TestAccountBroker.test_get_info ... ok test.unit.cli.test_ringcomposer.TestCommands.test_compose_insufficient_component_builder_files test.unit.cli.test_ringcomposer.TestCommands.test_compose_insufficient_component_builder_files ... ok test.unit.common.middleware.s3api.test_logging.TestS3ApiLogging.test_bucket_logging_GET test.unit.common.middleware.s3api.test_logging.TestS3ApiLogging.test_bucket_logging_GET ... ok test.unit.common.middleware.s3api.test_logging.TestS3ApiLogging.test_bucket_logging_PUT test.unit.common.middleware.s3api.test_logging.TestS3ApiLogging.test_bucket_logging_PUT ... ok test.unit.common.middleware.test_dlo.TestDloPutManifest.test_validating_x_object_manifest test.unit.common.middleware.test_dlo.TestDloPutManifest.test_validating_x_object_manifest ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_list_containers_iter test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_list_containers_iter ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_list_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_list_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_encoding_type_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_encoding_type_error ... ok test.unit.account.test_backend.TestAccountBroker.test_get_info_no_stale_reads test.unit.account.test_backend.TestAccountBroker.test_get_info_no_stale_reads ... ok test.unit.account.test_backend.TestAccountBroker.test_get_info_stale_read_ok test.unit.account.test_backend.TestAccountBroker.test_get_info_stale_read_ok ... ok test.unit.common.middleware.test_dlo.TestDloPutManifest.test_validation_ignores_accounts test.unit.common.middleware.test_dlo.TestDloPutManifest.test_validation_ignores_accounts ... ok test.unit.common.middleware.test_dlo.TestDloPutManifest.test_validation_ignores_containers test.unit.common.middleware.test_dlo.TestDloPutManifest.test_validation_ignores_containers ... ok test.unit.common.middleware.test_dlo.TestDloPutManifest.test_validation_watches_manifests_with_slashes test.unit.common.middleware.test_dlo.TestDloPutManifest.test_validation_watches_manifests_with_slashes ... ok test.unit.common.middleware.s3api.test_logging.TestS3ApiLogging.test_object_logging_GET_error test.unit.common.middleware.s3api.test_logging.TestS3ApiLogging.test_object_logging_GET_error ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account ... ok test.unit.common.middleware.s3api.test_logging.TestS3ApiLogging.test_object_logging_PUT_error test.unit.common.middleware.s3api.test_logging.TestS3ApiLogging.test_object_logging_PUT_error ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path_obj_slash_v1 test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path_obj_slash_v1 ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path_root_and_path test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path_root_and_path ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path_root_obj test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path_root_obj ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path_trailing_slash test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_path_trailing_slash ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_root_path_obj_slash_v1 test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_container_with_root_path_obj_slash_v1 ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_matching_ending_not_domain test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_matching_ending_not_domain ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_with_path_root_container test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_with_path_root_container ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_with_path_root_unicode_container test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_account_with_path_root_unicode_container ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_add_prefix test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_add_prefix ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_add_prefix_already_there test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_add_prefix_already_there ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_configured_with_bad_prefixes test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_configured_with_bad_prefixes ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_configured_with_empty_storage_domain test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_configured_with_empty_storage_domain ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_configured_with_no_prefixes test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_configured_with_no_prefixes ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_configured_with_prefixes test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_configured_with_prefixes ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_extra_subdomains test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_extra_subdomains ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_passthrough test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_passthrough ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_redirect test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_redirect ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_with_path_root_and_path_no_slash test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_domain_remap_with_path_root_and_path_no_slash ... ok test.unit.cli.test_ringcomposer.TestCommands.test_compose_nonexistent_component_builder_file test.unit.cli.test_ringcomposer.TestCommands.test_compose_nonexistent_component_builder_file ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_list_objects_iter_order_and_reverse test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_list_objects_iter_order_and_reverse ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_multiple_storage_domains test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_multiple_storage_domains ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_storage_domains_conf_format test.unit.common.middleware.test_domain_remap.TestDomainRemap.test_storage_domains_conf_format ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_account_off_overrides_cluster_on test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_account_off_overrides_cluster_on ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_account_on_overrides_cluster_off test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_account_on_overrides_cluster_off ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_already_valid test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_already_valid ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_already_weak_but_valid test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_already_weak_but_valid ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_cluster_wide test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_cluster_wide ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_container_off_overrides_account_on test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_container_off_overrides_account_on ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_get_policy_stats test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_get_policy_stats ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_max_shrinking test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_max_shrinking ... ok test.unit.cli.test_ringbuilder.TestCommands.test_find_parts test.unit.cli.test_ringbuilder.TestCommands.test_find_parts ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_container_off_overrides_cluster_on test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_container_off_overrides_cluster_on ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_load_old_pending_puts test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_load_old_pending_puts ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_container_on_overrides_account_off test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_container_on_overrides_account_off ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_container_on_overrides_cluster_off test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_container_on_overrides_cluster_off ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_no_account_info test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_no_account_info ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_no_container_info test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_no_container_info ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_no_etag test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_no_etag ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_non_object_request test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_non_object_request ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_non_swift_path test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_non_swift_path ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_only_half_valid test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_only_half_valid ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE ... ok test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_swift_info test.unit.common.middleware.test_etag_quoter.TestEtagQuoter.test_swift_info ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_maxuploads ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_maxuploads_over_default test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_maxuploads_over_default ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_initialize_fail test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_initialize_fail ... ok test.unit.account.test_backend.TestAccountBroker.test_get_policy_stats test.unit.account.test_backend.TestAccountBroker.test_get_policy_stats ... ok test.unit.account.test_backend.TestAccountBroker.test_initialize_fail test.unit.account.test_backend.TestAccountBroker.test_initialize_fail ... ok test.unit.cli.test_ringbuilder.TestCommands.test_invalid_device_name test.unit.cli.test_ringbuilder.TestCommands.test_invalid_device_name ... ok test.unit.cli.test_ringbuilder.TestCommands.test_ipv6_output test.unit.cli.test_ringbuilder.TestCommands.test_ipv6_output ... ok test.unit.common.middleware.test_formpost.TestSwiftInfo.test_bad_config test.unit.common.middleware.test_formpost.TestSwiftInfo.test_bad_config ... ok test.unit.common.middleware.test_formpost.TestSwiftInfo.test_no_deprecated_digests test.unit.common.middleware.test_formpost.TestSwiftInfo.test_no_deprecated_digests ... ok test.unit.common.middleware.test_formpost.TestSwiftInfo.test_non_default_methods test.unit.common.middleware.test_formpost.TestSwiftInfo.test_non_default_methods ... ok test.unit.common.middleware.test_formpost.TestSwiftInfo.test_registered_defaults test.unit.common.middleware.test_formpost.TestSwiftInfo.test_registered_defaults ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_anonymous_is_authorized_for_permitted_referrer test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_anonymous_is_authorized_for_permitted_referrer ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_anonymous_is_not_authorized_for_unknown_reseller_prefix test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_anonymous_is_not_authorized_for_unknown_reseller_prefix ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_ts_file test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_ts_file ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_anonymous_options_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_anonymous_options_allowed ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_anonymous_with_validtoken_authorized_for_permitted_referrer test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_anonymous_with_validtoken_authorized_for_permitted_referrer ... ok test.unit.cli.test_ringcomposer.TestCommands.test_show test.unit.cli.test_ringcomposer.TestCommands.test_show ... ok test.unit.account.test_backend.TestAccountBroker.test_is_status_deleted test.unit.account.test_backend.TestAccountBroker.test_is_status_deleted ... ok test.unit.cli.test_ringcomposer.TestCommands.test_show_nonexistent_composite_builder_file test.unit.cli.test_ringcomposer.TestCommands.test_show_nonexistent_composite_builder_file ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_is_status_deleted test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_is_status_deleted ... ok test.unit.cli.test_ringcomposer.TestCommands.test_unknown_command test.unit.cli.test_ringcomposer.TestCommands.test_unknown_command ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_merge_items test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_merge_items ... ok test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_domain_new_format test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_domain_new_format ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_auth_scheme test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_auth_scheme ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_blank_reseller_prefix test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_blank_reseller_prefix ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_confirmed_identity_is_authorized test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_confirmed_identity_is_authorized ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_confirmed_identity_is_not_authorized test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_confirmed_identity_is_not_authorized ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_denied_responses test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_denied_responses ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_detect_reseller_request test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_detect_reseller_request ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_identified_options_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_identified_options_allowed ... ok test.unit.account.test_backend.TestAccountBroker.test_list_container_iter_with_reserved_name test.unit.account.test_backend.TestAccountBroker.test_list_container_iter_with_reserved_name ... ok test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_ipv4_new_format test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_ipv4_new_format ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_GET_container_json test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_GET_container_json ... ok test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_ipv4_old_format test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_ipv4_old_format ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_GET_container_json_not_encrypted_obj test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_GET_container_json_not_encrypted_obj ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_max_shrinking_default test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_max_shrinking_default ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_invalid_request_authorized test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_invalid_request_authorized ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_invalid_request_non_authorized test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_invalid_request_non_authorized ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_override_asked_for_and_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_override_asked_for_and_allowed ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_override_asked_for_but_not_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_override_asked_for_but_not_allowed ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_override_default_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_override_default_allowed ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_project_domain_id_sysmeta_not_set test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_project_domain_id_sysmeta_not_set ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_list_container_iter_with_reserved_name test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_list_container_iter_with_reserved_name ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_GET_container_json_with_crypto_override test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_GET_container_json_with_crypto_override ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_GET_container_success test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_GET_container_success ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_cont_get_json_req_with_cipher_mismatch test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_cont_get_json_req_with_cipher_mismatch ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_project_domain_id_sysmeta_set test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_project_domain_id_sysmeta_set ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_project_domain_id_sysmeta_set_to_unknown test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_project_domain_id_sysmeta_set_to_unknown ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_project_domain_id_sysmeta_set_unknown_with_v2 test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_project_domain_id_sysmeta_set_unknown_with_v2 ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_reseller_prefix_added_underscore test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_reseller_prefix_added_underscore ... ok test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_cont_get_json_req_with_unknown_secret_id test.unit.common.middleware.crypto.test_decrypter.TestDecrypterContainerRequests.test_cont_get_json_req_with_unknown_secret_id ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_reseller_prefix_not_added_double_underscores test.unit.common.middleware.test_keystoneauth.SwiftAuth.test_reseller_prefix_not_added_double_underscores ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_app_exception test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_app_exception ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_merge_items_overwrite_unicode test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_merge_items_overwrite_unicode ... ok Data file doesn't exist Data file doesn't exist [2025-09-13 13:23:57] Checking auditor stats =============================================================================== fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'Content-Md5': '0psj556+oeNaquEdDeMxig==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd29b23e79ebea1e35aaae11d0de3318a', 'Content-Length': '226', 'Content-Type': 'multipart/form-data'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_empty_body test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_empty_body ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_no_gaps test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_no_gaps ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_newid test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_newid ... ok test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_ipv6_new_format test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_ipv6_new_format ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_can_only_configure_secret_in_one_place test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_can_only_configure_secret_in_one_place ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_chained_keymasters test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_chained_keymasters ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_container_path test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_container_path ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_maxuploads_over_max_32bit_int test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_maxuploads_over_max_32bit_int ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_negative_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_negative_maxuploads ... ok test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_ipv6_old_format test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_ipv6_old_format ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_get_endpoint test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_get_endpoint ... ok test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_no_matching test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_no_matching ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_correct_root_secret_used test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_correct_root_secret_used ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_get_object_ring test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_get_object_ring ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_filter test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_filter ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_not_root test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_not_root ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_policy_stats_tracking test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_policy_stats_tracking ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_invalid_root_secret test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_invalid_root_secret ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_account_that_looks_like_version test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_account_that_looks_like_version ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_path_no_version_specified test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_path_no_version_specified ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_path_with_invalid_version test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_path_with_invalid_version ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_path_with_no_account test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_path_with_no_account ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_key_uniqueness test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_key_uniqueness ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_path_with_valid_version test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_path_with_valid_version ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_response_version test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_response_version ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_version_that_looks_like_account test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_parse_version_that_looks_like_account ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_keymaster_config_path test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_keymaster_config_path ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_ts_is_linked_to_part_power_minus_1 test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_ts_is_linked_to_part_power_minus_1 ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_keys_cached test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_keys_cached ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_put_container test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_put_container ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_str_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_str_maxuploads ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_delimiter ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_missing_conf_section test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_missing_conf_section ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_multiple_root_secrets test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_multiple_root_secrets ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_multiple_root_secrets_missing_active_root_secret_id test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_multiple_root_secrets_missing_active_root_secret_id ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_not_sharded test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_not_sharded ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_v1_response test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_v1_response ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_v2_non_obj_response test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_v2_non_obj_response ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_v2_obj_response test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_v2_obj_response ... ok test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_version_account_response test.unit.common.middleware.test_list_endpoints.TestListEndpoints.test_version_account_response ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_multiple_root_secrets_with_invalid_id test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_multiple_root_secrets_with_invalid_id ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_multiple_root_secrets_with_invalid_secret test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_multiple_root_secrets_with_invalid_secret ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_no_root_secret test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_no_root_secret ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_object_path test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_object_path ... ok Ring Builder file does not exist: /tmp/tmpao4vvmju/tmpr8dfdvnu Device d4r2z3-test.test.com:6200Rr.test.com:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Device d4r2z3-127.0.0.2:6200R127.0.0.2:6200/sda3_"some meta data" with 3.14159265359 weight got id 4 Device d4r2z3-127.0.0.1:6200R127.0.0.1:6200/sda3_"some meta data" with 3.14159265359 weight got id 4 Device d4r2z3-[3001:0:1234::c1c0:abcd:876]:6200R[3::10]:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Ring Builder file does not exist: /tmp/tmpm6o5ax1w/tmpcpjqxety Partition power increase in progress. You need to finish the increase first before adding devices. Device d4r1z1-127.0.0.1:6200R127.0.0.1:6200/sda9_"" with 3.14159265359 weight got id 4 Device 4 already uses 127.0.0.1:6200/sda9. The on-disk ring builder is unchanged. swift-ring-builder create Creates with 2^ partitions and . is number of hours to restrict moving a partition more than once. /tmp/tmpunxfnkzz/tmpm1d341o7, build version 4, id c7830b564f464ca297195337b52282fb 64 partitions, 3.000000 replicas, 4 regions, 4 zones, 4 devices, 2-byte IDs, 100.00 balance, 0.00 dispersion The minimum number of hours before a partition can be reassigned is 1 (0:00:00 remaining) The overload factor is 0.00% (0.000000) Ring file /tmp/tmpunxfnkzz/tmpm1d341o7.ring.gz not found, probably it hasn't been written yet Devices: id region zone ip address:port replication ip:port name weight partitions balance flags meta 0 0 0 127.0.0.1:6200 127.0.0.1:6200 sda1 100.00 0 -100.00 some meta data 1 1 1 127.0.0.2:6201 127.0.0.2:6201 sda2 100.00 0 -100.00 2 2 2 127.0.0.3:6202 127.0.0.3:6202 sdc3 100.00 0 -100.00 3 3 3 127.0.0.4:6203 127.0.0.4:6203 sdd4 100.00 0 -100.00 /build/reproducible-path/swift-2.36.0/test/unit/cli/test_default_output /build/reproducible-path/swift-2.36.0/test/unit/cli/test_default_output_id_assigned Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"" weight set to 0.0 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 d1r1z1-127.0.0.2:6201R127.0.0.2:6201/sda2_"" marked for removal and will be removed next rebalance. d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"" weight set to 0.0 Device d4r1z2-127.0.0.5:6004R127.0.0.5:6004/sda5_"" with 100.0 weight got id 4 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"" marked for removal and will be removed next rebalance. Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Device d0r2z1-127.0.0.6:6005R127.0.0.6:6005/sdb6_"" with 100.0 weight got id 0 /build/reproducible-path/swift-2.36.0/test/unit/cli/test_default_sorted_output Invalid device name The on-disk ring builder is unchanged. Invalid device name The on-disk ring builder is unchanged. Invalid device name The on-disk ring builder is unchanged. Invalid device name The on-disk ring builder is unchanged. Invalid device name The on-disk ring builder is unchanged. Invalid device name The on-disk ring builder is unchanged. Invalid device name The on-disk ring builder is unchanged. Invalid device name The on-disk ring builder is unchanged. Invalid device name The on-disk ring builder is unchanged. Invalid device name The on-disk ring builder is unchanged. /build/reproducible-path/swift-2.36.0/test/unit/cli/test_ipv6_output Device d4r2z3-test.test.com:6200Rr.test.com:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Partition Matches 9 1 23 1 Partition Matches 8 1 10 1 16 1 21 1 22 1 28 1 30 1 31 1 32 1 37 1 38 1 39 1 46 1 55 1 56 1 58 1 1 1 3 1 5 1 6 1 9 1 20 1 23 1 25 1 27 1 29 1 33 1 35 1 40 1 41 1 52 1 62 1 0 1 12 1 13 1 15 1 19 1 24 1 34 1 36 1 49 1 50 1 51 1 53 1 54 1 57 1 60 1 63 1 Partition Matches 1 1 2 1 9 1 19 1 20 1 23 1 26 1 29 1 41 1 43 1 45 1 50 1 51 1 52 1 59 1 62 1 7 1 11 1 13 1 14 1 15 1 22 1 27 1 32 1 46 1 47 1 53 1 56 1 57 1 58 1 60 1 63 1 3 1 5 1 8 1 10 1 16 1 24 1 28 1 31 1 36 1 37 1 42 1 44 1 48 1 49 1 54 1 55 1 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Partition Matches 7 1 22 1 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Partition Matches 49 1 61 1 Specified builder file "/tmp/tmp_mbx3d6o/tmp7st143nz" is not rebalanced yet. Please rebalance first. swift-ring-builder list_parts [] .. or swift-ring-builder list_parts --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Returns a 2 column list of all the partitions that are assigned to any of the devices matching the search values given. The first column is the assigned partition number and the second column is the number of device matches for that partition. The list is ordered from most number of matches to least. If there are a lot of devices to match against, this command could take a while to run. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included.test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_root_secret test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_root_secret ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_reclaim test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_reclaim ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_POST_symlink test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_POST_symlink ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_POST_unversioned_obj test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_POST_unversioned_obj ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_PUT_overwrite_null_marker_versioning_disabled test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_PUT_overwrite_null_marker_versioning_disabled ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_PUT_with_recent_versioned_marker_versioning_disabled test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_PUT_with_recent_versioned_marker_versioning_disabled ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_root_secret_path_invalid_secret test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_root_secret_path_invalid_secret ... ok test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_list_parts_number_of_arguments ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_unicode_object_path test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_unicode_object_path ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_id_and_key_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_id_and_key_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_key_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_key_marker ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_nothing_to_do test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_nothing_to_do ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_delete_object_with_versioning_disabled test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_delete_object_with_versioning_disabled ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_disable_versioning test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_disable_versioning ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_get_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_get_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_head_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_head_container ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_v1_keys test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_v1_keys ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_v1_keys_with_weird_paths test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_v1_keys_with_weird_paths ... ok test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_v2_keys test.unit.common.middleware.crypto.test_keymaster.TestKeymaster.test_v2_keys ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_put_object_versioning_disabled test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDisabled.test_put_object_versioning_disabled ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_auth_fail test.unit.common.middleware.test_quotas.TestContainerQuotas.test_auth_fail ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_delete_quotas test.unit.common.middleware.test_quotas.TestContainerQuotas.test_delete_quotas ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_exceed_bytes_quota test.unit.common.middleware.test_quotas.TestContainerQuotas.test_exceed_bytes_quota ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_exceed_counts_quota test.unit.common.middleware.test_quotas.TestContainerQuotas.test_exceed_counts_quota ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_invalid_quotas test.unit.common.middleware.test_quotas.TestContainerQuotas.test_invalid_quotas ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_missing_container test.unit.common.middleware.test_quotas.TestContainerQuotas.test_missing_container ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_no_quotas test.unit.common.middleware.test_quotas.TestContainerQuotas.test_no_quotas ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_not_exceed_bytes_quota test.unit.common.middleware.test_quotas.TestContainerQuotas.test_not_exceed_bytes_quota ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_not_exceed_counts_quota test.unit.common.middleware.test_quotas.TestContainerQuotas.test_not_exceed_counts_quota ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_not_handled test.unit.common.middleware.test_quotas.TestContainerQuotas.test_not_handled ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_split_path_empty_container_path_segment test.unit.common.middleware.test_quotas.TestContainerQuotas.test_split_path_empty_container_path_segment ... ok test.unit.common.middleware.test_quotas.TestContainerQuotas.test_valid_quotas test.unit.common.middleware.test_quotas.TestContainerQuotas.test_valid_quotas ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest ... ok test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_reverse_prefix_delim test.unit.account.test_backend.TestAccountBrokerBeforeMetadata.test_reverse_prefix_delim ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_list_containers_iter test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_list_containers_iter ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_big_non_slo test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_big_non_slo ... ok test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:56 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpkn5zdmdf/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpkn5zdmdf/node/sda1/objects/325 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test WARNING: Error relinking (cleanup): failed to relink /tmp/tmpkn5zdmdf/node/sda1/objects/162/c8b/a29216517c10f8cbe40dfa777d8b8c8b/1757769836.76976.data to /tmp/tmpkn5zdmdf/node/sda1/objects/325/c8b/a29216517c10f8cbe40dfa777d8b8c8b/1757769836.76976.data: [Errno 17] File exists: '/tmp/tmpkn5zdmdf/node/sda1/objects/162/c8b/a29216517c10f8cbe40dfa777d8b8c8b/1757769836.76976.data' -> '/tmp/tmpkn5zdmdf/node/sda1/objects/325/c8b/a29216517c10f8cbe40dfa777d8b8c8b/1757769836.76976.data' test DEBUG: Run listdir on /tmp/tmpkn5zdmdf/node/sda1/objects/162 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=True): 13:23:56 09/13/25 GMT (0:00:00.117167 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:56 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpdklqgibj/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpdklqgibj/node/sda1/objects/310 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test WARNING: Error relinking (cleanup): failed to relink /tmp/tmpdklqgibj/node/sda1/objects/155/505/9b6b95d8ab910017e1b98c7526031505/1757769836.94097.data to /tmp/tmpdklqgibj/node/sda1/objects/310/505/9b6b95d8ab910017e1b98c7526031505/1757769836.94097.data: [Errno 17] File exists: '/tmp/tmpdklqgibj/node/sda1/objects/155/505/9b6b95d8ab910017e1b98c7526031505/1757769836.94097.data' -> '/tmp/tmpdklqgibj/node/sda1/objects/310/505/9b6b95d8ab910017e1b98c7526031505/1757769836.94097.data' test WARNING: Error relinking (cleanup): failed to relink /tmp/tmpdklqgibj/node/sda1/objects/155/505/9b6b95d8ab910017e1b98c7526031505/1757769837.94097.meta to /tmp/tmpdklqgibj/node/sda1/objects/310/505/9b6b95d8ab910017e1b98c7526031505/1757769837.94097.meta: [Errno 17] File exists: '/tmp/tmpdklqgibj/node/sda1/objects/155/505/9b6b95d8ab910017e1b98c7526031505/1757769837.94097.meta' -> '/tmp/tmpdklqgibj/node/sda1/objects/310/505/9b6b95d8ab910017e1b98c7526031505/1757769837.94097.meta' test DEBUG: Run listdir on /tmp/tmpdklqgibj/node/sda1/objects/155 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (2 files, 0 linked, 0 removed, 2 errors) test INFO: Finished relinker (cleanup=True): 13:23:56 09/13/25 GMT (0:00:00.020349 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:57 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpv9tq8vbt/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpv9tq8vbt/node/sda1/objects/347 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test WARNING: Error relinking (cleanup): failed to relink /tmp/tmpv9tq8vbt/node/sda1/objects/173/421/adaf6e04c78059ffe1b9e2dd58d0d421/1757769837.05223.data to /tmp/tmpv9tq8vbt/node/sda1/objects/347/421/adaf6e04c78059ffe1b9e2dd58d0d421/1757769837.05223.data: [Errno 17] File exists: '/tmp/tmpv9tq8vbt/node/sda1/objects/173/421/adaf6e04c78059ffe1b9e2dd58d0d421/1757769837.05223.data' -> '/tmp/tmpv9tq8vbt/node/sda1/objects/347/421/adaf6e04c78059ffe1b9e2dd58d0d421/1757769837.05223.data' test DEBUG: Run listdir on /tmp/tmpv9tq8vbt/node/sda1/objects/173 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (2 files, 0 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=True): 13:23:57 09/13/25 GMT (0:00:00.028461 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:57 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpt0u03ib5/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpt0u03ib5/node/sda1/objects/293 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmpt0u03ib5/node/sda1/objects/146/566/92dfc68ae92b481905e31ffa8ab0a566/1757769837.17002.data test DEBUG: Run listdir on /tmp/tmpt0u03ib5/node/sda1/objects/146 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (0 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:57 09/13/25 GMT (0:00:00.030114 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:57 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpv8vzjmbw/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpv8vzjmbw/node/sda1/objects/268 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking (cleanup): tolerating different inodes for tombstone with same timestamp: /tmp/tmpv8vzjmbw/node/sda1/objects/134/268/867351ca68fff713edf4a0df88bc9268/1757769837.32317.ts to /tmp/tmpv8vzjmbw/node/sda1/objects/268/268/867351ca68fff713edf4a0df88bc9268/1757769837.32317.ts test DEBUG: Removed /tmp/tmpv8vzjmbw/node/sda1/objects/134/268/867351ca68fff713edf4a0df88bc9268/1757769837.32317.ts test DEBUG: Run listdir on /tmp/tmpv8vzjmbw/node/sda1/objects/134 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:57 09/13/25 GMT (0:00:00.038254 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:57 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmprfvzq73i/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmprfvzq73i/node/sda1/objects/396 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/3 test DEBUG: Relinking (cleanup): tolerating different inodes for tombstone with same timestamp: /tmp/tmprfvzq73i/node/sda1/objects/198/f51/c619977fdfa4bab3f017e4e53ebd1f51/1757769837.45129.ts to /tmp/tmprfvzq73i/node/sda1/objects/396/f51/c619977fdfa4bab3f017e4e53ebd1f51/1757769837.45129.ts test DEBUG: Removed /tmp/tmprfvzq73i/node/sda1/objects/198/f51/c619977fdfa4bab3f017e4e53ebd1f51/1757769837.45129.ts test DEBUG: Run listdir on /tmp/tmprfvzq73i/node/sda1/objects/198 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/3 test DEBUG: Removed /tmp/tmprfvzq73i/node/sda1/objects/99/f51/c619977fdfa4bab3f017e4e53ebd1f51/1757769837.45129.ts test DEBUG: Run listdir on /tmp/tmprfvzq73i/node/sda1/objects/99 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 3/3 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 2 hash dirs processed (cleanup=True) (2 files, 0 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:57 09/13/25 GMT (0:00:00.043198 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:57 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp5jxcf1w8/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmp5jxcf1w8/node/sda1/objects/388 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/3 test DEBUG: Relinking (cleanup): tolerating different inodes for tombstone with same timestamp: /tmp/tmp5jxcf1w8/node/sda1/objects/194/755/c2581ae74cb8d6a48922d7d62fb23755/1757769837.63984.ts to /tmp/tmp5jxcf1w8/node/sda1/objects/388/755/c2581ae74cb8d6a48922d7d62fb23755/1757769837.63984.ts test DEBUG: Removed /tmp/tmp5jxcf1w8/node/sda1/objects/194/755/c2581ae74cb8d6a48922d7d62fb23755/1757769837.63984.ts test DEBUG: Run listdir on /tmp/tmp5jxcf1w8/node/sda1/objects/194 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/3 test DEBUG: Removed /tmp/tmp5jxcf1w8/node/sda1/objects/48/755/c2581ae74cb8d6a48922d7d62fb23755/1757769837.63984.tstest.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_ts_is_linked_to_part_power_minus_2_err test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_ts_is_linked_to_part_power_minus_2_err ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_empty_body test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_empty_body ... ok test.unit.account.test_server.TestAccountController.test_DELETE_empty test.unit.account.test_server.TestAccountController.test_DELETE_empty ... ok test.unit.account.test_server.TestAccountController.test_DELETE_invalid_partition test.unit.account.test_server.TestAccountController.test_DELETE_invalid_partition ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_fails test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_fails ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_finds_old test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_finds_old ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_list_objects_iter_order_and_reverse test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_list_objects_iter_order_and_reverse ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_small_non_slo test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_small_non_slo ... ok swift-ring-builder 1.3 swift-ring-builder Shows information about the ring and the devices within. Output includes a table that describes the report parameters (id, region, port, flags, etc). flags: possible values are 'DEL' and '' DEL - indicates that the device is marked for removal from ring and will be removed in next rebalance. swift-ring-builder add [r]z-:[R:]/_ [[r]z-:[R:]/_ ] ... Where and are replication ip and port. or swift-ring-builder add --region --zone --ip --port [--replication-ip ] [--replication-port ] --device --weight [--meta ] Adds devices to the ring with the given information. No partitions will be assigned to the new device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. swift-ring-builder cancel_increase_partition_power Cancel the increase of the partition power. A write_ring command is needed to make the change take effect. Once the updated rings have been deployed to all servers you need to run the swift-object-relinker tool to cleanup unneeded links. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder create Creates with 2^ partitions and . is number of hours to restrict moving a partition more than once. swift-ring-builder dispersion [options] Output report on dispersion. --recalculate option will rebuild cached dispersion info and save builder --verbose option will display dispersion graph broken down by tier You can filter which tiers are evaluated to drill down using a regex in the optional search_filter argument. i.e. swift-ring-builder dispersion "r\d+z\d+$" -v ... would only display rows for the zone tiers swift-ring-builder dispersion ".*\-[^/]*$" -v ... would only display rows for the server tiers The reports columns are: Tier : the name of the tier parts : the total number of partitions with assignment in the tier % : the percentage of parts in the tier with replicas over assigned max : maximum replicas a part should have assigned at the tier 0 - N : the number of parts with that many replicas assigned e.g. Tier: parts % max 0 1 2 3 r1z1 1022 79.45 1 2 210 784 28 r1z1 has 1022 total parts assigned, 79% of them have more than the recommend max replica count of 1 assigned. Only 2 parts in the ring are *not* assigned in this tier (0 replica count), 210 parts have the recommend replica count of 1, 784 have 2 replicas, and 28 sadly have all three replicas in this tier. swift-ring-builder finish_increase_partition_power Finally removes the next_part_power flag. Has to be run after the swift-object-relinker tool has been used to cleanup old existing data. A write_ring command is needed to make the change take effect. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder increase_partition_power Increases the partition power by one. Needs to be run after prepare_increase_partition_power has been run and all existing data has been relinked using the swift-object-relinker tool. A write_ring command is needed to make the change take effect. Once the updated rings have been deployed to all servers you need to run the swift-object-relinker tool to cleanup old data. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder list_parts [] .. or swift-ring-builder list_parts --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Returns a 2 column list of all the partitions that are assigned to any of the devices matching the search values given. The first column is the assigned partition number and the second column is the number of device matches for that partition. The list is ordered from most number of matches to least. If there are a lot of devices to match against, this command could take a while to run. swift-ring-builder prepare_increase_partition_power Prepare the ring to increase the partition power by one. A write_ring command is needed to make the change take effect. Once the updated rings have been deployed to all servers you need to run the swift-object-relinker tool to relink existing data. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder pretend_min_part_hours_passed Resets the clock on the last time a rebalance happened, thus circumventing the min_part_hours check. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you run this command and deploy rebalanced rings before a replication pass completes, you may introduce unavailability in your cluster. This has an end-user impact. swift-ring-builder rebalance [options] Attempts to rebalance the ring by reassigning partitions that haven't been recently reassigned. swift-ring-builder remove [search-value ...] [--yes] or swift-ring-builder remove --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Removes the device(s) from the ring. This should normally just be used for a device that has failed. For a device you wish to decommission, it's best to set its weight to 0, wait for it to drain all its data, then use this remove command. This will not take effect until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder search or swift-ring-builder search --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Shows information about matching devices.test.unit.cli.test_ringbuilder.TestCommands.test_main_no_arguments test.unit.cli.test_ringbuilder.TestCommands.test_main_no_arguments ... ok test.unit.account.test_server.TestAccountController.test_DELETE_not_empty test.unit.account.test_server.TestAccountController.test_DELETE_not_empty ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_multi_chars_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_multi_chars_delimiter ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_prefix test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_prefix ... ok test.unit.account.test_server.TestAccountController.test_DELETE_not_found test.unit.account.test_server.TestAccountController.test_DELETE_not_found ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_tombstone test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_beyond_manifest_refetch_tombstone ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_bogus_content_range test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_bogus_content_range ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_load_old_pending_puts test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_load_old_pending_puts ... ok test.unit.account.test_backend.TestAccountBroker.test_list_containers_iter test.unit.account.test_backend.TestAccountBroker.test_list_containers_iter ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_includes_whole_manifest test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_includes_whole_manifest ... ok test.unit.account.test_backend.TestAccountBroker.test_list_objects_iter_order_and_reverse test.unit.account.test_backend.TestAccountBroker.test_list_objects_iter_order_and_reverse ... ok test.unit.account.test_server.TestAccountController.test_DELETE_now_empty test.unit.account.test_server.TestAccountController.test_DELETE_now_empty ... ok test.unit.account.test_server.TestAccountController.test_DELETE_timestamp_not_float test.unit.account.test_server.TestAccountController.test_DELETE_timestamp_not_float ... ok test.unit.account.test_backend.TestAccountBroker.test_load_old_pending_puts test.unit.account.test_backend.TestAccountBroker.test_load_old_pending_puts ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9bc790ff256248a691f92-0068c5706d" "proxy-server 1824514" 0.0143 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/1/a/c04c047ff60c48cf8f112ea896e83ff7" 204 - "HEAD http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7" "tx12c9845f27014225b8234-0068c5706d" "proxy-server 1824514" 0.0173 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdg1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" 201 - "PUT http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx2c6ccb352a2f42e19c35e-0068c5706d" "proxy-server 1824514" 0.1357 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdb1/1/a/c04c047ff60c48cf8f112ea896e83ff7/o" 201 - "PUT http://foo:8080/sdh1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx2c6ccb352a2f42e19c35e-0068c5706d" "object-server 1824514" 0.0005 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdh1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" 201 - "PUT http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx2c6ccb352a2f42e19c35e-0068c5706d" "proxy-server 1824514" 0.1403 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/1/a/c04c047ff60c48cf8f112ea896e83ff7/o" 201 - "PUT http://foo:8080/sdi1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx2c6ccb352a2f42e19c35e-0068c5706d" "object-server 1824514" 0.0005 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdi1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" 201 - "PUT http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx2c6ccb352a2f42e19c35e-0068c5706d" "proxy-server 1824514" 0.1495 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx56b9f7a9ab4f44e1be725-0068c5706d" "proxy-server 1824514" 0.0096 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/1/a/c04c047ff60c48cf8f112ea896e83ff7" 204 - "HEAD http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7" "txe1be42b91304413597d9b-0068c5706d" "proxy-server 1824514" 0.0182 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "POST /sdi1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" 202 76 "POST http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx0706fe7ac19b4aca899d2-0068c5706d" "proxy-server 1824514" 0.0141 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdb1/1/a/c04c047ff60c48cf8f112ea896e83ff7/o" 201 - "POST http://foo:8080/sdg1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx0706fe7ac19b4aca899d2-0068c5706d" "object-server 1824514" 0.0004 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/1/a/c04c047ff60c48cf8f112ea896e83ff7/o" 201 - "POST http://foo:8080/sdh1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx0706fe7ac19b4aca899d2-0068c5706d" "object-server 1824514" 0.0004 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "POST /sdh1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" 202 76 "POST http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx0706fe7ac19b4aca899d2-0068c5706d" "proxy-server 1824514" 0.0195 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "POST /sdg1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" 202 76 "POST http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx0706fe7ac19b4aca899d2-0068c5706d" "proxy-server 1824514" 0.0212 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx4754baf550514f5c9f726-0068c5706d" "proxy-server 1824514" 0.0013 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/1/a/0dbbab12c9264c5fb01ced16351f1171" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" "tx4754baf550514f5c9f726-0068c5706d" "container-server 1824514" 0.0010 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdb1/1/a/0dbbab12c9264c5fb01ced16351f1171" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/0dbbab12c9264c5fb01ced16351f1171" "tx4754baf550514f5c9f726-0068c5706d" "container-server 1824514" 0.0010 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdb1/3/a/0dbbab12c9264c5fb01ced16351f1171" 201 - "PUT http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx4754baf550514f5c9f726-0068c5706d" "proxy-server 1824514" 0.0245 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 201 - "PUT http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx4754baf550514f5c9f726-0068c5706d" "proxy-server 1824514" 0.0374 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx24fee9f5917349dd9647a-0068c5706d" "proxy-server 1824514" 0.0099 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx24fee9f5917349dd9647a-0068c5706d" "proxy-server 1824514" 0.0012 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txd724694deca04fc48d5c0-0068c5706d" "proxy-server 1824514" 0.0100 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a/c04c047ff60c48cf8f112ea896e83ff7" 204 - "HEAD http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7" "tx9845c0e9ad284f39b4d34-0068c5706d" "proxy-server 1824514" 0.0171 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "GET /sdh1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" 200 92 "GET http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx003a5b0073fd45a38722a-0068c5706d" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "GET /sdi1/2/a/c04c047ff60c48cf8f112ea896e83ff7/o" 200 92 "GET http://foo:8080/v1/a/c04c047ff60c48cf8f112ea896e83ff7/o" "tx003a5b0073fd45a38722a-0068c5706d" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx54a3de7948c6407aa287f-0068c5706d" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://foo:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx7489443146974f7d855aa-0068c5706d" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdi1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 201 - "PUT http://foo:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txdcfdd68f7e3b442794d7e-0068c5706d" "proxy-server 1824514" 0.0469 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171/o" 201 - "PUT http://foo:8080/sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" "txdcfdd68f7e3b442794d7e-0068c5706d" "object-server 1824514" 0.0005 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 201 - "PUT http://foo:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txdcfdd68f7e3b442794d7e-0068c5706d" "proxy-server 1824514" 0.0528 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdb1/3/a/0dbbab12c9264c5fb01ced16351f1171/o" 201 - "PUT http://foo:8080/sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" "txdcfdd68f7e3b442794d7e-0068c5706d" "object-server 1824514" 0.0005 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "PUT /sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 201 - "PUT http://foo:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txdcfdd68f7e3b442794d7e-0068c5706d" "proxy-server 1824514" 0.0572 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx520148792e6545e4ab3c6-0068c5706d" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "txd51d791bb345430f8f6f5-0068c5706d" "proxy-server 1824514" 0.0151 "-" 1824514 3test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_includes_whole_range_manifest test.unit.common.middleware.test_slo.TestOldSwiftWithRangesOldManifests.test_old_swift_range_get_includes_whole_range_manifest ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_alternative_expirer_config test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_alternative_expirer_config ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_merge_items test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_merge_items ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_nested test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_nested ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_non_ascii test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_non_ascii ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_non_ascii_same_container test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_non_ascii_same_container ... ok test.unit.account.test_backend.TestAccountBroker.test_merge_items test.unit.account.test_backend.TestAccountBroker.test_merge_items ... ok test.unit.account.test_server.TestAccountController.test_GET_accept_application_wildcard test.unit.account.test_server.TestAccountController.test_GET_accept_application_wildcard ... ok test.unit.account.test_server.TestAccountController.test_GET_accept_conflicting test.unit.account.test_server.TestAccountController.test_GET_accept_conflicting ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_too_many_containers test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_too_many_containers ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_turned_off test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_turned_off ... ok test.unit.account.test_backend.TestAccountBroker.test_merge_items_overwrite_unicode test.unit.account.test_backend.TestAccountBroker.test_merge_items_overwrite_unicode ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_whole test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_whole ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_merge_items_overwrite_unicode test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_merge_items_overwrite_unicode ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_whole_404 test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_async_delete_whole_404 ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_prefix_and_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_with_prefix_and_delimiter ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_without_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_without_bucket ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_401 test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_401 ... ok test.unit.account.test_backend.TestAccountBroker.test_newid test.unit.account.test_backend.TestAccountBroker.test_newid ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_bad_json test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_bad_json ... ok test.unit.account.test_server.TestAccountController.test_GET_accept_json test.unit.account.test_server.TestAccountController.test_GET_accept_json ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_migrate_add_storage_policy_index_fail test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_migrate_add_storage_policy_index_fail ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_bad_utf8 test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_bad_utf8 ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_client_content_type test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_client_content_type ... ok test.unit.account.test_backend.TestAccountBroker.test_policy_stats_tracking test.unit.account.test_backend.TestAccountBroker.test_policy_stats_tracking ... ok test.unit.account.test_server.TestAccountController.test_GET_accept_not_valid test.unit.account.test_server.TestAccountController.test_GET_accept_not_valid ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_man test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_man ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested ... ok test.unit.account.test_backend.TestAccountBroker.test_put_container test.unit.account.test_backend.TestAccountBroker.test_put_container ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested_401 test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested_401 ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_newid test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_newid ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_without_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_GET_without_segment_bucket ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_abort test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_abort ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_complete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_complete ... ok test.unit.account.test_server.TestAccountController.test_GET_accept_wildcard test.unit.account.test_server.TestAccountController.test_GET_accept_wildcard ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested_404 test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested_404 ... ok swift-ring-builder set_info :[R:]/_ [ :[R:]/_] ... [--yes] or swift-ring-builder set_info --ip --port --replication-ip --replication-port --device --meta --change-ip --change-port --change-replication-ip --change-replication-port --change-device --change-meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. For each search-value, resets the matched device's information. This information isn't used to assign partitions, so you can use 'write_ring' afterward to rewrite the current ring with the newer device information. Any of the parts are optional in the final :/_ parameter; just give what you want to change. For instance set_info d74 _"snet: 5.6.7.8" would just update the meta data for device id 74. Option --yes assume a yes response to all questions. swift-ring-builder set_min_part_hours Changes the to the given . This should be set to however long a full replication/update cycle takes. We're working on a way to determine this more easily than scanning logs. swift-ring-builder set_overload [%] Changes the overload factor to the given . A rebalance is needed to make the change take effect. swift-ring-builder set_region [ set_region --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' regions. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_replicas Changes the replica count to the given . may be a floating-point value, in which case some partitions will have floor() replicas and some will have ceiling() in the correct proportions. A rebalance is needed to make the change take effect. swift-ring-builder set_weight [ ] ... [--yes] or swift-ring-builder set_weight --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. and are the search weight and new weight values respectively. Any of the options are optional in both cases. Resets the devices' weights. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_zone [ set_zone --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' zones. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder validate Just runs the validation routines on the ring. swift-ring-builder version swift-ring-builder write_builder [min_part_hours] Recreate a builder from a ring file (lossy) if you lost your builder backups. (Protip: don't lose your builder backups). [min_part_hours] is one of those numbers lost to the builder, you can change it with set_min_part_hours. swift-ring-builder write_ring Just rewrites the distributable ring file. This is done automatically after a successful rebalance, so really this is only useful after one or more 'set_info' calls when no rebalance is needed but you want to send out the new device information. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included. Quick list: add cancel_increase_partition_power create dispersion finish_increase_partition_power increase_partition_power list_parts prepare_increase_partition_power pretend_min_part_hours_passed rebalance remove search set_info set_min_part_hours set_overload set_region set_replicas set_weight set_zone validate version write_builder write_ring Exit codes: 0 = operation successful 1 = operation completed with warnings 2 = error swift-ring-builder 1.3 swift-ring-builder Shows information about the ring and the devices within. Output includes a table that describes the report parameters (id, region, port, flags, etc). flags: possible values are 'DEL' and '' DEL - indicates that the device is marked for removal from ring and will be removed in next rebalance. swift-ring-builder add [r]z-:[R:]/_ [[r]z-:[R:]/_ ] ... Where and are replication ip and port. or swift-ring-builder add --region --zone --ip --port [--replication-ip ] [--replication-port ] --device --weight [--meta ] Adds devices to the ring with the given information. No partitions will be assigned to the new device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. swift-ring-builder cancel_increase_partition_power Cancel the increase of the partition power. A write_ring command is needed to make the change take effect. Once the updated rings have been deployed to all servers you need to run the swift-object-relinker tool to cleanup unneeded links. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder create Creates with 2^ partitions and . is number of hours to restrict moving a partition more than once. swift-ring-builder dispersion [options] Output report on dispersion. --recalculate option will rebuild cached dispersion info and save builder --verbose option will display dispersion graph broken down by tier You can filter which tiers are evaluated to drill down using a regex in the optional search_filter argument. i.e. swift-ring-builder dispersion "r\d+z\d+$" -v ... would only display rows for the zone tiers swift-ring-builder dispersion ".*\-[^/]*$" -v ... would only display rows for the server tiers The reports columns are: Tier : the name of the tier parts : the total number of partitions with assignment in the tier % : the percentage of parts in the tier with replicas over assigned max : maximum replicas a part should have assigned at the tier 0 - N : the number of parts with that many replicas assigned e.g. Tier: parts % max 0 1 2 3 r1z1 1022 79.45 1 2 210 784 28 r1z1 has 1022 total parts assigned, 79% of them have more than the recommend max replica count of 1 assigned. Only 2 parts in the ring are *not* assigned in this tier (0 replica count), 210 parts have the recommend replica count of 1, 784 have 2 replicas, and 28 sadly have all three replicas in this tier. swift-ring-builder finish_increase_partition_power Finally removes the next_part_power flag. Has to be run after the swift-object-relinker tool has been used to cleanup old existing data. A write_ring command is needed to make the change take effect. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder increase_partition_power Increases the partition power by one. Needs to be run after prepare_increase_partition_power has been run and all existing data has been relinked using the swift-object-relinker tool. A write_ring command is needed to make the change take effect. Once the updated rings have been deployed to all servers you need to run the swift-object-relinker tool to cleanup old data. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder list_parts [] .. or swift-ring-builder list_parts --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Returns a 2 column list of all the partitions that are assigned to any of the devices matching the search values given. The first column is the assigned partition number and the second column is the number of device matches for that partition. The list is ordered from most number of matches to least. If there are a lot of devices to match against, this command could take a while to run. swift-ring-builder prepare_increase_partition_power Prepare the ring to increase the partition power by one. A write_ring command is needed to make the change take effect. Once the updated rings have been deployed to all servers you need to run the swift-object-relinker tool to relink existing data. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder pretend_min_part_hours_passed Resets the clock on the last time a rebalance happened, thus circumventing the min_part_hours check. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you run this command and deploy rebalanced rings before a replication pass completes, you may introduce unavailability in your cluster. This has an end-user impact. swift-ring-builder rebalance [options] Attempts to rebalance the ring by reassigning partitions that haven't been recently reassigned. swift-ring-builder remove [search-value ...] [--yes] or swift-ring-builder remove --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Removes the device(s) from the ring. This should normally just be used for a device that has failed. For a device you wish to decommission, it's best to set its weight to 0, wait for it to drain all its data, then use this remove command. This will not take effect until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder search or swift-ring-builder search --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Shows information about matching devices. swift-ring-builder set_info :[R:]/_ [ :[R:]/_] ... [--yes] or swift-ring-builder set_info --ip --port --replication-ip --replication-port --device --meta --change-ip --change-port --change-replication-ip --change-replication-port --change-device --change-meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. For each search-value, resets the matched device's information. This information isn't used to assign partitions, so you can use 'write_ring' afterward to rewrite the current ring with the newer device information. Any of the parts are optional in the final :/_ parameter; just give what you want to change. For instance set_info d74 _"snet: 5.6.7.8" would just update the meta data for device id 74. Option --yes assume a yes response to all questions.test.unit.cli.test_ringbuilder.TestCommands.test_main_single_argument test.unit.cli.test_ringbuilder.TestCommands.test_main_single_argument ... ok test.unit.cli.test_ringbuilder.TestCommands.test_main_with_safe test.unit.cli.test_ringbuilder.TestCommands.test_main_with_safe ... ok test.unit.cli.test_ringbuilder.TestCommands.test_no_warn_when_balanced test.unit.cli.test_ringbuilder.TestCommands.test_no_warn_when_balanced ... ok test.unit.account.test_backend.TestAccountBroker.test_reclaim test.unit.account.test_backend.TestAccountBroker.test_reclaim ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_overlapping_shard_ranges test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_overlapping_shard_ranges ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested_500 test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested_500 ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested_too_many_segments test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_nested_too_many_segments ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_per_policy_cont_count_migration_impossible test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_per_policy_cont_count_migration_impossible ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_non_ascii test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_non_ascii ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_not_a_manifest test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_not_a_manifest ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_segment_404 test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_segment_404 ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_whole test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_whole ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_whole_404 test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_whole_404 ... ok test.unit.account.test_server.TestAccountController.test_GET_accept_xml test.unit.account.test_server.TestAccountController.test_GET_accept_xml ... ok test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_whole_old_swift test.unit.common.middleware.test_slo.TestSloDeleteManifest.test_handle_multipart_delete_whole_old_swift ... ok test.unit.account.test_server.TestAccountController.test_GET_empty_account_json test.unit.account.test_server.TestAccountController.test_GET_empty_account_json ... ok swift-ring-builder set_min_part_hours Changes the to the given . This should be set to however long a full replication/update cycle takes. We're working on a way to determine this more easily than scanning logs. swift-ring-builder set_overload [%] Changes the overload factor to the given . A rebalance is needed to make the change take effect. swift-ring-builder set_region [ set_region --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' regions. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_replicas Changes the replica count to the given . may be a floating-point value, in which case some partitions will have floor() replicas and some will have ceiling() in the correct proportions. A rebalance is needed to make the change take effect. swift-ring-builder set_weight [ ] ... [--yes] or swift-ring-builder set_weight --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. and are the search weight and new weight values respectively. Any of the options are optional in both cases. Resets the devices' weights. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_zone [ set_zone --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' zones. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder validate Just runs the validation routines on the ring. swift-ring-builder version swift-ring-builder write_builder [min_part_hours] Recreate a builder from a ring file (lossy) if you lost your builder backups. (Protip: don't lose your builder backups). [min_part_hours] is one of those numbers lost to the builder, you can change it with set_min_part_hours. swift-ring-builder write_ring Just rewrites the distributable ring file. This is done automatically after a successful rebalance, so really this is only useful after one or more 'set_info' calls when no rebalance is needed but you want to send out the new device information. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included. Quick list: add cancel_increase_partition_power create dispersion finish_increase_partition_power increase_partition_power list_parts prepare_increase_partition_power pretend_min_part_hours_passed rebalance remove search set_info set_min_part_hours set_overload set_region set_replicas set_weight set_zone validate version write_builder write_ring Exit codes: 0 = operation successful 1 = operation completed with warnings 2 = error /tmp/tmpw121mmhd/tmp3qugwvzb, build version 4, id be862c6cb8e2429cb7ec0b1b6510e1dc 64 partitions, 3.000000 replicas, 4 regions, 4 zones, 4 devices, 2-byte IDs, 100.00 balance, 0.00 dispersion The minimum number of hours before a partition can be reassigned is 1 (0:00:00 remaining) The overload factor is 0.00% (0.000000) Ring file /tmp/tmpw121mmhd/tmp3qugwvzb.ring.gz not found, probably it hasn't been written yet Devices: id region zone ip address:port replication ip:port name weight partitions balance flags meta 0 0 0 127.0.0.1:6200 127.0.0.1:6200 sda1 100.00 0 -100.00 some meta data 1 1 1 127.0.0.2:6201 127.0.0.2:6201 sda2 100.00 0 -100.00 2 2 2 127.0.0.3:6202 127.0.0.3:6202 sdc3 100.00 0 -100.00 3 3 3 127.0.0.4:6203 127.0.0.4:6203 sdd4 100.00 0 -100.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 5.00. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 6.00. Dispersion is now 0.00 swift-ring-builder add [r]z-:[R:]/_ [[r]z-:[R:]/_ ] ... Where and are replication ip and port. or swift-ring-builder add --region --zone --ip --port [--replication-ip ] [--replication-port ] --device --weight [--meta ] Adds devices to the ring with the given information. No partitions will be assigned to the new device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once.test.unit.cli.test_ringbuilder.TestCommands.test_parse_add_values_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_parse_add_values_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_parse_list_parts_values_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_parse_list_parts_values_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_parse_remove_values_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_parse_remove_values_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_parse_search_values_new_format test.unit.cli.test_ringbuilder.TestCommands.test_parse_search_values_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_parse_search_values_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_parse_search_values_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_parse_search_values_old_format test.unit.cli.test_ringbuilder.TestCommands.test_parse_search_values_old_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_parse_set_info_values_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_parse_set_info_values_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_parse_set_region_values_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_parse_set_region_values_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_parse_set_weight_values_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_parse_set_weight_values_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_parse_set_zone_values_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_parse_set_zone_values_number_of_arguments ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_shard_ranges_in_found_state test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_shard_ranges_in_found_state ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_bad_etag_json test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_bad_etag_json ... ok test.unit.account.test_server.TestAccountController.test_GET_empty_account_plain test.unit.account.test_server.TestAccountController.test_GET_empty_account_plain ... ok test.unit.account.test_backend.TestAccountBroker.test_reverse_prefix_delim test.unit.account.test_backend.TestAccountBroker.test_reverse_prefix_delim ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_failure test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_failure ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_per_policy_cont_count_migration_with_deleted test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_per_policy_cont_count_migration_with_deleted ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_initiate test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_multipart_uploads_initiate ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_upload_part_missing_key test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_bucket_upload_part_missing_key ... ok test.unit.account.test_server.TestAccountController.test_GET_empty_account_xml test.unit.account.test_server.TestAccountController.test_GET_empty_account_xml ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_method_ratelimited test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_method_ratelimited ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_failure_json test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_failure_json ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_success test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_success ... ok test.unit.account.test_server.TestAccountController.test_GET_invalid_accept test.unit.account.test_server.TestAccountController.test_GET_invalid_accept ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_no_ratelimiting_configured test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_no_ratelimiting_configured ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_read_default_backend_ratelimit_conf test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_read_default_backend_ratelimit_conf ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_success_json test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_long_running_put_success_json ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_allow_empty_last_segment test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_allow_empty_last_segment ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_bad_data test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_bad_data ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_batched_reclaim test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_batched_reclaim ... ok test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_unhandled_request test.unit.common.middleware.test_backend_ratelimit.TestBackendRatelimitMiddleware.test_unhandled_request ... ok swift-ring-builder list_parts [] .. or swift-ring-builder list_parts --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Returns a 2 column list of all the partitions that are assigned to any of the devices matching the search values given. The first column is the assigned partition number and the second column is the number of device matches for that partition. The list is ordered from most number of matches to least. If there are a lot of devices to match against, this command could take a while to run. swift-ring-builder remove [search-value ...] [--yes] or swift-ring-builder remove --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Removes the device(s) from the ring. This should normally just be used for a device that has failed. For a device you wish to decommission, it's best to set its weight to 0, wait for it to drain all its data, then use this remove command. This will not take effect until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder search or swift-ring-builder search --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Shows information about matching devices. swift-ring-builder search or swift-ring-builder search --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Shows information about matching devices. swift-ring-builder set_region [ set_region --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' regions. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_region [ set_region --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' regions. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_weight [ ] ... [--yes] or swift-ring-builder set_weight --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. and are the search weight and new weight values respectively. Any of the options are optional in both cases. Resets the devices' weights. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_weight [ ] ... [--yes] or swift-ring-builder set_weight --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. and are the search weight and new weight values respectively. Any of the options are optional in both cases. Resets the devices' weights. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_zone [ set_zone --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' zones. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_zone [ set_zone --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' zones. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 768 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 No partitions could be reassigned. The time between rebalances must be at least min_part_hours: 1 hours (1:00:00 remaining)test.unit.cli.test_ringbuilder.TestCommands.test_pretend_min_part_hours_passed test.unit.cli.test_ringbuilder.TestCommands.test_pretend_min_part_hours_passed ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance test.unit.cli.test_ringbuilder.TestCommands.test_rebalance ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_failure_does_not_reset_last_moves_epoch test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_failure_does_not_reset_last_moves_epoch ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_min_part_hours_not_passed test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_min_part_hours_not_passed ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_no_device_change test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_no_device_change ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_no_devices test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_no_devices ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_part_power_increase test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_part_power_increase ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_remove_off_end_trims_dev_list test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_remove_off_end_trims_dev_list ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_remove_zero_weighted_device test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_remove_zero_weighted_device ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_removed_devices test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_removed_devices ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_shrink_threshold test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_shrink_threshold ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_per_policy_cont_count_migration_with_single_policy test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_per_policy_cont_count_migration_with_single_policy ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_check_data test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_check_data ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_resets_time_remaining test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_resets_time_remaining ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_saves_dispersion_improvement test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_saves_dispersion_improvement ... ok test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_with_seed test.unit.cli.test_ringbuilder.TestCommands.test_rebalance_with_seed ... ok test.unit.cli.test_ringbuilder.TestCommands.test_remove_all_devices test.unit.cli.test_ringbuilder.TestCommands.test_remove_all_devices ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_bad_destination_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_bad_destination_account ... ok test.unit.cli.test_ringbuilder.TestCommands.test_remove_device test.unit.cli.test_ringbuilder.TestCommands.test_remove_device ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_destination_leading_slash test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_destination_leading_slash ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_newest test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_newest ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_no_object_in_destination test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_no_object_in_destination ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_not_found_reading_source test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_not_found_reading_source ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_server_error_reading_source test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_server_error_reading_source ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_source_larger_than_max_file_size test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_source_larger_than_max_file_size ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_check_data_bad test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_check_data_bad ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_disallow_empty_first_segment test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_disallow_empty_first_segment ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_source_with_slashes_destination_leading_slash test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_source_with_slashes_destination_leading_slash ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_chexor test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_chexor ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_source_with_slashes_in_name test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_source_with_slashes_in_name ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_source_zero_content_length test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_source_zero_content_length ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_with_metadata test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_account_with_metadata ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_across_containers test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_across_containers ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '221'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_complete_multipart_upload_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_complete_multipart_upload_acl_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_complete_multipart_upload_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_complete_multipart_upload_acl_with_write_permission ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_policy_stats_tracking test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_policy_stats_tracking ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_ts_is_linked_to_part_power_minus_2_ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_conflicting_ts_is_linked_to_part_power_minus_2_ok ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_destination_leading_slash test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_destination_leading_slash ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_fast_heartbeat test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_fast_heartbeat ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_in_OPTIONS_response test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_in_OPTIONS_response ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_in_OPTIONS_response_CORS test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_in_OPTIONS_response_CORS ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_invalid_data test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_invalid_data ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_no_xml test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_no_xml ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_newest test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_newest ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_no_destination_header test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_no_destination_header ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_skip_etag_check test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_skip_etag_check ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_container_table_migration test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_container_table_migration ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_skip_size_check test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_skip_size_check ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_no_object_in_destination test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_no_object_in_destination ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_not_found_reading_source test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_not_found_reading_source ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_creation test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_creation ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_server_error_reading_source test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_server_error_reading_source ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_headers_no_updates test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_headers_no_updates ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_skip_size_check_no_early_bailout test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_skip_size_check_no_early_bailout ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_headers_with_updates test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_headers_with_updates ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_skip_size_check_still_uses_min_size test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_skip_size_check_still_uses_min_size ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_larger_than_max_file_size test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_larger_than_max_file_size ... ok test.unit.account.test_server.TestAccountController.test_GET_leading_delimiter test.unit.account.test_server.TestAccountController.test_GET_leading_delimiter ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_policy_table_cont_count_do_migrations test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_policy_table_cont_count_do_migrations ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_success test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_success ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_success_conditional test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_success_conditional ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_success_unicode test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_success_unicode ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_with_manipulator_callback test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_with_manipulator_callback ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_metadata test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_metadata ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_with_slashes_destination_leading_slash test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_with_slashes_destination_leading_slash ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_with_slashes_in_name test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_with_slashes_in_name ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_zero_content_length test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_source_zero_content_length ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_with_metadata test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_with_metadata ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_shrink_threshold_with_tombstones test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_shrink_threshold_with_tombstones ... ok Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (75.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 No partitions could be reassigned. The time between rebalances must be at least min_part_hours: 1 hours (0:24:00 remaining) Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 No partitions could be reassigned. There is no need to do so at this time Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 1000.0 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 No partitions could be reassigned. The time between rebalances must be at least min_part_hours: 1 hours (1:00:00 remaining) Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 ------------------------------------------------------------------------------- An error has occurred during ring validation. Common causes of failure are rings that are empty or do not have enough devices to accommodate the replica count. Original exception message: There are no devices in this ring, or all devices have been deleted ------------------------------------------------------------------------------- Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Partition power increase in progress. You need to finish the increase first before rebalancing. Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 0 (0.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 0 (0.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 48 (75.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 20 (31.25%) partitions. Balance is now 24.48. Dispersion is now 0.00 ------------------------------------------------------------------------------- NOTE: Balance of 24.48 indicates you should push this ring, wait at least 1 hours, and rebalance/repush. ------------------------------------------------------------------------------- Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 64 (100.00%) partitions. Balance is now 100.00. Dispersion is now 33.33 ------------------------------------------------------------------------------- NOTE: Dispersion of 33.333333 indicates some parts are not optimally dispersed. You may want to adjust some device weights, increase the overload or review the dispersion report. ------------------------------------------------------------------------------- Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 64 (100.00%) partitions. Balance is now 100.00. Dispersion is now 16.67 ------------------------------------------------------------------------------- NOTE: Dispersion of 16.666667 indicates some parts are not optimally dispersed. You may want to adjust some device weights, increase the overload or review the dispersion report. ------------------------------------------------------------------------------- Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Matched more than one device: d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" d1r1z1-127.0.0.2:6201R127.0.0.2:6201/sda2_"" d2r2z2-127.0.0.3:6202R127.0.0.3:6202/sdc3_"" d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"" d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d1r1z1-127.0.0.2:6201R127.0.0.2:6201/sda2_"" marked for removal and will be removed next rebalance. d2r2z2-127.0.0.3:6202R127.0.0.3:6202/sdc3_"" marked for removal and will be removed next rebalance. d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. Device d4r2z3-test.test.com:6200Rr.test.com:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 d4r2z3-test.test.com:6200Rr.test.com:7000/sda3_"some meta data" marked for removal and will be removed next rebalance.test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_domain_new_format test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_domain_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_ipv4_new_format test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_ipv4_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_ipv4_old_format test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_ipv4_old_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_ipv6_new_format test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_ipv6_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_ipv6_old_format test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_ipv6_old_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_no_matching test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_no_matching ... ok test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_part_power_increase test.unit.cli.test_ringbuilder.TestCommands.test_remove_device_part_power_increase ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_policy_table_cont_count_update_get_stats test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_policy_table_cont_count_update_get_stats ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_delete_container test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_delete_container ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_with_single_range test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_with_single_range ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_with_validator_callback test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_multipart_put_with_validator_callback ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_delete_db_status test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_delete_db_status ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_x_fresh_metadata_no_updates test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_x_fresh_metadata_no_updates ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_single_ranges test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_single_ranges ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_unsatisfiable_ranges test.unit.common.middleware.test_slo.TestSloPutManifest.test_handle_unsatisfiable_ranges ... ok test.unit.account.test_server.TestAccountController.test_GET_limit_marker_json test.unit.account.test_server.TestAccountController.test_GET_limit_marker_json ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_x_fresh_metadata_with_updates test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_COPY_x_fresh_metadata_with_updates ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_manifest_put_bad_etag_fail test.unit.common.middleware.test_slo.TestSloPutManifest.test_manifest_put_bad_etag_fail ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_manifest_put_no_etag_success test.unit.common.middleware.test_slo.TestSloPutManifest.test_manifest_put_no_etag_success ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_COPY test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_COPY ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_COPY_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_COPY_account ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_DLO test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_DLO ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_DLO_manifest test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_DLO_manifest ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_put_with_x_copy_from test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_put_with_x_copy_from ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_manifest_put_with_etag_success test.unit.common.middleware.test_slo.TestSloPutManifest.test_manifest_put_with_etag_success ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_put_container test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_put_container ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '221'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '221'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_complete_multipart_upload_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_complete_multipart_upload_acl_without_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_initiate_multipart_upload_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_initiate_multipart_upload_acl_with_fullcontrol_permission ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_manifest_put_with_etag_with_quotes_success test.unit.common.middleware.test_slo.TestSloPutManifest.test_manifest_put_with_etag_with_quotes_success ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_data_meta_existing_newer_ts_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_data_meta_existing_newer_ts_files ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_single_donor_shrink_to_root test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_single_donor_shrink_to_root ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_put_with_x_copy_from_across_container test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_put_with_x_copy_from_across_container ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_put_with_x_copy_from_across_container_and_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_basic_put_with_x_copy_from_across_container_and_account ... ok test.unit.common.middleware.test_slo.TestSloPutManifest.test_put_manifest_too_quick_fail test.unit.common.middleware.test_slo.TestSloPutManifest.test_put_manifest_too_quick_fail ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_non_zero_content_length test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_non_zero_content_length ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_reclaim test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_reclaim ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "GET /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx5834f20fbfac46af9e051-0068c5706d" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "GET /sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx5834f20fbfac46af9e051-0068c5706d" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb92988b691524f5f92912-0068c5706d" "proxy-server 1824514" 0.0135 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "txe6e4cca46e1d4b99aec6b-0068c5706d" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx2f347f9a6dca4c4db7074-0068c5706d" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd9a9d6024a2c4960977b5-0068c5706d" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "GET /sdb1/3/a/0dbbab12c9264c5fb01ced16351f1171" 200 380 "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171?format=json&states=listing" "txd9a9d6024a2c4960977b5-0068c5706d" "proxy-server 1824514" 0.0191 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx1c305ac9ea4149b1b4215-0068c5706d" "proxy-server 1824514" 0.0094 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "txa22dc26217ce4f8797a14-0068c5706d" "proxy-server 1824514" 0.0135 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "GET /sdi1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txff8df3e255d34d92aa639-0068c5706d" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "GET /sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txff8df3e255d34d92aa639-0068c5706d" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx5e1879d4ad4544f89cbcf-0068c5706d" "proxy-server 1824514" 0.0118 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "txe2a13fb847ce44f7a0967-0068c5706d" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "GET /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txefe8640792dc4ba2bd7b1-0068c5706d" "proxy-server 1824514" 0.0130 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "GET /sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txefe8640792dc4ba2bd7b1-0068c5706d" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfe5b5fc7bccd4018b8609-0068c5706d" "proxy-server 1824514" 0.0173 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:57 +0000] "HEAD /sdb1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx6a6e1c1d3fe64ce18ce1f-0068c5706d" "proxy-server 1824514" 0.0056 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 412 - "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx340e423c5a6245149771e-0068c5706d" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdi1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 412 - "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx340e423c5a6245149771e-0068c5706d" "proxy-server 1824514" 0.0008 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx340e423c5a6245149771e-0068c5706d) proxy DEBUG: Ignoring 412 from primary (txn: tx340e423c5a6245149771e-0068c5706d) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 412 - "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx340e423c5a6245149771e-0068c5706d" "proxy-server 1824514" 0.0008 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx340e423c5a6245149771e-0068c5706d) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txeaf3bec925d848c996b8d-0068c5706e" "proxy-server 1824514" 0.0055 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdb1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx28f0e694a0454e2caeaab-0068c5706e" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 304 - "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx0e670fe79ce24858a2ceb-0068c5706e" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 304 - "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx0e670fe79ce24858a2ceb-0068c5706e" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdi1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 304 - "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx0e670fe79ce24858a2ceb-0068c5706e" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx96141893500f4699916c8-0068c5706e" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "txa8f5995b70dd43d59d182-0068c5706e" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdi1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 304 - "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx5499d804a00749daa006b-0068c5706e" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 304 - "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx5499d804a00749daa006b-0068c5706e" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 304 - "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx5499d804a00749daa006b-0068c5706e" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx5a44e78f2a864521b3d5c-0068c5706e" "proxy-server 1824514" 0.0134 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdb1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "txe57bd4d6a6a145c79fefc-0068c5706e" "proxy-server 1824514" 0.0134 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txd2dba9b0a08547cea04ee-0068c5706e" "proxy-server 1824514" 0.0008 "-" 1824514 3test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_copy_symlink test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_copy_symlink ... ok test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_copy_symlink_new_target test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_copy_symlink_new_target ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_double_check_trailing_delimiter test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_double_check_trailing_delimiter ... ok test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_copy_symlink_target test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_copy_symlink_target ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_non_zero_content_length_with_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_non_zero_content_length_with_account ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_not_found_reading_source test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_not_found_reading_source ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_not_found_reading_source_and_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_not_found_reading_source_and_account ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_server_error_reading_source test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_server_error_reading_source ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_server_error_reading_source_and_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_server_error_reading_source_and_account ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_source_larger_than_max_file_size test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_source_larger_than_max_file_size ... ok test.unit.account.test_server.TestAccountController.test_GET_limit_marker_plain test.unit.account.test_server.TestAccountController.test_GET_limit_marker_plain ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_bad_x_copy_from_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_bad_x_copy_from_account ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_leading_slash_and_slashes_in_x_copy_from test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_leading_slash_and_slashes_in_x_copy_from ... ok test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_copy_symlink_with_slo_query test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_copy_symlink_with_slo_query ... ok test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_static_link_to_new_slo_manifest test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_static_link_to_new_slo_manifest ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_leading_slash_and_slashes_in_x_copy_from_acct test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_leading_slash_and_slashes_in_x_copy_from_acct ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_leading_slash_in_x_copy_from test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_leading_slash_in_x_copy_from ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_leading_slash_in_x_copy_from_and_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_leading_slash_in_x_copy_from_and_account ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_empty test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_empty ... ok test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_static_link_to_old_slo_manifest test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_static_link_to_old_slo_manifest ... ok test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_static_link_to_really_old_slo_manifest test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_static_link_to_really_old_slo_manifest ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'no', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'no', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_no_object_in_x_copy_from test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_no_object_in_x_copy_from ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_no_object_in_x_copy_from_and_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_no_object_in_x_copy_from_and_account ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_object_metadata test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_object_metadata ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_object_metadata_and_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_object_metadata_and_account ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_initiate_multipart_upload_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_initiate_multipart_upload_acl_with_write_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_initiate_multipart_upload_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_initiate_multipart_upload_acl_without_permission ... ok test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_reverse_prefix_delim test.unit.account.test_backend.TestAccountBrokerBeforePerPolicyContainerTrack.test_reverse_prefix_delim ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_add test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_add ... ok test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_static_link_to_slo_manifest_slo_etag test.unit.common.middleware.test_symlink.SymlinkCopyingTestCase.test_static_link_to_slo_manifest_slo_etag ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_overload test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_overload ... ok test.unit.common.middleware.test_tempauth.TestDefinitiveAuth.test_blank_prefix test.unit.common.middleware.test_tempauth.TestDefinitiveAuth.test_blank_prefix ... ok test.unit.common.middleware.test_tempauth.TestDefinitiveAuth.test_default_prefix test.unit.common.middleware.test_tempauth.TestDefinitiveAuth.test_default_prefix ... ok test.unit.common.middleware.test_tempauth.TestDefinitiveAuth.test_multiple_prefixes test.unit.common.middleware.test_tempauth.TestDefinitiveAuth.test_multiple_prefixes ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_part_power test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_part_power ... ok test.unit.common.middleware.test_tempauth.TestDefinitiveAuth.test_noreseller_prefix test.unit.common.middleware.test_tempauth.TestDefinitiveAuth.test_noreseller_prefix ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_slashes_in_x_copy_from test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_slashes_in_x_copy_from ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_random_seed test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_random_seed ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_slashes_in_x_copy_from_and_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_slashes_in_x_copy_from_and_account ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_remove test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_remove ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_replicas test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_replicas ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_rounds test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_rounds ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_save test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_save ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_set_weight test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_bad_set_weight ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_spaces_in_x_copy_from test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_spaces_in_x_copy_from ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_good test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_good ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_invalid_json test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_invalid_json ... ok test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_json_not_object test.unit.cli.test_ring_builder_analyzer.TestParseScenario.test_json_not_object ... ok test.unit.common.middleware.test_tempauth.TestTokenHandling.test_invalid_tokens test.unit.common.middleware.test_tempauth.TestTokenHandling.test_invalid_tokens ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_exception test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_exception ... ok test.unit.common.middleware.test_tempauth.TestTokenHandling.test_service_token_given_and_needed test.unit.common.middleware.test_tempauth.TestTokenHandling.test_service_token_given_and_needed ... ok test.unit.common.middleware.test_tempauth.TestTokenHandling.test_service_token_omitted test.unit.common.middleware.test_tempauth.TestTokenHandling.test_service_token_omitted ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_spaces_in_x_copy_from_and_account test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_spaces_in_x_copy_from_and_account ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_unicode test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_copy_with_unicode ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_no_object_in_path_pass_through test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_no_object_in_path_pass_through ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_user_input test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_compact_user_input ... ok test.unit.common.middleware.test_tempauth.TestTokenHandling.test_tokens_set_remote_user test.unit.common.middleware.test_tempauth.TestTokenHandling.test_tokens_set_remote_user ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesCopyingTestCase.test_copy_first_version test.unit.common.middleware.test_versioned_writes.VersionedWritesCopyingTestCase.test_copy_first_version ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_bucket_acl_GET test.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_bucket_acl_GET ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_object_pass_through_methods test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_object_pass_through_methods ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_static_large_object test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_static_large_object ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_static_large_object_manifest test.unit.common.middleware.test_copy.TestServerSideCopyMiddleware.test_static_large_object_manifest ... ok test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_exceeded test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_exceeded ... ok test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_exceeded_readline test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_exceeded_readline ... ok test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_read_sized test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_read_sized ... ok test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_whole test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_whole ... ok test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_whole_readline test.unit.common.middleware.test_formpost.TestCappedFileLikeObject.test_whole_readline ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_data_meta_existing_ts_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_data_meta_existing_ts_files ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesCopyingTestCase.test_copy_new_version test.unit.common.middleware.test_versioned_writes.VersionedWritesCopyingTestCase.test_copy_new_version ... ok test.unit.account.test_server.TestAccountController.test_GET_limit_marker_xml test.unit.account.test_server.TestAccountController.test_GET_limit_marker_xml ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_auth_scheme test.unit.common.middleware.test_formpost.TestFormPost.test_auth_scheme ... ok test.unit.account.test_server.TestAccountController.test_GET_log_requests_false test.unit.account.test_server.TestAccountController.test_GET_log_requests_false ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_bucket_canned_acl_PUT_with_s3acl test.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_bucket_canned_acl_PUT_with_s3acl ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesCopyingTestCase.test_copy_new_version_different_account test.unit.common.middleware.test_versioned_writes.VersionedWritesCopyingTestCase.test_copy_new_version_different_account ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesCopyingTestCase.test_copy_object_no_versioning_with_container_config_true test.unit.common.middleware.test_versioned_writes.VersionedWritesCopyingTestCase.test_copy_object_no_versioning_with_container_config_true ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_chrome test.unit.common.middleware.test_formpost.TestFormPost.test_chrome ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_get_info test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_get_info ... ok Loaded db broker for a/c test.unit.common.middleware.test_formpost.TestFormPost.test_completely_non_int_expires test.unit.common.middleware.test_formpost.TestFormPost.test_completely_non_int_expires ... ok test.unit.common.middleware.test_xprofile.TestProfilers.test_runcall test.unit.common.middleware.test_xprofile.TestProfilers.test_runcall ... ok test.unit.common.middleware.test_xprofile.TestProfilers.test_runctx test.unit.common.middleware.test_xprofile.TestProfilers.test_runctx ... ok test.unit.common.middleware.test_xprofile.TestStats2.test_func_to_dict test.unit.common.middleware.test_xprofile.TestStats2.test_func_to_dict ... ok test.unit.common.middleware.test_xprofile.TestStats2.test_to_csv test.unit.common.middleware.test_xprofile.TestStats2.test_to_csv ... ok Loaded db broker for a/c test.unit.common.middleware.test_xprofile.TestStats2.test_to_json test.unit.common.middleware.test_xprofile.TestStats2.test_to_json ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'no', 'Content-Type': 'application/directory'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_multipart_uploads_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_multipart_uploads_acl_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_multipart_uploads_acl_with_read_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_multipart_uploads_acl_with_read_permission ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_curl_with_unicode test.unit.common.middleware.test_formpost.TestFormPost.test_curl_with_unicode ... ok Loaded db broker for a/c test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_get_info_no_stale_reads test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_get_info_no_stale_reads ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_deprecated_options test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_deprecated_options ... ok test.unit.common.middleware.test_xprofile.TestStats2.test_to_ods test.unit.common.middleware.test_xprofile.TestStats2.test_to_ods ... ok test.unit.common.middleware.test_xprofile.TestXProfile.test_get_profiler test.unit.common.middleware.test_xprofile.TestXProfile.test_get_profiler ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_empty_account test.unit.common.middleware.test_formpost.TestFormPost.test_empty_account ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_empty_v1 test.unit.common.middleware.test_formpost.TestFormPost.test_empty_v1 ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_does_not_exist test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_does_not_exist ... ok test.unit.common.test_daemon.TestRunDaemon.test_fork_workers test.unit.common.test_daemon.TestRunDaemon.test_fork_workers ... ok test.unit.common.test_daemon.TestRunDaemon.test_forked_worker test.unit.common.test_daemon.TestRunDaemon.test_forked_worker ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_get_info_stale_read_ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_get_info_stale_read_ok ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_invalid test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_invalid ... ok test.unit.common.test_daemon.TestRunDaemon.test_restart_workers test.unit.common.test_daemon.TestRunDaemon.test_restart_workers ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_explorer test.unit.common.middleware.test_formpost.TestFormPost.test_explorer ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_data_meta_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_data_meta_files ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_firefox test.unit.common.middleware.test_formpost.TestFormPost.test_firefox ... ok test.unit.common.test_daemon.TestRunDaemon.test_run test.unit.common.test_daemon.TestRunDaemon.test_run ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_formpost_with_multiple_container_keys test.unit.common.middleware.test_formpost.TestFormPost.test_formpost_with_multiple_container_keys ... ok Loaded db broker for a/c test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0146 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "DELETE /sda1/./a" 400 20 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0148 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0127 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "DELETE /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0027 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a/c1" 204 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0140 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0111 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "DELETE /sda1/p/a" 400 26 "-" "-" "-" 0.0001 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0147 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "GET /sda1/p/a" 200 113 "-" "-" "-" 0.0142 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0171 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0020 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0131 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "GET /sda1/p/a" 200 113 "-" "-" "-" 0.0020 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0051 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "GET /sda1/p/a" 406 - "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0131 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:57 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0020 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0131 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 233 "-" "-" "-" 0.0156 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0110 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0188 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 68 "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 400 21 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0029 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.0" 201 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.0.0" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.0.1" 201 - "-" "-" "-" 0.0097 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.0.2" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.1" 201 - "-" "-" "-" 0.0137 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.1.0" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.1.1" 201 - "-" "-" "-" 0.0137 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.1.2" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.2" 201 - "-" "-" "-" 0.0137 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.2.0" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.2.1" 201 - "-" "-" "-" 0.0136 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/.sub.2.2" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0140 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 45 "-" "-" "-" 0.0136 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 27 "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c0" 201 - "-" "-" "-" 0.0115 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0015 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0015 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c3" 201 - "-" "-" "-" 0.0257 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c4" 201 - "-" "-" "-" 0.0014 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 338 "-" "-" "-" 0.0141 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 225 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c0" 201 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0136 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c3" 201 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c4" 201 - "-" "-" "-" 0.0134 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 9 "-" "-" "-" 0.0018 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0147 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0148 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c0" 201 - "-" "-" "-" 0.0010 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0137 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0015 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c3" 201 - "-" "-" "-" 0.0177 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c4" 201 - "-" "-" "-" 0.0015 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 562 "-" "-" "-" 0.0103 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 397 "-" "-" "-" 0.0304 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824502 -test.unit.account.test_server.TestAccountController.test_GET_log_requests_true test.unit.account.test_server.TestAccountController.test_GET_log_requests_true ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_invalid_deprecated_options test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_invalid_deprecated_options ... ok test.unit.cli.test_ringbuilder.TestCommands.test_search_device_domain_new_format test.unit.cli.test_ringbuilder.TestCommands.test_search_device_domain_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_search_device_ipv4_new_format test.unit.cli.test_ringbuilder.TestCommands.test_search_device_ipv4_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_search_device_ipv4_old_format test.unit.cli.test_ringbuilder.TestCommands.test_search_device_ipv4_old_format ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:read:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:read:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_multipart_uploads_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_multipart_uploads_acl_without_permission ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_get_policy_stats test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_get_policy_stats ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_parts_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_parts_acl_with_fullcontrol_permission ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_formpost_with_multiple_keys test.unit.common.middleware.test_formpost.TestFormPost.test_formpost_with_multiple_keys ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'X-Amz-Acl': 'public-read', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Grant AllUsers READ permission on the bucket /bucket fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the bucket /bucket fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e'}Loaded db broker for a/c test.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_bucket_fails_with_neither_acl_header_nor_xml_PUT test.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_bucket_fails_with_neither_acl_header_nor_xml_PUT ... ok test.unit.cli.test_ringbuilder.TestCommands.test_search_device_ipv6_new_format test.unit.cli.test_ringbuilder.TestCommands.test_search_device_ipv6_new_format ... ok test.unit.common.test_daemon.TestRunDaemon.test_run_daemon test.unit.common.test_daemon.TestRunDaemon.test_run_daemon ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_formpost_with_origin test.unit.common.middleware.test_formpost.TestFormPost.test_formpost_with_origin ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_formpost_without_useragent test.unit.common.middleware.test_formpost.TestFormPost.test_formpost_without_useragent ... ok Loaded db broker for a/c Loaded db broker for a/c test.unit.cli.test_ringbuilder.TestCommands.test_search_device_ipv6_old_format test.unit.cli.test_ringbuilder.TestCommands.test_search_device_ipv6_old_format ... ok test.unit.account.test_server.TestAccountController.test_GET_multichar_delimiter test.unit.account.test_server.TestAccountController.test_GET_multichar_delimiter ... ok test.unit.cli.test_ringbuilder.TestCommands.test_search_device_no_matching test.unit.cli.test_ringbuilder.TestCommands.test_search_device_no_matching ... ok test.unit.cli.test_ringbuilder.TestCommands.test_search_device_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_search_device_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_server_overload_crazy_high test.unit.cli.test_ringbuilder.TestCommands.test_server_overload_crazy_high ... ok test.unit.common.test_daemon.TestRunDaemon.test_run_daemon_diff_tz test.unit.common.test_daemon.TestRunDaemon.test_run_daemon_diff_tz ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_half_upgraded_database test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_half_upgraded_database ... ok test.unit.common.test_daemon.TestRunDaemon.test_run_daemon_from_conf_dir_with_duplicate_var test.unit.common.test_daemon.TestRunDaemon.test_run_daemon_from_conf_dir_with_duplicate_var ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_global_content_type_encoding test.unit.common.middleware.test_formpost.TestFormPost.test_global_content_type_encoding ... ok test.unit.account.test_server.TestAccountController.test_GET_not_found_json test.unit.account.test_server.TestAccountController.test_GET_not_found_json ... ok test.unit.common.test_daemon.TestRunDaemon.test_run_daemon_from_conf_file_with_duplicate_var test.unit.common.test_daemon.TestRunDaemon.test_run_daemon_from_conf_file_with_duplicate_var ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_initialize_fail test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_initialize_fail ... ok Loaded db broker for a/c Loaded db broker for a/c test.unit.common.test_daemon.TestRunDaemon.test_run_deamon_from_conf_dir test.unit.common.test_daemon.TestRunDaemon.test_run_deamon_from_conf_dir ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_max_file_count_exceeded test.unit.common.middleware.test_formpost.TestFormPost.test_max_file_count_exceeded ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_options test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_conf_file_options ... ok test.unit.account.test_server.TestAccountController.test_GET_not_found_plain test.unit.account.test_server.TestAccountController.test_GET_not_found_plain ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_max_file_size_exceeded test.unit.common.middleware.test_formpost.TestFormPost.test_max_file_size_exceeded ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_dry_run_and_yes_is_invalid test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_dry_run_and_yes_is_invalid ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_deleted test.unit.cli.test_relinker.TestRelinker.test_cleanup_deleted ... ok test.unit.common.test_daemon.TestRunDaemon.test_run_deamon_from_conf_file test.unit.common.test_daemon.TestRunDaemon.test_run_deamon_from_conf_file ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_messed_up_start test.unit.common.middleware.test_formpost.TestFormPost.test_messed_up_start ... ok test.unit.account.test_server.TestAccountController.test_GET_not_found_xml test.unit.account.test_server.TestAccountController.test_GET_not_found_xml ... ok test.unit.account.test_server.TestAccountController.test_GET_over_limit test.unit.account.test_server.TestAccountController.test_GET_over_limit ... ok test.unit.common.test_daemon.TestRunDaemon.test_signal test.unit.common.test_daemon.TestRunDaemon.test_signal ... ok test.unit.common.test_daemon.TestRunDaemon.test_worker_disappears test.unit.common.test_daemon.TestRunDaemon.test_worker_disappears ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_is_status_deleted test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_is_status_deleted ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:read:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.test_formpost.TestFormPost.test_multiple_content_type_encoding test.unit.common.middleware.test_formpost.TestFormPost.test_multiple_content_type_encoding ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_no_container test.unit.common.middleware.test_formpost.TestFormPost.test_no_container ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_parts_acl_with_read_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_parts_acl_with_read_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_parts_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_list_parts_acl_without_permission ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_no_file_to_process test.unit.common.middleware.test_formpost.TestFormPost.test_no_file_to_process ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_list_container_iter_with_reserved_name test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_list_container_iter_with_reserved_name ... ok test.unit.common.test_daemon.TestRunDaemon.test_worker_disappears_in_cleanup test.unit.common.test_daemon.TestRunDaemon.test_worker_disappears_in_cleanup ... ok test.unit.common.test_daemon.TestRunDaemon.test_worker_kills_pids_in_cleanup test.unit.common.test_daemon.TestRunDaemon.test_worker_kills_pids_in_cleanup ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_no_redirect test.unit.common.middleware.test_formpost.TestFormPost.test_no_redirect ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_no_redirect_expired test.unit.common.middleware.test_formpost.TestFormPost.test_no_redirect_expired ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_no_redirect_invalid_sig test.unit.common.middleware.test_formpost.TestFormPost.test_no_redirect_invalid_sig ... ok test.unit.common.test_db_replicator.TestReplicatorSync.test_clean_up_after_deleted_brokers test.unit.common.test_db_replicator.TestReplicatorSync.test_clean_up_after_deleted_brokers ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': 'CY9rzUYh03PK3k6DJie09g==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '098f6bcd4621d373cade4e832627b4f6'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e', 'Content-Length': '0'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': 'CY9rzUYh03PK3k6DJie09g==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '098f6bcd4621d373cade4e832627b4f6', 'Content-Length': '0'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Transfer-Encoding': 'chunked', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': 'Je0by0I7C3IA9IX8X/ccjg==', 'Transfer-Encoding': 'chunked', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '25ed1bcb423b0b7200f485fc5ff71c8e'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_handle_acl_header_with_s3acl test.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_handle_acl_header_with_s3acl ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_object_acl_GET test.unit.common.middleware.s3api.test_acl.TestS3ApiAclCommonSetup.test_object_acl_GET ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_no_redirect_with_error test.unit.common.middleware.test_formpost.TestFormPost.test_no_redirect_with_error ... ok test.unit.common.test_db_replicator.TestReplicatorSync.test_local_ids test.unit.common.test_db_replicator.TestReplicatorSync.test_local_ids ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_no_v1 test.unit.common.middleware.test_formpost.TestFormPost.test_no_v1 ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_passthrough test.unit.common.middleware.test_formpost.TestFormPost.test_passthrough ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_device_filter test.unit.cli.test_relinker.TestRelinker.test_cleanup_device_filter ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_prefixed_and_not_prefixed_sigs_good test.unit.common.middleware.test_formpost.TestFormPost.test_prefixed_and_not_prefixed_sigs_good ... ok test.unit.common.test_db_replicator.TestReplicatorSync.test_replicator_sync test.unit.common.test_db_replicator.TestReplicatorSync.test_replicator_sync ... ok test.unit.account.test_server.TestAccountController.test_GET_prefix_delimiter_json test.unit.account.test_server.TestAccountController.test_GET_prefix_delimiter_json ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_list_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_list_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_list_parts_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_list_parts_error ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_prefixed_and_not_prefixed_sigs_unsupported test.unit.common.middleware.test_formpost.TestFormPost.test_prefixed_and_not_prefixed_sigs_unsupported ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_redirect test.unit.common.middleware.test_formpost.TestFormPost.test_redirect ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_enable test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_enable ... ok test.unit.common.test_db_replicator.TestReplicatorSync.test_rsync_then_merge test.unit.common.test_db_replicator.TestReplicatorSync.test_rsync_then_merge ... ok d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. Device d4r2z3-[3001:0:1234::c1c0:abcd:876]:8000R[3::10]:9000/sda30_"other meta data" with 3.14159265359 weight got id 4 d4r2z3-[3001:0:1234::c1c0:abcd:876]:8000R[3::10]:9000/sda30_"other meta data" marked for removal and will be removed next rebalance. Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" marked for removal and will be removed next rebalance. Search value matched 0 devices. The on-disk ring builder is unchanged. swift-ring-builder remove [search-value ...] [--yes] or swift-ring-builder remove --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Removes the device(s) from the ring. This should normally just be used for a device that has failed. For a device you wish to decommission, it's best to set its weight to 0, wait for it to drain all its data, then use this remove command. This will not take effect until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included. Partition power increase in progress. You need to finish the increase first before removing devices. Device d4r2z3-test.test.com:6200Rr.test.com:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Devices: id region zone ip address port replication ip replication port name weight partitions balance meta 4 2 3 test.test.com 6200 r.test.com 7000 sda3 3.14 2 33.67 some meta data Devices: id region zone ip address port replication ip replication port name weight partitions balance meta 0 0 0 127.0.0.1 6200 127.0.0.1 6200 sda1 100.00 0 -100.00 some meta data Devices: id region zone ip address port replication ip replication port name weight partitions balance meta 0 0 0 127.0.0.1 6200 127.0.0.1 6200 sda1 100.00 0 -100.00 some meta data Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Devices: id region zone ip address port replication ip replication port name weight partitions balance meta 4 2 3 2001:0:1234::c1c0:abcd:876 6200 2::10 7000 sda3 3.14 2 33.67 some meta data Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Devices: id region zone ip address port replication ip replication port name weight partitions balance meta 4 2 3 2001:0:1234::c1c0:abcd:876 6200 2::10 7000 sda3 3.14 2 33.67 some meta data No matching devices found swift-ring-builder search or swift-ring-builder search --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Shows information about matching devices. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included. Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data"test.unit.common.middleware.test_formpost.TestFormPost.test_redirect_allowed_deprecated_and_unsupported_digests test.unit.common.middleware.test_formpost.TestFormPost.test_redirect_allowed_deprecated_and_unsupported_digests ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_redirect_with_query test.unit.common.middleware.test_formpost.TestFormPost.test_redirect_with_query ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_safari test.unit.common.middleware.test_formpost.TestFormPost.test_safari ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info test.unit.cli.test_ringbuilder.TestCommands.test_set_info ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_all_devices test.unit.cli.test_ringbuilder.TestCommands.test_set_info_all_devices ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_already_exists test.unit.cli.test_ringbuilder.TestCommands.test_set_info_already_exists ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_domain_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_info_domain_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_ipv4_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_info_ipv4_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_ipv4_old_format test.unit.cli.test_ringbuilder.TestCommands.test_set_info_ipv4_old_format ... ok test.unit.common.test_swob.TestConditionalIfNoneMatch.test_list_match test.unit.common.test_swob.TestConditionalIfNoneMatch.test_list_match ... ok test.unit.common.test_swob.TestConditionalIfNoneMatch.test_list_no_match test.unit.common.test_swob.TestConditionalIfNoneMatch.test_list_no_match ... ok test.unit.common.test_swob.TestConditionalIfNoneMatch.test_match_star test.unit.common.test_swob.TestConditionalIfNoneMatch.test_match_star ... ok test.unit.common.test_swob.TestConditionalIfNoneMatch.test_quoted_simple_match test.unit.common.test_swob.TestConditionalIfNoneMatch.test_quoted_simple_match ... ok test.unit.common.test_swob.TestConditionalIfNoneMatch.test_simple_match test.unit.common.test_swob.TestConditionalIfNoneMatch.test_simple_match ... ok test.unit.common.test_utils.TestFsHasFreeSpace.test_bytes test.unit.common.test_utils.TestFsHasFreeSpace.test_bytes ... ok test.unit.common.test_utils.TestFsHasFreeSpace.test_bytes_using_file_descriptor test.unit.common.test_utils.TestFsHasFreeSpace.test_bytes_using_file_descriptor ... ok test.unit.common.test_utils.TestFsHasFreeSpace.test_percent test.unit.common.test_utils.TestFsHasFreeSpace.test_percent ... ok test.unit.common.test_utils.TestPunchHole.test_arg_bounds test.unit.common.test_utils.TestPunchHole.test_arg_bounds ... ok test.unit.common.test_utils.TestPunchHole.test_error test.unit.common.test_utils.TestPunchHole.test_error ... ok test.unit.common.test_utils.TestPunchHole.test_no_fallocate test.unit.common.test_utils.TestPunchHole.test_no_fallocate ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_single_content_type_encoding test.unit.common.middleware.test_formpost.TestFormPost.test_single_content_type_encoding ... ok test.unit.common.test_utils.TestPunchHole.test_punch_hole test.unit.common.test_utils.TestPunchHole.test_punch_hole ... ok test.unit.common.test_utils.TestSpliterator.test_big_input_string test.unit.common.test_utils.TestSpliterator.test_big_input_string ... ok test.unit.common.test_utils.TestSpliterator.test_chunk_boundaries test.unit.common.test_utils.TestSpliterator.test_chunk_boundaries ... ok test.unit.common.test_utils.TestSpliterator.test_closing test.unit.common.test_utils.TestSpliterator.test_closing ... ok test.unit.common.test_utils.TestSpliterator.test_no_empty_strings test.unit.common.test_utils.TestSpliterator.test_no_empty_strings ... ok test.unit.common.test_utils.TestSpliterator.test_overlap test.unit.common.test_utils.TestSpliterator.test_overlap ... ok test.unit.common.test_utils.TestSpliterator.test_running_out test.unit.common.test_utils.TestSpliterator.test_running_out ... ok test.unit.common.test_utils.TestSpliterator.test_string test.unit.common.test_utils.TestSpliterator.test_string ... ok test.unit.common.utils.test_config.TestAffinityKeyFunction.test_all_whitespace_value test.unit.common.utils.test_config.TestAffinityKeyFunction.test_all_whitespace_value ... ok test.unit.common.utils.test_config.TestAffinityKeyFunction.test_bogus_value test.unit.common.utils.test_config.TestAffinityKeyFunction.test_bogus_value ... ok test.unit.common.utils.test_config.TestAffinityKeyFunction.test_empty_value test.unit.common.utils.test_config.TestAffinityKeyFunction.test_empty_value ... ok test.unit.common.utils.test_config.TestAffinityKeyFunction.test_more_specific_after_less_specific test.unit.common.utils.test_config.TestAffinityKeyFunction.test_more_specific_after_less_specific ... ok test.unit.common.utils.test_config.TestAffinityKeyFunction.test_multiple test.unit.common.utils.test_config.TestAffinityKeyFunction.test_multiple ... ok test.unit.common.utils.test_config.TestAffinityKeyFunction.test_single_region test.unit.common.utils.test_config.TestAffinityKeyFunction.test_single_region ... ok test.unit.common.utils.test_config.TestAffinityKeyFunction.test_with_zone_zero test.unit.common.utils.test_config.TestAffinityKeyFunction.test_with_zone_zero ... ok test.unit.common.utils.test_logs.TestPipeMutex.test_blocking test.unit.common.utils.test_logs.TestPipeMutex.test_blocking ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_error ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_ipv6_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_info_ipv6_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_ipv6_old_format test.unit.cli.test_ringbuilder.TestCommands.test_set_info_ipv6_old_format ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_subrequest_does_not_pass_query test.unit.common.middleware.test_formpost.TestFormPost.test_subrequest_does_not_pass_query ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_subrequest_fails_no_redirect_503 test.unit.common.middleware.test_formpost.TestFormPost.test_subrequest_fails_no_redirect_503 ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_subrequest_fails_redirect_404 test.unit.common.middleware.test_formpost.TestFormPost.test_subrequest_fails_redirect_404 ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_no_matching test.unit.cli.test_ringbuilder.TestCommands.test_set_info_no_matching ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_set_info_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_info_values_no_devices test.unit.cli.test_ringbuilder.TestCommands.test_set_info_values_no_devices ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_min_part_hours test.unit.cli.test_ringbuilder.TestCommands.test_set_min_part_hours ... ok test.unit.common.utils.test_logs.TestPipeMutex.test_blocking_preserves_ownership test.unit.common.utils.test_logs.TestPipeMutex.test_blocking_preserves_ownership ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_min_part_hours_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_set_min_part_hours_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_overload test.unit.cli.test_ringbuilder.TestCommands.test_set_overload ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_negative test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_negative ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_non_numeric test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_non_numeric ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_percent test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_percent ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_truncated_attr_value test.unit.common.middleware.test_formpost.TestFormPost.test_truncated_attr_value ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_percent_strange_input test.unit.cli.test_ringbuilder.TestCommands.test_set_overload_percent_strange_input ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_device_filter_invalid test.unit.cli.test_relinker.TestRelinker.test_cleanup_device_filter_invalid ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_wrong_account test.unit.common.middleware.test_formpost.TestFormPost.test_wrong_account ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_x_delete_after test.unit.common.middleware.test_formpost.TestFormPost.test_x_delete_after ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': 'CY9rzUYh03PK3k6DJie09g==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '098f6bcd4621d373cade4e832627b4f6'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e', 'Content-Length': '0'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': 'CY9rzUYh03PK3k6DJie09g==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '098f6bcd4621d373cade4e832627b4f6', 'Content-Length': '0'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Transfer-Encoding': 'chunked', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'Content-Md5': 'CY9rzUYh03PK3k6DJie09g==', 'Transfer-Encoding': 'chunked', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '098f6bcd4621d373cade4e832627b4f6'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multi_upload_empty_body test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multi_upload_empty_body ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_abort test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_abort ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_x_delete_after_not_int test.unit.common.middleware.test_formpost.TestFormPost.test_x_delete_after_not_int ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_find_replace_enable test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_find_replace_enable ... ok fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 406, in DELETE self._delete_segments_bucket(req) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 55, in _delete_segments_bucket resp = req.get_response(self.app, 'HEAD') File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2445, in get_response resp = self.acl_handler.handle_acl( app, method, container, obj, headers) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 94, in handle_acl return getattr(ah, method)(app) ~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 208, in HEAD return self._handle_acl(app, 'DELETE') ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 150, in _handle_acl resp = self.req.get_acl_response(app, 'HEAD', container, '') File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_error_while_segment_bucket_delete test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_error_while_segment_bucket_delete ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_error_with_enabled_versioning test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_error_with_enabled_versioning ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_x_delete_at test.unit.common.middleware.test_formpost.TestFormPost.test_x_delete_at ... ok test.unit.common.middleware.test_formpost.TestFormPost.test_x_delete_at_not_int test.unit.common.middleware.test_formpost.TestFormPost.test_x_delete_at_not_int ... ok test.unit.common.utils.test_logs.TestPipeMutex.test_blocking_tpool test.unit.common.utils.test_logs.TestPipeMutex.test_blocking_tpool ... ok test.unit.common.utils.test_logs.TestPipeMutex.test_context_manager_api test.unit.common.utils.test_logs.TestPipeMutex.test_context_manager_api ... ok test.unit.common.utils.test_logs.TestPipeMutex.test_nonblocking test.unit.common.utils.test_logs.TestPipeMutex.test_nonblocking ... ok test.unit.common.utils.test_logs.TestPipeMutex.test_recursive test.unit.common.utils.test_logs.TestPipeMutex.test_recursive ... ok test.unit.common.utils.test_logs.TestPipeMutex.test_release_without_acquire test.unit.common.utils.test_logs.TestPipeMutex.test_release_without_acquire ... ok test.unit.common.utils.test_logs.TestPipeMutex.test_too_many_releases test.unit.common.utils.test_logs.TestPipeMutex.test_too_many_releases ... ok test.unit.common.utils.test_logs.TestPipeMutex.test_wrong_releaser test.unit.common.utils.test_logs.TestPipeMutex.test_wrong_releaser ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers_add_to_response_headers test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers_add_to_response_headers ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers_match_path test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers_match_path ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers_overwritten_by_response_header test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers_overwritten_by_response_header ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers_update test.unit.common.middleware.test_helpers.TestFakeSwiftStickyHeaders.test_sticky_headers_update ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_add_to_reconciler_queue test.unit.container.test_reconciler.TestReconcilerUtils.test_add_to_reconciler_queue ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_add_to_reconciler_queue_fails test.unit.container.test_reconciler.TestReconcilerUtils.test_add_to_reconciler_queue_fails ... ok test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACLWithConfiguredDomain.test_is_name_allowed_in_acl_with_token_scoped_to_other_tenant test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACLWithConfiguredDomain.test_is_name_allowed_in_acl_with_token_scoped_to_other_tenant ... ok test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACLWithConfiguredDomain.test_is_name_allowed_in_acl_with_token_scoped_to_tenant test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACLWithConfiguredDomain.test_is_name_allowed_in_acl_with_token_scoped_to_tenant ... ok test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACLWithConfiguredDomain.test_is_name_allowed_in_acl_with_unscoped_token test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACLWithConfiguredDomain.test_is_name_allowed_in_acl_with_unscoped_token ... ok test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_get_nonmanifest_passthrough test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_get_nonmanifest_passthrough ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_add_to_reconciler_queue_force test.unit.container.test_reconciler.TestReconcilerUtils.test_add_to_reconciler_queue_force ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_add_to_reconciler_queue_socket_error test.unit.container.test_reconciler.TestReconcilerUtils.test_add_to_reconciler_queue_socket_error ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_direct_delete_container_entry test.unit.container.test_reconciler.TestReconcilerUtils.test_direct_delete_container_entry ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_direct_delete_container_entry_with_errors test.unit.container.test_reconciler.TestReconcilerUtils.test_direct_delete_container_entry_with_errors ... ok test.unit.account.test_server.TestAccountController.test_GET_prefix_delimiter_plain test.unit.account.test_server.TestAccountController.test_GET_prefix_delimiter_plain ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_error_with_suspended_versioning test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_error_with_suspended_versioning ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_with_empty_versioning test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_with_empty_versioning ... ok test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_multi_range_partially_satisfiable_passthrough test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_multi_range_partially_satisfiable_passthrough ... ok test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_multi_range_passthrough test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_multi_range_passthrough ... ok test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_multi_range_starting_beyond_multipart_resp_length test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_multi_range_starting_beyond_multipart_resp_length ... ok test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_multi_range_unsatisfiable_passthrough test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_multi_range_unsatisfiable_passthrough ... ok test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_range_passthrough test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_range_passthrough ... ok test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_range_unsatisfiable_passthrough test.unit.common.middleware.test_slo.TestNonSloPassthrough.test_non_slo_range_unsatisfiable_passthrough ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_cache test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_cache ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_deleted test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_deleted ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_bad_keys test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_bad_keys ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_multiple test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_multiple ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_path test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_path ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_ranges test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_ranges ... ok test DEBUG: Run listdir on /tmp/tmp5jxcf1w8/node/sda1/objects/48 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 3/3 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 2 hash dirs processed (cleanup=True) (2 files, 0 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:57 09/13/25 GMT (0:00:00.053974 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:58 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpi2q7kvbw/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpi2q7kvbw/node/sda1/objects/292 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/3 test DEBUG: Relinking (cleanup): tolerating different inodes for tombstone with same timestamp: /tmp/tmpi2q7kvbw/node/sda1/objects/146/54a/92627ff55720ac3b2b6e5d0d8bd7f54a/1757769837.78773.ts to /tmp/tmpi2q7kvbw/node/sda1/objects/292/54a/92627ff55720ac3b2b6e5d0d8bd7f54a/1757769837.78773.ts test DEBUG: Removed /tmp/tmpi2q7kvbw/node/sda1/objects/146/54a/92627ff55720ac3b2b6e5d0d8bd7f54a/1757769837.78773.ts test DEBUG: Run listdir on /tmp/tmpi2q7kvbw/node/sda1/objects/146 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/3 test DEBUG: Removed /tmp/tmpi2q7kvbw/node/sda1/objects/36/54a/92627ff55720ac3b2b6e5d0d8bd7f54a/1757769837.78773.ts test DEBUG: Run listdir on /tmp/tmpi2q7kvbw/node/sda1/objects/36 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 3/3 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 2 hash dirs processed (cleanup=True) (2 files, 0 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:58 09/13/25 GMT (0:00:00.045056 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:58 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpm713qcjl/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpm713qcjl/node/sda1/objects/310 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmpm713qcjl/node/sda1/objects/155/417/9b1765ed844c733414f6a43d2da84417/1757769839.31194.meta test DEBUG: Removed /tmp/tmpm713qcjl/node/sda1/objects/155/417/9b1765ed844c733414f6a43d2da84417/1757769838.31194.data test DEBUG: Run listdir on /tmp/tmpm713qcjl/node/sda1/objects/155 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (0 files, 0 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:58 09/13/25 GMT (0:00:00.041951 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:58 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpihh31v7s/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpihh31v7s/node/sda1/objects/454 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmpihh31v7s/node/sda1/objects/227/c9b/e3100ba0b60cf82826f5d4695485bc9b/1757769840.44937.ts test DEBUG: Run listdir on /tmp/tmpihh31v7s/node/sda1/objects/227 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:58 09/13/25 GMT (0:00:00.028246 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:58 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpq9ebzwcz/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpq9ebzwcz/node/sda1/objects/469 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmpq9ebzwcz/node/sda1/objects/234/102/ea9a0d9c1d37dadb48aa1278bc65a102/1757769839.56496.meta test DEBUG: Removed /tmp/tmpq9ebzwcz/node/sda1/objects/234/102/ea9a0d9c1d37dadb48aa1278bc65a102/1757769838.56496.data test DEBUG: Run listdir on /tmp/tmpq9ebzwcz/node/sda1/objects/234 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (2 files, 0 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:58 09/13/25 GMT (0:00:00.028772 elapsed) test INFO: Processing files for policy platinum under /tmp/tmp8yxs9xr5/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp8yxs9xr5/node/sda1/objects/197/b5e/c54f1431a5d8d925caffc43e22465b5e/1757769838.67779.data to /tmp/tmp8yxs9xr5/node/sda1/objects/394/b5e/c54f1431a5d8d925caffc43e22465b5e/1757769838.67779.data test DEBUG: Run listdir on /tmp/tmp8yxs9xr5/node/sda1/objects/394 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:58 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp8yxs9xr5/node/sda1 (cleanup=True) test DEBUG: Removed /tmp/tmp8yxs9xr5/node/sda1/objects/197/b5e/c54f1431a5d8d925caffc43e22465b5e/1757769838.67779.data test DEBUG: Run listdir on /tmp/tmp8yxs9xr5/node/sda1/objects/197 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (0 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:58 09/13/25 GMT (0:00:00.019006 elapsed) test INFO: Processing files for policy platinum under /tmp/tmptzb1qwdi/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmptzb1qwdi/node/sda1/objects/56/a5e/382ec085c830f099d5d3547e8bdd2a5e/1757769838.79440.data to /tmp/tmptzb1qwdi/node/sda1/objects/112/a5e/382ec085c830f099d5d3547e8bdd2a5e/1757769838.79440.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:58 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmptzb1qwdi/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmptzb1qwdi/node/sda1/objects/112 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmptzb1qwdi/node/sda1/objects/56/a5e/382ec085c830f099d5d3547e8bdd2a5e/1757769838.79440.data test DEBUG: Run listdir on /tmp/tmptzb1qwdi/node/sda1/objects/56 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:58 09/13/25 GMT (0:00:00.022076 elapsed) test INFO: Processing files for policy platinum under /tmp/tmpysk85_9c/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpysk85_9c/node/sda1/objects/45/739/2d2a77e62ccd11d330e6217c7e55c739/1757769838.92777.data to /tmp/tmpysk85_9c/node/sda1/objects/90/739/2d2a77e62ccd11d330e6217c7e55c739/1757769838.92777.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:58 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpysk85_9c/node/none (cleanup=True) test DEBUG: Updating recon test INFO: 0 hash dirs processed (cleanup=True) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:58 09/13/25 GMT (0:00:00.010525 elapsed) test INFO: Processing files for policy platinum under /tmp/tmpt92imf6s/node/sda1 (cleanup=False) test WARNING: Unexpected file /tmp/tmpt92imf6s/node/sda1/objects/238/6fc/ee9a6b819bb22265c31c4e5d6c0c16fc/1757769839.03198.data: Bad fragment index: None: invalid literal for int() with base 10: 'None'test.unit.cli.test_relinker.TestRelinker.test_cleanup_diskfile_error test.unit.cli.test_relinker.TestRelinker.test_cleanup_diskfile_error ... ok fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_self_referential test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_self_referential ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_self_referential_last_segment test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_self_referential_last_segment ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_self_referential_non_ascii test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_self_referential_non_ascii ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_size_bytes test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_size_bytes ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_undersize_segment test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_undersize_segment ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_find_shard_ranges test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_find_shard_ranges ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_recently_deleted test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_recently_deleted ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_abort_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_abort_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_complete_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_complete_error ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_recently_recreated test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_recently_recreated ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_recently_split_brain test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_recently_split_brain ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_unsatisfiable_range test.unit.common.middleware.test_slo.TestSloMiddleware.test_bogus_input_unsatisfiable_range ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_container_listing test.unit.common.middleware.test_slo.TestSloMiddleware.test_container_listing ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_handle_multipart_no_obj test.unit.common.middleware.test_slo.TestSloMiddleware.test_handle_multipart_no_obj ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_list_containers_iter test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_list_containers_iter ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_slo_PUT_env_override test.unit.common.middleware.test_slo.TestSloMiddleware.test_slo_PUT_env_override ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_slo_header_assigned test.unit.common.middleware.test_slo.TestSloMiddleware.test_slo_header_assigned ... ok test.unit.common.middleware.test_slo.TestSloMiddleware.test_valid_input test.unit.common.middleware.test_slo.TestSloMiddleware.test_valid_input ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '13'} fake-swift DEBUG: Start tag expected, '<' not found, line 1, column 1 (, line 1) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '221'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_complete_s3acl test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_complete_s3acl ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_initiate_no_content_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_upload_initiate_no_content_type ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_get_range_manifest test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_get_range_manifest ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_get_segment_with_non_ascii_path test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_get_segment_with_non_ascii_path ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_diskfile_error_new_file_missing test.unit.cli.test_relinker.TestRelinker.test_cleanup_diskfile_error_new_file_missing ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_list_objects_iter_order_and_reverse test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_list_objects_iter_order_and_reverse ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_get_subrange_manifest test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_get_subrange_manifest ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_load_old_pending_puts test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_load_old_pending_puts ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_first_byte test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_first_byte ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_on_segment_boundaries test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_on_segment_boundaries ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_overlapping_end test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_overlapping_end ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'no', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_uploads_list test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_multipart_uploads_list ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_upload_part test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_upload_part ... ok test.unit.account.test_server.TestAccountController.test_GET_prefix_delimiter_xml test.unit.account.test_server.TestAccountController.test_GET_prefix_delimiter_xml ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_sub_slo test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_sub_slo ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_unsatisfiable test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_manifest_unsatisfiable ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_region test.unit.cli.test_ringbuilder.TestCommands.test_set_region ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_range_manifest test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_range_manifest ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_merge_items test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_merge_items ... ok test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_subrange_manifest test.unit.common.middleware.test_slo.TestSloRangeRequestsOldManifest.test_range_get_subrange_manifest ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_region_domain_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_region_domain_new_format ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_find_shard_ranges_with_minimum_size test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_find_shard_ranges_with_minimum_size ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_region_ipv4_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_region_ipv4_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_region_ipv4_old_format test.unit.cli.test_ringbuilder.TestCommands.test_set_region_ipv4_old_format ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '11'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_upload_part_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_object_upload_part_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_acl_with_fullcontrol_permission ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_region_ipv6_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_region_ipv6_new_format ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_merge_items_overwrite_unicode test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_merge_items_overwrite_unicode ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_region_ipv6_old_format test.unit.cli.test_ringbuilder.TestCommands.test_set_region_ipv6_old_format ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_recently_split_recreated test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_for_recently_split_recreated ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_newid test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_newid ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_with_error test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_with_error ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_with_socket_error test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_with_socket_error ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_with_too_many_errors test.unit.container.test_reconciler.TestReconcilerUtils.test_get_container_policy_index_with_too_many_errors ... ok test.unit.container.test_reconciler.TestReconcilerUtils.test_parse_raw_obj test.unit.container.test_reconciler.TestReconcilerUtils.test_parse_raw_obj ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_policy_stats_tracking test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_policy_stats_tracking ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_add_update_existing_pair test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_add_update_existing_pair ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_add_update_new_pair test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_add_update_new_pair ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_eviction_when_limit_exceeded test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_eviction_when_limit_exceeded ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_eviction_when_multiple_same_timestamps test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_eviction_when_multiple_same_timestamps ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_n_oldest_timestamp_acs test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_n_oldest_timestamp_acs ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_n_oldest_timestamp_acs_exceeding_dump_count test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_n_oldest_timestamp_acs_exceeding_dump_count ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_oldest_timestamp test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_oldest_timestamp ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_oldest_timestamp_age test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_oldest_timestamp_age ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_oldest_timestamp_age_no_updates test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_get_oldest_timestamp_age_no_updates ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_memory_usage test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_memory_usage ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_newest_pairs_not_added_when_limit_exceeded test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_newest_pairs_not_added_when_limit_exceeded ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_info test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_info ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_policy_table_migration test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_policy_table_migration ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_no_eviction_when_below_max_entries test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_no_eviction_when_below_max_entries ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_policy_table_migration_in_get_policy_stats test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_policy_table_migration_in_get_policy_stats ... ok test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_reset test.unit.obj.test_updater.TestOldestAsyncPendingTracker.test_reset ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_GET_bad_requests test.unit.proxy.controllers.test_container.TestContainerController.test_GET_bad_requests ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_merge test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_merge ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_container_cache_cleared_after_PUT test.unit.proxy.controllers.test_container.TestContainerController.test_container_cache_cleared_after_PUT ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_pre_storage_policy_replication test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_pre_storage_policy_replication ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_merge_fills_gap test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_merge_fills_gap ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_merge_warns_of_gap test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_merge_warns_of_gap ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_put_container test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_put_container ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_merge_warns_of_overlap test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_merge_warns_of_overlap ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "GET /sdi1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "GET http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txd2dba9b0a08547cea04ee-0068c5706e" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx3d3afb4b2c1144a59c8fc-0068c5706e" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx9e0d4ac00b4849bebd37e-0068c5706e" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txe7bc7092caaf476e87ba6-0068c5706e" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx74b1b1a9ddbb47e28ce69-0068c5706e" "proxy-server 1824514" 0.0101 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "txe307e4451d314405bc9d7-0068c5706e" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx33aed20dc44a4d2786563-0068c5706e" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txaf22ec5ed9e342dba41c1-0068c5706e" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx8428061215b94558ab977-0068c5706e" "proxy-server 1824514" 0.0174 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdi1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 412 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx72f8bec674d049adae972-0068c5706e" "proxy-server 1824514" 0.0128 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 412 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx72f8bec674d049adae972-0068c5706e" "proxy-server 1824514" 0.3276 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 412 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx72f8bec674d049adae972-0068c5706e" "proxy-server 1824514" 0.0128 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7d5b67a19ce4488091882-0068c5706e" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdb1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx9319c626dbf44691a159d-0068c5706e" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdh1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 304 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx353f0fa8dbe6457c892b8-0068c5706e" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfe4c64094264458fbd0dd-0068c5706e" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "tx986e03befea54de1901fe-0068c5706e" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdi1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 304 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "tx00d850bd50734c4bb321f-0068c5706e" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx12061f77490848229af0d-0068c5706e" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sda1/3/a/0dbbab12c9264c5fb01ced16351f1171" 204 - "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171" "txad86461be4194179b51aa-0068c5706e" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdg1/2/a/0dbbab12c9264c5fb01ced16351f1171/o" 200 92 "HEAD http://localhost:8080/v1/a/0dbbab12c9264c5fb01ced16351f1171/o" "txc57d1cb54baa4383a72c1-0068c5706e" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx79b704aa446445568bdf0-0068c5706e" "proxy-server 1824514" 0.0013 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/1/a/ccbf3a9681044603b1b190819d774035" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/ccbf3a9681044603b1b190819d774035" "tx79b704aa446445568bdf0-0068c5706e" "container-server 1824514" 0.0093 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdb1/1/a/ccbf3a9681044603b1b190819d774035" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/ccbf3a9681044603b1b190819d774035" "tx79b704aa446445568bdf0-0068c5706e" "container-server 1824514" 0.0010 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdb1/3/a/ccbf3a9681044603b1b190819d774035" 201 - "PUT http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035" "tx79b704aa446445568bdf0-0068c5706e" "proxy-server 1824514" 0.0609 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/3/a/ccbf3a9681044603b1b190819d774035" 201 - "PUT http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035" "tx79b704aa446445568bdf0-0068c5706e" "proxy-server 1824514" 0.0411 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0d51eab636ff488d9ff6e-0068c5706f" "proxy-server 1824514" 0.0141 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/3/a/ccbf3a9681044603b1b190819d774035" 204 - "HEAD http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035" "tx0d51eab636ff488d9ff6e-0068c5706f" "proxy-server 1824514" 0.0153 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf69f343e99e641dea247a-0068c5706f" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/3/a/ccbf3a9681044603b1b190819d774035" 204 - "HEAD http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035" "tx744b58ff1e0841459cbd1-0068c5706f" "proxy-server 1824514" 0.0014 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/3/a/ccbf3a9681044603b1b190819d774035/o" 201 - "PUT http://foo:8080/sdd1/3/a/ccbf3a9681044603b1b190819d774035/o" "tx317556461eef44bc805a2-0068c5706f" "object-server 1824514" 0.0005 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdb1/3/a/ccbf3a9681044603b1b190819d774035/o" 201 - "PUT http://foo:8080/sdc1/3/a/ccbf3a9681044603b1b190819d774035/o" "tx317556461eef44bc805a2-0068c5706f" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdd1/3/a/ccbf3a9681044603b1b190819d774035/o" 201 - "PUT http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035/o" "tx317556461eef44bc805a2-0068c5706f" "proxy-server 1824514" 0.0511 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdc1/3/a/ccbf3a9681044603b1b190819d774035/o" 201 - "PUT http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035/o" "tx317556461eef44bc805a2-0068c5706f" "proxy-server 1824514" 0.0509 "-" 1824514 1test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_reclaim test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_reclaim ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_children_overlaps_with_parent_donor test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_children_overlaps_with_parent_donor ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_exits_if_sharding_state test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_exits_if_sharding_state ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_exits_if_shrinking_state test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_exits_if_shrinking_state ... ok test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0028 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/US~~TX~~A" 201 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/US~~TX~~B" 201 - "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/US~~OK~~A" 201 - "-" "-" "-" 0.0097 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/US~~OK~~B" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/US~~OK~Tulsa~~A" 201 - "-" "-" "-" 0.0137 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/US~~OK~Tulsa~~B" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/US~~UT~~A" 201 - "-" "-" "-" 0.0145 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/US~~UT~~~B" 201 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 102 "-" "-" "-" 0.0020 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 102 "-" "-" "-" 0.0136 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 24 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 24 "-" "-" "-" 0.0135 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 145 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 145 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 241 "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 241 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 121 "-" "-" "-" 0.0018 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0024 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0130 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 412 22 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0139 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.0" 201 - "-" "-" "-" 0.0008 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.0.0" 201 - "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.0.1" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.0.2" 201 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.1" 201 - "-" "-" "-" 0.0175 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.1.0" 201 - "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.1.1" 201 - "-" "-" "-" 0.0137 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.1.2" 201 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.2" 201 - "-" "-" "-" 0.0136 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.2.0" 201 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.2.1" 201 - "-" "-" "-" 0.0135 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.2.2" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 20 "-" "-" "-" 0.0181 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 414 "-" "-" "-" 0.0037 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "GET /sda1/p/a" 200 354 "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0228 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.0" 201 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.0.0" 201 - "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.0.1" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.0.2" 201 - "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.1" 201 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.1.0" 201 - "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.1.1" 201 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.1.2" 201 - "-" "-" "-" 0.0017 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.2" 201 - "-" "-" "-" 0.0180 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.2.0" 201 - "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.2.1" 201 - "-" "-" "-" 0.0176 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:58 +0000] "PUT /sda1/p/a/sub.2.2" 201 - "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 5 "-" "-" "-" 0.0217 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 39 "-" "-" "-" 0.0435 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 24 "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0028 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.0" 201 - "-" "-" "-" 0.0135 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.0.0" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.0.1" 201 - "-" "-" "-" 0.0177 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.0.2" 201 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.1" 201 - "-" "-" "-" 0.0137 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.1.0" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.1.1" 201 - "-" "-" "-" 0.0177 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.1.2" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.2" 201 - "-" "-" "-" 0.0136 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.2.0" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.2.1" 201 - "-" "-" "-" 0.0136 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/sub.2.2" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 91 "-" "-" "-" 0.0121 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 647 "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 578 "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0091 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0015 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 225 "-" "-" "-" 0.0141 "-" 1824502 -test.unit.account.test_server.TestAccountController.test_GET_with_containers_json test.unit.account.test_server.TestAccountController.test_GET_with_containers_json ... ok test.unit.account.test_server.TestAccountController.test_GET_with_containers_plain test.unit.account.test_server.TestAccountController.test_GET_with_containers_plain ... ok test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_reverse_prefix_delim test.unit.account.test_backend.TestAccountBrokerBeforeSPI.test_reverse_prefix_delim ... ok test.unit.account.test_server.TestAccountController.test_GET_with_containers_xml test.unit.account.test_server.TestAccountController.test_GET_with_containers_xml ... ok test.unit.account.test_server.TestAccountController.test_GET_xml_escapes_account_name test.unit.account.test_server.TestAccountController.test_GET_xml_escapes_account_name ... ok test.unit.account.test_server.TestAccountController.test_GET_xml_escapes_container_name test.unit.account.test_server.TestAccountController.test_GET_xml_escapes_container_name ... ok test.unit.account.test_server.TestAccountController.test_GET_xml_escapes_container_name_as_subdir test.unit.account.test_server.TestAccountController.test_GET_xml_escapes_container_name_as_subdir ... ok test.unit.account.test_server.TestAccountController.test_HEAD_empty_account test.unit.account.test_server.TestAccountController.test_HEAD_empty_account ... ok test.unit.account.test_server.TestAccountController.test_HEAD_has_content_length test.unit.account.test_server.TestAccountController.test_HEAD_has_content_length ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:58 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:full_control OWNER fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_with_fullcontrol_permission test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_with_fullcontrol_permission ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_empty test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_empty ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_with_write_permission test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_with_write_permission ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_invalid_partition test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_invalid_partition ... ok test.unit.account.test_server.TestAccountController.test_HEAD_invalid_accept test.unit.account.test_server.TestAccountController.test_HEAD_invalid_accept ... ok test.unit.account.test_server.TestAccountController.test_HEAD_invalid_content_type test.unit.account.test_server.TestAccountController.test_HEAD_invalid_content_type ... ok test.unit.account.test_server.TestAccountController.test_HEAD_invalid_format test.unit.account.test_server.TestAccountController.test_HEAD_invalid_format ... ok test.unit.account.test_server.TestAccountController.test_HEAD_invalid_partition test.unit.account.test_server.TestAccountController.test_HEAD_invalid_partition ... ok test.unit.account.test_server.TestAccountController.test_HEAD_not_found test.unit.account.test_server.TestAccountController.test_HEAD_not_found ... ok test.unit.account.test_server.TestAccountController.test_HEAD_with_containers test.unit.account.test_server.TestAccountController.test_HEAD_with_containers ... ok test.unit.account.test_server.TestAccountController.test_OPTIONS test.unit.account.test_server.TestAccountController.test_OPTIONS ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_not_empty test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_not_empty ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_not_found test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_not_found ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_now_empty test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_now_empty ... ok test.unit.account.test_server.TestAccountController.test_POST_HEAD_metadata test.unit.account.test_server.TestAccountController.test_POST_HEAD_metadata ... ok test WARNING: Unexpected file 1757769839.03198.data: Bad fragment index: None: invalid literal for int() with base 10: 'None' test DEBUG: Relinking created link: /tmp/tmpt92imf6s/node/sda1/objects/238/6fc/ee9a6b819bb22265c31c4e5d6c0c16fc/1757769839.03198.data to /tmp/tmpt92imf6s/node/sda1/objects/477/6fc/ee9a6b819bb22265c31c4e5d6c0c16fc/1757769839.03198.data test DEBUG: Run listdir on /tmp/tmpt92imf6s/node/sda1/objects/477 test WARNING: Unexpected file /tmp/tmpt92imf6s/node/sda1/objects/477/6fc/ee9a6b819bb22265c31c4e5d6c0c16fc/1757769839.03198.data: Bad fragment index: None: invalid literal for int() with base 10: 'None' test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:59 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpt92imf6s/node/sda1 (cleanup=True) test WARNING: Unexpected file /tmp/tmpt92imf6s/node/sda1/objects/477/6fc/ee9a6b819bb22265c31c4e5d6c0c16fc/1757769839.03198.data: Bad fragment index: None: invalid literal for int() with base 10: 'None' test WARNING: Unexpected file /tmp/tmpt92imf6s/node/sda1/objects/238/6fc/ee9a6b819bb22265c31c4e5d6c0c16fc/1757769839.03198.data: Bad fragment index: None: invalid literal for int() with base 10: 'None' test WARNING: Unexpected file 1757769839.03198.data: Bad fragment index: None: invalid literal for int() with base 10: 'None' test DEBUG: Removed /tmp/tmpt92imf6s/node/sda1/objects/238/6fc/ee9a6b819bb22265c31c4e5d6c0c16fc/1757769839.03198.data test DEBUG: Run listdir on /tmp/tmpt92imf6s/node/sda1/objects/238 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:59 09/13/25 GMT (0:00:00.017092 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:59 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmptl5pdz7d/node/sda1 (cleanup=True) test WARNING: Unexpected file /tmp/tmptl5pdz7d/node/sda1/objects/7/2ce/074b2967c066a605650c18d05f9e82ce/1757769839.12655.data: Bad fragment index: None: invalid literal for int() with base 10: 'None' test WARNING: Unexpected file 1757769839.12655.data: Bad fragment index: None: invalid literal for int() with base 10: 'None' test DEBUG: Relinking (cleanup) created link: /tmp/tmptl5pdz7d/node/sda1/objects/7/2ce/074b2967c066a605650c18d05f9e82ce/1757769839.12655.data to /tmp/tmptl5pdz7d/node/sda1/objects/14/2ce/074b2967c066a605650c18d05f9e82ce/1757769839.12655.data test DEBUG: Removed /tmp/tmptl5pdz7d/node/sda1/objects/7/2ce/074b2967c066a605650c18d05f9e82ce/1757769839.12655.data test DEBUG: Run listdir on /tmp/tmptl5pdz7d/node/sda1/objects/14 test WARNING: Unexpected file /tmp/tmptl5pdz7d/node/sda1/objects/14/2ce/074b2967c066a605650c18d05f9e82ce/1757769839.12655.data: Bad fragment index: None: invalid literal for int() with base 10: 'None' test DEBUG: Run listdir on /tmp/tmptl5pdz7d/node/sda1/objects/7 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:59 09/13/25 GMT (0:00:00.013669 elapsed) test INFO: Processing files for policy platinum under /tmp/tmpkuxae5wo/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpkuxae5wo/node/sda1/objects/114/ff2/72a8912ceaa59ebe6e45591fb9fdfff2/1757769839.20558.data to /tmp/tmpkuxae5wo/node/sda1/objects/229/ff2/72a8912ceaa59ebe6e45591fb9fdfff2/1757769839.20558.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_cleanup_files_per_second test.unit.cli.test_relinker.TestRelinker.test_cleanup_files_per_second ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_timestamp_not_float test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_timestamp_not_float ... ok Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.0.1:6200/sda1_"other meta data" Matched more than one device: d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" d1r1z1-127.0.0.2:6201R127.0.0.2:6201/sda2_"" d2r2z2-127.0.0.3:6202R127.0.0.3:6202/sdc3_"" d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"something" Device d1r1z1-127.0.0.2:6201R127.0.0.2:6201/sda2_"" is now d1r1z1-127.0.0.2:6201R127.0.0.2:6201/sda2_"something" Device d2r2z2-127.0.0.3:6202R127.0.0.3:6202/sdc3_"" is now d2r2z2-127.0.0.3:6202R127.0.0.3:6202/sdc3_"something" Device d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"" is now d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"something" Device 1 already uses 127.0.0.2:6201/sda2. Device d4r2z3-test.test.com:6200Rr.test.com:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Device d4r2z3-test.test.com:6200Rr.test.com:7000/sda3_"some meta data" is now d4r2z3-test.test2.com:9000Rr.test2.com:9000/sda300_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.2.1:9000R127.0.2.1:9000/sda100_"other meta data" Device d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" is now d0r0z0-127.0.1.1:8000R127.0.1.1:8000/sda10_"other meta data" Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" is now d4r2z3-[4001:0:1234::c1c0:abcd:876]:9000R[4::10]:9000/sda300_"other meta data" Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 3.14159265359 weight got id 4 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" is now d4r2z3-[3001:0:1234::c1c0:abcd:876]:8000R[3::10]:8000/sda30_"other meta data" Search value matched 0 devices. The on-disk ring builder is unchanged. swift-ring-builder set_info :[R:]/_ [ :[R:]/_] ... [--yes] or swift-ring-builder set_info --ip --port --replication-ip --replication-port --device --meta --change-ip --change-port --change-replication-ip --change-replication-port --change-device --change-meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. For each search-value, resets the matched device's information. This information isn't used to assign partitions, so you can use 'write_ring' afterward to rewrite the current ring with the newer device information. Any of the parts are optional in the final :/_ parameter; just give what you want to change. For instance set_info d74 _"snet: 5.6.7.8" would just update the meta data for device id 74. Option --yes assume a yes response to all questions. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included. Search value matched 0 devices. The on-disk ring builder is unchanged. The minimum number of hours before a partition can be reassigned is now set to 24 swift-ring-builder set_min_part_hours Changes the to the given . This should be set to however long a full replication/update cycle takes. We're working on a way to determine this more easily than scanning logs. The overload factor is now 19.88% (0.198780) The change will take effect after the next rebalance. Overload must be non-negative. swift-ring-builder set_overload [%] Changes the overload factor to the given . A rebalance is needed to make the change take effect. 'swedish fish' is not a valid number. swift-ring-builder set_overload [%] Changes the overload factor to the given . A rebalance is needed to make the change take effect. d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 Device d4r2z3-test.test.com:6000Rr.test.com:7000/sda3_"some meta data" with 100.0 weight got id 4 d4r314z3-test.test.com:6000Rr.test.com:7000/sda3_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 d0r314z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" region set to 314 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6000R[2::10]:7000/sda3_"some meta data" with 100.0 weight got id 4 d4r314z3-[2001:0:1234::c1c0:abcd:876]:6000R[2::10]:7000/sda3_"some meta data" region set to 314 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6000R[2::10]:7000/sda3_"some meta data" with 100.0 weight got id 4 d4r314z3-[2001:0:1234::c1c0:abcd:876]:6000R[2::10]:7000/sda3_"some meta data" region set to 314 swift-ring-builder set_region [ set_region --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' regions. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions.test.unit.cli.test_ringbuilder.TestCommands.test_set_region_no_matching test.unit.cli.test_ringbuilder.TestCommands.test_set_region_no_matching ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_region_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_set_region_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_region_values_no_devices test.unit.cli.test_ringbuilder.TestCommands.test_set_region_values_no_devices ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_replicas test.unit.cli.test_ringbuilder.TestCommands.test_set_replicas ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_replicas_invalid_value test.unit.cli.test_ringbuilder.TestCommands.test_set_replicas_invalid_value ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_replicas_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_set_replicas_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight test.unit.cli.test_ringbuilder.TestCommands.test_set_weight ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_all_devices test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_all_devices ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_domain_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_domain_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_ipv4_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_ipv4_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_ipv4_old_format test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_ipv4_old_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_ipv6_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_ipv6_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_ipv6_old_format test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_ipv6_old_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_no_matching test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_no_matching ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_application_wildcard test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_application_wildcard ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_conflicting test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_conflicting ... ok test-reaper ERROR: Exception with 10.10.10.1:6202/sda2: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 412, in reap_container direct_delete_container( ~~~~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 167, in fake_direct_delete_container raise self.myexp swift.common.exceptions.ClientException: : 404 test-reaper ERROR: Exception with 10.0.0.0:1000/sda: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 488, in reap_object direct_delete_object( ~~~~~~~~~~~~~~~~~~~~^ node, part, account, container, obj, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<6 lines>... 'X-Timestamp': timestamp.internal, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ USE_REPLICATION_NETWORK_HEADER: 'true'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_reaper.py", line 160, in fake_direct_delete_object raise self.myexp swift.common.exceptions.ClientException: : 404 test-reaper ERROR: Timeout Exception with 10.0.0.0:1000/sda test-reaper ERROR: Timeout Exception with 10.0.0.1:1001/sdb test-reaper ERROR: Timeout Exception with 10.0.0.2:1002/sdc test-reaper ERROR: Timeout Exception with 10.0.0.3:1003/sdd test-reaper DEBUG: Begin devices pass: thisdeviceisbad test-reaper ERROR: Exception in top-level account reaper loop: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/reaper.py", line 135, in run_once for device in os.listdir(self.devices): ~~~~~~~~~~^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: 'thisdeviceisbad' test-reaper INFO: Devices pass completed: 0.01s Finished. Marked 0 objects for deletion. test ERROR: get_keys(): from callback: Testing: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 166, in get_keys keys = fetch_crypto_keys(key_id=key_id) File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/crypto/test_encrypter.py", line 919, in raise_exc raise Exception('Testing') Exception: Testing test ERROR: ERROR get_keys() missing callback: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 158, in get_keys fetch_crypto_keys = env[CRYPTO_KEY_CALLBACK] ~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: 'swift.callback.fetch_crypto_keys' test INFO: Loaded config file /tmp/tmp9ixrl236/backend-ratelimit.conf, config changed test WARNING: Failed to load config file, config unchanged: Unable to read config from /tmp/tmp9ixrl236/backend-ratelimit.conf test INFO: Loaded new config file /tmp/tmp9ixrl236/backend-ratelimit.conf, config unchanged test DEBUG: Loaded existing config file /tmp/tmp9ixrl236/backend-ratelimit.conf, config unchanged test INFO: Loaded config file /tmp/tmpo2j2270_/missing, config changed test INFO: Loaded config file /tmp/tmpo2j2270_/missing, config changed test INFO: Loaded new config file /tmp/tmppzycr05n/backend-ratelimit.conf, config unchanged test INFO: Loaded config file /tmp/tmp7qwgqnnf/backend-ratelimit.conf, config changed test WARNING: Invalid config file /tmp/tmp7qwgqnnf/backend-ratelimit.conf, config unchanged: BOOM test INFO: Loaded config file /tmp/tmp7qwgqnnf/backend-ratelimit.conf, config changed test INFO: Loaded config file /tmp/tmpfude936l/backend-ratelimit.conf, config changed test DEBUG: Loaded existing config file /tmp/tmpfude936l/backend-ratelimit.conf, config unchanged test INFO: Loaded config file /tmp/tmpfude936l/backend-ratelimit.conf, config changed test WARNING: Failed to load config file, config unchanged: Unable to read config from /tmp/tmp7dn1a7t9/missing test INFO: Loaded config file /tmp/tmpmr7lm9cm/override-ratelimit.conf, config changed test WARNING: Invalid config file /tmp/tmp1wvo08e1/backend_rl.conf, config unchanged: Unable to find backend_ratelimit config section in /tmp/tmp1wvo08e1/backend_rl.conf test WARNING: Failed to load config file, config unchanged: Unable to read config from test WARNING: Failed to load config file, config unchanged: Unable to read config from /tmp/tmp157lqhxz/backend_rl.conf test INFO: Loaded config file /tmp/tmpdehcg6wj/backend-ratelimit.conf, config changed test WARNING: The following digest algorithms are configured but deprecated: sha1. Support will be removed in a future release. test WARNING: The following digest algorithms are configured but deprecated: sha1. Support will be removed in a future release. test WARNING: The following digest algorithms are configured but deprecated: sha1. Support will be removed in a future release. test WARNING: The following digest algorithms are configured but deprecated: sha1. Support will be removed in a future release. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test INFO: - - 13/Sep/2025/13/23/59 HEAD /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0002 FA - 1757769839.239588976 1757769839.239801645 0 - test INFO: - - 13/Sep/2025/13/23/59 POST /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0008 - - 1757769839.239544153 1757769839.240359306 0 - test INFO: - - 13/Sep/2025/13/23/59 GET /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0003 FA - 1757769839.241975784 1757769839.242228985 0 - test INFO: - - 13/Sep/2025/13/23/59 POST /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0102 - - 1757769839.241934538 1757769839.252125025 0 -test.unit.common.middleware.test_subrequest_logging.TestSubRequestLogging.test_subrequest_logged_with_POST test.unit.common.middleware.test_subrequest_logging.TestSubRequestLogging.test_subrequest_logged_with_POST ... ok test.unit.common.middleware.test_subrequest_logging.TestSubRequestLogging.test_subrequest_logged_x_copy_from test.unit.common.middleware.test_subrequest_logging.TestSubRequestLogging.test_subrequest_logged_x_copy_from ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_extract_symlink_path_json_extra_key test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_extract_symlink_path_json_extra_key ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_extract_symlink_path_json_simple_etag test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_extract_symlink_path_json_simple_etag ... ok test INFO: Begin account audit "once" mode test INFO: Account audit "once" mode completed: 0.00s Checking config for swift-proxy-server Sending USR1 signal Process is RELOADING Process is READY Reloaded swift-proxy-server test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'' test DEBUG: Error on keystone reply: 201 b'' - deferring rejection downstream test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Received error, deferring rejection based on error: 400 Bad Request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone reply error: status=403 reason=None test DEBUG: Received error, deferring rejection based on error: 401 Unauthorized test ERROR: Invalid current //REALM/CLUSTER (foo) test ERROR: Unknown current //REALM/CLUSTER (//FOO/BAR) test ERROR: Unknown current //REALM/CLUSTER (//FOO/BAR) test WARNING: The following digest algorithms are configured but not supported: md5, not-a-valid-digest test WARNING: The following digest algorithms are configured but deprecated: sha1. Support will be removed in a future release. test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Using identity: {'user': ('42', 'usr'), 'tenant': ('1', 'acct'), 'roles': ['admin'], 'service_roles': [], 'user_domain': (None, None), 'project_domain': (None, None), 'auth_version': 0} test DEBUG: tenant mismatch: AUTH_acct != 1 test DEBUG: Using identity: {'user': (None, None), 'tenant': (None, None), 'roles': [], 'service_roles': [], 'user_domain': (None, None), 'project_domain': (None, None), 'auth_version': 0} test DEBUG: tenant mismatch: AUTH_foo != None test DEBUG: Using identity: {'user': (None, None), 'tenant': (None, None), 'roles': [], 'service_roles': [], 'user_domain': (None, None), 'project_domain': (None, None), 'auth_version': 0} test DEBUG: tenant mismatch: AUTH_foo != None test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Authorizing from an overriding middleware my-daemon DEBUG: Spawned worker mock-pid-0 with {} my-daemon DEBUG: Spawned worker mock-pid-1 with {} my-daemon DEBUG: Spawned worker mock-pid-2 with {} my-daemon DEBUG: Worker mock-pid-0 exited my-daemon DEBUG: Worker mock-pid-1 exited my-daemon DEBUG: Worker mock-pid-2 exited my-daemon NOTICE: Finished 1824498 my-daemon DEBUG: Forked worker 1824498 finished my-daemon DEBUG: Spawned worker mock-pid-0 with {} my-daemon DEBUG: Spawned worker mock-pid-1 with {} my-daemon DEBUG: Spawned worker mock-pid-2 with {} my-daemon DEBUG: Daemon needs to change options, aborting workers my-daemon DEBUG: Cleaned up worker mock-pid-0 my-daemon DEBUG: Cleaned up worker mock-pid-1 my-daemon DEBUG: Cleaned up worker mock-pid-2 my-daemon DEBUG: Spawned worker mock-pid-3 with {} my-daemon DEBUG: Spawned worker mock-pid-4 with {} my-daemon DEBUG: Spawned worker mock-pid-5 with {} my-daemon DEBUG: Cleaned up worker mock-pid-3 my-daemon DEBUG: Cleaned up worker mock-pid-4 my-daemon DEBUG: Cleaned up worker mock-pid-5 my-daemon NOTICE: SIGTERM received () my-daemon DEBUG: Spawned worker mock-pid with {'mock_options': True} my-daemon DEBUG: Spawned worker mock-pid with {'mock_options': True} my-daemon DEBUG: Worker mock-pid exited my-daemon DEBUG: Spawned worker mock-pid with {'mock_options': True} my-daemon NOTICE: Worker mock-pid died my-daemon DEBUG: Spawned worker mock-pid-1 with {'mock_options': True} my-daemon DEBUG: Spawned worker mock-pid-2 with {'mock_options': True} my-daemon DEBUG: Cleaned up worker mock-pid-1 my-daemon DEBUG: Cleaned up worker mock-pid-2 my-daemon DEBUG: Spawned worker mock-pid-1 with {'mock_options': True} my-daemon DEBUG: Spawned worker mock-pid-2 with {'mock_options': True} my-daemon DEBUG: Cleaned up worker mock-pid-1 my-daemon DEBUG: Cleaned up worker mock-pid-2 test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00025 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp0uq1852k/sda/fake/0/59e/33379ecb053aa5c9e356c68997cbb59e/33379ecb053aa5c9e356c68997cbb59e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01449 seconds (69.02679/s) test INFO: Removed 1 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00026 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00032 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00585 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:1002/sdc (txn: txb53af8b3d46e4bcfa0f0e-0068c5706f) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:1001/sdb (txn: txb53af8b3d46e4bcfa0f0e-0068c5706f) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:1000/sda (txn: txb53af8b3d46e4bcfa0f0e-0068c5706f) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.3:1003/sda (txn: txb53af8b3d46e4bcfa0f0e-0068c5706f) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.4:1004/sda (txn: txb53af8b3d46e4bcfa0f0e-0068c5706f) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.5:1005/sda (txn: txb53af8b3d46e4bcfa0f0e-0068c5706f)test.unit.proxy.controllers.test_container.TestContainerController.test_container_info_got_cached test.unit.proxy.controllers.test_container.TestContainerController.test_container_info_got_cached ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_extract_symlink_path_json_symlink_path test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_extract_symlink_path_json_symlink_path ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_extract_symlink_path_json_symlink_path_and_account test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_extract_symlink_path_json_symlink_path_and_account ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_json test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_json ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_error_cases test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_error_cases ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_simple test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_simple ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_simple_with_listing_format test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_simple_with_listing_format ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_simple_with_listing_format_xml test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_simple_with_listing_format_xml ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_handoff_has_deleted_database test.unit.proxy.controllers.test_container.TestContainerController.test_handoff_has_deleted_database ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_node_errors test.unit.proxy.controllers.test_container.TestContainerController.test_node_errors ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_with_subdir test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_get_container_with_subdir ... ok test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_no_affect_for_account_request test.unit.common.middleware.test_symlink.TestSymlinkContainerContext.test_no_affect_for_account_request ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_options test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_options ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_reseller_admin test.unit.proxy.controllers.test_container.TestContainerController.test_reseller_admin ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_trumps_incoming_header_conflict test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_trumps_incoming_header_conflict ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_trumps_incoming_header_startswith_conflict test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_trumps_incoming_header_startswith_conflict ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_trumps_outgoing_header_conflict test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_trumps_outgoing_header_conflict ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_not_valid test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_not_valid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_trumps_outgoing_header_startswith_conflict test.unit.common.middleware.test_tempurl.TestTempURL.test_allow_trumps_outgoing_header_startswith_conflict ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_auth_scheme_value test.unit.common.middleware.test_tempurl.TestTempURL.test_auth_scheme_value ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_authorize_limits_scope test.unit.common.middleware.test_tempurl.TestTempURL.test_authorize_limits_scope ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_bad_ip_range_invalid test.unit.common.middleware.test_tempurl.TestTempURL.test_bad_ip_range_invalid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_bad_path test.unit.common.middleware.test_tempurl.TestTempURL.test_bad_path ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_changed_expires_invalid test.unit.common.middleware.test_tempurl.TestTempURL.test_changed_expires_invalid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_changed_path_invalid test.unit.common.middleware.test_tempurl.TestTempURL.test_changed_path_invalid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_changed_sig_invalid test.unit.common.middleware.test_tempurl.TestTempURL.test_changed_sig_invalid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_clean_incoming_headers test.unit.common.middleware.test_tempurl.TestTempURL.test_clean_incoming_headers ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_clean_outgoing_headers test.unit.common.middleware.test_tempurl.TestTempURL.test_clean_outgoing_headers ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_delete_allowed test.unit.common.middleware.test_tempurl.TestTempURL.test_delete_allowed ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_delete_when_forbidden_by_config test.unit.common.middleware.test_tempurl.TestTempURL.test_delete_when_forbidden_by_config ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_different_key_invalid test.unit.common.middleware.test_tempurl.TestTempURL.test_different_key_invalid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_disallowed_header_object_manifest test.unit.common.middleware.test_tempurl.TestTempURL.test_disallowed_header_object_manifest ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_filename_trailing_slash test.unit.common.middleware.test_tempurl.TestTempURL.test_filename_trailing_slash ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_hmacs test.unit.common.middleware.test_tempurl.TestTempURL.test_get_hmacs ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_not_allowed_by_put test.unit.common.middleware.test_tempurl.TestTempURL.test_get_not_allowed_by_put ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_path_parts test.unit.common.middleware.test_tempurl.TestTempURL.test_get_path_parts ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_temp_url_info test.unit.common.middleware.test_tempurl.TestTempURL.test_get_temp_url_info ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_but_404 test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_but_404 ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_wildcard test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_wildcard ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_container_keys test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_container_keys ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_key2 test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_key2 ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_fake_ip_from_x_forwarded_for test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_fake_ip_from_x_forwarded_for ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_filename test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_filename ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_filename_and_inline test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_filename_and_inline ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_inline test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_inline ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_ip_from_remote_addr test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_ip_from_remote_addr ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_ip_range test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_ip_range ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_ipv6_range test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_ipv6_range ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_no_client_address test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_no_client_address ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_prefix test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_prefix ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_prefix_and_staticweb test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_prefix_and_staticweb ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_prefix_empty test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_prefix_empty ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_single_ipv6 test.unit.common.middleware.test_tempurl.TestTempURL.test_get_valid_with_single_ipv6 ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_head_allowed_by_get test.unit.common.middleware.test_tempurl.TestTempURL.test_head_allowed_by_get ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_head_allowed_by_post test.unit.common.middleware.test_tempurl.TestTempURL.test_head_allowed_by_post ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_head_allowed_by_put test.unit.common.middleware.test_tempurl.TestTempURL.test_head_allowed_by_put ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_head_and_get_headers_match test.unit.common.middleware.test_tempurl.TestTempURL.test_head_and_get_headers_match ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_head_otherwise_not_allowed test.unit.common.middleware.test_tempurl.TestTempURL.test_head_otherwise_not_allowed ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_head_valid_with_filename test.unit.common.middleware.test_tempurl.TestTempURL.test_head_valid_with_filename ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_invalid test.unit.common.middleware.test_tempurl.TestTempURL.test_invalid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_ip_range_value_error test.unit.common.middleware.test_tempurl.TestTempURL.test_ip_range_value_error ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_missing_expires test.unit.common.middleware.test_tempurl.TestTempURL.test_missing_expires ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_missing_sig test.unit.common.middleware.test_tempurl.TestTempURL.test_missing_sig ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_no_key test.unit.common.middleware.test_tempurl.TestTempURL.test_no_key ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_no_prefix_match_invalid test.unit.common.middleware.test_tempurl.TestTempURL.test_no_prefix_match_invalid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_normalize_temp_url_expires test.unit.common.middleware.test_tempurl.TestTempURL.test_normalize_temp_url_expires ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_obj_odd_chars test.unit.common.middleware.test_tempurl.TestTempURL.test_obj_odd_chars ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_obj_odd_chars_in_content_disposition_metadata test.unit.common.middleware.test_tempurl.TestTempURL.test_obj_odd_chars_in_content_disposition_metadata ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_obj_trailing_slash test.unit.common.middleware.test_tempurl.TestTempURL.test_obj_trailing_slash ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_object_url_with_prefix_invalid test.unit.common.middleware.test_tempurl.TestTempURL.test_object_url_with_prefix_invalid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_passthrough test.unit.common.middleware.test_tempurl.TestTempURL.test_passthrough ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_post_when_forbidden_by_config test.unit.common.middleware.test_tempurl.TestTempURL.test_post_when_forbidden_by_config ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_put_not_allowed_by_get test.unit.common.middleware.test_tempurl.TestTempURL.test_put_not_allowed_by_get ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_put_response_headers_in_list test.unit.common.middleware.test_tempurl.TestTempURL.test_put_response_headers_in_list ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_put_valid test.unit.common.middleware.test_tempurl.TestTempURL.test_put_valid ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_incoming_header test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_incoming_header ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_incoming_header_defaults test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_incoming_header_defaults ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_incoming_headers_match test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_incoming_headers_match ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_outgoing_header test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_outgoing_header ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_outgoing_headers_match test.unit.common.middleware.test_tempurl.TestTempURL.test_removed_outgoing_headers_match ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_signature_trim test.unit.common.middleware.test_tempurl.TestTempURL.test_signature_trim ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_unicode_metadata_value test.unit.common.middleware.test_tempurl.TestTempURL.test_unicode_metadata_value ... ok test.unit.common.middleware.test_tempurl.TestTempURL.test_unknown_not_allowed test.unit.common.middleware.test_tempurl.TestTempURL.test_unknown_not_allowed ... ok test.unit.common.ring.test_composite_builder.TestCooperativeRingBuilder.test_rebalance_cobuilder_states test.unit.common.ring.test_composite_builder.TestCooperativeRingBuilder.test_rebalance_cobuilder_states ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_xml test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_xml ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_empty_account_json test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_empty_account_json ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_acl_with_write_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_acl_without_permission ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_empty_account_plain test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_empty_account_plain ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_empty_account_xml test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_empty_account_xml ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_invalid_accept test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_invalid_accept ... ok test.unit.account.test_server.TestAccountController.test_POST_HEAD_sys_metadata test.unit.account.test_server.TestAccountController.test_POST_HEAD_sys_metadata ... ok test.unit.account.test_server.TestAccountController.test_POST_after_DELETE_not_found test.unit.account.test_server.TestAccountController.test_POST_after_DELETE_not_found ... ok test.unit.common.ring.test_composite_builder.TestCooperativeRingBuilder.test_rebalance_cobuilders_calls test.unit.common.ring.test_composite_builder.TestCooperativeRingBuilder.test_rebalance_cobuilders_calls ... ok test.unit.account.test_server.TestAccountController.test_POST_insufficient_space test.unit.account.test_server.TestAccountController.test_POST_insufficient_space ... ok test.unit.account.test_server.TestAccountController.test_POST_invalid_partition test.unit.account.test_server.TestAccountController.test_POST_invalid_partition ... ok test.unit.account.test_server.TestAccountController.test_POST_timestamp_not_float test.unit.account.test_server.TestAccountController.test_POST_timestamp_not_float ... ok test.unit.account.test_server.TestAccountController.test_PUT test.unit.account.test_server.TestAccountController.test_PUT ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_leading_delimiter test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_leading_delimiter ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_limit_marker_json test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_limit_marker_json ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_limit_marker_plain test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_limit_marker_plain ... ok test INFO: Processing files for policy platinum under /tmp/tmp6tgt64q8/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp6tgt64q8/node/sda1/objects/81/e7a/51cae864b17a818760a669d53f7d9e7a/1757769839.37256.data to /tmp/tmp6tgt64q8/node/sda1/objects/163/e7a/51cae864b17a818760a669d53f7d9e7a/1757769839.37256.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_cleanup_first_quartile_does_rehash test.unit.cli.test_relinker.TestRelinker.test_cleanup_first_quartile_does_rehash ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_listdir_error test.unit.cli.test_relinker.TestRelinker.test_cleanup_listdir_error ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_and_meta_file_both_relinks_fails test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_and_meta_file_both_relinks_fails ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_and_meta_file_one_relink_fails test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_and_meta_file_one_relink_fails ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_existing_meta_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_existing_meta_files ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_file test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_file ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_file_relink_fails test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_file_relink_fails ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_data_missing_meta_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_data_missing_meta_files ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_limit_marker_xml test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_limit_marker_xml ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_log_requests_false test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_log_requests_false ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:write OWNER fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_without_permission test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_DELETE_without_permission ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_all_users test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_all_users ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps_complete_sequence test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps_complete_sequence ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_invalid_source test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_invalid_source ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_with_fullcontrol_permission ... ok swift-ring-builder set_region [ set_region --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' regions. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included. Search value matched 0 devices. The on-disk ring builder is unchanged. The replica count is now 3.141593. The change will take effect after the next rebalance. swift-ring-builder set_replicas Changes the replica count to the given . may be a floating-point value, in which case some partitions will have floor() replicas and some will have ceiling() in the correct proportions. A rebalance is needed to make the change take effect. "test" is not a valid number. Replica count must be at least 1. swift-ring-builder set_replicas Changes the replica count to the given . may be a floating-point value, in which case some partitions will have floor() replicas and some will have ceiling() in the correct proportions. A rebalance is needed to make the change take effect. d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 Matched more than one device: d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" d1r1z1-127.0.0.2:6201R127.0.0.2:6201/sda2_"" d2r2z2-127.0.0.3:6202R127.0.0.3:6202/sdc3_"" d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"" d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 200.0 d1r1z1-127.0.0.2:6201R127.0.0.2:6201/sda2_"" weight set to 200.0 d2r2z2-127.0.0.3:6202R127.0.0.3:6202/sdc3_"" weight set to 200.0 d3r3z3-127.0.0.4:6203R127.0.0.4:6203/sdd4_"" weight set to 200.0 Device d4r2z3-test.test.com:6200Rr.test.com:7000/sda3_"some meta data" with 100.0 weight got id 4 d4r2z3-test.test.com:6200Rr.test.com:7000/sda3_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" weight set to 3.14159265359 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 100.0 weight got id 4 d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" weight set to 3.14159265359 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" with 100.0 weight got id 4 d4r2z3-[2001:0:1234::c1c0:abcd:876]:6200R[2::10]:7000/sda3_"some meta data" weight set to 3.14159265359 swift-ring-builder set_weight [ ] ... [--yes] or swift-ring-builder set_weight --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. and are the search weight and new weight values respectively. Any of the options are optional in both cases. Resets the devices' weights. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_weight [ ] ... [--yes] or swift-ring-builder set_weight --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. and are the search weight and new weight values respectively. Any of the options are optional in both cases. Resets the devices' weights. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included.test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_old_format_two_devices test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_old_format_two_devices ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_values_no_devices test.unit.cli.test_ringbuilder.TestCommands.test_set_weight_values_no_devices ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_zone test.unit.cli.test_ringbuilder.TestCommands.test_set_zone ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_domain_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_domain_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_ipv4_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_ipv4_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_ipv4_old_format test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_ipv4_old_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_ipv6_new_format test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_ipv6_new_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_ipv6_old_format test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_ipv6_old_format ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_no_matching test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_no_matching ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_number_of_arguments test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_number_of_arguments ... ok test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_values_no_devices test.unit.cli.test_ringbuilder.TestCommands.test_set_zone_values_no_devices ... ok test.unit.cli.test_ringbuilder.TestCommands.test_time_remaining test.unit.cli.test_ringbuilder.TestCommands.test_time_remaining ... ok test.unit.cli.test_ringbuilder.TestCommands.test_unknown test.unit.cli.test_ringbuilder.TestCommands.test_unknown ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps_multiple_missing test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps_multiple_missing ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps_not_root test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps_not_root ... ok test INFO: Processing files for policy platinum under /tmp/tmpqcvu_ahg/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpqcvu_ahg/node/sda1/objects/110/780/6ec11652de3367449c7f7f9cd3264780/1757769839.50144.data to /tmp/tmpqcvu_ahg/node/sda1/objects/221/780/6ec11652de3367449c7f7f9cd3264780/1757769839.50144.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:59 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpqcvu_ahg/node/sda1 (cleanup=True) test WARNING: Skipping /tmp/tmpqcvu_ahg/node/sda1/objects because test DEBUG: Updating recon test WARNING: There were 1 errors listing partition directories test WARNING: 0 hash dirs processed (cleanup=True) (0 files, 0 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=True): 13:23:59 09/13/25 GMT (0:00:00.020410 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:59 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp_mv_lnf8/node/sda1 (cleanup=True) test WARNING: Error relinking (cleanup): failed to relink /tmp/tmp_mv_lnf8/node/sda1/objects/201/6b4/c9d23bea1b7983e1d13e106027f136b4/1757769839.61114.data to /tmp/tmp_mv_lnf8/node/sda1/objects/403/6b4/c9d23bea1b7983e1d13e106027f136b4/1757769839.61114.data: [Errno 1] oops test WARNING: Error relinking (cleanup): failed to relink /tmp/tmp_mv_lnf8/node/sda1/objects/201/6b4/c9d23bea1b7983e1d13e106027f136b4/1757769840.61114.meta to /tmp/tmp_mv_lnf8/node/sda1/objects/403/6b4/c9d23bea1b7983e1d13e106027f136b4/1757769840.61114.meta: [Errno 1] oops test DEBUG: Run listdir on /tmp/tmp_mv_lnf8/node/sda1/objects/201 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 0/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (2 files, 0 linked, 0 removed, 2 errors) test INFO: Finished relinker (cleanup=True): 13:23:59 09/13/25 GMT (0:00:00.014536 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:59 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp51wzj3_i/node/sda1 (cleanup=True) test WARNING: Error relinking (cleanup): failed to relink /tmp/tmp51wzj3_i/node/sda1/objects/236/95e/ec79fe64adb7a6ee54a9c4a7252c095e/1757769840.70628.meta to /tmp/tmp51wzj3_i/node/sda1/objects/472/95e/ec79fe64adb7a6ee54a9c4a7252c095e/1757769840.70628.meta: [Errno 1] oops test DEBUG: Relinking (cleanup) created link: /tmp/tmp51wzj3_i/node/sda1/objects/236/95e/ec79fe64adb7a6ee54a9c4a7252c095e/1757769839.70628.data to /tmp/tmp51wzj3_i/node/sda1/objects/472/95e/ec79fe64adb7a6ee54a9c4a7252c095e/1757769839.70628.data test DEBUG: Run listdir on /tmp/tmp51wzj3_i/node/sda1/objects/472 test DEBUG: Run listdir on /tmp/tmp51wzj3_i/node/sda1/objects/236 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 0/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (2 files, 1 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=True): 13:23:59 09/13/25 GMT (0:00:00.025531 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:59 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpavwkoseq/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpavwkoseq/node/sda1/objects/493 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking (cleanup) created link: /tmp/tmpavwkoseq/node/sda1/objects/246/a7f/f6aa290ee157469ed290263725baca7f/1757769839.82524.data to /tmp/tmpavwkoseq/node/sda1/objects/493/a7f/f6aa290ee157469ed290263725baca7f/1757769839.82524.data test DEBUG: Removed /tmp/tmpavwkoseq/node/sda1/objects/246/a7f/f6aa290ee157469ed290263725baca7f/1757769840.82524.meta test DEBUG: Removed /tmp/tmpavwkoseq/node/sda1/objects/246/a7f/f6aa290ee157469ed290263725baca7f/1757769839.82524.data test DEBUG: Run listdir on /tmp/tmpavwkoseq/node/sda1/objects/246 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (2 files, 1 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:59 09/13/25 GMT (0:00:00.020530 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:23:59 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpv3xbxymn/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmpv3xbxymn/node/sda1/objects/218/c8c/da2c8e68dc5904dade3a9eb7c4016c8c/1757769839.92581.data to /tmp/tmpv3xbxymn/node/sda1/objects/436/c8c/da2c8e68dc5904dade3a9eb7c4016c8c/1757769839.92581.data test DEBUG: Removed /tmp/tmpv3xbxymn/node/sda1/objects/218/c8c/da2c8e68dc5904dade3a9eb7c4016c8c/1757769839.92581.data test DEBUG: Run listdir on /tmp/tmpv3xbxymn/node/sda1/objects/436 test DEBUG: Run listdir on /tmp/tmpv3xbxymn/node/sda1/objects/218 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:23:59 09/13/25 GMT (0:00:00.021227 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpqrmtt6c6/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpqrmtt6c6/node/sda1/objects/304 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test WARNING: Error relinking (cleanup): failed to relink /tmp/tmpqrmtt6c6/node/sda1/objects/152/84d/9811f723730fa02fe20e5258603d984d/1757769840.05708.data to /tmp/tmpqrmtt6c6/node/sda1/objects/304/84d/9811f723730fa02fe20e5258603d984d/1757769840.05708.data: [Errno 1] oops test DEBUG: Run listdir on /tmp/tmpqrmtt6c6/node/sda1/objects/152 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (2 files, 0 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.032335 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpl4gfb6v2/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmpl4gfb6v2/node/sda1/objects/133/8cf/85866fd25600c76bd2ae8628c898b8cf/1757769842.16609.meta to /tmp/tmpl4gfb6v2/node/sda1/objects/267/8cf/85866fd25600c76bd2ae8628c898b8cf/1757769842.16609.meta test DEBUG: Relinking (cleanup) created link: /tmp/tmpl4gfb6v2/node/sda1/objects/133/8cf/85866fd25600c76bd2ae8628c898b8cf/1757769841.16609.data to /tmp/tmpl4gfb6v2/node/sda1/objects/267/8cf/85866fd25600c76bd2ae8628c898b8cf/1757769841.16609.data test DEBUG: Removed /tmp/tmpl4gfb6v2/node/sda1/objects/133/8cf/85866fd25600c76bd2ae8628c898b8cf/1757769842.16609.meta test DEBUG: Removed /tmp/tmpl4gfb6v2/node/sda1/objects/133/8cf/85866fd25600c76bd2ae8628c898b8cf/1757769841.16609.data test DEBUG: Run listdir on /tmp/tmpl4gfb6v2/node/sda1/objects/267 test DEBUG: Run listdir on /tmp/tmpl4gfb6v2/node/sda1/objects/133 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (2 files, 2 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.024325 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpt5p7c7w2/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpt5p7c7w2/node/sda1/objects/289 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking (cleanup) created link: /tmp/tmpt5p7c7w2/node/sda1/objects/144/8d9/908c4abbe100ff0895aa812eacf658d9/1757769842.27742.meta to /tmp/tmpt5p7c7w2/node/sda1/objects/289/8d9/908c4abbe100ff0895aa812eacf658d9/1757769842.27742.metatest.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_meta_existing_older_meta_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_meta_existing_older_meta_files ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_meta_existing_older_ts_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_meta_existing_older_ts_files ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_meta_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_meta_files ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps_with_overlap test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_gaps_with_overlap ... ok test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0137 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 225 "-" "-" "-" 0.0019 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0130 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0140 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0141 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0131 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0014 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 397 "-" "-" "-" 0.0141 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0137 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 397 "-" "-" "-" 0.0488 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/%22%27" 201 - "-" "-" "-" 0.0151 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/%22%27" 200 74 "-" "-" "-" 0.0135 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0149 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/%22%3Cword" 201 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 240 "-" "-" "-" 0.0142 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0149 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/%22%3Cword-test" 201 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 102 "-" "-" "-" 0.0143 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0148 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0149 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0132 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 400 21 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 406 - "-" "-" "-" 0.0003 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 400 34 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/./a" 400 20 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0209 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 404 - "-" "-" "-" 0.0008 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0131 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0139 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0137 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0018 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0172 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0008 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0130 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0146 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0008 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.1917 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0028 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "POST /sda1/p/a" 404 - "-" "-" "-" 0.0090 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "POST /sda1/./a" 400 20 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "POST /sda1/p/a" 400 26 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0140 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0058 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0019 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0025 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0051 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0036 "-" 1824502 -test.unit.account.test_server.TestAccountController.test_PUT_GET_metadata test.unit.account.test_server.TestAccountController.test_PUT_GET_metadata ... ok test.unit.account.test_server.TestAccountController.test_PUT_GET_sys_metadata test.unit.account.test_server.TestAccountController.test_PUT_GET_sys_metadata ... ok test.unit.account.test_server.TestAccountController.test_PUT_after_DELETE test.unit.account.test_server.TestAccountController.test_PUT_after_DELETE ... ok test.unit.account.test_server.TestAccountController.test_PUT_auto_create test.unit.account.test_server.TestAccountController.test_PUT_auto_create ... ok test.unit.account.test_server.TestAccountController.test_PUT_insufficient_space test.unit.account.test_server.TestAccountController.test_PUT_insufficient_space ... ok test.unit.account.test_server.TestAccountController.test_PUT_invalid_partition test.unit.account.test_server.TestAccountController.test_PUT_invalid_partition ... ok test.unit.account.test_server.TestAccountController.test_PUT_non_utf8_metadata test.unit.account.test_server.TestAccountController.test_PUT_non_utf8_metadata ... ok test.unit.account.test_server.TestAccountController.test_PUT_not_found test.unit.account.test_server.TestAccountController.test_PUT_not_found ... ok test.unit.account.test_server.TestAccountController.test_PUT_simulated_create_race test.unit.account.test_server.TestAccountController.test_PUT_simulated_create_race ... ok test.unit.account.test_server.TestAccountController.test_REPLICATE_complete_rsync_works test.unit.account.test_server.TestAccountController.test_REPLICATE_complete_rsync_works ... ok test.unit.account.test_server.TestAccountController.test_REPLICATE_insufficient_space test.unit.account.test_server.TestAccountController.test_REPLICATE_insufficient_space ... ok test.unit.account.test_server.TestAccountController.test_REPLICATE_rsync_then_merge_works test.unit.account.test_server.TestAccountController.test_REPLICATE_rsync_then_merge_works ... ok test.unit.account.test_server.TestAccountController.test_REPLICATE_unknown_sync test.unit.account.test_server.TestAccountController.test_REPLICATE_unknown_sync ... ok test.unit.account.test_server.TestAccountController.test_REPLICATE_value_error_works test.unit.account.test_server.TestAccountController.test_REPLICATE_value_error_works ... ok test.unit.account.test_server.TestAccountController.test__call__raise_timeout test.unit.account.test_server.TestAccountController.test__call__raise_timeout ... ok test.unit.account.test_server.TestAccountController.test_content_type_on_HEAD test.unit.account.test_server.TestAccountController.test_content_type_on_HEAD ... ok test.unit.account.test_server.TestAccountController.test_correct_allowed_method test.unit.account.test_server.TestAccountController.test_correct_allowed_method ... ok test.unit.account.test_server.TestAccountController.test_create_invalid_reserved_container_in_account test.unit.account.test_server.TestAccountController.test_create_invalid_reserved_container_in_account ... ok test.unit.account.test_server.TestAccountController.test_create_invalid_reserved_namespace_account test.unit.account.test_server.TestAccountController.test_create_invalid_reserved_namespace_account ... ok test.unit.account.test_server.TestAccountController.test_create_reserved_container_in_account test.unit.account.test_server.TestAccountController.test_create_reserved_container_in_account ... ok test.unit.account.test_server.TestAccountController.test_create_reserved_namespace_account test.unit.account.test_server.TestAccountController.test_create_reserved_namespace_account ... ok test.unit.account.test_server.TestAccountController.test_delimiter_with_reserved_and_no_public test.unit.account.test_server.TestAccountController.test_delimiter_with_reserved_and_no_public ... ok test.unit.account.test_server.TestAccountController.test_delimiter_with_reserved_and_public test.unit.account.test_server.TestAccountController.test_delimiter_with_reserved_and_public ... ok test.unit.account.test_server.TestAccountController.test_empty_except_for_used_policies test.unit.account.test_server.TestAccountController.test_empty_except_for_used_policies ... ok test.unit.account.test_server.TestAccountController.test_empty_policy_stats test.unit.account.test_server.TestAccountController.test_empty_policy_stats ... ok test.unit.account.test_server.TestAccountController.test_init test.unit.account.test_server.TestAccountController.test_init ... ok test.unit.account.test_server.TestAccountController.test_insufficient_storage_mount_check_false test.unit.account.test_server.TestAccountController.test_insufficient_storage_mount_check_false ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_no_shard_ranges test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_no_shard_ranges ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_not_needed test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_not_needed ... ok test ERROR: Container GET returning 503 for [500, 500, 500, 500, 500, 500] (txn: txb53af8b3d46e4bcfa0f0e-0068c5706f) test INFO: Client disconnected on read of '/a/c' (txn: txb53af8b3d46e4bcfa0f0e-0068c5706f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx76517a1ed3db433385287-0068c5706f) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx76517a1ed3db433385287-0068c5706f) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx76517a1ed3db433385287-0068c5706f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda (txn: tx4519cbee012644da95a19-0068c5706f) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb (txn: tx359b2a03e3c34eafaa560-0068c5706f) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc (txn: tx59afaaed49bb45619e0bc-0068c5706f) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to PUT /a/c: Timeout (Nones) (txn: txe38ec83150df4805b4d7e-0068c5706f) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx562f956dfe13457682924-0068c5706f) test ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: txe16ab740f8dd434080286-0068c5706f) test DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: txe16ab740f8dd434080286-0068c5706f) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:1000/sda (txn: txe5d4d59033f840a6bb7be-0068c5706f) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb (txn: tx6d8398bc4d184096ae020-0068c5706f) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc (txn: txfe1ec14347544fcaa6e9a-0068c5706f) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to DELETE /a/c: Timeout (Nones) (txn: tx69ab8bdf53054219bead2-0068c5706f) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: txf94f6e7ecbd547619db06-0068c5706f) test ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: txfd2da58e631544cd8bed8-0068c5706f) test DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: txfd2da58e631544cd8bed8-0068c5706f) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda (txn: tx7b8f60aa15224d9ba6a88-0068c5706f) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb (txn: txaf6d8441323c4a8ab9c77-0068c5706f) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc (txn: tx5a048f03e67a420a99187-0068c5706f) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to POST /a/c: Timeout (Nones) (txn: tx2fe5759b7e2d414e8d72f-0068c5706f) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: txa9b83df8f16246728c6bb-0068c5706f) test ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx9c19098cb1bb4e8e9dd68-0068c5706f) test DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx9c19098cb1bb4e8e9dd68-0068c5706f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: tx757e85316e084ad4836bd-0068c5706f) test INFO: Client disconnected on read of '/a/c' (txn: tx500786c90fb645c7a3cdb-0068c5706f) test INFO: Client disconnected on read of '/a/c' (txn: tx6068f085cffd44d1b092e-0068c5706f) test INFO: Client disconnected on read of '/a/c' (txn: tx6068f085cffd44d1b092e-0068c5706f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: Container GET returning 503 for (204, 404, 503) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: Container GET returning 503 for (204, 503, 503) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIterationtest.unit.account.test_server.TestAccountController.test_insufficient_storage_mount_check_true test.unit.account.test_server.TestAccountController.test_insufficient_storage_mount_check_true ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_response_code_for_DELETE test.unit.proxy.controllers.test_container.TestContainerController.test_response_code_for_DELETE ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_meta_missing_ts_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_meta_missing_ts_files ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_not_root test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_not_root ... ok test.unit.account.test_server.TestAccountController.test_invalid_method_doesnt_exist test.unit.account.test_server.TestAccountController.test_invalid_method_doesnt_exist ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_older_overlapping_donor_and_acceptor_shards test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_older_overlapping_donor_and_acceptor_shards ... ok test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0042 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "DELETE /sda1/./a" 400 20 "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0084 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0095 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0018 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "DELETE /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0112 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0076 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 204 - "-" "-" "-" 0.0016 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0103 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "DELETE /sda1/p/a" 400 26 "-" "-" "-" 0.0224 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0029 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0093 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 113 "-" "-" "-" 0.0022 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0027 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0092 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0020 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0027 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0128 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 113 "-" "-" "-" 0.0020 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0089 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0056 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 406 - "-" "-" "-" 0.0035 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0045 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0086 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0079 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 233 "-" "-" "-" 0.0068 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0157 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0091 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/p/a" 200 68 "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 400 21 "-" "-" "-" 0.0082 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0062 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.0" 201 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.0.0" 201 - "-" "-" "-" 0.0097 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.0.1" 201 - "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.0.2" 201 - "-" "-" "-" 0.0016 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.1" 201 - "-" "-" "-" 0.0041 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.1.0" 201 - "-" "-" "-" 0.0016 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.1.1" 201 - "-" "-" "-" 0.0095 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.1.2" 201 - "-" "-" "-" 0.0018 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.2" 201 - "-" "-" "-" 0.0032 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.2.0" 201 - "-" "-" "-" 0.0133 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.2.1" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.sub.2.2" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0064 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0037 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 45 "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 27 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0027 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c0" 201 - "-" "-" "-" 0.0009 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0042 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0014 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c3" 201 - "-" "-" "-" 0.0014 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c4" 201 - "-" "-" "-" 0.0098 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 338 "-" "-" "-" 0.0019 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 225 "-" "-" "-" 0.0032 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c0" 201 - "-" "-" "-" 0.0035 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0016 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0080 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c3" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c4" 201 - "-" "-" "-" 0.0059 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 9 "-" "-" "-" 0.0038 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0012 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0024 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c0" 201 - "-" "-" "-" 0.0008 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0016 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0014 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c3" 201 - "-" "-" "-" 0.0015 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c4" 201 - "-" "-" "-" 0.0013 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 562 "-" "-" "-" 0.0061 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 397 "-" "-" "-" 0.0095 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0002 "-" 1824529 -test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_log_requests_true test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_log_requests_true ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_multichar_delimiter test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_multichar_delimiter ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_not_found_json test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_not_found_json ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_not_found_plain test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_not_found_plain ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_not_found_xml test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_not_found_xml ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_over_limit test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_over_limit ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_prefix_delimiter_json test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_prefix_delimiter_json ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_prefix_delimiter_plain test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_prefix_delimiter_plain ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_prefix_delimiter_xml test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_prefix_delimiter_xml ... ok test.unit.common.ring.test_composite_builder.TestCooperativeRingBuilder.test_rebalance_respects_cobuilder_part_moves test.unit.common.ring.test_composite_builder.TestCooperativeRingBuilder.test_rebalance_respects_cobuilder_part_moves ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_with_owner_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_with_owner_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_with_write_permission ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_ts_missing_meta_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_data_missing_ts_missing_meta_files ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other OWNER fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: public None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: authenticated None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_authenticated_users test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_authenticated_users ... ok test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: Container GET returning 503 for (404, 503, 503) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:1000/sda test ERROR: Container GET returning 503 for (503, 503, 503) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: Container GET returning 503 for (204, 404, 503) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIterationtest.unit.proxy.controllers.test_container.TestContainerController.test_response_code_for_POST test.unit.proxy.controllers.test_container.TestContainerController.test_response_code_for_POST ... ok test.unit.common.ring.test_composite_builder.TestCooperativeRingBuilder.test_save_then_load test.unit.common.ring.test_composite_builder.TestCooperativeRingBuilder.test_save_then_load ... ok test.unit.common.ring.test_ring.TestRingV2.test_4_byte_dev_ids test.unit.common.ring.test_ring.TestRingV2.test_4_byte_dev_ids ... ok test.unit.common.ring.test_ring.TestRingV2.test_creation test.unit.common.ring.test_ring.TestRingV2.test_creation ... ok test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0047 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0071 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0079 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0053 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0068 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0064 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 403 16 "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c" 404 - "-" "-" "-" 0.0003 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/.a/c" 201 - "-" "-" "-" 0.0027 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/.c" 404 - "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/./a" 400 20 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 400 28 "-" "-" "-" 0.0028 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 400 28 "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c" 404 - "-" "-" "-" 0.0044 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0079 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0062 "-" 1824502 - test DEBUG: - - - [13/Sep/2025:13:24:00 +0000] "REPLICATE /sda1/p/a/" 204 - "-" "-" "-" 0.0003 "-" 1824502 - test DEBUG: - - - [13/Sep/2025:13:24:00 +0000] "REPLICATE /sda1/p/a/" 204 - "-" "-" "-" 0.0002 "-" 1824502 - test DEBUG: - - - [13/Sep/2025:13:24:00 +0000] "REPLICATE /sda1/p/a/" 404 - "-" "-" "-" 0.0027 "-" 1824502 - test ERROR: ERROR __call__ error with REPLICATE /sda1/p/a/ : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/server.py", line 316, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/swift/common/base_storage_server.py", line 71, in _timing_stats resp = func(ctrl, *args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/account/server.py", line 282, in REPLICATE ret = self.replicator_rpc.dispatch(post_args, args) File "/build/reproducible-path/swift-2.36.0/swift/common/db_replicator.py", line 903, in dispatch return getattr(self, op)( ~~~~~~~^^^^^^^^^^ AttributeError: 'ReplicatorRpc' object has no attribute 'unknown_sync' test DEBUG: - - - [13/Sep/2025:13:24:00 +0000] "REPLICATE /sda1/p/a/" 500 700 "-" "-" "-" 0.0049 "-" 1824502 - test DEBUG: - - - [13/Sep/2025:13:24:00 +0000] "REPLICATE /sda1/p/a/" 400 49 "-" "-" "-" 0.0002 "-" 1824502 - test ERROR: ERROR __call__ error with PUT /sda1/p/a/c : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/server.py", line 316, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_server.py", line 2714, in mock_put_method raise Exception() Exception test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0111 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0033 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0142 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c%00stuff" 400 36 "-" "-" "-" 0.0001 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/foo%00bar" 400 34 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0071 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00c%00stuff" 201 - "-" "-" "-" 0.0092 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/%00a" 201 - "-" "-" "-" 0.0111 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/%00foo%00bar" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0086 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0009 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0019 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 135 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 26 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0114 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0010 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/nullish" 201 - "-" "-" "-" 0.0125 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 20 "-" "-" "-" 0.0019 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 20 "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0096 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 26 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 119 "-" "-" "-" 0.0213 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 141 "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0027 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0018 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0029 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0021 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "method_doesnt_exist /sda1/p/a" 405 - "-" "-" "-" 0.0001 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "__init__ /sda1/p/a" 405 - "-" "-" "-" 0.0001 "-" 1824502 -test.unit.account.test_server.TestAccountController.test_invalid_method_is_not_public test.unit.account.test_server.TestAccountController.test_invalid_method_is_not_public ... ok test.unit.account.test_server.TestAccountController.test_list_allowed_methods test.unit.account.test_server.TestAccountController.test_list_allowed_methods ... ok test.unit.account.test_server.TestAccountController.test_log_line_format test.unit.account.test_server.TestAccountController.test_log_line_format ... ok test.unit.account.test_server.TestAccountController.test_markers_with_reserved test.unit.account.test_server.TestAccountController.test_markers_with_reserved ... ok test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0097 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/US~~TX~~A" 201 - "-" "-" "-" 0.0159 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/US~~TX~~B" 201 - "-" "-" "-" 0.0016 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/US~~OK~~A" 201 - "-" "-" "-" 0.0053 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/US~~OK~~B" 201 - "-" "-" "-" 0.0052 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/US~~OK~Tulsa~~A" 201 - "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/US~~OK~Tulsa~~B" 201 - "-" "-" "-" 0.0081 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/US~~UT~~A" 201 - "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/US~~UT~~~B" 201 - "-" "-" "-" 0.0091 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 102 "-" "-" "-" 0.0025 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 102 "-" "-" "-" 0.0175 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 24 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 24 "-" "-" "-" 0.0133 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 145 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 145 "-" "-" "-" 0.0045 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 241 "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 241 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 121 "-" "-" "-" 0.0096 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0060 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0008 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0107 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0008 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0019 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 412 22 "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0123 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0" 201 - "-" "-" "-" 0.0008 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0.0" 201 - "-" "-" "-" 0.0096 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0.1" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0.2" 201 - "-" "-" "-" 0.0119 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1" 201 - "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1.0" 201 - "-" "-" "-" 0.0055 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1.1" 201 - "-" "-" "-" 0.0081 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1.2" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2" 201 - "-" "-" "-" 0.0016 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2.0" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2.1" 201 - "-" "-" "-" 0.0060 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2.2" 201 - "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 20 "-" "-" "-" 0.0098 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 414 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 354 "-" "-" "-" 0.0072 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0092 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0" 201 - "-" "-" "-" 0.0293 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0.0" 201 - "-" "-" "-" 0.0095 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0.1" 201 - "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0.2" 201 - "-" "-" "-" 0.0072 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1" 201 - "-" "-" "-" 0.0016 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1.0" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1.1" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1.2" 201 - "-" "-" "-" 0.0096 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2" 201 - "-" "-" "-" 0.0017 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2.0" 201 - "-" "-" "-" 0.0091 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2.1" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2.2" 201 - "-" "-" "-" 0.0016 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 5 "-" "-" "-" 0.0018 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 39 "-" "-" "-" 0.0057 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 24 "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0066 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0" 201 - "-" "-" "-" 0.0054 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0.0" 201 - "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0.1" 201 - "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.0.2" 201 - "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1" 201 - "-" "-" "-" 0.0056 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1.0" 201 - "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1.1" 201 - "-" "-" "-" 0.0060 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.1.2" 201 - "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2" 201 - "-" "-" "-" 0.0033 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2.0" 201 - "-" "-" "-" 0.0054 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2.1" 201 - "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/sub.2.2" 201 - "-" "-" "-" 0.0060 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 91 "-" "-" "-" 0.0019 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 647 "-" "-" "-" 0.0057 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 578 "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0111 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0014 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 225 "-" "-" "-" 0.0107 "-" 1824529 -test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_containers_json test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_containers_json ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_containers_plain test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_containers_plain ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_meta_existing_newer_data_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_meta_existing_newer_data_files ... ok test.unit.account.test_server.TestAccountController.test_multiple_policies_in_use test.unit.account.test_server.TestAccountController.test_multiple_policies_in_use ... ok test.unit.account.test_server.TestAccountController.test_not_allowed_method test.unit.account.test_server.TestAccountController.test_not_allowed_method ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_one_complete_sequences_one_incomplete test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_one_complete_sequences_one_incomplete ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_one_incomplete_sequence test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_one_incomplete_sequence ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_meta_file test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_meta_file ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_without_permission ... ok test.unit.account.test_server.TestAccountController.test_null_markers test.unit.account.test_server.TestAccountController.test_null_markers ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_overlapping_donor_and_acceptor_shards_default test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_overlapping_donor_and_acceptor_shards_default ... ok test.unit.account.test_server.TestAccountController.test_params_format test.unit.account.test_server.TestAccountController.test_params_format ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx58520a8f298e4cf5a2e2f-0068c5706f" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/3/a/ccbf3a9681044603b1b190819d774035" 204 - "HEAD http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035" "tx60be2427bd024771bf851-0068c5706f" "proxy-server 1824514" 0.0078 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdb1/3/a/ccbf3a9681044603b1b190819d774035/o" 201 - "POST http://foo:8080/sdc1/3/a/ccbf3a9681044603b1b190819d774035/o" "tx74944b3e9b9249cbbf21c-0068c5706f" "object-server 1824514" 0.0005 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/3/a/ccbf3a9681044603b1b190819d774035/o" 201 - "POST http://foo:8080/sdd1/3/a/ccbf3a9681044603b1b190819d774035/o" "tx74944b3e9b9249cbbf21c-0068c5706f" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "POST /sdc1/3/a/ccbf3a9681044603b1b190819d774035/o" 202 76 "POST http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035/o" "tx74944b3e9b9249cbbf21c-0068c5706f" "proxy-server 1824514" 0.0151 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "POST /sdd1/3/a/ccbf3a9681044603b1b190819d774035/o" 202 76 "POST http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035/o" "tx74944b3e9b9249cbbf21c-0068c5706f" "proxy-server 1824514" 0.0146 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0a326914699444aa9b219-0068c5706f" "proxy-server 1824514" 0.0134 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/1/a/dc4afb266d934a19a397febcb012b115" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/dc4afb266d934a19a397febcb012b115" "tx0a326914699444aa9b219-0068c5706f" "container-server 1824514" 0.0011 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdb1/1/a/dc4afb266d934a19a397febcb012b115" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/dc4afb266d934a19a397febcb012b115" "tx0a326914699444aa9b219-0068c5706f" "container-server 1824514" 0.0131 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/0/a/dc4afb266d934a19a397febcb012b115" 201 - "PUT http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx0a326914699444aa9b219-0068c5706f" "proxy-server 1824514" 0.0323 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 201 - "PUT http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx0a326914699444aa9b219-0068c5706f" "proxy-server 1824514" 0.0492 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd731611b5ad343c495d0e-0068c5706f" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "txd731611b5ad343c495d0e-0068c5706f" "proxy-server 1824514" 0.0012 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7b43095571b04436ba0ed-0068c5706f" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/3/a/ccbf3a9681044603b1b190819d774035" 204 - "HEAD http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035" "txf7f6e83f87134a7abc878-0068c5706f" "proxy-server 1824514" 0.0156 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdc1/3/a/ccbf3a9681044603b1b190819d774035/o" 200 24 "GET http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035/o" "tx60522c6b9d774de7b6fce-0068c5706f" "proxy-server 1824514" 0.0008 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdd1/3/a/ccbf3a9681044603b1b190819d774035/o" 200 24 "GET http://foo:8080/v1/a/ccbf3a9681044603b1b190819d774035/o" "tx60522c6b9d774de7b6fce-0068c5706f" "proxy-server 1824514" 0.0130 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx59110133c4d9466d9915f-0068c5706f" "proxy-server 1824514" 0.0171 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://foo:8080/v1/a/dc4afb266d934a19a397febcb012b115" "txda2ad58d6afd4fa989685-0068c5706f" "proxy-server 1824514" 0.0015 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdh1/1/a/dc4afb266d934a19a397febcb012b115/o" 201 - "PUT http://foo:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txf6e377b88c204ce6b0636-0068c5706f" "proxy-server 1824514" 0.0502 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdb1/0/a/dc4afb266d934a19a397febcb012b115/o" 201 - "PUT http://foo:8080/sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" "txf6e377b88c204ce6b0636-0068c5706f" "object-server 1824514" 0.0005 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sda1/0/a/dc4afb266d934a19a397febcb012b115/o" 201 - "PUT http://foo:8080/sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" "txf6e377b88c204ce6b0636-0068c5706f" "object-server 1824514" 0.0005 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 201 - "PUT http://foo:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txf6e377b88c204ce6b0636-0068c5706f" "proxy-server 1824514" 0.0420 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "PUT /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 201 - "PUT http://foo:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txf6e377b88c204ce6b0636-0068c5706f" "proxy-server 1824514" 0.0563 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx14cb4f8f53f24a31afd14-0068c5706f" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx5a770acd21e8444ab83dc-0068c5706f" "proxy-server 1824514" 0.0146 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx63d84e874b404b419a3a3-0068c5706f" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx63d84e874b404b419a3a3-0068c5706f" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txcdab1722f2c346efbecad-0068c5706f" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "txf12cfe10fe084daeb2cf2-0068c5706f" "proxy-server 1824514" 0.0120 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx7adc45a3f66b4d39b0259-0068c5706f" "proxy-server 1824514" 0.0128 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6e4f04820a6b44cbb1ec6-0068c5706f" "proxy-server 1824514" 0.0134 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sda1/0/a/dc4afb266d934a19a397febcb012b115" 200 382 "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115?format=json&states=listing" "tx6e4f04820a6b44cbb1ec6-0068c5706f" "proxy-server 1824514" 0.0144 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx19e7500eeccd4c329b79b-0068c5706f" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx9bd2d4807b304d1fb3040-0068c5706f" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx5e37c9d1563e431bbb8a5-0068c5706f" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdh1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx5e37c9d1563e431bbb8a5-0068c5706f" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txe87653a6c12141ea9cfb1-0068c5706f" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx2b52838e4b7a413b9fbf3-0068c5706f" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx7e219b00c52343eaa45b9-0068c5706f" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdh1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx7e219b00c52343eaa45b9-0068c5706f" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7f9c9f75a6044eb9a3a5b-0068c5706f" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx1b621ec73c4c4bc8a093b-0068c5706f" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 412 - "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txa9abd295a3574ba787721-0068c5706f" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdh1/1/a/dc4afb266d934a19a397febcb012b115/o" 412 - "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txa9abd295a3574ba787721-0068c5706f" "proxy-server 1824514" 0.0007 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: txa9abd295a3574ba787721-0068c5706f) proxy DEBUG: Ignoring 412 from primary (txn: txa9abd295a3574ba787721-0068c5706f) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 412 - "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txa9abd295a3574ba787721-0068c5706f" "proxy-server 1824514" 0.0008 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: txa9abd295a3574ba787721-0068c5706f) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfec76dd136ab4c579bb0b-0068c5706f" "proxy-server 1824514" 0.0055 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "txbbdf51e733ef466089906-0068c5706f" "proxy-server 1824514" 0.0054 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 304 - "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txf67853a0f2e7472793fda-0068c5706f" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 304 - "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txf67853a0f2e7472793fda-0068c5706f" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "GET /sdh1/1/a/dc4afb266d934a19a397febcb012b115/o" 304 - "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txf67853a0f2e7472793fda-0068c5706f" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:23:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txa834bac4762a41d582d7e-0068c5706f" "proxy-server 1824514" 0.0055 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx404fce53e95f4838b4b3d-0068c57070" "proxy-server 1824514" 0.0054 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdh1/1/a/dc4afb266d934a19a397febcb012b115/o" 304 - "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx805a263fabd84af7b9f42-0068c57070" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 304 - "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx805a263fabd84af7b9f42-0068c57070" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 304 - "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx805a263fabd84af7b9f42-0068c57070" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txbc0b305103ca47d7b16e7-0068c57070" "proxy-server 1824514" 0.0053 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx04e24056d0154521a3025-0068c57070" "proxy-server 1824514" 0.0054 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdh1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx61f3fd2af33c4590bb56c-0068c57070" "proxy-server 1824514" 0.0049 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "GET http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx61f3fd2af33c4590bb56c-0068c57070" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6c3cfcb2d3c9467e98cf8-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx0edaea3f57544cc6b457c-0068c57070" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx9ae4e8601fdf4967b7d08-0068c57070" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx09700237762a41c0801a4-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "txf27d181d366549eca22a1-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx3bfabfa3c8214a709db9f-0068c57070" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txcf2bcbd872034aff86bd9-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx247f4f6880a44c89a3694-0068c57070" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdi1/1/a/dc4afb266d934a19a397febcb012b115/o" 412 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx67ed5f4d0c4b48759d9f3-0068c57070" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdh1/1/a/dc4afb266d934a19a397febcb012b115/o" 412 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx67ed5f4d0c4b48759d9f3-0068c57070" "proxy-server 1824514" 0.0006 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 412 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx67ed5f4d0c4b48759d9f3-0068c57070" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txc4e09b5ae86744d28228c-0068c57070" "proxy-server 1824514" 0.0097 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "txa78597613cb6436bb0075-0068c57070" "proxy-server 1824514" 0.0068 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 304 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txa7aa15ea675540b98bf30-0068c57070" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx93a779936698485eb5aa5-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "txe427c0dcbe034b04a3e9d-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdg1/1/a/dc4afb266d934a19a397febcb012b115/o" 304 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "txd0ff70b13b8c4e78b95a4-0068c57070" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6101583a5f254a39a941e-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/0/a/dc4afb266d934a19a397febcb012b115" 204 - "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115" "tx89c081069ec4425e92b45-0068c57070" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdh1/1/a/dc4afb266d934a19a397febcb012b115/o" 200 92 "HEAD http://localhost:8080/v1/a/dc4afb266d934a19a397febcb012b115/o" "tx659e951cc4ec4e5f9ba7f-0068c57070" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx652f05f4dc5e495fb53b8-0068c57070" "proxy-server 1824514" 0.0055 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/1/a/908097c9c1ce447381e90ac5ce01c812" 201 - "PUT http://127.0.0.1:40941/sda1/1/a/908097c9c1ce447381e90ac5ce01c812" "tx652f05f4dc5e495fb53b8-0068c57070" "container-server 1824514" 0.0280 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdb1/1/a/908097c9c1ce447381e90ac5ce01c812" 201 - "PUT http://127.0.0.1:60751/sdb1/1/a/908097c9c1ce447381e90ac5ce01c812" "tx652f05f4dc5e495fb53b8-0068c57070" "container-server 1824514" 0.0072 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/1/a/908097c9c1ce447381e90ac5ce01c812" 201 - "PUT http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812" "tx652f05f4dc5e495fb53b8-0068c57070" "proxy-server 1824514" 0.0604 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdb1/1/a/908097c9c1ce447381e90ac5ce01c812" 201 - "PUT http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812" "tx652f05f4dc5e495fb53b8-0068c57070" "proxy-server 1824514" 0.0526 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf76b63d829d4465b979c4-0068c57070" "proxy-server 1824514" 0.0183 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a/908097c9c1ce447381e90ac5ce01c812" 204 - "HEAD http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812" "txf76b63d829d4465b979c4-0068c57070" "proxy-server 1824514" 0.0036 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx050722d985bb45a480414-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a/908097c9c1ce447381e90ac5ce01c812" 204 - "HEAD http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812" "tx068c6f09eeac4d3db35b2-0068c57070" "proxy-server 1824514" 0.0095 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdh1/2/a/908097c9c1ce447381e90ac5ce01c812/o" 201 - "PUT http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812/o" "txbb3343449e1c44ab9094e-0068c57070" "proxy-server 1824514" 0.0197 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdb1/1/a/908097c9c1ce447381e90ac5ce01c812/o" 201 - "PUT http://foo:8080/sdi1/2/a/908097c9c1ce447381e90ac5ce01c812/o" "txbb3343449e1c44ab9094e-0068c57070" "object-server 1824514" 0.0005 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/1/a/908097c9c1ce447381e90ac5ce01c812/o" 201 - "PUT http://foo:8080/sdg1/2/a/908097c9c1ce447381e90ac5ce01c812/o" "txbb3343449e1c44ab9094e-0068c57070" "object-server 1824514" 0.0004 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdg1/2/a/908097c9c1ce447381e90ac5ce01c812/o" 201 - "PUT http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812/o" "txbb3343449e1c44ab9094e-0068c57070" "proxy-server 1824514" 0.0307 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdi1/2/a/908097c9c1ce447381e90ac5ce01c812/o" 201 - "PUT http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812/o" "txbb3343449e1c44ab9094e-0068c57070" "proxy-server 1824514" 0.0327 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txd9cfe0d1fcff4be6beeff-0068c57070" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a/908097c9c1ce447381e90ac5ce01c812" 204 - "HEAD http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812" "tx5c482435011c4251ada9c-0068c57070" "proxy-server 1824514" 0.0098 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "POST /sdi1/2/a/908097c9c1ce447381e90ac5ce01c812/o" 202 76 "POST http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812/o" "txdb6ddd59bcab4b81b80b2-0068c57070" "proxy-server 1824514" 0.0043 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdb1/1/a/908097c9c1ce447381e90ac5ce01c812/o" 201 - "POST http://foo:8080/sdh1/2/a/908097c9c1ce447381e90ac5ce01c812/o" "txdb6ddd59bcab4b81b80b2-0068c57070" "object-server 1824514" 0.0005 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/1/a/908097c9c1ce447381e90ac5ce01c812/o" 201 - "POST http://foo:8080/sdg1/2/a/908097c9c1ce447381e90ac5ce01c812/o" "txdb6ddd59bcab4b81b80b2-0068c57070" "object-server 1824514" 0.0005 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "POST /sdh1/2/a/908097c9c1ce447381e90ac5ce01c812/o" 202 76 "POST http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812/o" "txdb6ddd59bcab4b81b80b2-0068c57070" "proxy-server 1824514" 0.0240 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "POST /sdg1/2/a/908097c9c1ce447381e90ac5ce01c812/o" 202 76 "POST http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812/o" "txdb6ddd59bcab4b81b80b2-0068c57070" "proxy-server 1824514" 0.0229 "-" 1824514 3test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_overlapping_incomplete_sequences test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_overlapping_incomplete_sequences ... ok test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda test ERROR: Container GET returning 503 for (204, 503, 503) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: Container GET returning 503 for (404, 503, 503) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda test ERROR: Container GET returning 503 for (503, 503, 503) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: Container GET returning 503 for (201, 404, 503) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: Container GET returning 503 for (201, 503, 503) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda test ERROR: Container GET returning 503 for (404, 503, 503) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 343, in GET resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2452, in get_response return self.get_acl_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READtest.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_non_json test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_non_json ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_response_code_for_PUT test.unit.proxy.controllers.test_container.TestContainerController.test_response_code_for_PUT ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_parent_overlaps_with_children_donors test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_parent_overlaps_with_children_donors ... ok test.unit.account.test_server.TestAccountController.test_params_utf8 test.unit.account.test_server.TestAccountController.test_params_utf8 ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: test:testertest:testertest:writetest:writeWRITE fake-swift DEBUG: permission denined: 403 Forbidden test:write READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_without_src_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_acl_without_src_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_headers_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_headers_error ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift ERROR: Got non-JSON response trying to list /bucket: b'obj0\nobj1\nobj2\nobj3\nobj4\nobj5\nobj6\nobj7\nobj8\nobj9\nobj10\nobj1...' fake-swift ERROR: Expecting value: line 1 column 1 (char 0): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 346, in GET objects = json.loads(resp.body) File "/usr/lib/python3.13/json/__init__.py", line 346, in loads return _default_decoder.decode(s) ~~~~~~~~~~~~~~~~~~~~~~~^^^ File "/usr/lib/python3.13/json/decoder.py", line 345, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/json/decoder.py", line 363, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_with_fullcontrol_permission test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_with_fullcontrol_permission ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_two_complete_sequences_one_incomplete test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_two_complete_sequences_one_incomplete ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_with_owner_permission test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_with_owner_permission ... ok test.unit.account.test_server.TestAccountController.test_policy_stats_non_default test.unit.account.test_server.TestAccountController.test_policy_stats_non_default ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_younger_acceptor_with_overlapping_donor_shards test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_younger_acceptor_with_overlapping_donor_shards ... ok test DEBUG: Relinking (cleanup) created link: /tmp/tmpt5p7c7w2/node/sda1/objects/144/8d9/908c4abbe100ff0895aa812eacf658d9/1757769840.27742.data to /tmp/tmpt5p7c7w2/node/sda1/objects/289/8d9/908c4abbe100ff0895aa812eacf658d9/1757769840.27742.data test DEBUG: Removed /tmp/tmpt5p7c7w2/node/sda1/objects/144/8d9/908c4abbe100ff0895aa812eacf658d9/1757769842.27742.meta test DEBUG: Removed /tmp/tmpt5p7c7w2/node/sda1/objects/144/8d9/908c4abbe100ff0895aa812eacf658d9/1757769840.27742.data test DEBUG: Run listdir on /tmp/tmpt5p7c7w2/node/sda1/objects/144 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (2 files, 2 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.013977 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmph11zwjpy/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmph11zwjpy/node/sda1/objects/404 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking (cleanup) created link: /tmp/tmph11zwjpy/node/sda1/objects/202/3e7/ca26763aaf7978bb47236c1461cd33e7/1757769842.37726.meta to /tmp/tmph11zwjpy/node/sda1/objects/404/3e7/ca26763aaf7978bb47236c1461cd33e7/1757769842.37726.meta test DEBUG: Relinking (cleanup) created link: /tmp/tmph11zwjpy/node/sda1/objects/202/3e7/ca26763aaf7978bb47236c1461cd33e7/1757769841.37726.data to /tmp/tmph11zwjpy/node/sda1/objects/404/3e7/ca26763aaf7978bb47236c1461cd33e7/1757769841.37726.data test DEBUG: Removed /tmp/tmph11zwjpy/node/sda1/objects/202/3e7/ca26763aaf7978bb47236c1461cd33e7/1757769842.37726.meta test DEBUG: Removed /tmp/tmph11zwjpy/node/sda1/objects/202/3e7/ca26763aaf7978bb47236c1461cd33e7/1757769841.37726.data test DEBUG: Run listdir on /tmp/tmph11zwjpy/node/sda1/objects/202 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (2 files, 2 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.033528 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpgs26l25l/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmpgs26l25l/node/sda1/objects/244/997/f4d0038718d5d640332562aa4ebb7997/1757769840.49268.data to /tmp/tmpgs26l25l/node/sda1/objects/489/997/f4d0038718d5d640332562aa4ebb7997/1757769840.49268.data test DEBUG: Relinking (cleanup) created link: /tmp/tmpgs26l25l/node/sda1/objects/244/997/f4d0038718d5d640332562aa4ebb7997/1757769841.49268.meta to /tmp/tmpgs26l25l/node/sda1/objects/489/997/f4d0038718d5d640332562aa4ebb7997/1757769841.49268.meta test DEBUG: Removed /tmp/tmpgs26l25l/node/sda1/objects/244/997/f4d0038718d5d640332562aa4ebb7997/1757769841.49268.meta test DEBUG: Removed /tmp/tmpgs26l25l/node/sda1/objects/244/997/f4d0038718d5d640332562aa4ebb7997/1757769840.49268.data test DEBUG: Run listdir on /tmp/tmpgs26l25l/node/sda1/objects/489 test DEBUG: Run listdir on /tmp/tmpgs26l25l/node/sda1/objects/244 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (2 files, 2 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.025086 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpydq6c651/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmpydq6c651/node/sda1/objects/205/1f3/cd95660a0321972db584872140f651f3/1757769842.60335.ts to /tmp/tmpydq6c651/node/sda1/objects/411/1f3/cd95660a0321972db584872140f651f3/1757769842.60335.ts test DEBUG: Removed /tmp/tmpydq6c651/node/sda1/objects/205/1f3/cd95660a0321972db584872140f651f3/1757769842.60335.ts test DEBUG: Run listdir on /tmp/tmpydq6c651/node/sda1/objects/411 test DEBUG: Run listdir on /tmp/tmpydq6c651/node/sda1/objects/205 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.024563 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpirmcg2il/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmpirmcg2il/node/sda1/objects/132/de4/84b19f9a1f01c25690b63fac2fa41de4/1757769842.69741.meta to /tmp/tmpirmcg2il/node/sda1/objects/265/de4/84b19f9a1f01c25690b63fac2fa41de4/1757769842.69741.meta test DEBUG: Relinking (cleanup) created link: /tmp/tmpirmcg2il/node/sda1/objects/132/de4/84b19f9a1f01c25690b63fac2fa41de4/1757769841.69741.ts to /tmp/tmpirmcg2il/node/sda1/objects/265/de4/84b19f9a1f01c25690b63fac2fa41de4/1757769841.69741.ts test DEBUG: Removed /tmp/tmpirmcg2il/node/sda1/objects/132/de4/84b19f9a1f01c25690b63fac2fa41de4/1757769842.69741.meta test DEBUG: Removed /tmp/tmpirmcg2il/node/sda1/objects/132/de4/84b19f9a1f01c25690b63fac2fa41de4/1757769841.69741.ts test DEBUG: Run listdir on /tmp/tmpirmcg2il/node/sda1/objects/265 test DEBUG: Run listdir on /tmp/tmpirmcg2il/node/sda1/objects/132 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (2 files, 2 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.014137 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp_ig8b6y0/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmp_ig8b6y0/node/sda1/objects/446 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking (cleanup) created link: /tmp/tmp_ig8b6y0/node/sda1/objects/223/1c7/df32dcf44e910ccbd52e91464bd661c7/1757769842.77850.meta to /tmp/tmp_ig8b6y0/node/sda1/objects/446/1c7/df32dcf44e910ccbd52e91464bd661c7/1757769842.77850.meta test DEBUG: Removed /tmp/tmp_ig8b6y0/node/sda1/objects/223/1c7/df32dcf44e910ccbd52e91464bd661c7/1757769842.77850.meta test DEBUG: Removed /tmp/tmp_ig8b6y0/node/sda1/objects/223/1c7/df32dcf44e910ccbd52e91464bd661c7/1757769840.77850.data test DEBUG: Run listdir on /tmp/tmp_ig8b6y0/node/sda1/objects/223 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.014622 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp7edh3fqv/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmp7edh3fqv/node/sda1/objects/150/0e2/9643e6ce99b8480547339bdbb34e70e2/1757769840.84241.meta to /tmp/tmp7edh3fqv/node/sda1/objects/300/0e2/9643e6ce99b8480547339bdbb34e70e2/1757769840.84241.meta test DEBUG: Removed /tmp/tmp7edh3fqv/node/sda1/objects/150/0e2/9643e6ce99b8480547339bdbb34e70e2/1757769840.84241.meta test DEBUG: Run listdir on /tmp/tmp7edh3fqv/node/sda1/objects/300 test DEBUG: Run listdir on /tmp/tmp7edh3fqv/node/sda1/objects/150 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.009393 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMTtest.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_meta_file_relink_fails test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_meta_file_relink_fails ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_meta_missing_ts_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_meta_missing_ts_files ... ok test.unit.account.test_server.TestAccountController.test_policy_stats_with_legacy test.unit.account.test_server.TestAccountController.test_policy_stats_with_legacy ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_younger_overlapping_donor_shards test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_repair_younger_overlapping_donor_shards ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_containers_xml test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_containers_xml ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_ts_file test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_ts_file ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_xml_escapes_account_name test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_xml_escapes_account_name ... ok test.unit.account.test_server.TestAccountController.test_prefix_and_delim_with_reserved test.unit.account.test_server.TestAccountController.test_prefix_and_delim_with_reserved ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'X-Amz-Copy-Source-If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'X-Amz-Copy-Source-If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'X-Amz-Copy-Source-If-Modified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-Modified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'X-Amz-Copy-Source-If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'X-Amz-Copy-Source-If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'X-Amz-Copy-Source-If-Modified-Since': 'Fri, 01 Apr 2014 11:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'If-Modified-Since': 'Fri, 01 Apr 2014 11:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_headers_with_match_and_s3acl test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_headers_with_match_and_s3acl ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_xml_escapes_container_name test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_xml_escapes_container_name ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_headers_with_not_match_and_s3acl test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAcl.test_upload_part_copy_headers_with_not_match_and_s3acl ... ok test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_bad_hash test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_bad_hash ... ok test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_bad_hash_readline test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_bad_hash_readline ... ok test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_empty test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_empty ... ok test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_empty_bad_hash test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_empty_bad_hash ... ok test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_good test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_good ... ok test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_good_readline test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_good_readline ... ok test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_too_long test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_too_long ... ok test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_too_short_read_all test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_too_short_read_all ... ok test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_too_short_read_piecemeal test.unit.common.middleware.s3api.test_s3request.TestHashingInput.test_too_short_read_piecemeal ... ok test.unit.common.middleware.test_bulk.TestConfig.test_defaults test.unit.common.middleware.test_bulk.TestConfig.test_defaults ... ok test.unit.common.middleware.test_bulk.TestConfig.test_delete_concurrency test.unit.common.middleware.test_bulk.TestConfig.test_delete_concurrency ... ok test.unit.common.middleware.test_bulk.TestUntarMetadata.test_extract_metadata test.unit.common.middleware.test_bulk.TestUntarMetadata.test_extract_metadata ... ok test.unit.common.middleware.test_copy.TestCopyConstraints.test_validate_bad_copy_from test.unit.common.middleware.test_copy.TestCopyConstraints.test_validate_bad_copy_from ... ok test.unit.common.middleware.test_copy.TestCopyConstraints.test_validate_bad_destination test.unit.common.middleware.test_copy.TestCopyConstraints.test_validate_bad_destination ... ok test.unit.common.middleware.test_copy.TestCopyConstraints.test_validate_copy_from test.unit.common.middleware.test_copy.TestCopyConstraints.test_validate_copy_from ... ok test.unit.common.middleware.test_copy.TestCopyConstraints.test_validate_destination test.unit.common.middleware.test_copy.TestCopyConstraints.test_validate_destination ... ok test.unit.common.middleware.test_healthcheck.TestHealthCheck.test_healthcheck test.unit.common.middleware.test_healthcheck.TestHealthCheck.test_healthcheck ... ok test.unit.common.middleware.test_healthcheck.TestHealthCheck.test_healthcheck_pass test.unit.common.middleware.test_healthcheck.TestHealthCheck.test_healthcheck_pass ... ok test.unit.common.middleware.test_healthcheck.TestHealthCheck.test_healthcheck_pass_disabled test.unit.common.middleware.test_healthcheck.TestHealthCheck.test_healthcheck_pass_disabled ... ok test.unit.common.middleware.test_healthcheck.TestHealthCheck.test_healthcheck_pass_not_disabled test.unit.common.middleware.test_healthcheck.TestHealthCheck.test_healthcheck_pass_not_disabled ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_authed_for_path_single test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_authed_for_path_single ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_authed_for_primary_path_multiple test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_authed_for_primary_path_multiple ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_authed_for_second_path_with_operator_role_and_service test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_authed_for_second_path_with_operator_role_and_service ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_delete_denied_for_second_path test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_delete_denied_for_second_path ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_delete_of_second_path_by_reseller_admin test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_delete_of_second_path_by_reseller_admin ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_denied_for_path_single test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_denied_for_path_single ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_denied_for_second_path_for_service_user test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_denied_for_second_path_for_service_user ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_denied_for_second_path_with_only_operator_role test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_denied_for_second_path_with_only_operator_role ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_denied_for_second_path_with_only_service test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_denied_for_second_path_with_only_service ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_existing_swift_owner_ignored test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_existing_swift_owner_ignored ... ok test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_unknown_prefix test.unit.common.middleware.test_keystoneauth.ServiceTokenFunctionality.test_unknown_prefix ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderProject.test_reader_get test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderProject.test_reader_get ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderProject.test_reader_put test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderProject.test_reader_put ... ok test.unit.common.middleware.test_ratelimit.TestSwiftInfo.test_registered_defaults test.unit.common.middleware.test_ratelimit.TestSwiftInfo.test_registered_defaults ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_from_recon_cache test.unit.common.middleware.test_recon.TestReconSuccess.test_from_recon_cache ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_from_recon_cache_exception test.unit.common.middleware.test_recon.TestReconSuccess.test_from_recon_cache_exception ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_from_recon_cache_ioerror test.unit.common.middleware.test_recon.TestReconSuccess.test_from_recon_cache_ioerror ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_replace test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_replace ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_xml_escapes_container_name_as_subdir test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_xml_escapes_container_name_as_subdir ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx66729e607bfb4334a4f13-0068c57070" "proxy-server 1824514" 0.0095 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/1/a/766f39d38cbe464a89c177db573bfa14" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/766f39d38cbe464a89c177db573bfa14" "tx66729e607bfb4334a4f13-0068c57070" "container-server 1824514" 0.0010 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdb1/1/a/766f39d38cbe464a89c177db573bfa14" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/766f39d38cbe464a89c177db573bfa14" "tx66729e607bfb4334a4f13-0068c57070" "container-server 1824514" 0.0009 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/2/a/766f39d38cbe464a89c177db573bfa14" 201 - "PUT http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx66729e607bfb4334a4f13-0068c57070" "proxy-server 1824514" 0.0297 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 201 - "PUT http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx66729e607bfb4334a4f13-0068c57070" "proxy-server 1824514" 0.0467 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx740857c61608498586ced-0068c57070" "proxy-server 1824514" 0.0018 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx740857c61608498586ced-0068c57070" "proxy-server 1824514" 0.0011 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx92e47a961dc2491f832bc-0068c57070" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a/908097c9c1ce447381e90ac5ce01c812" 204 - "HEAD http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812" "tx58721e1640724acf9c5a4-0068c57070" "proxy-server 1824514" 0.0083 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdh1/2/a/908097c9c1ce447381e90ac5ce01c812/o" 200 92 "GET http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812/o" "tx49ad78f9b860414f8b459-0068c57070" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdg1/2/a/908097c9c1ce447381e90ac5ce01c812/o" 200 92 "GET http://foo:8080/v1/a/908097c9c1ce447381e90ac5ce01c812/o" "tx49ad78f9b860414f8b459-0068c57070" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6399ce167b734802b3505-0068c57070" "proxy-server 1824514" 0.0096 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://foo:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "txdf61be40d36c459095593-0068c57070" "proxy-server 1824514" 0.0014 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdb1/2/a/766f39d38cbe464a89c177db573bfa14/o" 201 - "PUT http://foo:8080/sdc1/2/a/766f39d38cbe464a89c177db573bfa14/o" "tx43eb41a0baac493c87d8c-0068c57070" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdc1/2/a/766f39d38cbe464a89c177db573bfa14/o" 201 - "PUT http://foo:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx43eb41a0baac493c87d8c-0068c57070" "proxy-server 1824514" 0.0206 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/2/a/766f39d38cbe464a89c177db573bfa14/o" 201 - "PUT http://foo:8080/sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" "tx43eb41a0baac493c87d8c-0068c57070" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "PUT /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 201 - "PUT http://foo:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx43eb41a0baac493c87d8c-0068c57070" "proxy-server 1824514" 0.0381 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx79c1df68702148e2bf1c7-0068c57070" "proxy-server 1824514" 0.0135 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx1d893325b5cc4906b80be-0068c57070" "proxy-server 1824514" 0.0176 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 200 24 "GET http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx0feecc3d4ece4487b7aef-0068c57070" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txde22dab8a2624fbe8e072-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "txd5ab1ecde6b24952b022c-0068c57070" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 200 24 "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx3755adc0430b405284af6-0068c57070" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx4f9657a9bd2c406ab3217-0068c57070" "proxy-server 1824514" 0.0080 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 200 380 "GET http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14?format=json&states=listing" "tx4f9657a9bd2c406ab3217-0068c57070" "proxy-server 1824514" 0.0183 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx998448e12d274a7c8f597-0068c57070" "proxy-server 1824514" 0.0100 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx3499d9ff27244ff49f086-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdc1/2/a/766f39d38cbe464a89c177db573bfa14/o" 200 24 "GET http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx8bb222dc46ef44a18a451-0068c57070" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txf3639a606c6f4356839e4-0068c57070" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "HEAD /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx61d9dae809e842fc912c1-0068c57070" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:00 +0000] "GET /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 200 24 "GET http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "txaddb70dbdc4843938dfbf-0068c57070" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd8024c84ac3a469d95cb9-0068c57070" "proxy-server 1824514" 0.0057 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx79e11a19ab3c4a2ebf715-0068c57071" "proxy-server 1824514" 0.0180 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "GET /sdc1/2/a/766f39d38cbe464a89c177db573bfa14/o" 412 - "GET http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "txc154aa7d1ce84d848a1a8-0068c57071" "proxy-server 1824514" 0.0071 "-" 1824514 1test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_empty_account test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_empty_account ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_ts_missing_data_missing_meta_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_missing_ts_missing_data_missing_meta_files ... ok test.unit.account.test_server.TestAccountController.test_prefix_with_reserved test.unit.account.test_server.TestAccountController.test_prefix_with_reserved ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_show test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_show ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_has_content_length test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_has_content_length ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_accept test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_accept ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_content_type test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_content_type ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:read:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_with_read_permission test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_with_read_permission ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_without_permission test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_GET_without_permission ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'X-Amz-Copy-Source-If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'X-Amz-Copy-Source-If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ test DEBUG: User tenant_id with role(s) rdr1,rdr2 has project reader authorizing test ERROR: Error retrieving recon data: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 84, in _from_recon_cache with openr(cache_file, 'r') as f: ~~~~~^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/test_recon.py", line 226, in raise_Exception raise Exception Exception test ERROR: Error reading recon cache file: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 84, in _from_recon_cache with openr(cache_file, 'r') as f: ~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: [Errno None] None test ERROR: Error reading recon cache file: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 84, in _from_recon_cache with openr(cache_file, 'r') as f: ~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 84, in _from_recon_cache with openr(cache_file, 'r') as f: ~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: [Errno None] None test ERROR: Error parsing recon cache file: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 84, in _from_recon_cache with openr(cache_file, 'r') as f: ~~~~~^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/test_recon.py", line 223, in raise_ValueError raise ValueError ValueErrortest.unit.common.middleware.test_recon.TestReconSuccess.test_from_recon_cache_valueerror test.unit.common.middleware.test_recon.TestReconSuccess.test_from_recon_cache_valueerror ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_async_info test.unit.common.middleware.test_recon.TestReconSuccess.test_get_async_info ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_account test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_account ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_container test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_container ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_object test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_object ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_object_parallel_once test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_object_parallel_once ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_unrecognized test.unit.common.middleware.test_recon.TestReconSuccess.test_get_auditor_info_unrecognized ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_diskusage test.unit.common.middleware.test_recon.TestReconSuccess.test_get_diskusage ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_diskusage_checkmount_fail test.unit.common.middleware.test_recon.TestReconSuccess.test_get_diskusage_checkmount_fail ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_diskusage_excludes_files test.unit.common.middleware.test_recon.TestReconSuccess.test_get_diskusage_excludes_files ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_diskusage_oserror test.unit.common.middleware.test_recon.TestReconSuccess.test_get_diskusage_oserror ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_driveaudit_info test.unit.common.middleware.test_recon.TestReconSuccess.test_get_driveaudit_info ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_expirer_info_object test.unit.common.middleware.test_recon.TestReconSuccess.test_get_expirer_info_object ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_load test.unit.common.middleware.test_recon.TestReconSuccess.test_get_load ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_mem test.unit.common.middleware.test_recon.TestReconSuccess.test_get_mem ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_mounted test.unit.common.middleware.test_recon.TestReconSuccess.test_get_mounted ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_quarantine_count test.unit.common.middleware.test_recon.TestReconSuccess.test_get_quarantine_count ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_reconstruction test.unit.common.middleware.test_recon.TestReconSuccess.test_get_reconstruction ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_relinker_info test.unit.common.middleware.test_recon.TestReconSuccess.test_get_relinker_info ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_replication_info_account test.unit.common.middleware.test_recon.TestReconSuccess.test_get_replication_info_account ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_replication_info_container test.unit.common.middleware.test_recon.TestReconSuccess.test_get_replication_info_container ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_replication_info_unrecognized test.unit.common.middleware.test_recon.TestReconSuccess.test_get_replication_info_unrecognized ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_replication_object test.unit.common.middleware.test_recon.TestReconSuccess.test_get_replication_object ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5 test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5 ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_excludes_configured_missing_obj_rings test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_excludes_configured_missing_obj_rings ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_excludes_unconfigured_present_obj_rings test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_excludes_unconfigured_present_obj_rings ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_failed_ring_hash_recovers_without_restart test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_failed_ring_hash_recovers_without_restart ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_ioerror_produces_none_hash test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_ioerror_produces_none_hash ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_missing_ring_recovers_without_restart test.unit.common.middleware.test_recon.TestReconSuccess.test_get_ring_md5_missing_ring_recovers_without_restart ... ok test.unit.account.test_server.TestAccountController.test_replicaiton_server_call_all_methods test.unit.account.test_server.TestAccountController.test_replicaiton_server_call_all_methods ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_sharding_info test.unit.common.middleware.test_recon.TestReconSuccess.test_get_sharding_info ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_socket_info test.unit.common.middleware.test_recon.TestReconSuccess.test_get_socket_info ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_time test.unit.common.middleware.test_recon.TestReconSuccess.test_get_time ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted_all_mounted test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted_all_mounted ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted_checkmount_fail test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted_checkmount_fail ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted_excludes_files test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted_excludes_files ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted_no_mounts test.unit.common.middleware.test_recon.TestReconSuccess.test_get_unmounted_no_mounts ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_updater_info_container test.unit.common.middleware.test_recon.TestReconSuccess.test_get_updater_info_container ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_updater_info_object test.unit.common.middleware.test_recon.TestReconSuccess.test_get_updater_info_object ... ok test.unit.common.middleware.test_recon.TestReconSuccess.test_get_updater_info_unrecognized test.unit.common.middleware.test_recon.TestReconSuccess.test_get_updater_info_unrecognized ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_default_types test.unit.common.middleware.test_slo.TestRespAttrs.test_default_types ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_from_empty_headers test.unit.common.middleware.test_slo.TestRespAttrs.test_from_empty_headers ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_from_only_timestamp test.unit.common.middleware.test_slo.TestRespAttrs.test_from_only_timestamp ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_from_regular_object test.unit.common.middleware.test_slo.TestRespAttrs.test_from_regular_object ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_from_valid_sysmeta test.unit.common.middleware.test_slo.TestRespAttrs.test_from_valid_sysmeta ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_from_zero_byte_sysmeta test.unit.common.middleware.test_slo.TestRespAttrs.test_from_zero_byte_sysmeta ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_init_calculates_is_legacy test.unit.common.middleware.test_slo.TestRespAttrs.test_init_calculates_is_legacy ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_init_converts_timestamps_from_strings test.unit.common.middleware.test_slo.TestRespAttrs.test_init_converts_timestamps_from_strings ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_init_with_no_sysmeta test.unit.common.middleware.test_slo.TestRespAttrs.test_init_with_no_sysmeta ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_init_with_no_sysmeta_offset test.unit.common.middleware.test_slo.TestRespAttrs.test_init_with_no_sysmeta_offset ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_invalid_sysmeta test.unit.common.middleware.test_slo.TestRespAttrs.test_invalid_sysmeta ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_legacy_slo_sysmeta test.unit.common.middleware.test_slo.TestRespAttrs.test_legacy_slo_sysmeta ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_non_slo_with_sysmeta test.unit.common.middleware.test_slo.TestRespAttrs.test_non_slo_with_sysmeta ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_partial_modern_sysmeta test.unit.common.middleware.test_slo.TestRespAttrs.test_partial_modern_sysmeta ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_not_legacy test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_not_legacy ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_with_range test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_with_range ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_with_raw_data test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_with_raw_data ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_with_sub_slo test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_with_sub_slo ... ok test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_with_sub_slo_range test.unit.common.middleware.test_slo.TestRespAttrs.test_update_from_segments_with_sub_slo_range ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_account_delete_permissions test.unit.common.middleware.test_tempauth.TestAuth.test_account_delete_permissions ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_account_put_permissions test.unit.common.middleware.test_tempauth.TestAuth.test_account_put_permissions ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_admin_is_owner test.unit.common.middleware.test_tempauth.TestAuth.test_admin_is_owner ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_anon test.unit.common.middleware.test_tempauth.TestAuth.test_anon ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_anon_badpath test.unit.common.middleware.test_tempauth.TestAuth.test_anon_badpath ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_format test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_format ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_deny_non_reseller_prefix test.unit.common.middleware.test_tempauth.TestAuth.test_auth_deny_non_reseller_prefix ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_deny_non_reseller_prefix_no_override test.unit.common.middleware.test_tempauth.TestAuth.test_auth_deny_non_reseller_prefix_no_override ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_partition test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_partition ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_fail test.unit.common.middleware.test_tempauth.TestAuth.test_auth_fail ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_no_reseller_prefix_deny test.unit.common.middleware.test_tempauth.TestAuth.test_auth_no_reseller_prefix_deny ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_no_reseller_prefix_no_token test.unit.common.middleware.test_tempauth.TestAuth.test_auth_no_reseller_prefix_no_token ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_prefix_init test.unit.common.middleware.test_tempauth.TestAuth.test_auth_prefix_init ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_reseller_prefix_with_s3_deny test.unit.common.middleware.test_tempauth.TestAuth.test_auth_reseller_prefix_with_s3_deny ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_scheme test.unit.common.middleware.test_tempauth.TestAuth.test_auth_scheme ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_old_s3api_details test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_old_s3api_details ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_old_swift3_details test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_old_swift3_details ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_s3api_authorization_good test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_s3api_authorization_good ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_s3api_authorization_invalid test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_s3api_authorization_invalid ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_s3api_unicode_authorization_good test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_s3api_unicode_authorization_good ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_swift3_authorization_good test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_swift3_authorization_good ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_swift3_authorization_invalid test.unit.common.middleware.test_tempauth.TestAuth.test_auth_with_swift3_authorization_invalid ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_account_access test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_account_access ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_acl_group_access test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_acl_group_access ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_acl_referer_after_user_groups test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_acl_referer_after_user_groups ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_acl_referrer_access test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_acl_referrer_access ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_bad_path test.unit.common.middleware.test_tempauth.TestAuth.test_authorize_bad_path ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_new_does_not_exist test.unit.cli.test_relinker.TestRelinker.test_cleanup_new_does_not_exist ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_not_found test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_not_found ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_show_and_analyze test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_show_and_analyze ... ok test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_subcommand_required test.unit.cli.test_manage_shard_ranges.TestManageShardRanges.test_subcommand_required ... ok test.unit.account.test_server.TestAccountController.test_reserved_markers_with_non_reserved test.unit.account.test_server.TestAccountController.test_reserved_markers_with_non_reserved ... ok test.unit.cli.test_recon.TestRecon.test_async_check test.unit.cli.test_recon.TestRecon.test_async_check ... ok test.unit.cli.test_recon.TestRecon.test_calculate_least_and_most_recent test.unit.cli.test_recon.TestRecon.test_calculate_least_and_most_recent ... ok test.unit.cli.test_recon.TestRecon.test_drive_audit_check test.unit.cli.test_recon.TestRecon.test_drive_audit_check ... ok test.unit.cli.test_recon.TestRecon.test_gen_stats test.unit.cli.test_recon.TestRecon.test_gen_stats ... ok test.unit.account.test_server.TestAccountController.test_serv_reserv test.unit.account.test_server.TestAccountController.test_serv_reserv ... ok test.unit.account.test_server.TestAccountController.test_through_call test.unit.account.test_server.TestAccountController.test_through_call ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_with_containers test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_with_containers ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_OPTIONS test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_OPTIONS ... ok test.unit.account.test_server.TestAccountController.test_through_call_invalid_path test.unit.account.test_server.TestAccountController.test_through_call_invalid_path ... ok test.unit.account.test_server.TestAccountController.test_through_call_invalid_path_utf8 test.unit.account.test_server.TestAccountController.test_through_call_invalid_path_utf8 ... ok test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda test ERROR: Container GET returning 503 for (503, 503, 503) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: txff826321e585416eb848c-0068c5706f) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: txff826321e585416eb848c-0068c5706f) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: txff826321e585416eb848c-0068c5706f) test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: txff826321e585416eb848c-0068c5706f) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: txff826321e585416eb848c-0068c5706f) test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: txff826321e585416eb848c-0068c5706f)test.unit.proxy.controllers.test_container.TestContainerController.test_response_codes_for_GET test.unit.proxy.controllers.test_container.TestContainerController.test_response_codes_for_GET ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_swift_owner test.unit.proxy.controllers.test_container.TestContainerController.test_swift_owner ... ok test ERROR: Error reading ringfile: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 277, in get_ring_md5 sums[ringfile] = md5_hash_for_file(ringfile) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test ERROR: Error reading ringfile: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 277, in get_ring_md5 sums[ringfile] = md5_hash_for_file(ringfile) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test ERROR: Error reading ringfile: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 277, in get_ring_md5 sums[ringfile] = md5_hash_for_file(ringfile) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test ERROR: Error reading ringfile: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 277, in get_ring_md5 sums[ringfile] = md5_hash_for_file(ringfile) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/test_recon.py", line 384, in fake_hash_for_file raise IOError OSError test ERROR: Error reading ringfile: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 277, in get_ring_md5 sums[ringfile] = md5_hash_for_file(ringfile) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/test_recon.py", line 384, in fake_hash_for_file raise IOError OSError test ERROR: Error reading ringfile: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 277, in get_ring_md5 sums[ringfile] = md5_hash_for_file(ringfile) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test ERROR: Error reading ringfile: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 277, in get_ring_md5 sums[ringfile] = md5_hash_for_file(ringfile) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test ERROR: Error reading ringfile: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/recon.py", line 277, in get_ring_md5 sums[ringfile] = md5_hash_for_file(ringfile) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError ERROR: swift.cache could not be found in env! test.unit.common.middleware.test_tempauth.TestAuth.test_compressed_fernet_token_no_memcache test.unit.common.middleware.test_tempauth.TestAuth.test_compressed_fernet_token_no_memcache ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_deny_cross_reseller test.unit.common.middleware.test_tempauth.TestAuth.test_deny_cross_reseller ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_detect_reseller_request test.unit.common.middleware.test_tempauth.TestAuth.test_detect_reseller_request ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_new_does_not_exist_and_relink_fails test.unit.cli.test_relinker.TestRelinker.test_cleanup_new_does_not_exist_and_relink_fails ... ok test.unit.cli.test_recon.TestRecon.test_get_error_ringnames test.unit.cli.test_recon.TestRecon.test_get_error_ringnames ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_metadata test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_metadata ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_lots_of_keys test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_lots_of_keys ... ok ERROR: swift.cache could not be found in env! ERROR: swift.cache could not be found in env! test.unit.common.middleware.test_tempauth.TestAuth.test_fernet_token_no_memcache test.unit.common.middleware.test_tempauth.TestAuth.test_fernet_token_no_memcache ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail_bad_path test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail_bad_path ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail_invalid_x_auth_user_format test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail_invalid_x_auth_user_format ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail_missing_key test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail_missing_key ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail_non_matching_account_in_request test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_fail_non_matching_account_in_request ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_memcache_error test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_memcache_error ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_sets_access_logging_user_id test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_sets_access_logging_user_id ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_success test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_success ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_success_other_auth_prefix test.unit.common.middleware.test_tempauth.TestAuth.test_get_token_success_other_auth_prefix ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_get_user_group test.unit.common.middleware.test_tempauth.TestAuth.test_get_user_group ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_object_name_containing_slash test.unit.common.middleware.test_tempauth.TestAuth.test_object_name_containing_slash ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_old_token_overdate test.unit.common.middleware.test_tempauth.TestAuth.test_old_token_overdate ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_old_token_with_old_data test.unit.common.middleware.test_tempauth.TestAuth.test_old_token_with_old_data ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_options_call test.unit.common.middleware.test_tempauth.TestAuth.test_options_call ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_override_asked_for_and_allowed test.unit.common.middleware.test_tempauth.TestAuth.test_override_asked_for_and_allowed ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_override_asked_for_but_not_allowed test.unit.common.middleware.test_tempauth.TestAuth.test_override_asked_for_but_not_allowed ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_override_default_allowed test.unit.common.middleware.test_tempauth.TestAuth.test_override_default_allowed ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_regular_is_not_owner test.unit.common.middleware.test_tempauth.TestAuth.test_regular_is_not_owner ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_request_method_not_allowed test.unit.common.middleware.test_tempauth.TestAuth.test_request_method_not_allowed ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_reseller_admin_is_owner test.unit.common.middleware.test_tempauth.TestAuth.test_reseller_admin_is_owner ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_reseller_prefix_init test.unit.common.middleware.test_tempauth.TestAuth.test_reseller_prefix_init ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_statsd_prefix test.unit.common.middleware.test_tempauth.TestAuth.test_statsd_prefix ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_storage_url_based_on_host test.unit.common.middleware.test_tempauth.TestAuth.test_storage_url_based_on_host ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_storage_url_default test.unit.common.middleware.test_tempauth.TestAuth.test_storage_url_default ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_storage_url_overridden_scheme test.unit.common.middleware.test_tempauth.TestAuth.test_storage_url_overridden_scheme ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_successful_token_unicode_user test.unit.common.middleware.test_tempauth.TestAuth.test_successful_token_unicode_user ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_sync_request_fail_key test.unit.common.middleware.test_tempauth.TestAuth.test_sync_request_fail_key ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_sync_request_fail_no_timestamp test.unit.common.middleware.test_tempauth.TestAuth.test_sync_request_fail_no_timestamp ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_sync_request_success test.unit.common.middleware.test_tempauth.TestAuth.test_sync_request_success ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_sync_request_success_lb_sync_host test.unit.common.middleware.test_tempauth.TestAuth.test_sync_request_success_lb_sync_host ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_top_level_deny test.unit.common.middleware.test_tempauth.TestAuth.test_top_level_deny ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_use_old_token_from_memcached test.unit.common.middleware.test_tempauth.TestAuth.test_use_old_token_from_memcached ... ok test.unit.common.middleware.test_tempauth.TestAuth.test_use_token_success test.unit.common.middleware.test_tempauth.TestAuth.test_use_token_success ... ok test.unit.common.middleware.test_tempurl.TestSwiftInfo.test_bad_config test.unit.common.middleware.test_tempurl.TestSwiftInfo.test_bad_config ... ok test.unit.common.middleware.test_tempurl.TestSwiftInfo.test_no_deprecated_digests test.unit.common.middleware.test_tempurl.TestSwiftInfo.test_no_deprecated_digests ... ok test.unit.common.middleware.test_tempurl.TestSwiftInfo.test_non_default_methods test.unit.common.middleware.test_tempurl.TestSwiftInfo.test_non_default_methods ... ok test.unit.common.middleware.test_tempurl.TestSwiftInfo.test_registered_defaults test.unit.common.middleware.test_tempurl.TestSwiftInfo.test_registered_defaults ... ok test.unit.common.test_daemon.TestDaemon.test_create test.unit.common.test_daemon.TestDaemon.test_create ... ok test.unit.common.test_daemon.TestDaemon.test_stubs test.unit.common.test_daemon.TestDaemon.test_stubs ... ok test.unit.common.test_db.TestDatabaseBroker.test_DB_PREALLOCATION_setting test.unit.common.test_db.TestDatabaseBroker.test_DB_PREALLOCATION_setting ... ok test.unit.common.test_db.TestDatabaseBroker.test_commit_puts test.unit.common.test_db.TestDatabaseBroker.test_commit_puts ... ok test.unit.common.test_db.TestDatabaseBroker.test_delete_db test.unit.common.test_db.TestDatabaseBroker.test_delete_db ... ok test.unit.common.test_db.TestDatabaseBroker.test_disk_db_init test.unit.common.test_db.TestDatabaseBroker.test_disk_db_init ... ok test.unit.common.test_db.TestDatabaseBroker.test_disk_preallocate test.unit.common.test_db.TestDatabaseBroker.test_disk_preallocate ... ok test.unit.common.test_db.TestDatabaseBroker.test_initialize test.unit.common.test_db.TestDatabaseBroker.test_initialize ... ok test.unit.common.test_db.TestDatabaseBroker.test_lock test.unit.common.test_db.TestDatabaseBroker.test_lock ... ok test.unit.common.test_db.TestDatabaseBroker.test_memory_db_init test.unit.common.test_db.TestDatabaseBroker.test_memory_db_init ... ok test.unit.common.test_db.TestDatabaseBroker.test_merge_syncs test.unit.common.test_db.TestDatabaseBroker.test_merge_syncs ... ok test.unit.common.test_db.TestDatabaseBroker.test_metadata test.unit.common.test_db.TestDatabaseBroker.test_metadata ... ok test.unit.common.test_db.TestDatabaseBroker.test_metadata_raises_exception_on_non_utf8 test.unit.common.test_db.TestDatabaseBroker.test_metadata_raises_exception_on_non_utf8 ... ok test.unit.common.test_db.TestDatabaseBroker.test_metadata_raises_exception_over_max_count test.unit.common.test_db.TestDatabaseBroker.test_metadata_raises_exception_over_max_count ... ok test.unit.common.test_db.TestDatabaseBroker.test_metadata_raises_exception_over_max_overall_size test.unit.common.test_db.TestDatabaseBroker.test_metadata_raises_exception_over_max_overall_size ... ok test.unit.common.test_db.TestDatabaseBroker.test_metadata_with_max_count test.unit.common.test_db.TestDatabaseBroker.test_metadata_with_max_count ... ok test.unit.common.test_db.TestDatabaseBroker.test_metadata_with_max_overall_size test.unit.common.test_db.TestDatabaseBroker.test_metadata_with_max_overall_size ... ok test.unit.common.test_db.TestDatabaseBroker.test_newid test.unit.common.test_db.TestDatabaseBroker.test_newid ... ok Quarantined /tmp/tmpiwbqakwm/dev/dbs/par/pre/db to /tmp/tmpiwbqakwm/dev/quarantined/tests/db due to malformed database Quarantined /tmp/tmpiwbqakwm/dev/dbs/par/pre/db to /tmp/tmpiwbqakwm/dev/quarantined/tests/db due to malformed database Quarantined /tmp/tmpiwbqakwm/dev/dbs/par/pre/db to /tmp/tmpiwbqakwm/dev/quarantined/tests/db due to corrupted database Quarantined /tmp/tmpiwbqakwm/dev/dbs/par/pre/db to /tmp/tmpiwbqakwm/dev/quarantined/tests/db due to disk error while accessing database test.unit.common.test_db.TestDatabaseBroker.test_possibly_quarantine_db_errors test.unit.common.test_db.TestDatabaseBroker.test_possibly_quarantine_db_errors ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_no_content_md5 test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_no_content_md5 ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_no_key test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_no_key ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:59 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_bucket_already_owned_by_you test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_bucket_already_owned_by_you ... ok test.unit.common.ring.test_ring.TestRingV2.test_get_more_nodes test.unit.common.ring.test_ring.TestRingV2.test_get_more_nodes ... ok test.unit.cli.test_recon.TestRecon.test_get_hosts test.unit.cli.test_recon.TestRecon.test_get_hosts ... ok test.unit.cli.test_recon.TestRecon.test_get_ring_names test.unit.cli.test_recon.TestRecon.test_get_ring_names ... ok test.unit.cli.test_recon.TestRecon.test_get_ringmd5 test.unit.cli.test_recon.TestRecon.test_get_ringmd5 ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_sys_metadata test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_sys_metadata ... ok test.unit.cli.test_recon.TestRecon.test_main_object_hosts_default_alias test.unit.cli.test_recon.TestRecon.test_main_object_hosts_default_alias ... ok test.unit.common.test_db.TestDatabaseBroker.test_put_record test.unit.common.test_db.TestDatabaseBroker.test_put_record ... ok Quarantined /tmp/tmpj048yq1n/dev/dbs/par/pre/db to /tmp/tmpj048yq1n/dev/quarantined/containers/db due to missing row in container_stat table test.unit.common.test_db.TestDatabaseBroker.test_reclaim_missing_container_info test.unit.common.test_db.TestDatabaseBroker.test_reclaim_missing_container_info ... ok test.unit.common.test_db.TestDatabaseBroker.test_skip_commits test.unit.common.test_db.TestDatabaseBroker.test_skip_commits ... ok Quarantined /tmp/tmpvx7_b_wi/dev/dbs/par/pre/db to /tmp/tmpvx7_b_wi/dev/quarantined/containers/db due to missing row in container_stat table test.unit.common.test_db.TestDatabaseBroker.test_update_metadata_missing_container_info test.unit.common.test_db.TestDatabaseBroker.test_update_metadata_missing_container_info ... ok test.unit.common.test_db.TestDatabaseBroker.test_validate_metadata_is_called_from_update_metadata test.unit.common.test_db.TestDatabaseBroker.test_validate_metadata_is_called_from_update_metadata ... ok test.unit.cli.test_recon.TestRecon.test_main_object_hosts_default_all_policies test.unit.cli.test_recon.TestRecon.test_main_object_hosts_default_all_policies ... ok test.unit.common.test_db.TestDatabaseBroker.test_validate_metadata_is_not_called_from_update_metadata test.unit.common.test_db.TestDatabaseBroker.test_validate_metadata_is_not_called_from_update_metadata ... ok test.unit.common.test_db.TestGetDBConnection.test_invalid_path test.unit.common.test_db.TestGetDBConnection.test_invalid_path ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_after_DELETE_not_found test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_after_DELETE_not_found ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_insufficient_space test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_insufficient_space ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_invalid_partition test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_invalid_partition ... ok test.unit.cli.test_recon.TestRecon.test_main_object_hosts_default_invalid test.unit.cli.test_recon.TestRecon.test_main_object_hosts_default_invalid ... ok test.unit.cli.test_recon.TestRecon.test_main_object_hosts_default_unu test.unit.cli.test_recon.TestRecon.test_main_object_hosts_default_unu ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_quiet test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_quiet ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_no_applicable_policy test.unit.cli.test_relinker.TestRelinker.test_cleanup_no_applicable_policy ... ok test ERROR: Container GET returning 503 for [] (txn: txff826321e585416eb848c-0068c5706f) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:1001/sdb (txn: txf8ee2af4624c433ba32fa-0068c57070) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:1000/sda (txn: txf8ee2af4624c433ba32fa-0068c57070) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:1002/sdc (txn: txf8ee2af4624c433ba32fa-0068c57070) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.3:1003/sda (txn: txf8ee2af4624c433ba32fa-0068c57070) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.4:1004/sda (txn: txf8ee2af4624c433ba32fa-0068c57070) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.5:1005/sda (txn: txf8ee2af4624c433ba32fa-0068c57070) test ERROR: Container GET returning 503 for [500, 500, 500, 500, 500, 500] (txn: txf8ee2af4624c433ba32fa-0068c57070) test INFO: Client disconnected on read of '/a/c' (txn: tx5ea0b75a773b4771b76e7-0068c57070) test INFO: Client disconnected on read of '/a/c' (txn: tx0c396741af7144d9a69a7-0068c57070) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx663ed240790e4a2ca9f03-0068c57070) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx663ed240790e4a2ca9f03-0068c57070) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx663ed240790e4a2ca9f03-0068c57070) test ERROR: Container GET returning 503 for [] (txn: tx663ed240790e4a2ca9f03-0068c57070) test INFO: Client disconnected on read of '/a/c' (txn: tx663ed240790e4a2ca9f03-0068c57070) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx76ddf04727d641eaaa077-0068c57070) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx76ddf04727d641eaaa077-0068c57070) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx76ddf04727d641eaaa077-0068c57070) test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx76ddf04727d641eaaa077-0068c57070) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx76ddf04727d641eaaa077-0068c57070) test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx76ddf04727d641eaaa077-0068c57070) test ERROR: Container GET returning 503 for [] (txn: tx76ddf04727d641eaaa077-0068c57070) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx38cfc896947b4450abcec-0068c57070) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx38cfc896947b4450abcec-0068c57070) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx38cfc896947b4450abcec-0068c57070) test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx38cfc896947b4450abcec-0068c57070) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx38cfc896947b4450abcec-0068c57070) test ERROR: Container GET returning 503 for [] (txn: tx38cfc896947b4450abcec-0068c57070) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txeb9bf8161a37495ebeafd-0068c57070) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txeb9bf8161a37495ebeafd-0068c57070) test ERROR: Container GET returning 503 for [] (txn: txeb9bf8161a37495ebeafd-0068c57070) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txb7b7a0bf59d142268fe1d-0068c57070) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:1002/sdc (txn: tx34a8e79659f448459e4f7-0068c57070) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:1001/sdb (txn: tx34a8e79659f448459e4f7-0068c57070) test ERROR: Container GET returning 503 for [500, 500] (txn: tx34a8e79659f448459e4f7-0068c57070) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:1002/sdc (txn: tx1107e71b666d4fb68817b-0068c57070) test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: tx6e383fc148d74b7f9a265-0068c57070) test DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx6e383fc148d74b7f9a265-0068c57070) test INFO: Client disconnected on read of '/a/c' (txn: tx6e383fc148d74b7f9a265-0068c57070) test ERROR: Container GET returning 503 for [] (txn: txaa80ed26fa29429f8c8bc-0068c57070) test INFO: Client disconnected on read of '/a/c' (txn: txaa80ed26fa29429f8c8bc-0068c57070) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: tx83277d7207f64c81a4687-0068c57070) test INFO: Client disconnected on read of '/a/c' (txn: tx83277d7207f64c81a4687-0068c57070) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx55c7761c9bc54c47b8e53-0068c57070) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx55c7761c9bc54c47b8e53-0068c57070) test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx55c7761c9bc54c47b8e53-0068c57070) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx55c7761c9bc54c47b8e53-0068c57070)test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_sha256_bad test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_sha256_bad ... ok test.unit.common.ring.test_ring.TestRingV2.test_get_more_nodes_with_zero_weight_region test.unit.common.ring.test_ring.TestRingV2.test_get_more_nodes_with_zero_weight_region ... ok test.unit.common.ring.test_ring.TestRingV2.test_get_nodes test.unit.common.ring.test_ring.TestRingV2.test_get_nodes ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_sha256_invalid test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_sha256_invalid ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_sys_meta_headers_POST test.unit.proxy.controllers.test_container.TestContainerController.test_sys_meta_headers_POST ... ok test.unit.proxy.controllers.test_container.TestContainerController.test_sys_meta_headers_PUT test.unit.proxy.controllers.test_container.TestContainerController.test_sys_meta_headers_PUT ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_timestamp_not_float test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_timestamp_not_float ... ok test.unit.cli.test_recon.TestRecon.test_ptime test.unit.cli.test_recon.TestRecon.test_ptime ... ok test.unit.cli.test_recon.TestRecon.test_quarantine_check test.unit.cli.test_recon.TestRecon.test_quarantine_check ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_lots_of_keys test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_lots_of_keys ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_record_type_object test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_record_type_object ... ok test INFO: 1.2.3.4 - - [01/Jan/1970:02:46:42 +0000] "HEAD /sda1/p/a" 404 - "-" "-" "-" 2.0000 "-" 1234 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0030 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0111 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0015 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0019 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 269 "-" "-" "-" 0.0180 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 134 "-" "-" "-" 0.0121 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0009 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0098 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00null%00test03" 201 - "-" "-" "-" 0.0015 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 270 "-" "-" "-" 0.0221 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 136 "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c_nulo" 201 - "-" "-" "-" 0.0010 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c_unu" 201 - "-" "-" "-" 0.0014 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0178 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0154 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00null%00" 201 - "-" "-" "-" 0.0010 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0121 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/null" 201 - "-" "-" "-" 0.0081 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 118 "-" "-" "-" 0.0020 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 381 "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 252 "-" "-" "-" 0.0014 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 252 "-" "-" "-" 0.0111 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0148 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 68 "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0119 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 400 37 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 400 33 "-" "-" "-" 0.0001 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 400 34 "-" "-" "-" 0.0001 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 400 34 "-" "-" "-" 0.0001 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 400 38 "-" "-" "-" 0.0001 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 400 34 "-" "-" "-" 0.0001 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0210 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0212 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0018 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0173 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0187 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0140 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0187 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0008 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0176 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00null%00foo" 201 - "-" "-" "-" 0.0014 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00nullish" 201 - "-" "-" "-" 0.0176 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0018 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 158 "-" "-" "-" 0.0172 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0227 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0010 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0308 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00null%00foo" 201 - "-" "-" "-" 0.0016 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00nullish" 201 - "-" "-" "-" 0.0137 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0020 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 269 "-" "-" "-" 0.0016 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0149 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0009 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0177 "-" 1824502 1 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/nullish" 201 - "-" "-" "-" 0.0015 "-" 1824502 0 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 390 "-" "-" "-" 0.0143 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 121 "-" "-" "-" 0.0136 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 390 "-" "-" "-" 0.0015 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 255 "-" "-" "-" 0.0136 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /bob" 400 18 "-" "-" "-" 0.0002 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a/c%D8%3E%2520" 412 12 "-" "-" "-" 0.0001 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0198 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0013 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824502 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824502 -test.unit.account.test_server.TestAccountController.test_utf8_metadata test.unit.account.test_server.TestAccountController.test_utf8_metadata ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_acl_GET test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_acl_GET ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_acl_PUT test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_acl_PUT ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_canned_acl_PUT test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_canned_acl_PUT ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_fails_with_both_acl_header_and_xml_PUT test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_fails_with_both_acl_header_and_xml_PUT ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_record_type_shard test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_record_type_shard ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_record_type_shard_with_listing_state test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_record_type_shard_with_listing_state ... ok test.unit.cli.test_recon.TestRecon.test_umount_check test.unit.cli.test_recon.TestRecon.test_umount_check ... ok test.unit.cli.test_recon.TestScout.test_scout_http_error test.unit.cli.test_recon.TestScout.test_scout_http_error ... ok test.unit.cli.test_recon.TestScout.test_scout_ok test.unit.cli.test_recon.TestScout.test_scout_ok ... ok test.unit.cli.test_recon.TestScout.test_scout_server_type_http_error test.unit.cli.test_recon.TestScout.test_scout_server_type_http_error ... ok test.unit.cli.test_recon.TestScout.test_scout_server_type_ok test.unit.cli.test_recon.TestScout.test_scout_server_type_ok ... ok test.unit.common.ring.test_ring.TestRingV2.test_get_part test.unit.common.ring.test_ring.TestRingV2.test_get_part ... ok test.unit.common.ring.test_ring.TestRingV2.test_get_part_nodes test.unit.common.ring.test_ring.TestRingV2.test_get_part_nodes ... ok test.unit.common.ring.test_ring.TestRingV2.test_has_changed test.unit.common.ring.test_ring.TestRingV2.test_has_changed ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT ... ok test.unit.cli.test_recon.TestScout.test_scout_server_type_socket_timeout test.unit.cli.test_recon.TestScout.test_scout_server_type_socket_timeout ... ok test.unit.cli.test_recon.TestScout.test_scout_server_type_url_error test.unit.cli.test_recon.TestScout.test_scout_server_type_url_error ... ok test.unit.cli.test_recon.TestScout.test_scout_socket_timeout test.unit.cli.test_recon.TestScout.test_scout_socket_timeout ... ok test.unit.cli.test_recon.TestScout.test_scout_url_error test.unit.cli.test_recon.TestScout.test_scout_url_error ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_bad_container_key_for_default_required_list test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_bad_container_key_for_default_required_list ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_bad_object_key_for_default_required_list test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_bad_object_key_for_default_required_list ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_callback_exception test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_callback_exception ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_missing_callback test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_missing_callback ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_sha256_valid test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_sha256_valid ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_missing_container_key_for_specified_required_list test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_missing_container_key_for_specified_required_list ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_missing_key_for_default_required_list test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_missing_key_for_default_required_list ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_fails_with_neither_acl_header_nor_xml_PUT test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_bucket_fails_with_neither_acl_header_nor_xml_PUT ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_missing_object_key_for_specified_required_list test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_missing_object_key_for_specified_required_list ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_to_object test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_to_object ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_not_a_dict test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_not_a_dict ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_with_crypto_meta test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_keys_with_crypto_meta ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_multiple_keys test.unit.common.middleware.crypto.test_crypto_utils.TestCryptoWsgiContext.test_get_multiple_keys ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_no_content_md5 test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_no_content_md5 ... ok test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_bad_active_key test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_bad_active_key ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_handle_acl_header test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_handle_acl_header ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_handle_acl_with_invalid_header_string test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_handle_acl_with_invalid_header_string ... ok d2r2z2-127.0.0.3:6202R127.0.0.3:6202/sdc3_"" weight set to 3.14 d1r1z1-127.0.0.2:6201R127.0.0.2:6201/sda2_"" weight set to 6.28 Search value matched 0 devices. The on-disk ring builder is unchanged. d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 Device d4r2z3-test.test.com:6000Rr.test.com:7000/sda3_"some meta data" with 100.0 weight got id 4 d4r2z314-test.test.com:6000Rr.test.com:7000/sda3_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 d0r0z314-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" zone set to 314 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6000R[2::10]:7000/sda3_"some meta data" with 100.0 weight got id 4 d4r2z314-[2001:0:1234::c1c0:abcd:876]:6000R[2::10]:7000/sda3_"some meta data" zone set to 314 Device d4r2z3-[2001:0:1234::c1c0:abcd:876]:6000R[2::10]:7000/sda3_"some meta data" with 100.0 weight got id 4 d4r2z314-[2001:0:1234::c1c0:abcd:876]:6000R[2::10]:7000/sda3_"some meta data" zone set to 314 swift-ring-builder set_zone [ set_zone --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' zones. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_zone [ set_zone --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' zones. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included. Search value matched 0 devices. The on-disk ring builder is unchanged. Unknown command: unknown swift-ring-builder 1.3 swift-ring-builder Shows information about the ring and the devices within. Output includes a table that describes the report parameters (id, region, port, flags, etc). flags: possible values are 'DEL' and '' DEL - indicates that the device is marked for removal from ring and will be removed in next rebalance. swift-ring-builder add [r]z-:[R:]/_ [[r]z-:[R:]/_ ] ... Where and are replication ip and port. or swift-ring-builder add --region --zone --ip --port [--replication-ip ] [--replication-port ] --device --weight [--meta ] Adds devices to the ring with the given information. No partitions will be assigned to the new device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. swift-ring-builder cancel_increase_partition_power Cancel the increase of the partition power. A write_ring command is needed to make the change take effect. Once the updated rings have been deployed to all servers you need to run the swift-object-relinker tool to cleanup unneeded links. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder create Creates with 2^ partitions and . is number of hours to restrict moving a partition more than once. swift-ring-builder dispersion [options] Output report on dispersion. --recalculate option will rebuild cached dispersion info and save builder --verbose option will display dispersion graph broken down by tier You can filter which tiers are evaluated to drill down using a regex in the optional search_filter argument. i.e. swift-ring-builder dispersion "r\d+z\d+$" -v ... would only display rows for the zone tiers swift-ring-builder dispersion ".*\-[^/]*$" -v ... would only display rows for the server tiers The reports columns are: Tier : the name of the tier parts : the total number of partitions with assignment in the tier % : the percentage of parts in the tier with replicas over assigned max : maximum replicas a part should have assigned at the tier 0 - N : the number of parts with that many replicas assigned e.g. Tier: parts % max 0 1 2 3 r1z1 1022 79.45 1 2 210 784 28 r1z1 has 1022 total parts assigned, 79% of them have more than the recommend max replica count of 1 assigned. Only 2 parts in the ring are *not* assigned in this tier (0 replica count), 210 parts have the recommend replica count of 1, 784 have 2 replicas, and 28 sadly have all three replicas in this tier. swift-ring-builder finish_increase_partition_power Finally removes the next_part_power flag. Has to be run after the swift-object-relinker tool has been used to cleanup old existing data. A write_ring command is needed to make the change take effect. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder increase_partition_power Increases the partition power by one. Needs to be run after prepare_increase_partition_power has been run and all existing data has been relinked using the swift-object-relinker tool. A write_ring command is needed to make the change take effect. Once the updated rings have been deployed to all servers you need to run the swift-object-relinker tool to cleanup old data. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder list_parts [] .. or swift-ring-builder list_parts --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Returns a 2 column list of all the partitions that are assigned to any of the devices matching the search values given. The first column is the assigned partition number and the second column is the number of device matches for that partition. The list is ordered from most number of matches to least. If there are a lot of devices to match against, this command could take a while to run. swift-ring-builder prepare_increase_partition_power Prepare the ring to increase the partition power by one. A write_ring command is needed to make the change take effect. Once the updated rings have been deployed to all servers you need to run the swift-object-relinker tool to relink existing data. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you increase the partition power and deploy changed rings, you may introduce unavailability in your cluster. This has an end-user impact. Make sure you execute required operations to increase the partition power accurately. swift-ring-builder pretend_min_part_hours_passed Resets the clock on the last time a rebalance happened, thus circumventing the min_part_hours check. ***************************** USE THIS WITH EXTREME CAUTION ***************************** If you run this command and deploy rebalanced rings before a replication pass completes, you may introduce unavailability in your cluster. This has an end-user impact. swift-ring-builder rebalance [options] Attempts to rebalance the ring by reassigning partitions that haven't been recently reassigned. swift-ring-builder remove [search-value ...] [--yes] or swift-ring-builder remove --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Removes the device(s) from the ring. This should normally just be used for a device that has failed. For a device you wish to decommission, it's best to set its weight to 0, wait for it to drain all its data, then use this remove command. This will not take effect until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder search or swift-ring-builder search --region --zone --ip --port --replication-ip --replication-port --device --meta --weight Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Shows information about matching devices. swift-ring-builder set_info :[R:]/_ [ :[R:]/_] ... [--yes] or swift-ring-builder set_info --ip --port --replication-ip --replication-port --device --meta --change-ip --change-port --change-replication-ip --change-replication-port --change-device --change-meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. For each search-value, resets the matched device's information. This information isn't used to assign partitions, so you can use 'write_ring' afterward to rewrite the current ring with the newer device information. Any of the parts are optional in the final :/_ parameter; just give what you want to change. For instance set_info d74 _"snet: 5.6.7.8" would just update the meta data for device id 74. Option --yes assume a yes response to all questions. swift-ring-builder set_min_part_hours Changes the to the given . This should be set to however long a full replication/update cycle takes. We're working on a way to determine this more easily than scanning logs. swift-ring-builder set_overload [%] Changes the overload factor to the given . A rebalance is needed to make the change take effect. swift-ring-builder set_region [ set_region --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' regions. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder set_replicas Changes the replica count to the given . may be a floating-point value, in which case some partitions will have floor() replicas and some will have ceiling() in the correct proportions. A rebalance is needed to make the change take effect. swift-ring-builder set_weight [ ] ... [--yes] or swift-ring-builder set_weight --region --zone --ip --port --replication-ip --replication-port --device --meta --weight [--yes] Where , and are replication ip, hostname and port. and are the search weight and new weight values respectively. Any of the options are optional in both cases. Resets the devices' weights. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions.test.unit.cli.test_ringbuilder.TestCommands.test_use_ringfile_as_builderfile test.unit.cli.test_ringbuilder.TestCommands.test_use_ringfile_as_builderfile ... ok test.unit.cli.test_ringbuilder.TestCommands.test_validate test.unit.cli.test_ringbuilder.TestCommands.test_validate ... ok test.unit.cli.test_ringbuilder.TestCommands.test_validate_composite_builder_file test.unit.cli.test_ringbuilder.TestCommands.test_validate_composite_builder_file ... ok test.unit.cli.test_ringbuilder.TestCommands.test_validate_corrupted_file test.unit.cli.test_ringbuilder.TestCommands.test_validate_corrupted_file ... ok test.unit.cli.test_ringbuilder.TestCommands.test_validate_empty_file test.unit.cli.test_ringbuilder.TestCommands.test_validate_empty_file ... ok test.unit.cli.test_ringbuilder.TestCommands.test_validate_generic_error test.unit.cli.test_ringbuilder.TestCommands.test_validate_generic_error ... ok test.unit.cli.test_ringbuilder.TestCommands.test_validate_non_accessible_file test.unit.cli.test_ringbuilder.TestCommands.test_validate_non_accessible_file ... ok test.unit.cli.test_ringbuilder.TestCommands.test_validate_non_existent_file test.unit.cli.test_ringbuilder.TestCommands.test_validate_non_existent_file ... ok test.unit.cli.test_ringbuilder.TestCommands.test_version_from_builder_file test.unit.cli.test_ringbuilder.TestCommands.test_version_from_builder_file ... ok test.unit.cli.test_ringbuilder.TestCommands.test_version_from_builder_file_with_ring_missing test.unit.cli.test_ringbuilder.TestCommands.test_version_from_builder_file_with_ring_missing ... ok test.unit.cli.test_ringbuilder.TestCommands.test_version_serialization_1 test.unit.cli.test_ringbuilder.TestCommands.test_version_serialization_1 ... ok test.unit.cli.test_ringbuilder.TestCommands.test_version_serialization_2 test.unit.cli.test_ringbuilder.TestCommands.test_version_serialization_2 ... ok test.unit.common.test_db.TestGetDBConnection.test_locked_db test.unit.common.test_db.TestGetDBConnection.test_locked_db ... ok test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_invalid_xml test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_invalid_xml ... ok test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_bad_key_algorithm test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_bad_key_algorithm ... ok test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_bad_key_length test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_bad_key_length ... ok test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_config_in_filter_section test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_config_in_filter_section ... ok test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_config_in_separate_file test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_config_in_separate_file ... ok test.unit.cli.test_ringbuilder.TestCommands.test_version_serialization_default test.unit.cli.test_ringbuilder.TestCommands.test_version_serialization_default ... ok test.unit.cli.test_ringbuilder.TestCommands.test_version_with_builder_file_missing test.unit.cli.test_ringbuilder.TestCommands.test_version_with_builder_file_missing ... ok test.unit.cli.test_ringbuilder.TestCommands.test_warn_at_risk test.unit.cli.test_ringbuilder.TestCommands.test_warn_at_risk ... ok test.unit.cli.test_ringbuilder.TestCommands.test_write_builder test.unit.cli.test_ringbuilder.TestCommands.test_write_builder ... ok test.unit.cli.test_ringbuilder.TestCommands.test_write_builder_after_device_removal test.unit.cli.test_ringbuilder.TestCommands.test_write_builder_after_device_removal ... ok test.unit.cli.test_ringbuilder.TestCommands.test_write_builder_fractional_replicas test.unit.cli.test_ringbuilder.TestCommands.test_write_builder_fractional_replicas ... ok test.unit.cli.test_ringbuilder.TestCommands.test_write_builder_no_version test.unit.cli.test_ringbuilder.TestCommands.test_write_builder_no_version ... ok test.unit.cli.test_ringbuilder.TestCommands.test_write_empty_ring test.unit.cli.test_ringbuilder.TestCommands.test_write_empty_ring ... ok test.unit.cli.test_ringbuilder.TestCommands.test_write_ring test.unit.cli.test_ringbuilder.TestCommands.test_write_ring ... ok test.unit.cli.test_ringbuilder.TestRebalanceCommand.test_cached_dispersion_value test.unit.cli.test_ringbuilder.TestRebalanceCommand.test_cached_dispersion_value ... ok test.unit.common.test_db.TestGetDBConnection.test_normal_case test.unit.common.test_db.TestGetDBConnection.test_normal_case ... ok test.unit.common.test_digest.TestDigestUtils.test_extract_digest_and_algorithm test.unit.common.test_digest.TestDigestUtils.test_extract_digest_and_algorithm ... ok test.unit.common.test_digest.TestDigestUtils.test_get_allowed_digests test.unit.common.test_digest.TestDigestUtils.test_get_allowed_digests ... ok test.unit.common.test_digest.TestDigestUtils.test_get_hmac test.unit.common.test_digest.TestDigestUtils.test_get_hmac ... ok test.unit.common.test_digest.TestDigestUtils.test_get_hmac_digest test.unit.common.test_digest.TestDigestUtils.test_get_hmac_digest ... ok test.unit.common.test_digest.TestDigestUtils.test_get_hmac_ip_range test.unit.common.test_digest.TestDigestUtils.test_get_hmac_ip_range ... ok test.unit.common.test_digest.TestDigestUtils.test_get_hmac_ip_range_non_binary_type test.unit.common.test_digest.TestDigestUtils.test_get_hmac_ip_range_non_binary_type ... ok kmip.services.server.kmip_protocol: Something useful kmip.services.server.kmip_protocol: Something useful kmip.services.server.kmip_protocol: Something useful kmip.services.server.kmip_protocol: Something useful kmip.services.server.kmip_protocol: Something useful kmip.services.server.kmip_protocol: Something useful kmip.core.config_helper: Also useful kmip.core.config_helper: Also useful kmip.core.config_helper: Also useful kmip.core.config_helper: Also useful kmip.core.config_helper: Also useful kmip.core.config_helper: Also useful kmip: Boring, but not secret kmip: Boring, but not secret kmip: Boring, but not secret kmip: Boring, but not secret kmip: Boring, but not secret kmip: Boring, but not secret test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_object_acl_GET test.unit.common.middleware.s3api.test_acl.TestS3ApiAclNoSetup.test_object_acl_GET ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_absolute_target test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_absolute_target ... ok test.unit.common.middleware.s3api.test_location.TestS3ApiLocation.test_object_location test.unit.common.middleware.s3api.test_location.TestS3ApiLocation.test_object_location ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_bad_request test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_bad_request ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_bad_request_app_logging test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_bad_request_app_logging ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_bad_request_server_logging test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_bad_request_server_logging ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_chunked_with_content_length test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_chunked_with_content_length ... ok test.unit.common.middleware.s3api.test_location.TestS3ApiLocation.test_object_location_setting_as_us_west_1 test.unit.common.middleware.s3api.test_location.TestS3ApiLocation.test_object_location_setting_as_us_west_1 ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_leading_slashes test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_leading_slashes ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_messy test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_messy ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_quoted test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_quoted ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_list_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_list_parts ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_too_many_keys test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_too_many_keys ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_request_lines test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_request_lines ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_simple test.unit.common.test_http_protocol.TestSwiftHttpProtocolSomeMore.test_simple ... ok test.unit.common.test_manager.TestManagerModule.test_command_wrapper test.unit.common.test_manager.TestManagerModule.test_command_wrapper ... ok test.unit.common.test_manager.TestManagerModule.test_exc test.unit.common.test_manager.TestManagerModule.test_exc ... ok test.unit.common.test_manager.TestManagerModule.test_format_server_name test.unit.common.test_manager.TestManagerModule.test_format_server_name ... ok test.unit.common.test_manager.TestManagerModule.test_safe_kill test.unit.common.test_manager.TestManagerModule.test_safe_kill ... ok test.unit.common.test_manager.TestManagerModule.test_servers test.unit.common.test_manager.TestManagerModule.test_servers ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. =============================================================================== --> Starting reconnaissance on 2 hosts (object) =============================================================================== =============================================================================== --> Starting reconnaissance on 5 hosts (object) =============================================================================== =============================================================================== --> Starting reconnaissance on 2 hosts (object) =============================================================================== test ERROR: Bad key for 'container': Key must be length 32 bytes: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 178, in get_keys self.crypto.check_key(key) ~~~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 141, in check_key raise ValueError("Key must be length %s bytes" % self.key_length) ValueError: Key must be length 32 bytes test ERROR: Bad key for 'object': Key must be length 32 bytes: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 178, in get_keys self.crypto.check_key(key) ~~~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 141, in check_key raise ValueError("Key must be length %s bytes" % self.key_length) ValueError: Key must be length 32 bytes test ERROR: get_keys(): from callback: boom: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 166, in get_keys keys = fetch_crypto_keys(key_id=key_id) File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/crypto/test_crypto_utils.py", line 95, in callback raise Exception('boom') Exception: boom test ERROR: ERROR get_keys() missing callback: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 158, in get_keys fetch_crypto_keys = env[CRYPTO_KEY_CALLBACK] ~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: 'swift.callback.fetch_crypto_keys' test ERROR: Missing key for 'container': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 177, in get_keys key = keys[name] ~~~~^^^^^^ KeyError: 'container' test ERROR: Missing key for 'object': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 177, in get_keys key = keys[name] ~~~~^^^^^^ KeyError: 'object' test ERROR: Missing key for 'object': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 177, in get_keys key = keys[name] ~~~~^^^^^^ KeyError: 'object' test ERROR: Did not get a keys dict: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/crypto/crypto_utils.py", line 177, in get_keys key = keys[name] ~~~~^^^^^^ TypeError: list indices must be integers or slices, not str Something useful Also useful Boring, but not secret test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_logger_manipulations test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_logger_manipulations ... ok test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_missing_key_id test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_missing_key_id ... ok test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_multikey_config_in_filter_section test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_multikey_config_in_filter_section ... ok test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_multikey_config_in_separate_file test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_multikey_config_in_separate_file ... ok test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_proxy_server_conf_dir test.unit.common.middleware.crypto.test_kmip_keymaster.TestKmipKeymaster.test_proxy_server_conf_dir ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_GET_part_num test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_GET_part_num ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_GET_part_num_and_range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_GET_part_num_and_range ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_encoding_type_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_encoding_type_error ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_unhandled_exception test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_unhandled_exception ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 392, in PUT resp = req.get_response(self.app) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2445, in get_response resp = self.acl_handler.handle_acl( app, method, container, obj, headers) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 94, in handle_acl return getattr(ah, method)(app) ~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 229, in PUT self.req.get_acl_response(app, 'PUT', self.container) ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_error_non_swift_owner test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_error_non_swift_owner ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0015 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 225 "-" "-" "-" 0.0135 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0095 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0018 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0067 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0008 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0018 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0101 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "GET /sda1/p/a" 200 6 "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0105 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0008 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:00 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0111 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 397 "-" "-" "-" 0.3033 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0016 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 397 "-" "-" "-" 0.0184 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/%22%27" 201 - "-" "-" "-" 0.0189 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/%22%27" 200 74 "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0187 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%22%3Cword" 201 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 240 "-" "-" "-" 0.0021 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0228 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/%22%3Cword-test" 201 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 200 102 "-" "-" "-" 0.0101 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0151 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0028 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0171 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 400 21 "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 406 - "-" "-" "-" 0.0003 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 400 34 "-" "-" "-" 0.0029 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/./a" 400 20 "-" "-" "-" 0.0123 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0191 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0016 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 404 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0188 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0056 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0017 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0018 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0094 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0108 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0087 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0094 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0086 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0008 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0086 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0171 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 404 - "-" "-" "-" 0.0166 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/./a" 400 20 "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 400 26 "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0115 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0024 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0159 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0054 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0105 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0133 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0014 "-" 1824529 -test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_metadata test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_metadata ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_maxuploads ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_sys_metadata test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_sys_metadata ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_versioned_enabled test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_versioned_enabled ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_after_DELETE test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_after_DELETE ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_auto_create test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_auto_create ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_insufficient_space test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_insufficient_space ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_invalid_partition test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_invalid_partition ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_non_utf8_metadata test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_non_utf8_metadata ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_not_found test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_not_found ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_maxuploads_over_default test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_maxuploads_over_default ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_versioned_suspended test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_versioned_suspended ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_simulated_create_race test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_simulated_create_race ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_with_error test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_with_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. swift: Using crc32c_kern implementation for CRC32C. test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_maxuploads_over_max_32bit_int test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_maxuploads_over_max_32bit_int ... ok swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_with_invalid_md5 test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_with_invalid_md5 ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_complete_rsync_works test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_complete_rsync_works ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_insufficient_space test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_insufficient_space ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_rsync_then_merge_works test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_rsync_then_merge_works ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_negative_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_negative_maxuploads ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_with_non_json test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_with_non_json ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_unknown_sync test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_unknown_sync ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_value_error_works test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_value_error_works ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test__call__raise_timeout test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test__call__raise_timeout ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_with_system_entity test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_with_system_entity ... ok swift: Using crc32c_kern implementation for CRC32C. test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_without_md5 test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_without_md5 ... ok swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. swift: Using crc32c_kern implementation for CRC32C. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_cors_headers test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_cors_headers ... ok swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_content_type_on_HEAD test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_content_type_on_HEAD ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_paginated test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_paginated ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_cors_preflight test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_cors_preflight ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_str_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_str_maxuploads ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_correct_allowed_method test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_correct_allowed_method ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_GET_part_num test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_GET_part_num ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_create_invalid_reserved_container_in_account test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_create_invalid_reserved_container_in_account ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_GET_part_num_and_range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_GET_part_num_and_range ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_create_invalid_reserved_namespace_account test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_create_invalid_reserved_namespace_account ... ok swift: Using crc32c_kern implementation for CRC32C. test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_delimiter ... ok test.unit.common.ring.test_ring.TestRingV2.test_reload test.unit.common.ring.test_ring.TestRingV2.test_reload ... ok test.unit.common.ring.test_ring.TestRingV2.test_reload_without_replication test.unit.common.ring.test_ring.TestRingV2.test_reload_without_replication ... ok test.unit.common.ring.test_ring.TestRingV2.test_replica_count test.unit.common.ring.test_ring.TestRingV2.test_replica_count ... ok swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test INFO: Processing files for policy platinum under /tmp/tmpa3cie67d/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpa3cie67d/node/sda1/objects/268 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test WARNING: Error relinking (cleanup): failed to relink /tmp/tmpa3cie67d/node/sda1/objects/134/59c/8644fb448af0add4a4f6390926f2e59c/1757769841.90149.meta to /tmp/tmpa3cie67d/node/sda1/objects/268/59c/8644fb448af0add4a4f6390926f2e59c/1757769841.90149.meta: [Errno 1] oops test DEBUG: Run listdir on /tmp/tmpa3cie67d/node/sda1/objects/134 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (2 files, 0 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=True): 13:24:00 09/13/25 GMT (0:00:00.009865 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:00 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp9w5na0eq/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmp9w5na0eq/node/sda1/objects/281 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking (cleanup) created link: /tmp/tmp9w5na0eq/node/sda1/objects/140/83d/8cfdddbab41c8c70ac8118d9a323083d/1757769842.98087.ts to /tmp/tmp9w5na0eq/node/sda1/objects/281/83d/8cfdddbab41c8c70ac8118d9a323083d/1757769842.98087.ts test DEBUG: Removed /tmp/tmp9w5na0eq/node/sda1/objects/140/83d/8cfdddbab41c8c70ac8118d9a323083d/1757769842.98087.ts test DEBUG: Run listdir on /tmp/tmp9w5na0eq/node/sda1/objects/140 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:01 09/13/25 GMT (0:00:00.041620 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:01 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpxi66lyv_/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmpxi66lyv_/node/sda1/objects/217/045/d974ec781225bc5155fb42df099ab045/1757769841.11729.ts to /tmp/tmpxi66lyv_/node/sda1/objects/434/045/d974ec781225bc5155fb42df099ab045/1757769841.11729.ts test DEBUG: Removed /tmp/tmpxi66lyv_/node/sda1/objects/217/045/d974ec781225bc5155fb42df099ab045/1757769841.11729.ts test DEBUG: Run listdir on /tmp/tmpxi66lyv_/node/sda1/objects/434 test DEBUG: Run listdir on /tmp/tmpxi66lyv_/node/sda1/objects/217 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:01 09/13/25 GMT (0:00:00.014436 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:01 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpbnh5_f7j/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmpbnh5_f7j/node/sda1/objects/224/e24/e07c891d041ee437d5c62bef643ebe24/1757769843.20532.meta to /tmp/tmpbnh5_f7j/node/sda1/objects/448/e24/e07c891d041ee437d5c62bef643ebe24/1757769843.20532.meta test DEBUG: Relinking (cleanup) created link: /tmp/tmpbnh5_f7j/node/sda1/objects/224/e24/e07c891d041ee437d5c62bef643ebe24/1757769842.20532.data to /tmp/tmpbnh5_f7j/node/sda1/objects/448/e24/e07c891d041ee437d5c62bef643ebe24/1757769842.20532.data test DEBUG: Removed /tmp/tmpbnh5_f7j/node/sda1/objects/224/e24/e07c891d041ee437d5c62bef643ebe24/1757769843.20532.meta test DEBUG: Removed /tmp/tmpbnh5_f7j/node/sda1/objects/224/e24/e07c891d041ee437d5c62bef643ebe24/1757769842.20532.data test DEBUG: Run listdir on /tmp/tmpbnh5_f7j/node/sda1/objects/448 test DEBUG: Run listdir on /tmp/tmpbnh5_f7j/node/sda1/objects/224 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (2 files, 2 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:01 09/13/25 GMT (0:00:00.014252 elapsed) test INFO: Processing files for policy platinum under /tmp/tmps7fc4u32/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmps7fc4u32/node/sda1/objects/13/d2b/0dba7fb943935f292baa0fbff82c1d2b/1757769841.29367.data to /tmp/tmps7fc4u32/node/sda1/objects/27/d2b/0dba7fb943935f292baa0fbff82c1d2b/1757769841.29367.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:01 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmps7fc4u32/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmps7fc4u32/node/sda1/objects/27 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking (cleanup) created link: /tmp/tmps7fc4u32/node/sda1/objects/13/d2b/0dba7fb943935f292baa0fbff82c1d2b/1757769841.29367.data to /tmp/tmps7fc4u32/node/sda1/objects/27/d2b/0dba7fb943935f292baa0fbff82c1d2b/1757769841.29367.data test DEBUG: Removed /tmp/tmps7fc4u32/node/sda1/objects/13/d2b/0dba7fb943935f292baa0fbff82c1d2b/1757769841.29367.data test DEBUG: Run listdir on /tmp/tmps7fc4u32/node/sda1/objects/27 test DEBUG: Run listdir on /tmp/tmps7fc4u32/node/sda1/objects/13 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:01 09/13/25 GMT (0:00:00.015758 elapsed) test INFO: Processing files for policy platinum under /tmp/tmpiwt9_n8v/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpiwt9_n8v/node/sda1/objects/129/55e/81edf5094563f2a73a6751a138e2955e/1757769841.41515.data to /tmp/tmpiwt9_n8v/node/sda1/objects/259/55e/81edf5094563f2a73a6751a138e2955e/1757769841.41515.data test DEBUG: Run listdir on /tmp/tmpiwt9_n8v/node/sda1/objects/259 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:01 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpiwt9_n8v/node/sda1 (cleanup=True) test WARNING: Error relinking (cleanup): failed to relink /tmp/tmpiwt9_n8v/node/sda1/objects/129/55e/81edf5094563f2a73a6751a138e2955e/1757769841.41515.data to /tmp/tmpiwt9_n8v/node/sda1/objects/259/55e/81edf5094563f2a73a6751a138e2955e/1757769841.41515.data: test DEBUG: Run listdir on /tmp/tmpiwt9_n8v/node/sda1/objects/129 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 0/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=True): 13:24:01 09/13/25 GMT (0:00:00.013204 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:01 09/13/25 GMT test DEBUG: Updating recon test WARNING: No policy found to increase the partition power. test INFO: Finished relinker (cleanup=True): 13:24:01 09/13/25 GMT (0:00:00.002088 elapsed) test INFO: Processing files for policy platinum under /tmp/tmpc2gxp6bu/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpc2gxp6bu/node/sda1/objects/16/aa2/1039cf250f4d3db2c08662bd4be21aa2/1757769841.62946.data to /tmp/tmpc2gxp6bu/node/sda1/objects/32/aa2/1039cf250f4d3db2c08662bd4be21aa2/1757769841.62946.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors)test.unit.cli.test_relinker.TestRelinker.test_cleanup_not_mounted test.unit.cli.test_relinker.TestRelinker.test_cleanup_not_mounted ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_not_yet_relinked test.unit.cli.test_relinker.TestRelinker.test_cleanup_not_yet_relinked ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_not_yet_relinked_low test.unit.cli.test_relinker.TestRelinker.test_cleanup_not_yet_relinked_low ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:23:57 -0000', 'Content-Md5': 'i4CS9WiTvEfCFGqAHP8j0A==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '8b8092f56893bc47c2146a801cff23d0', 'Content-Length': '1030946'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_no_key test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_no_key ... ok test.unit.common.test_internal_client.TestSimpleClient.test_delete_object_with_404_no_retry test.unit.common.test_internal_client.TestSimpleClient.test_delete_object_with_404_no_retry ... ok test.unit.common.test_internal_client.TestSimpleClient.test_delete_object_with_409_no_retry test.unit.common.test_internal_client.TestSimpleClient.test_delete_object_with_409_no_retry ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_create_reserved_container_in_account test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_create_reserved_container_in_account ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_id_and_key_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_id_and_key_marker ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_create_reserved_namespace_account test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_create_reserved_namespace_account ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_GET_part_num_invalid test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_GET_part_num_invalid ... ok test.unit.common.test_internal_client.TestSimpleClient.test_get test.unit.common.test_internal_client.TestSimpleClient.test_get ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_key_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_key_marker ... ok test.unit.common.test_internal_client.TestSimpleClient.test_get_with_retries test.unit.common.test_internal_client.TestSimpleClient.test_get_with_retries ... ok test.unit.common.test_internal_client.TestSimpleClient.test_get_with_retries_all_failed test.unit.common.test_internal_client.TestSimpleClient.test_get_with_retries_all_failed ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_GET_part_num_not_satisfiable test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_GET_part_num_not_satisfiable ... ok test_digest_utils WARNING: The following digest algorithms are allowed by default but deprecated: sha1. Support will be disabled by default in a future release, and later removed entirely. test_digest_utils WARNING: The following digest algorithms are configured but deprecated: sha1. Support will be removed in a future release. test_digest_utils WARNING: The following digest algorithms are configured but not supported: md5 test_digest_utils WARNING: The following digest algorithms are configured but deprecated: sha1. Support will be removed in a future release. test_digest_utils WARNING: The following digest algorithms are configured but not supported: md5 proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET https://cluster.domain/bucket/key HTTP/1.0" 200 106 0.000053 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET http://cluster.domain/v1/acct/cont/obj HTTP/1.0" 200 112 0.000048 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET ftp://cluster.domain/bucket/key HTTP/1.0" 200 126 0.000043 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET https://cluster.domain HTTP/1.0" 200 117 0.000034 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET http:omg//wtf/bbq HTTP/1.0" 200 112 0.000036 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: ERROR WSGI: code 400, message Bad request syntax ('ONLY-METHOD'), (txn: txe823be15b2824387aa055-0068c57071) proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) test ERROR: ERROR WSGI: code 400, message Bad request syntax ('ONLY-METHOD') (txn: test-trans-id) proxy INFO: wsgi exiting (txn: test-trans-id) proxy INFO: (1824541) wsgi exited, is_accepting=True (txn: test-trans-id) proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: ERROR WSGI: code 400, message Bad request syntax ('ONLY-METHOD'), (txn: test-trans-id) proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "PUT /path HTTP/1.0" 200 105 0.000059 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET ///some-leading-slashes HTTP/1.0" 200 118 0.000046 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET /ohÿboy%what$now%E2%80%bd HTTP/1.0" 200 120 0.000068 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET /some%fFpath%D8%AA HTTP/1.0" 200 113 0.000040 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET / HTTP/1.1" 200 120 0.004090 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True b'HTTP/1.1 200 OK\r\nContent-Length: 44\r\nDate: Sat, 13 Sep 2025 13:24:01 GMT\r\n\r\n{"RAW_PATH_INFO": "/", "QUERY_STRING": null}' proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET /%FF HTTP/1.1" 200 123 0.000056 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True b'HTTP/1.1 200 OK\r\nContent-Length: 47\r\nDate: Sat, 13 Sep 2025 13:24:01 GMT\r\n\r\n{"RAW_PATH_INFO": "/%FF", "QUERY_STRING": null}' proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET /ÿ HTTP/1.1" 200 126 0.000058 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True b'HTTP/1.1 200 OK\r\nContent-Length: 50\r\nDate: Sat, 13 Sep 2025 13:24:01 GMT\r\n\r\n{"RAW_PATH_INFO": "/\\u00ff", "QUERY_STRING": null}' proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "PUT /Here%20Is%20A%20SnowMan:☃ HTTP/1.0" 200 181 0.000050 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True b'HTTP/1.1 200 OK\r\nContent-Length: 86\r\nDate: Sat, 13 Sep 2025 13:24:01 GMT\r\nConnection: close\r\n\r\n{"RAW_PATH_INFO": "/Here%20Is%20A%20SnowMan:\\u00e2\\u0098\\u0083", "QUERY_STRING": null}' proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "POST /?and%20it=does+nothing+to+params&PALMTREE=ð%9fŒ%b4 HTTP/1.1" 200 178 0.000050 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True b'HTTP/1.1 200 OK\r\nContent-Length: 101\r\nDate: Sat, 13 Sep 2025 13:24:01 GMT\r\n\r\n{"RAW_PATH_INFO": "/", "QUERY_STRING": "and%20it=does+nothing+to+params&PALMTREE=\\u00f0%9f\\u008c%b4"}' proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET // HTTP/1.1" 200 121 0.000059 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True b'HTTP/1.1 200 OK\r\nContent-Length: 45\r\nDate: Sat, 13 Sep 2025 13:24:01 GMT\r\n\r\n{"RAW_PATH_INFO": "//", "QUERY_STRING": null}' proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET //bar HTTP/1.1" 200 124 0.000048 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True b'HTTP/1.1 200 OK\r\nContent-Length: 48\r\nDate: Sat, 13 Sep 2025 13:24:01 GMT\r\n\r\n{"RAW_PATH_INFO": "//bar", "QUERY_STRING": null}' proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET //////baz HTTP/1.1" 200 128 0.000062 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True b'HTTP/1.1 200 OK\r\nContent-Length: 52\r\nDate: Sat, 13 Sep 2025 13:24:01 GMT\r\n\r\n{"RAW_PATH_INFO": "//////baz", "QUERY_STRING": null}' proxy INFO: (1824541) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824541) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:01] "GET /someurl HTTP/1.0" 200 102 0.002486 proxy INFO: wsgi exiting proxy INFO: (1824541) wsgi exited, is_accepting=True WARNING: Unable to modify file descriptor limit. Running as non-root?test.unit.common.test_manager.TestManagerModule.test_setup_env test.unit.common.test_manager.TestManagerModule.test_setup_env ... ok test.unit.common.test_manager.TestManagerModule.test_verify_server test.unit.common.test_manager.TestManagerModule.test_verify_server ... ok test.unit.common.test_manager.TestManagerModule.test_watch_server_pids test.unit.common.test_manager.TestManagerModule.test_watch_server_pids ... ok test.unit.common.test_statsd_client.TestGetStatsdClient.test_bad_hostname_instantiation test.unit.common.test_statsd_client.TestGetStatsdClient.test_bad_hostname_instantiation ... ok test.unit.common.test_statsd_client.TestGetStatsdClient.test_ipv4_instantiation_and_socket_creation test.unit.common.test_statsd_client.TestGetStatsdClient.test_ipv4_instantiation_and_socket_creation ... ok test.unit.common.test_statsd_client.TestGetStatsdClient.test_ipv4_or_ipv6_hostname_defaults_to_ipv4 test.unit.common.test_statsd_client.TestGetStatsdClient.test_ipv4_or_ipv6_hostname_defaults_to_ipv4 ... ok test.unit.common.test_statsd_client.TestGetStatsdClient.test_ipv6_instantiation_and_socket_creation test.unit.common.test_statsd_client.TestGetStatsdClient.test_ipv6_instantiation_and_socket_creation ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_delimiter_with_reserved_and_no_public test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_delimiter_with_reserved_and_no_public ... ok test.unit.common.test_internal_client.TestSimpleClient.test_get_with_retries_param test.unit.common.test_internal_client.TestSimpleClient.test_get_with_retries_param ... ok test.unit.common.test_internal_client.TestSimpleClient.test_head test.unit.common.test_internal_client.TestSimpleClient.test_head ... ok test.unit.common.test_internal_client.TestSimpleClient.test_proxy test.unit.common.test_internal_client.TestSimpleClient.test_proxy ... ok test.unit.common.test_statsd_client.TestGetStatsdClient.test_no_exception_when_cant_send_udp_packet test.unit.common.test_statsd_client.TestGetStatsdClient.test_no_exception_when_cant_send_udp_packet ... ok test.unit.common.test_statsd_client.TestGetStatsdClient.test_sample_rates test.unit.common.test_statsd_client.TestGetStatsdClient.test_sample_rates ... ok test.unit.common.test_statsd_client.TestGetStatsdClient.test_sample_rates_with_sample_rate_factor test.unit.common.test_statsd_client.TestGetStatsdClient.test_sample_rates_with_sample_rate_factor ... ok test.unit.common.test_statsd_client.TestGetStatsdClient.test_sending_ipv6 test.unit.common.test_statsd_client.TestGetStatsdClient.test_sending_ipv6 ... ok test.unit.common.test_swob.TestHeaderEnvironProxy.test_contains test.unit.common.test_swob.TestHeaderEnvironProxy.test_contains ... ok test.unit.common.test_swob.TestHeaderEnvironProxy.test_del test.unit.common.test_swob.TestHeaderEnvironProxy.test_del ... ok test.unit.common.test_swob.TestHeaderEnvironProxy.test_ignored_keys test.unit.common.test_swob.TestHeaderEnvironProxy.test_ignored_keys ... ok test.unit.common.test_swob.TestHeaderEnvironProxy.test_keys test.unit.common.test_swob.TestHeaderEnvironProxy.test_keys ... ok test.unit.common.test_swob.TestHeaderEnvironProxy.test_proxy test.unit.common.test_swob.TestHeaderEnvironProxy.test_proxy ... ok test.unit.common.test_swob.TestRange.test_range test.unit.common.test_swob.TestRange.test_range ... ok test.unit.common.test_swob.TestRange.test_range_invalid_syntax test.unit.common.test_swob.TestRange.test_range_invalid_syntax ... ok test.unit.common.test_swob.TestRange.test_ranges_for_large_length test.unit.common.test_swob.TestRange.test_ranges_for_large_length ... ok test.unit.common.test_swob.TestRange.test_ranges_for_length test.unit.common.test_swob.TestRange.test_ranges_for_length ... ok test.unit.common.test_swob.TestRange.test_ranges_for_length_edges test.unit.common.test_swob.TestRange.test_ranges_for_length_edges ... ok test.unit.common.test_swob.TestRange.test_ranges_for_length_multi test.unit.common.test_swob.TestRange.test_ranges_for_length_multi ... ok test.unit.common.test_swob.TestRange.test_ranges_for_length_no_end test.unit.common.test_swob.TestRange.test_ranges_for_length_no_end ... ok test.unit.common.test_swob.TestRange.test_ranges_for_length_no_start test.unit.common.test_swob.TestRange.test_ranges_for_length_no_start ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_multi_chars_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_multi_chars_delimiter ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_HEAD_part_num test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_HEAD_part_num ... ok test.unit.common.test_swob.TestRange.test_ranges_for_length_nonascending test.unit.common.test_swob.TestRange.test_ranges_for_length_nonascending ... ok test.unit.common.test_swob.TestRange.test_ranges_for_length_overlapping test.unit.common.test_swob.TestRange.test_ranges_for_length_overlapping ... ok test.unit.common.test_swob.TestRange.test_ranges_for_length_too_many test.unit.common.test_swob.TestRange.test_ranges_for_length_too_many ... ok test.unit.common.test_swob.TestRange.test_str test.unit.common.test_swob.TestRange.test_str ... ok test.unit.common.test_internal_client.TestSimpleClient.test_request_container_with_retries_with_HTTPError test.unit.common.test_internal_client.TestSimpleClient.test_request_container_with_retries_with_HTTPError ... ok test.unit.common.test_swob.TestRange.test_upsidedown_range test.unit.common.test_swob.TestRange.test_upsidedown_range ... ok test.unit.common.test_utils.TestCloseableChain.test_closeable_chain_closes test.unit.common.test_utils.TestCloseableChain.test_closeable_chain_closes ... ok test.unit.common.test_utils.TestCloseableChain.test_closeable_chain_iterates test.unit.common.test_utils.TestCloseableChain.test_closeable_chain_iterates ... ok test.unit.common.test_utils.TestClosingMapper.test_close test.unit.common.test_utils.TestClosingMapper.test_close ... ok test.unit.common.test_utils.TestClosingMapper.test_function_raises_exception test.unit.common.test_utils.TestClosingMapper.test_function_raises_exception ... ok test.unit.common.test_utils.TestEventletRateLimiter.test_burst test.unit.common.test_utils.TestEventletRateLimiter.test_burst ... ok test.unit.common.test_utils.TestEventletRateLimiter.test_burst_after_idle test.unit.common.test_utils.TestEventletRateLimiter.test_burst_after_idle ... ok test.unit.common.test_utils.TestEventletRateLimiter.test_incr_by test.unit.common.test_utils.TestEventletRateLimiter.test_incr_by ... ok test.unit.common.test_utils.TestEventletRateLimiter.test_init test.unit.common.test_utils.TestEventletRateLimiter.test_init ... ok test.unit.common.test_utils.TestEventletRateLimiter.test_non_blocking test.unit.common.test_utils.TestEventletRateLimiter.test_non_blocking ... ok test.unit.common.test_utils.TestEventletRateLimiter.test_non_blocking_max_rate_adjusted test.unit.common.test_utils.TestEventletRateLimiter.test_non_blocking_max_rate_adjusted ... ok test.unit.common.test_utils.TestEventletRateLimiter.test_ratelimit test.unit.common.test_utils.TestEventletRateLimiter.test_ratelimit ... ok test.unit.common.test_utils.TestEventletRateLimiter.test_set_max_rate test.unit.common.test_utils.TestEventletRateLimiter.test_set_max_rate ... ok test.unit.common.test_utils.TestEventletRateLimiter.test_set_rate_buffer test.unit.common.test_utils.TestEventletRateLimiter.test_set_rate_buffer ... ok test.unit.common.test_utils.TestParseMimeHeaders.test_parse_mime_headers test.unit.common.test_utils.TestParseMimeHeaders.test_parse_mime_headers ... ok test.unit.common.test_utils.TestWatchdog.test_start_stop test.unit.common.test_utils.TestWatchdog.test_start_stop ... ok test.unit.common.test_utils.TestWatchdog.test_timeout_concurrency test.unit.common.test_utils.TestWatchdog.test_timeout_concurrency ... ok test.unit.common.test_utils.TestWatchdog.test_timeout_expire test.unit.common.test_utils.TestWatchdog.test_timeout_expire ... ok test.unit.common.test_wsgi.TestServersPerPortStrategy.test_loop_timeout test.unit.common.test_wsgi.TestServersPerPortStrategy.test_loop_timeout ... ok test.unit.common.test_wsgi.TestServersPerPortStrategy.test_new_worker_socks test.unit.common.test_wsgi.TestServersPerPortStrategy.test_new_worker_socks ... ok test.unit.common.test_wsgi.TestServersPerPortStrategy.test_no_fork_sock test.unit.common.test_wsgi.TestServersPerPortStrategy.test_no_fork_sock ... ok test.unit.common.test_wsgi.TestServersPerPortStrategy.test_post_fork_hook test.unit.common.test_wsgi.TestServersPerPortStrategy.test_post_fork_hook ... ok test.unit.common.test_wsgi.TestServersPerPortStrategy.test_servers_per_port_in_container test.unit.common.test_wsgi.TestServersPerPortStrategy.test_servers_per_port_in_container ... ok test.unit.common.test_wsgi.TestServersPerPortStrategy.test_shutdown_sockets test.unit.common.test_wsgi.TestServersPerPortStrategy.test_shutdown_sockets ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_PUT_recreate test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_PUT_recreate ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_PUT_recreate_replication_race test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_PUT_recreate_replication_race ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_account_update test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_account_update ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_container_not_found test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_container_not_found ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_invalid_partition test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_invalid_partition ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_not_found test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_not_found ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_obj_not_found test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_obj_not_found ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_prefix test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_prefix ... ok test.unit.common.test_internal_client.TestSimpleClient.test_request_object_with_retries_with_HTTPError test.unit.common.test_internal_client.TestSimpleClient.test_request_object_with_retries_with_HTTPError ... ok test.unit.common.test_internal_client.TestSimpleClient.test_request_with_retries_with_HTTPError test.unit.common.test_internal_client.TestSimpleClient.test_request_with_retries_with_HTTPError ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_HEAD_part_num_and_range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_HEAD_part_num_and_range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_HEAD_part_num_invalid test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_HEAD_part_num_invalid ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_HEAD_part_num_not_satisfiable test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_non_slo_object_HEAD_part_num_not_satisfiable ... ok test.unit.common.test_utils.TestAuditLocationGenerator.test_drive_tree_access test.unit.common.test_utils.TestAuditLocationGenerator.test_drive_tree_access ... ok test.unit.common.test_utils.TestAuditLocationGenerator.test_error_counter test.unit.common.test_utils.TestAuditLocationGenerator.test_error_counter ... ok test.unit.common.test_utils.TestAuditLocationGenerator.test_filters test.unit.common.test_utils.TestAuditLocationGenerator.test_filters ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_delimiter_with_reserved_and_public test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_delimiter_with_reserved_and_public ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_prefix_and_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_with_prefix_and_delimiter ... ok test.unit.common.test_utils.TestAuditLocationGenerator.test_find_objects test.unit.common.test_utils.TestAuditLocationGenerator.test_find_objects ... ok swift: Using crc32c_kern implementation for CRC32C. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'}swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.test_utils.TestAuditLocationGenerator.test_hooks test.unit.common.test_utils.TestAuditLocationGenerator.test_hooks ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "GET /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 412 - "GET http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "txc154aa7d1ce84d848a1a8-0068c57071" "proxy-server 1824514" 0.0019 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6ffcfe3e929244c1b7e49-0068c57071" "proxy-server 1824514" 0.0050 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "txb212085c9fca486da1fdb-0068c57071" "proxy-server 1824514" 0.0055 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "GET /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 304 - "GET http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx4abd2c9669ab4192a2f13-0068c57071" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txdaf5ff843b804c4ea3354-0068c57071" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "txa00d5805527c4e28ad486-0068c57071" "proxy-server 1824514" 0.0088 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "GET /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 304 - "GET http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "txb54b5d96e7354c9687f68-0068c57071" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx784e9156951842af9ddec-0068c57071" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx0ca5cbd685114c8b97187-0068c57071" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "GET /sdc1/2/a/766f39d38cbe464a89c177db573bfa14/o" 200 24 "GET http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx3b555574a35549ccba0dc-0068c57071" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx3c35afeab8704be9b6aa0-0068c57071" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx524ffc88f9cf40a98a40e-0068c57071" "proxy-server 1824514" 0.0054 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 200 24 "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "txba05e466d65c46c3a7d8e-0068c57071" "proxy-server 1824514" 0.0095 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6faca0d03ea84bcd9fa58-0068c57071" "proxy-server 1824514" 0.0081 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx2f3327daea5346238237e-0068c57071" "proxy-server 1824514" 0.0015 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 200 24 "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx5fb5f3e974bb45b0b4bbd-0068c57071" "proxy-server 1824514" 0.0051 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6c57bfc7471643159909b-0068c57071" "proxy-server 1824514" 0.0054 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "txccb442abeb39475b9b81d-0068c57071" "proxy-server 1824514" 0.0038 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdc1/2/a/766f39d38cbe464a89c177db573bfa14/o" 412 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "txab5355d8649f4449b138e-0068c57071" "proxy-server 1824514" 0.0047 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 412 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "txab5355d8649f4449b138e-0068c57071" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx05fcf3984d364c45b1a9e-0068c57071" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx7a95b08db5c54441aad37-0068c57071" "proxy-server 1824514" 0.0011 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 304 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx4c68be3221db40b4bb93b-0068c57071" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx00c31992750f4b589fe79-0068c57071" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx0cc5063c35764764adf86-0068c57071" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdc1/2/a/766f39d38cbe464a89c177db573bfa14/o" 304 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx672545cf303d4d3c84181-0068c57071" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx734e37f3a1d74b878cd5a-0068c57071" "proxy-server 1824514" 0.0023 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/2/a/766f39d38cbe464a89c177db573bfa14" 204 - "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14" "tx78cf0232cae445e88f489-0068c57071" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdd1/2/a/766f39d38cbe464a89c177db573bfa14/o" 200 24 "HEAD http://localhost:8080/v1/a/766f39d38cbe464a89c177db573bfa14/o" "tx1b601efcc7914e378a232-0068c57071" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx413bd19ad15a420ebb935-0068c57071" "proxy-server 1824514" 0.0037 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdb1/1/a/f86b010dcdfb4a13bf5406dea083eb26" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/f86b010dcdfb4a13bf5406dea083eb26" "tx413bd19ad15a420ebb935-0068c57071" "container-server 1824514" 0.0010 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/1/a/f86b010dcdfb4a13bf5406dea083eb26" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/f86b010dcdfb4a13bf5406dea083eb26" "tx413bd19ad15a420ebb935-0068c57071" "container-server 1824514" 0.0011 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdb1/0/a/f86b010dcdfb4a13bf5406dea083eb26" 201 - "PUT http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26" "tx413bd19ad15a420ebb935-0068c57071" "proxy-server 1824514" 0.0121 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/0/a/f86b010dcdfb4a13bf5406dea083eb26" 201 - "PUT http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26" "tx413bd19ad15a420ebb935-0068c57071" "proxy-server 1824514" 0.0088 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx77a02c18fe0b42998f490-0068c57071" "proxy-server 1824514" 0.0019 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/0/a/f86b010dcdfb4a13bf5406dea083eb26" 204 - "HEAD http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26" "tx77a02c18fe0b42998f490-0068c57071" "proxy-server 1824514" 0.0012 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2398234845414c9681d3b-0068c57071" "proxy-server 1824514" 0.0060 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/0/a/f86b010dcdfb4a13bf5406dea083eb26" 204 - "HEAD http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26" "txc5fcfd0f7d0841169b36a-0068c57071" "proxy-server 1824514" 0.0179 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/0/a/f86b010dcdfb4a13bf5406dea083eb26/o" 201 - "PUT http://foo:8080/sdc1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "txd7ccb4bd26934ee08fbc8-0068c57071" "object-server 1824514" 0.0005 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdb1/0/a/f86b010dcdfb4a13bf5406dea083eb26/o" 201 - "PUT http://foo:8080/sdd1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "txd7ccb4bd26934ee08fbc8-0068c57071" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdc1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" 201 - "PUT http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "txd7ccb4bd26934ee08fbc8-0068c57071" "proxy-server 1824514" 0.0210 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdd1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" 201 - "PUT http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "txd7ccb4bd26934ee08fbc8-0068c57071" "proxy-server 1824514" 0.0208 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx82173e618af84041b1dde-0068c57071" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/0/a/f86b010dcdfb4a13bf5406dea083eb26" 204 - "HEAD http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26" "txef6addae8fd94bdf99226-0068c57071" "proxy-server 1824514" 0.0204 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/0/a/f86b010dcdfb4a13bf5406dea083eb26/o" 201 - "POST http://foo:8080/sdc1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "tx2d22076914fa495b92798-0068c57071" "object-server 1824514" 0.0241 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdb1/0/a/f86b010dcdfb4a13bf5406dea083eb26/o" 201 - "POST http://foo:8080/sdd1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "tx2d22076914fa495b92798-0068c57071" "object-server 1824514" 0.0004 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "POST /sdc1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" 202 76 "POST http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "tx2d22076914fa495b92798-0068c57071" "proxy-server 1824514" 0.0478 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "POST /sdd1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" 202 76 "POST http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "tx2d22076914fa495b92798-0068c57071" "proxy-server 1824514" 0.0475 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx4a7aea4019174f42ae5de-0068c57071" "proxy-server 1824514" 0.0014 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdb1/1/a/7ea2455bab3f4fceaafa91baabbac07e" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" "tx4a7aea4019174f42ae5de-0068c57071" "container-server 1824514" 0.0178 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/1/a/7ea2455bab3f4fceaafa91baabbac07e" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e" "tx4a7aea4019174f42ae5de-0068c57071" "container-server 1824514" 0.0010 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 201 - "PUT http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx4a7aea4019174f42ae5de-0068c57071" "proxy-server 1824514" 0.0372 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 201 - "PUT http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx4a7aea4019174f42ae5de-0068c57071" "proxy-server 1824514" 0.0546 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7701d5453c284cac80f3f-0068c57071" "proxy-server 1824514" 0.0124 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx7701d5453c284cac80f3f-0068c57071" "proxy-server 1824514" 0.0013 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf00b82f619f0494780eef-0068c57071" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/0/a/f86b010dcdfb4a13bf5406dea083eb26" 204 - "HEAD http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26" "tx9c9fdf96dbbf4370a90fe-0068c57071" "proxy-server 1824514" 0.0113 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "GET /sdd1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" 200 24 "GET http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "txe658622a471045afb628c-0068c57071" "proxy-server 1824514" 0.0009 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "GET /sdc1/1/a/f86b010dcdfb4a13bf5406dea083eb26/o" 200 24 "GET http://foo:8080/v1/a/f86b010dcdfb4a13bf5406dea083eb26/o" "txe658622a471045afb628c-0068c57071" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4779ca20ddb34d1bacc1e-0068c57071" "proxy-server 1824514" 0.0094 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://foo:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "txbd2338a952454440be7e6-0068c57071" "proxy-server 1824514" 0.0135 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 201 - "PUT http://foo:8080/sdc1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx8a98167b9d8448b5918a3-0068c57071" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdc1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 201 - "PUT http://foo:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx8a98167b9d8448b5918a3-0068c57071" "proxy-server 1824514" 0.0253 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 201 - "PUT http://foo:8080/sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx8a98167b9d8448b5918a3-0068c57071" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "PUT /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 201 - "PUT http://foo:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx8a98167b9d8448b5918a3-0068c57071" "proxy-server 1824514" 0.0390 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx9d577f7405a84246bf65f-0068c57071" "proxy-server 1824514" 0.0101 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "txa4aac7290ac64fc9b9559-0068c57071" "proxy-server 1824514" 0.0077 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "GET /sdc1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 200 24 "GET http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx82e20b586c76465c8e9ef-0068c57071" "proxy-server 1824514" 0.0048 "-" 1824514 1test.unit.common.test_utils.TestAuditLocationGenerator.test_ignore_metadata test.unit.common.test_utils.TestAuditLocationGenerator.test_ignore_metadata ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_empty_except_for_used_policies test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_empty_except_for_used_policies ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id_GET_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id_GET_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_GET_part_num_invalid test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_GET_part_num_invalid ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_GET_part_num_not_satisfiable test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_GET_part_num_not_satisfiable ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_without_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_without_bucket ... ok test.unit.common.test_utils.TestAuditLocationGenerator.test_mount_check_drive test.unit.common.test_utils.TestAuditLocationGenerator.test_mount_check_drive ... ok test.unit.common.test_utils.TestAuditLocationGenerator.test_non_dir_contents test.unit.common.test_utils.TestAuditLocationGenerator.test_non_dir_contents ... ok test.unit.common.test_utils.TestAuditLocationGenerator.test_non_dir_drive test.unit.common.test_utils.TestAuditLocationGenerator.test_non_dir_drive ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_empty_policy_stats test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_empty_policy_stats ... ok test.unit.common.test_utils.TestMemcachedTimingStatsDecorators.test_memcached_timing_stats test.unit.common.test_utils.TestMemcachedTimingStatsDecorators.test_memcached_timing_stats ... ok test.unit.common.test_utils.TestParseContentRange.test_bad test.unit.common.test_utils.TestParseContentRange.test_bad ... ok test.unit.common.test_utils.TestParseContentRange.test_good test.unit.common.test_utils.TestParseContentRange.test_good ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_init test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_init ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_without_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_GET_without_segment_bucket ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.test_utils.TestSetSwiftDir.test_set_swift_dir test.unit.common.test_utils.TestSetSwiftDir.test_set_swift_dir ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_abort test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_abort ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_insufficient_storage_mount_check_false test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_insufficient_storage_mount_check_false ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'Content-Md5': '/JzPJjlXCqpRBmlyhGXNDg==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'fc9ccf2639570aaa510669728465cd0e', 'Content-Length': '139'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'Content-Md5': 'PggRsy85Tu07EsbATYB/cA==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '3e0811b32f394eed3b12c6c04d807f70', 'Content-Length': '139'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'Content-Md5': 'zDBBHq17IpuHzskOm+GHEQ==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'cc30411ead7b229b87cec90e9be18711', 'Content-Length': '139'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'Content-Md5': 'hTnOh9sxGnzPiScnD+t0Mg==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '8539ce87db311a7ccf8927270feb7432', 'Content-Length': '139'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_quiet test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_quiet ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_sha256_bad test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_sha256_bad ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_sha256_invalid test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_sha256_invalid ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_complete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_complete ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_initiate test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_multipart_uploads_initiate ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_object test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_object ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_upload_part_missing_key test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_upload_part_missing_key ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_insufficient_storage_mount_check_true test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_insufficient_storage_mount_check_true ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_upload_part_success test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_upload_part_success ... ok test.unit.common.test_wsgi.TestPipelineModification.test_catch_errors_gatekeeper_configured_not_at_start test.unit.common.test_wsgi.TestPipelineModification.test_catch_errors_gatekeeper_configured_not_at_start ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_invalid_method_doesnt_exist test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_invalid_method_doesnt_exist ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_upload_part_success_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_upload_part_success_mixed_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_upload_part_v4_bad_hash test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_bucket_upload_part_v4_bad_hash ... ok test.unit.common.test_wsgi.TestPipelineModification.test_gatekeeper_insertion_catch_errors_configured_at_start test.unit.common.test_wsgi.TestPipelineModification.test_gatekeeper_insertion_catch_errors_configured_at_start ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_mpu_complete_mixed_policy_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_mpu_complete_mixed_policy_with_if_none_match_star ... ok test.unit.common.test_wsgi.TestPipelineModification.test_gatekeeper_insertion_catch_errors_configured_not_at_start test.unit.common.test_wsgi.TestPipelineModification.test_gatekeeper_insertion_catch_errors_configured_not_at_start ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_mpu_retry_complete_mixed_policy_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_mpu_retry_complete_mixed_policy_with_if_none_match_star ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_mpu_retry_complete_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_mpu_retry_complete_with_if_none_match_star ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'X-Amz-Content-Sha256': '1f7579140d49b831582cb0c7358ed480afb750509ae4a5791572c5bde7f53a44', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '90'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_sha256_valid test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_sha256_valid ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_to_object test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_to_object ... ok test.unit.common.test_wsgi.TestPipelineModification.test_load_app test.unit.common.test_wsgi.TestPipelineModification.test_load_app ... ok test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:01 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpc2gxp6bu/node/sda1 (cleanup=True) test WARNING: Skipping sda1 as it is not mounted test DEBUG: Updating recon test WARNING: 1 disks were unmounted test WARNING: 0 hash dirs processed (cleanup=True) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:01 09/13/25 GMT (0:00:00.002293 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:01 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp0sn2v7b5/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmp0sn2v7b5/node/sda1/objects/255/42d/ff655ef049e58bcee0bb5092fcc4542d/1757769841.72794.data to /tmp/tmp0sn2v7b5/node/sda1/objects/510/42d/ff655ef049e58bcee0bb5092fcc4542d/1757769841.72794.data test DEBUG: Removed /tmp/tmp0sn2v7b5/node/sda1/objects/255/42d/ff655ef049e58bcee0bb5092fcc4542d/1757769841.72794.data test DEBUG: Run listdir on /tmp/tmp0sn2v7b5/node/sda1/objects/510 test DEBUG: Run listdir on /tmp/tmp0sn2v7b5/node/sda1/objects/255 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:01 09/13/25 GMT (0:00:00.014821 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:01 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpzk7q_bxr/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmpzk7q_bxr/node/sda1/objects/74/8f2/4a726d0421552f1fb49d6b0d649898f2/1757769841.80732.data to /tmp/tmpzk7q_bxr/node/sda1/objects/148/8f2/4a726d0421552f1fb49d6b0d649898f2/1757769841.80732.data test DEBUG: Removed /tmp/tmpzk7q_bxr/node/sda1/objects/74/8f2/4a726d0421552f1fb49d6b0d649898f2/1757769841.80732.data test DEBUG: Run listdir on /tmp/tmpzk7q_bxr/node/sda1/objects/148 test DEBUG: Run listdir on /tmp/tmpzk7q_bxr/node/sda1/objects/74 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:01 09/13/25 GMT (0:00:00.026485 elapsed) test INFO: Processing files for policy platinum under /tmp/tmppl9qe32n/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmppl9qe32n/node/sda1/objects/121/2da/79ac5e2d63cb7040977c062ea9dee2da/1757769841.89520.data to /tmp/tmppl9qe32n/node/sda1/objects/243/2da/79ac5e2d63cb7040977c062ea9dee2da/1757769841.89520.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_careful_dir test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_careful_dir ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_careful_file test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_careful_file ... ok test.unit.common.test_wsgi.TestPipelineModification.test_load_app_request_logging_app test.unit.common.test_wsgi.TestPipelineModification.test_load_app_request_logging_app ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test INFO: Disabling account_sdb test INFO: Disabling container_sdb test INFO: Disabling object_sdb test INFO: Enabling account_sdb test INFO: Enabling container_sdb test INFO: Enabling object_sdb test ERROR: Error decrypting container listing: Bad crypto meta: Cipher must be AES_CTR_256 test ERROR: get_keys(): unknown key id: unknown_key test ERROR: Error decrypting container listing: unknown_key fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: Unexpected Error handling DELETE of 'bucket' 'Key1': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/multi_delete.py", line 133, in do_delete resp = req.get_response(self.app, method='DELETE', query=query, headers={'Accept': 'application/json'}) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2181, in _get_response sw_resp = sw_req.get_response(app) File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1115, in get_response status, headers, app_iter = self.call_application(application) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1099, in call_application app_iter = application(self.environ, start_response) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 183, in __call__ return self.app(env, start_response) ~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/s3api/__init__.py", line 85, in __call__ return self.app(env, start_response) ~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/helpers.py", line 386, in __call__ resp = resp_class( req=req, headers=headers, body=body, conditional_response=req.method in ('GET', 'HEAD'), conditional_etag=conditional_etag) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/helpers.py", line 262, in _select_response is_success = resp_class().is_success ~~~~~~~~~~^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception: kaboom fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: Could not parse SLO delete response (200 OK): b'asdf': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/multi_delete.py", line 141, in do_delete delete_result = json.loads(resp.body) File "/usr/lib/python3.13/json/__init__.py", line 346, in loads return _default_decoder.decode(s) ~~~~~~~~~~~~~~~~~~~~~~~^^^ File "/usr/lib/python3.13/json/decoder.py", line 345, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/json/decoder.py", line 363, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 261, in DELETE new_resp = self._restore_on_delete(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 195, in _restore_on_delete resp = req.get_response(self.app, 'GET', req.container_name, '', query={'prefix': req.object_name, 'versions': True}) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 261, in DELETE new_resp = self._restore_on_delete(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 207, in _restore_on_delete resp = req.get_response(self.app, 'PUT', query={ 'version-id': item['version_id']}) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500)test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id_PUT_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id_PUT_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id_is_delete_marker test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id_is_delete_marker ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id_is_missing test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_current_version_id_is_missing ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_in_versioned_container_with_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_in_versioned_container_with_version_id ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_in_versioned_container_without_version test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_in_versioned_container_without_version ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_missing test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_missing ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_multipart test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_multipart ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_no_multipart test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_no_multipart ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_old_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_old_version_id ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_version_id_not_implemented test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_version_id_not_implemented ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_with_version_id_but_not_enabled test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_DELETE_with_version_id_but_not_enabled ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_Range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_Range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_Range_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_Range_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_Response test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_Response ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_version_id ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_version_id_not_implemented test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_version_id_not_implemented ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_with_version_id_but_not_enabled test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_GET_with_version_id_but_not_enabled ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_HEAD test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_HEAD ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_HEAD_Range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_HEAD_Range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_HEAD_Range_with_invalid_value test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_HEAD_Range_with_invalid_value ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_HEAD_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_HEAD_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_POST_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_POST_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_bad_hash test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_bad_hash ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_headers_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_headers_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_headers_with_match test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_headers_with_match ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_headers_with_not_match test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_headers_with_not_match ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_metadata_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_metadata_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_metadata_replace test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_metadata_replace ... ok test.unit.common.test_wsgi.TestPipelineModification.test_loadapp_proxy test.unit.common.test_wsgi.TestPipelineModification.test_loadapp_proxy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_self test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_self ... ok test.unit.common.test_wsgi.TestPipelineModification.test_loadapp_storage test.unit.common.test_wsgi.TestPipelineModification.test_loadapp_storage ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx86f4e0de8ae14c77b172d-0068c57071" "proxy-server 1824514" 0.0062 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx4ff40a66a5034be4b8086-0068c57071" "proxy-server 1824514" 0.0138 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 200 24 "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx2e0fb376287145e98937d-0068c57071" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txdb175109d9884e5487a78-0068c57071" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:01 +0000] "GET /sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 200 382 "GET http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e?format=json&states=listing" "txdb175109d9884e5487a78-0068c57071" "proxy-server 1824514" 0.0106 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txc4a3f2ed9cf94e61879d2-0068c57071" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx872dc9ae7cca4502a9cfb-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "GET /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 200 24 "GET http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "txec4d9f7a5e374899a5e6a-0068c57072" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx624533a2397c41cebd042-0068c57072" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx7ab66c175fec4578b7b58-0068c57072" "proxy-server 1824514" 0.0176 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "GET /sdc1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 200 24 "GET http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx06e53bbdc3c849939d4b7-0068c57072" "proxy-server 1824514" 0.0088 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx27967f6a19e04c079af35-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "txaa28e218060d41bab0186-0068c57072" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "GET /sdc1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 412 - "GET http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx1f4be28f1f6649b5bd844-0068c57072" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "GET /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 412 - "GET http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx1f4be28f1f6649b5bd844-0068c57072" "proxy-server 1824514" 0.0087 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txedc17b3a751b49eba2cd0-0068c57072" "proxy-server 1824514" 0.0118 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx71fc38dbedc343058dab5-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "GET /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 304 - "GET http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx0daaa9566ea84151a6599-0068c57072" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx04a61367d0884e43be82c-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx97e92c873c5a4a02b7f71-0068c57072" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "GET /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 304 - "GET http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx2680901b668648b7acbb5-0068c57072" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx19abe414ed794048b7fb0-0068c57072" "proxy-server 1824514" 0.0134 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx86791c6bae9148abb13c1-0068c57072" "proxy-server 1824514" 0.0093 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "GET /sdc1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 200 24 "GET http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx61d40d3fdff5485f8007d-0068c57072" "proxy-server 1824514" 0.0120 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txa20cb11f69cf4d8eaf13f-0068c57072" "proxy-server 1824514" 0.0098 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "txe0933a497a1040c4a7c14-0068c57072" "proxy-server 1824514" 0.0096 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdc1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 200 24 "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx4196379f2ba14f53b7825-0068c57072" "proxy-server 1824514" 0.0087 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txa98dd33b9be04944bbccb-0068c57072" "proxy-server 1824514" 0.0094 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "txd5a8c15505d543358dd45-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdc1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 200 24 "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "txa663e9f2dd4544ac9da82-0068c57072" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx25cbdfb4fe6b4c01804a4-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "txb92e4667eb4f473390768-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdc1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 412 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "txf6cdb50cc257446881ef0-0068c57072" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 412 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "txf6cdb50cc257446881ef0-0068c57072" "proxy-server 1824514" 0.0087 "-" 1824514 1test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_self_metadata_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_self_metadata_copy ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_copy_encrypted_to_encrypted test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_copy_encrypted_to_encrypted ... ok WARNING: Unable to modify memory limit. Running as non-root? WARNING: Unable to modify max process limit. Running as non-root? test WARNING: Error sending UDP message to ('some.host.com', 8125): [Errno 1] test errno 1 test NOTICE: Started child 0 (PID 88) for port 6006 test NOTICE: Started child 1 (PID 89) for port 6006 test NOTICE: Started child 2 (PID 90) for port 6006 test NOTICE: Started child 0 (PID 91) for port 6007 test NOTICE: Started child 1 (PID 92) for port 6007 test NOTICE: Started child 2 (PID 93) for port 6007 test NOTICE: Closing unnecessary sock for port 6006 (child pid 88) test NOTICE: Closing unnecessary sock for port 6006 (child pid 89) test NOTICE: Closing unnecessary sock for port 6006 (child pid 90) test CRITICAL: Unable to bind to port 6009: ack test CRITICAL: Unable to bind to port 6009: ack test CRITICAL: Unable to bind to port 6009: ack test NOTICE: Started child 0 (PID 94) for port 6009 test NOTICE: Started child 1 (PID 95) for port 6009 test NOTICE: Started child 2 (PID 96) for port 6009 test ERROR: Removing dead child 95 from parent 1824541 test NOTICE: Started child 1 (PID 97) for port 6009 test NOTICE: Child 2 (PID 1824541, port 6007) exiting normally test WARNING: Ignoring wait() result from unknown PID 89 test NOTICE: Started child 0 (PID 88) for port 6006 test NOTICE: Started child 1 (PID 89) for port 6006 test NOTICE: Started child 2 (PID 90) for port 6006 test NOTICE: Started child 0 (PID 91) for port 6007 test NOTICE: Started child 1 (PID 92) for port 6007 test NOTICE: Started child 2 (PID 93) for port 6007 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0114 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0081 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0024 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0101 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0161 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0055 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0099 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0101 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0115 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0076 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0118 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0003 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0123 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0079 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0096 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0087 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c" 404 - "-" "-" "-" 0.0037 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0018 "-" 1824541 2 test ERROR: ERROR Account update failed with 127.0.0.1:59931/sda1 (will retry later): Response 503 OK test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0142 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c" 404 - "-" "-" "-" 0.0056 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/./a/c" 400 20 "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c" 404 - "-" "-" "-" 0.0003 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0003 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0039 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0045 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c" 409 - "-" "-" "-" 0.0767 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0042 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0128 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/bashful" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0144 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy10" 204 - "-" "-" "-" 0.0089 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy10_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy20" 301 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy20_no_header" 204 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy30" 301 - "-" "-" "-" 0.0009 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy30_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy40" 301 - "-" "-" "-" 0.0009 "-" 1824541 2test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_self_metadata_replace test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_copy_self_metadata_replace ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0130 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0057 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0174 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0185 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "DELETE /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 403 16 "-" "-" "-" 0.0006 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c" 404 - "-" "-" "-" 0.0003 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/.a/c" 201 - "-" "-" "-" 0.0026 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/.c" 404 - "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/./a" 400 20 "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 400 28 "-" "-" "-" 0.0144 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 400 28 "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a/c" 404 - "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0146 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0019 "-" 1824529 - test DEBUG: - - - [13/Sep/2025:13:24:01 +0000] "REPLICATE /sda1/p/a/" 204 - "-" "-" "-" 0.0003 "-" 1824529 - test DEBUG: - - - [13/Sep/2025:13:24:01 +0000] "REPLICATE /sda1/p/a/" 204 - "-" "-" "-" 0.0002 "-" 1824529 - test DEBUG: - - - [13/Sep/2025:13:24:01 +0000] "REPLICATE /sda1/p/a/" 404 - "-" "-" "-" 0.0002 "-" 1824529 - test ERROR: ERROR __call__ error with REPLICATE /sda1/p/a/ : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/server.py", line 316, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/swift/common/base_storage_server.py", line 71, in _timing_stats resp = func(ctrl, *args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/account/server.py", line 282, in REPLICATE ret = self.replicator_rpc.dispatch(post_args, args) File "/build/reproducible-path/swift-2.36.0/swift/common/db_replicator.py", line 903, in dispatch return getattr(self, op)( ~~~~~~~^^^^^^^^^^ AttributeError: 'ReplicatorRpc' object has no attribute 'unknown_sync' test DEBUG: - - - [13/Sep/2025:13:24:01 +0000] "REPLICATE /sda1/p/a/" 500 700 "-" "-" "-" 0.0152 "-" 1824529 - test DEBUG: - - - [13/Sep/2025:13:24:01 +0000] "REPLICATE /sda1/p/a/" 400 49 "-" "-" "-" 0.0003 "-" 1824529 - test ERROR: ERROR __call__ error with PUT /sda1/p/a/c : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/account/server.py", line 316, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/test/unit/account/test_server.py", line 2714, in mock_put_method raise Exception() Exception test INFO: - - - [13/Sep/2025:13:24:01 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0232 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0089 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:01 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0169 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0111 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c%00stuff" 400 36 "-" "-" "-" 0.0001 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/foo%00bar" 400 34 "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0028 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00c%00stuff" 201 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/%00a" 201 - "-" "-" "-" 0.0085 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/%00foo%00bar" 201 - "-" "-" "-" 0.0026 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0108 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0009 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0060 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 135 "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0056 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 26 "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0124 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0009 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/nullish" 201 - "-" "-" "-" 0.0015 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 20 "-" "-" "-" 0.0105 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 20 "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 26 "-" "-" "-" 0.0087 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 119 "-" "-" "-" 0.0058 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 141 "-" "-" "-" 0.0072 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0053 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0012 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0076 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0009 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0067 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0067 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0056 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "method_doesnt_exist /sda1/p/a" 405 - "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "__init__ /sda1/p/a" 405 - "-" "-" "-" 0.0001 "-" 1824529 -test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_invalid_method_is_not_public test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_invalid_method_is_not_public ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_list_allowed_methods test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_list_allowed_methods ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_log_line_format test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_log_line_format ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_markers_with_reserved test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_markers_with_reserved ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_multiple_policies_in_use test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_multiple_policies_in_use ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_not_allowed_method test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_not_allowed_method ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_null_markers test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_null_markers ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_params_format test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_params_format ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_params_utf8 test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_params_utf8 ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_policy_stats_non_default test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_policy_stats_non_default ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_policy_stats_with_legacy test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_policy_stats_with_legacy ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_first_put_fail test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_first_put_fail ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_ami_location test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_ami_location ... ok test.unit.common.test_wsgi.TestPipelineModification.test_proxy_modify_wsgi_pipeline test.unit.common.test_wsgi.TestPipelineModification.test_proxy_modify_wsgi_pipeline ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_canned_s3acl test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_canned_s3acl ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_prefix_and_delim_with_reserved test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_prefix_and_delim_with_reserved ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_prefix_with_reserved test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_prefix_with_reserved ... ok test.unit.common.test_wsgi.TestPipelineModification.test_proxy_modify_wsgi_pipeline_inserts_versioned_writes test.unit.common.test_wsgi.TestPipelineModification.test_proxy_modify_wsgi_pipeline_inserts_versioned_writes ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_HEAD_part_num test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_HEAD_part_num ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_HEAD_part_num_and_range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_HEAD_part_num_and_range ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.test_wsgi.TestPipelineModification.test_proxy_modify_wsgi_pipeline_ordering test.unit.common.test_wsgi.TestPipelineModification.test_proxy_modify_wsgi_pipeline_ordering ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: skipping failed PUT?version-id=1574341899.21751 fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 249, in DELETE resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 156, in GET return self.GETorHEAD(req) ~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 109, in GETorHEAD resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 143, in HEAD resp = self.GETorHEAD(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 109, in GETorHEAD resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 177, in PUT resp = req.get_response(self.app) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500)test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_headers test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_headers ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_quota_exceeded test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_quota_exceeded ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_v4 test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_v4 ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_v4_bad_hash test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_v4_bad_hash ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_v4_unsigned_payload test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_v4_unsigned_payload ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_with_version test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_PUT_with_version ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_policy_index_logging test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_object_policy_index_logging ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_simple_object_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_simple_object_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_slo_object_DELETE test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_slo_object_DELETE ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_slo_object_async_DELETE test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTC.test_slo_object_async_DELETE ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_GET_part_num test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_GET_part_num ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'Content-Md5': 'mbEtd8ufKpkpCIfMjGD7Tw==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '99b12d77cb9f2a99290887cc8c60fb4f', 'Content-Length': '90'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_too_many_keys test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_too_many_keys ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_replicaiton_server_call_all_methods test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_replicaiton_server_call_all_methods ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_encoding_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_encoding_type ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_encoding_type_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_encoding_type_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_HEAD_part_num_invalid test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_HEAD_part_num_invalid ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_HEAD_part_num_not_satisfiable test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_non_slo_object_HEAD_part_num_not_satisfiable ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_reserved_markers_with_non_reserved test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_reserved_markers_with_non_reserved ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_serv_reserv test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_serv_reserv ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call ... ok test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call_invalid_path test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call_invalid_path ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call_invalid_path_utf8 test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call_invalid_path_utf8 ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_max_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_max_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_negative_max_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_negative_max_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_negative_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_negative_part_number_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_over_max_32bit_int test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_over_max_32bit_int ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_over_max_32bit_int_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_over_max_32bit_int_part_number_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_over_max_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_over_max_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_over_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_over_part_number_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_same_max_marts_as_objects_num test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_same_max_marts_as_objects_num ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_str_max_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_str_max_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_str_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_str_part_number_marker ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift DEBUG: Calling S3Api Middleware fake-swift INFO: - - 13/Sep/2025/13/24/02 GET /bucket/object HTTP/1.0 200 - Mozzarella%20Foxfire - - 5 - - - 0.0036 - - 1757769842.658786774 1757769842.662348270 1 test:tester fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift DEBUG: Calling S3Api Middleware fake-swift INFO: - - 13/Sep/2025/13/24/02 GET /bucket/object HTTP/1.0 200 - Mozzarella%20Foxfire - - 5 - - - 0.0009 - - 1757769842.663055897 1757769842.663906813 0 test:tester fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_GET_part_num_and_range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_GET_part_num_and_range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_GET_part_num_invalid test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_GET_part_num_invalid ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_with_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_with_part_number_marker ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_lock_taken_between_get_hashes_and_rm test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_lock_taken_between_get_hashes_and_rm ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_without_encoding_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_list_parts_without_encoding_type ... ok test INFO: 1.2.3.4 - - [01/Jan/1970:02:46:42 +0000] "HEAD /sda1/p/a" 404 - "-" "-" "-" 2.0000 "-" 1234 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0028 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0088 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0014 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0088 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 269 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 134 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0133 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0009 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0015 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test03" 201 - "-" "-" "-" 0.0081 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 270 "-" "-" "-" 0.0133 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 136 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0107 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c_zero" 201 - "-" "-" "-" 0.0009 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c_one" 201 - "-" "-" "-" 0.0016 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c_two" 201 - "-" "-" "-" 0.0015 "-" 1824529 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c_three" 201 - "-" "-" "-" 0.0094 "-" 1824529 3 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0017 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0112 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00" 201 - "-" "-" "-" 0.0010 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0014 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/null" 201 - "-" "-" "-" 0.0015 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 118 "-" "-" "-" 0.0018 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 381 "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 252 "-" "-" "-" 0.0138 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 252 "-" "-" "-" 0.0015 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0102 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 68 "-" "-" "-" 0.0012 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0169 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 400 37 "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 400 33 "-" "-" "-" 0.0001 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 400 34 "-" "-" "-" 0.0001 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 400 34 "-" "-" "-" 0.0001 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 400 38 "-" "-" "-" 0.0001 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 400 34 "-" "-" "-" 0.0001 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0025 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0129 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0093 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0147 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0008 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0091 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0009 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0106 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c1" 201 - "-" "-" "-" 0.0008 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 3 "-" "-" "-" 0.0140 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/p/a" 204 - "-" "-" "-" 0.0011 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0104 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0009 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0096 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00foo" 201 - "-" "-" "-" 0.0014 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00nullish" 201 - "-" "-" "-" 0.0096 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0017 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 158 "-" "-" "-" 0.0133 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0177 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0009 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0014 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00foo" 201 - "-" "-" "-" 0.0255 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00nullish" 201 - "-" "-" "-" 0.0015 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 2 "-" "-" "-" 0.0095 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 269 "-" "-" "-" 0.0013 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0026 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test01" 201 - "-" "-" "-" 0.0291 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/%00null%00test02" 201 - "-" "-" "-" 0.0015 "-" 1824529 1 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/nullish" 201 - "-" "-" "-" 0.0052 "-" 1824529 0 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 390 "-" "-" "-" 0.0019 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 121 "-" "-" "-" 0.0215 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 390 "-" "-" "-" 0.0014 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 200 255 "-" "-" "-" 0.0098 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a" 404 - "-" "-" "-" 0.0003 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /bob" 400 18 "-" "-" "-" 0.0002 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "GET /sda1/p/a/c%D8%3E%2520" 412 12 "-" "-" "-" 0.0138 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 201 - "-" "-" "-" 0.0185 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a" 202 - "-" "-" "-" 0.0011 "-" 1824529 -test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_utf8_metadata test.unit.account.test_server.TestNonLegacyDefaultStoragePolicy.test_utf8_metadata ... ok test.unit.cli.test_recon_cron.TestReconCron.test_get_async_count test.unit.cli.test_recon_cron.TestReconCron.test_get_async_count ... ok test.unit.cli.test_recon_cron.TestReconCron.test_get_async_count_deleted test.unit.cli.test_recon_cron.TestReconCron.test_get_async_count_deleted ... ok test.unit.common.middleware.crypto.test_decrypter.TestModuleMethods.test_purge_crypto_sysmeta_headers test.unit.common.middleware.crypto.test_decrypter.TestModuleMethods.test_purge_crypto_sysmeta_headers ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_error_while_segment_bucket_delete test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_error_while_segment_bucket_delete ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_error_with_enabled_versioning test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_error_with_enabled_versioning ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_error_with_suspended_versioning test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_error_with_suspended_versioning ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_with_empty_versioning test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_DELETE_with_empty_versioning ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_s3acl_with_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_s3acl_with_segment_bucket ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_s3acl_with_segment_bucket_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_s3acl_with_segment_bucket_mixed_policy ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'Content-Md5': '9Z+cE+YYsVYXLtR89GLUSA==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'f59f9c13e618b156172ed47cf462d448', 'Content-Length': '88'} fake-swift ERROR: Unexpected Error handling DELETE of 'bucket' 'Key1': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/multi_delete.py", line 133, in do_delete resp = req.get_response(self.app, method='DELETE', query=query, headers={'Accept': 'application/json'}) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2452, in get_response return self.get_acl_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2181, in _get_response sw_resp = sw_req.get_response(app) File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1115, in get_response status, headers, app_iter = self.call_application(application) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1099, in call_application app_iter = application(self.environ, start_response) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 183, in __call__ return self.app(env, start_response) ~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/s3api/__init__.py", line 85, in __call__ return self.app(env, start_response) ~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/helpers.py", line 386, in __call__ resp = resp_class( req=req, headers=headers, body=body, conditional_response=req.method in ('GET', 'HEAD'), conditional_etag=conditional_etag) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/helpers.py", line 262, in _select_response is_success = resp_class().is_success ~~~~~~~~~~^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception: kaboom fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_unhandled_exception test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_unhandled_exception ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_versioned_enabled test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_versioned_enabled ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx89f33cb8e3dd4648b3a80-0068c57072" "proxy-server 1824514" 0.0134 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "txacfc4e224c7b4a5bb9f18-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 304 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "tx791856ad371141de9b987-0068c57072" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx03deb5ec04d3412ba3e27-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "tx628146e9fe44442b94001-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 304 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "txa4791e1133ac4ca6a3501-0068c57072" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx94285137ad844a7f9b141-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/2/a/7ea2455bab3f4fceaafa91baabbac07e" 204 - "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e" "txbab935a9d3f0491bb4d38-0068c57072" "proxy-server 1824514" 0.0057 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdd1/2/a/7ea2455bab3f4fceaafa91baabbac07e/o" 200 24 "HEAD http://localhost:8080/v1/a/7ea2455bab3f4fceaafa91baabbac07e/o" "txbcf34937bad3448380677-0068c57072" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx40d75dc2f32742f08f3e9-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdb1/1/a/0870f17966d047188e8e926ce0feffd2" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/0870f17966d047188e8e926ce0feffd2" "tx40d75dc2f32742f08f3e9-0068c57072" "container-server 1824514" 0.0011 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/1/a/0870f17966d047188e8e926ce0feffd2" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/0870f17966d047188e8e926ce0feffd2" "tx40d75dc2f32742f08f3e9-0068c57072" "container-server 1824514" 0.0174 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/0/a/0870f17966d047188e8e926ce0feffd2" 201 - "PUT http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2" "tx40d75dc2f32742f08f3e9-0068c57072" "proxy-server 1824514" 0.0492 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdb1/0/a/0870f17966d047188e8e926ce0feffd2" 201 - "PUT http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2" "tx40d75dc2f32742f08f3e9-0068c57072" "proxy-server 1824514" 0.0619 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6a4cefad1d4f45a9896e6-0068c57072" "proxy-server 1824514" 0.0020 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/0/a/0870f17966d047188e8e926ce0feffd2" 204 - "HEAD http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2" "tx6a4cefad1d4f45a9896e6-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx82ad5f71f351407599ae2-0068c57072" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/0/a/0870f17966d047188e8e926ce0feffd2" 204 - "HEAD http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2" "tx212cf9fb55f146b5b1074-0068c57072" "proxy-server 1824514" 0.0018 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdg1/2/a/0870f17966d047188e8e926ce0feffd2/o" 201 - "PUT http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2/o" "tx095dc9cc4f5943f78d24a-0068c57072" "proxy-server 1824514" 0.0393 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/0/a/0870f17966d047188e8e926ce0feffd2/o" 201 - "PUT http://foo:8080/sdh1/2/a/0870f17966d047188e8e926ce0feffd2/o" "tx095dc9cc4f5943f78d24a-0068c57072" "object-server 1824514" 0.0005 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdb1/0/a/0870f17966d047188e8e926ce0feffd2/o" 201 - "PUT http://foo:8080/sdi1/2/a/0870f17966d047188e8e926ce0feffd2/o" "tx095dc9cc4f5943f78d24a-0068c57072" "object-server 1824514" 0.0059 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdh1/2/a/0870f17966d047188e8e926ce0feffd2/o" 201 - "PUT http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2/o" "tx095dc9cc4f5943f78d24a-0068c57072" "proxy-server 1824514" 0.0497 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdi1/2/a/0870f17966d047188e8e926ce0feffd2/o" 201 - "PUT http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2/o" "tx095dc9cc4f5943f78d24a-0068c57072" "proxy-server 1824514" 0.0519 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa5236407e0f04cb8aa669-0068c57072" "proxy-server 1824514" 0.0092 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/0/a/0870f17966d047188e8e926ce0feffd2" 204 - "HEAD http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2" "tx0aa3541c00614fb0b0c83-0068c57072" "proxy-server 1824514" 0.0110 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "POST /sdi1/2/a/0870f17966d047188e8e926ce0feffd2/o" 202 76 "POST http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2/o" "tx0fb052b98c2d42e78ce38-0068c57072" "proxy-server 1824514" 0.0117 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/0/a/0870f17966d047188e8e926ce0feffd2/o" 201 - "POST http://foo:8080/sdh1/2/a/0870f17966d047188e8e926ce0feffd2/o" "tx0fb052b98c2d42e78ce38-0068c57072" "object-server 1824514" 0.0008 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdb1/0/a/0870f17966d047188e8e926ce0feffd2/o" 201 - "POST http://foo:8080/sdg1/2/a/0870f17966d047188e8e926ce0feffd2/o" "tx0fb052b98c2d42e78ce38-0068c57072" "object-server 1824514" 0.0004 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "POST /sdh1/2/a/0870f17966d047188e8e926ce0feffd2/o" 202 76 "POST http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2/o" "tx0fb052b98c2d42e78ce38-0068c57072" "proxy-server 1824514" 0.0212 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "POST /sdg1/2/a/0870f17966d047188e8e926ce0feffd2/o" 202 76 "POST http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2/o" "tx0fb052b98c2d42e78ce38-0068c57072" "proxy-server 1824514" 0.0194 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx63b05712ecf247b4a84f8-0068c57072" "proxy-server 1824514" 0.0051 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx63b05712ecf247b4a84f8-0068c57072" "container-server 1824514" 0.0010 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdb1/1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx63b05712ecf247b4a84f8-0068c57072" "container-server 1824514" 0.0051 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 201 - "PUT http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx63b05712ecf247b4a84f8-0068c57072" "proxy-server 1824514" 0.0163 "-" 1824514 3test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_s3acl_without_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_s3acl_without_segment_bucket ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_is_truncated test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_is_truncated ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_s3acl_without_segment_bucket_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_s3acl_without_segment_bucket_mixed_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_with_segment_bucket_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_with_segment_bucket_mixed_policy ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_is_truncated_url_encoded test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_is_truncated_url_encoded ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'Content-Md5': 'zavuQyQF58vjKr0+D1KgXQ==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'cdabee432405e7cbe32abd3e0f52a05d', 'Content-Length': '289'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'Content-Md5': 'q4tcOg3UMYo5ugtOzdCAKw==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'ab8b5c3a0dd4318a39ba0b4ecdd0802b', 'Content-Length': '230'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_versioned_suspended test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_versioned_suspended ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_without_segment_bucket_make_public test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_without_segment_bucket_make_public ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_error test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_last_modified_rounding test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_last_modified_rounding ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_partition_lock_taken_during_get_hashes test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_partition_lock_taken_during_get_hashes ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_max_keys test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_max_keys ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_GET_part_num_not_satisfiable test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_GET_part_num_not_satisfiable ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_HEAD_part_num test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_HEAD_part_num ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_HEAD_part_num_and_range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_HEAD_part_num_and_range ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_negative_max_keys test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_negative_max_keys ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_without_segment_bucket_same_acls test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_without_segment_bucket_same_acls ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_non_json test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_non_json ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_over_32bit_int_max_keys test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_over_32bit_int_max_keys ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_without_segment_bucket_same_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_mpu_initiate_without_segment_bucket_same_policy ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 201 - "PUT http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx63b05712ecf247b4a84f8-0068c57072" "proxy-server 1824514" 0.0305 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7a9cd4474593478888fda-0068c57072" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx7a9cd4474593478888fda-0068c57072" "proxy-server 1824514" 0.0011 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa8c7630d765a410e9c8d8-0068c57072" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/0/a/0870f17966d047188e8e926ce0feffd2" 204 - "HEAD http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2" "tx92fb78fb192a432587fb3-0068c57072" "proxy-server 1824514" 0.0063 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "GET /sdg1/2/a/0870f17966d047188e8e926ce0feffd2/o" 200 92 "GET http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2/o" "tx846678599b8d4da99932d-0068c57072" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "GET /sdh1/2/a/0870f17966d047188e8e926ce0feffd2/o" 200 92 "GET http://foo:8080/v1/a/0870f17966d047188e8e926ce0feffd2/o" "tx846678599b8d4da99932d-0068c57072" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx90b872790c224c9ebc124-0068c57072" "proxy-server 1824514" 0.0102 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://foo:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx79f26da590824275a6035-0068c57072" "proxy-server 1824514" 0.0095 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 201 - "PUT http://foo:8080/sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx86232d2dc0df4c739b7f5-0068c57072" "object-server 1824514" 0.0005 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 201 - "PUT http://foo:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx86232d2dc0df4c739b7f5-0068c57072" "proxy-server 1824514" 0.0414 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 201 - "PUT http://foo:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx86232d2dc0df4c739b7f5-0068c57072" "proxy-server 1824514" 0.0459 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 201 - "PUT http://foo:8080/sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx86232d2dc0df4c739b7f5-0068c57072" "object-server 1824514" 0.0005 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "PUT /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 201 - "PUT http://foo:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx86232d2dc0df4c739b7f5-0068c57072" "proxy-server 1824514" 0.0576 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx53c182c5953448c4a12fa-0068c57072" "proxy-server 1824514" 0.0096 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "txf25328556dec4ff4a3eb6-0068c57073" "proxy-server 1824514" 0.0108 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx6bd318387dac4d96a8318-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx6bd318387dac4d96a8318-0068c57073" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx06f10b6efe6c48afb1032-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx41312bc4d98b4841a1f82-0068c57073" "proxy-server 1824514" 0.0021 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx082b6205083c40e9a5164-0068c57073" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0613c5b9b8c1429ca3239-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx7fdc55dbdcc54ec29943a-0068c57073" "proxy-server 1824514" 0.0085 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx70000f9af90c48e7bc8cb-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx70000f9af90c48e7bc8cb-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txf97ccb9e662d4003a7c83-0068c57073" "proxy-server 1824514" 0.0054 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx9ddaa9f7ac8143bd87ff1-0068c57073" "proxy-server 1824514" 0.0074 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "txf534276e4fb8456f96311-0068c57073" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0acc744cbeb6445f838ee-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 200 155 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0?format=json&states=listing" "tx0acc744cbeb6445f838ee-0068c57073" "proxy-server 1824514" 0.0101 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txef73a0c4d88a439aa0d49-0068c57073" "proxy-server 1824514" 0.0096 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 200 155 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0?format=json&states=listing" "txef73a0c4d88a439aa0d49-0068c57073" "proxy-server 1824514" 0.0107 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txaca0b62978dc487dbf95a-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "txdba0411ed7454c1fb95ea-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 3test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_passthroughs test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_passthroughs ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multi_upload_empty_body test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multi_upload_empty_body ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_str_max_keys test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_str_max_keys ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_abort test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_abort ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_subdir test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_subdir ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_abort_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_abort_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_subdir_with_delimiter_max_keys test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_subdir_with_delimiter_max_keys ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_404_on_marker_delete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_404_on_marker_delete ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_url_encoded test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_url_encoded ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_409_on_marker_delete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_409_on_marker_delete ... ok fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'Content-Md5': '1mSVh2rJhFbgxzf6YLHnJA==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd66495876ac98456e0c737fa60b1e724', 'Content-Length': '184', 'Content-Type': 'multipart/form-data'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'Content-Md5': 'ud0C7/g6K1j77RpgTDYdwQ==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'b9dd02eff83a2b58fbed1a604c361dc1', 'Content-Length': '120'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_invalid_md5 test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_invalid_md5 ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_fetch_owner test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_fetch_owner ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_failure_with_heartbeat test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_failure_with_heartbeat ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_marker_ts_in_future test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_marker_ts_in_future ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 249, in DELETE resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2452, in get_response return self.get_acl_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500)test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_is_truncated test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_is_truncated ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_marker_ts_now test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_marker_ts_now ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_mixed_policy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_missing test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_missing ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_passthroughs test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_passthroughs ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_no_content_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_no_content_type ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_HEAD_part_num_invalid test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_HEAD_part_num_invalid ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_HEAD_part_num_not_satisfiable test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_non_slo_object_HEAD_part_num_not_satisfiable ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_with_delimiter_max_keys test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_with_delimiter_max_keys ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_non_ascii test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_non_ascii ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_old_content_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_old_content_type ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_with_nonascii_queries test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_v2_with_nonascii_queries ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_other_headers test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_other_headers ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_versions_non_existent_version_id_marker test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_versions_non_existent_version_id_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_segment_too_small test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_segment_too_small ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_versions_prefix test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_versions_prefix ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_single_zero_length_segment test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_single_zero_length_segment ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_weird_host_name test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_weird_host_name ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:00 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_location test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_location ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_location_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_location_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_versions_with_key_marker_and_version_id_marker test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_versions_with_key_marker_and_version_id_marker ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'Content-Md5': '1mSVh2rJhFbgxzf6YLHnJA==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd66495876ac98456e0c737fa60b1e724', 'Content-Length': '184', 'Content-Type': 'multipart/form-data'} fake-swift ERROR: Could not parse SLO delete response (200 OK): b'asdf': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/multi_delete.py", line 141, in do_delete delete_result = json.loads(resp.body) File "/usr/lib/python3.13/json/__init__.py", line 346, in loads return _default_decoder.decode(s) ~~~~~~~~~~~~~~~~~~~~~~~^^^ File "/usr/lib/python3.13/json/decoder.py", line 345, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/json/decoder.py", line 363, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_non_json test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_non_json ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_write_permission test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_with_write_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_heartbeat test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_heartbeat ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_match ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_modified_since test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_modified_since ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_none_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_none_match ... ok test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy40_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy50" 204 - "-" "-" "-" 0.0089 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy50_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy60" 301 - "-" "-" "-" 0.0009 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy60_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy70" 204 - "-" "-" "-" 0.0092 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy70_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy80" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpy80_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier10" 204 - "-" "-" "-" 0.0053 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier10_no_header" 204 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier20" 301 - "-" "-" "-" 0.0009 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier20_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier30" 301 - "-" "-" "-" 0.0089 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier30_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier40" 301 - "-" "-" "-" 0.0091 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier40_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier50" 204 - "-" "-" "-" 0.0131 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier50_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier60" 301 - "-" "-" "-" 0.0044 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier60_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier70" 204 - "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier70_no_header" 204 - "-" "-" "-" 0.0199 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0080 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier80" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/grumpier80_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/dopey" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/dopey10" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/dopey10_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/dopey20" 301 - "-" "-" "-" 0.0009 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/dopey20_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/dopey30" 301 - "-" "-" "-" 0.0136 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/dopey30_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/dopey40" 301 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "DELETE /sda1/p/a/c/dopey40_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:02 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/dopey50" 204 - "-" "-" "-" 0.0132 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/dopey50_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/dopey60" 301 - "-" "-" "-" 0.0132 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/dopey60_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0058 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/dopey70" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/dopey70_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/dopey80" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/dopey80_no_header" 204 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/bashful" 301 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/dopey" 301 - "-" "-" "-" 0.0090 "-" 1824541 2 test DEBUG: Unlinked retiring db '/tmp/tmpvlrsi2t6/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0022 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest10" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest10_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest20" 301 - "-" "-" "-" 0.0051 "-" 1824541 2test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_object_update_redirected_to_shard test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_object_update_redirected_to_shard ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_timestamp_not_float test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_DELETE_timestamp_not_float ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_not_valid test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_accept_not_valid ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_auto_record_type test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_auto_record_type ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_delimiter test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_delimiter ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_delimiter_non_ascii test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_delimiter_non_ascii ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_versions_with_version_id_marker test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_versions_with_version_id_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_none_match_star ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_unmodified_since test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_with_if_unmodified_since ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_delimiter_max_keys test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_delimiter_max_keys ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_zero_length_final_segment test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_zero_length_final_segment ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_zero_segments test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_complete_zero_segments ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_s3acl_with_cached_seg_buck test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_s3acl_with_cached_seg_buck ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_nonascii_queries test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_nonascii_queries ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_with_checksum_algorithm test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_with_checksum_algorithm ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_versions test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_versions ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_with_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_with_segment_bucket ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_versions_versioning_not_configured test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_versions_versioning_not_configured ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_without_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_without_bucket ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_without_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_initiate_without_segment_bucket ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_versions_with_max_keys test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_versions_with_max_keys ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_versions_with_max_keys_and_key_marker test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_GET_with_versions_with_max_keys_and_key_marker ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_multipart test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_multipart ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_no_multipart test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_no_multipart ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_invalid_md5 test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_invalid_md5 ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_invalid_sha256 test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_invalid_sha256 ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_503 test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_503 ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_missing_part_with_heartbeat test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_missing_part_with_heartbeat ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_policy_index_logging test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_policy_index_logging ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_etag_mismatch test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_etag_mismatch ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_slash test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_slash ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_mixed_policy ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_slash_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_HEAD_slash_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_nothing_there test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_nothing_there ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_upload_id_mismatch test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_upload_id_mismatch ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_bucket_already_owned_by_you test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_bucket_already_owned_by_you ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_match ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_modified_since test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_modified_since ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_none_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_none_match ... ok test.unit.common.test_wsgi.TestPipelineModification.test_proxy_modify_wsgi_pipeline_recommended_pipelines test.unit.common.test_wsgi.TestPipelineModification.test_proxy_modify_wsgi_pipeline_recommended_pipelines ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_none_match_star ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_unmodified_since test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_retry_complete_with_if_unmodified_since ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_upper_sha256 test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_upload_upper_sha256 ... ok test.unit.common.test_wsgi.TestPipelineModification.test_proxy_unmodified_wsgi_pipeline test.unit.common.test_wsgi.TestPipelineModification.test_proxy_unmodified_wsgi_pipeline ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_uploads_list test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_multipart_uploads_list ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_upload_part test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_upload_part ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_upload_part_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_object_upload_part_error ... ok test.unit.common.utils.test_checksum.TestCRC64NVME.test_anycrc test.unit.common.utils.test_checksum.TestCRC64NVME.test_anycrc ... skipped 'No anycrc CRC64NVME' test.unit.common.utils.test_checksum.TestCRC64NVME.test_isal test.unit.common.utils.test_checksum.TestCRC64NVME.test_isal ... skipped 'No ISA-L CRC64NVME' test.unit.common.utils.test_checksum.TestCRCHasher.test_base_crc_hasher test.unit.common.utils.test_checksum.TestCRCHasher.test_base_crc_hasher ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32_hasher test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32_hasher ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32_hasher_contructed_with_data test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32_hasher_contructed_with_data ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32_hasher_copy test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32_hasher_copy ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32_hasher_initial_value test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32_hasher_initial_value ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_constructed_with_data test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_constructed_with_data ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_copy test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_copy ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_initial_value test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_initial_value ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_selects_anycrc_impl test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_selects_anycrc_impl ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_selects_isal_impl test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_selects_isal_impl ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_selects_kern_impl test.unit.common.utils.test_checksum.TestCRCHasher.test_crc32c_hasher_selects_kern_impl ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher ... skipped 'no crc64nvme implementation, install isal or anycrc' test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_constructed_with_data test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_constructed_with_data ... skipped 'no crc64nvme implementation, install isal or anycrc' test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_copy test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_copy ... skipped 'no crc64nvme implementation, install isal or anycrc' test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_initial_value test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_initial_value ... skipped 'no crc64nvme implementation, install isal or anycrc' test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_selects_anycrc_impl test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_selects_anycrc_impl ... ok test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_selects_isal_impl test.unit.common.utils.test_checksum.TestCRCHasher.test_crc64nvme_hasher_selects_isal_impl ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy ... ok test.unit.obj.test_auditor.TestAuditor.test_audit_location_gets_quarantined test.unit.obj.test_auditor.TestAuditor.test_audit_location_gets_quarantined ... ok test.unit.obj.test_auditor.TestAuditor.test_auditor_reclaim_age test.unit.obj.test_auditor.TestAuditor.test_auditor_reclaim_age ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_replication_lock_taken test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_replication_lock_taken ... ok test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest20_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest30" 301 - "-" "-" "-" 0.0052 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest30_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest40" 301 - "-" "-" "-" 0.0052 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest40_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest50" 204 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest50_no_header" 204 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest60" 301 - "-" "-" "-" 0.0132 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest60_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest70" 204 - "-" "-" "-" 0.0053 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest70_no_header" 204 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest80" 204 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c/grumpiest80_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "DELETE /sda1/p/a/c" 400 26 "-" "-" "-" 0.0001 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0155 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 406 - "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0113 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/obj_0" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/obj_1" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0150 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0178 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0023 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0023 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0109 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0148 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0104 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 126 "-" "-" "-" 0.0026 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 126 "-" "-" "-" 0.0108 "-" 1824541 2 test DEBUG: Unlinked retiring db '/tmp/tmpc75yd0j2/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0143 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0024 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0062 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0186 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-TX-A" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-TX-B" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-OK-A" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-OK-B" 201 - "-" "-" "-" 0.0030 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-UT-A" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 66 "-" "-" "-" 0.0204 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0135 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/a/%E2%9D%A5/1" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/a/%E2%9D%A5/2" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/a/%EA%99%AE/1" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/a/%EA%99%AE/2" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 50 "-" "-" "-" 0.0184 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 14 "-" "-" "-" 0.0020 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-TX-A" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-TX-B" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-OK-A" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-OK-B" 201 - "-" "-" "-" 0.0242 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/US-UT-A" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 221 "-" "-" "-" 0.0167 "-" 1824541 2test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_delimiter_xml test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_delimiter_xml ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_delimiter_xml_with_quotes test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_delimiter_xml_with_quotes ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_invalid_accept test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_invalid_accept ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_json test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_json ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_json_last_modified test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_json_last_modified ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_leading_delimiter test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_leading_delimiter ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_limit test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_limit ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_log_requests_false test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_log_requests_false ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_log_requests_true test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_log_requests_true ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_marker test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_marker ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_multichar_delimiter test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_multichar_delimiter ... ok test INFO: - - - [13/Sep/2025:13:24:02 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0010 "-" 1824529 - test INFO: - - - [13/Sep/2025:13:24:02 +0000] "POST /sda1/p/a" 204 - "-" "-" "-" 0.0127 "-" 1824529 - fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 406, in DELETE self._delete_segments_bucket(req) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 55, in _delete_segments_bucket resp = req.get_response(self.app, 'HEAD') File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 343, in GET resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: Got non-JSON response trying to list /bucket: b'obj0\nobj1\nobj2\nobj3\nobj4\nobj5\nobj6\nobj7\nobj8\nobj9\nobj10\nobj1...' fake-swift ERROR: Expecting value: line 1 column 1 (char 0): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 346, in GET objects = json.loads(resp.body) File "/usr/lib/python3.13/json/__init__.py", line 346, in loads return _default_decoder.decode(s) ~~~~~~~~~~~~~~~~~~~~~~~^^^ File "/usr/lib/python3.13/json/decoder.py", line 345, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/json/decoder.py", line 363, in raw_decode raise JSONDecodeError("Expecting value", s, err.value) from None json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift DEBUG: Calling S3Api Middleware fake-swift INFO: - - 13/Sep/2025/13/24/03 HEAD /junk HTTP/1.0 200 - Mozzarella%20Foxfire - - - - - - 0.0006 - - 1757769843.991903543 1757769843.992549181 0 test:tester fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift DEBUG: Calling S3Api Middleware fake-swift INFO: - - 13/Sep/2025/13/24/03 HEAD /junk HTTP/1.0 200 - Mozzarella%20Foxfire - - - - - - 0.0005 - - 1757769843.993180513 1757769843.993705750 1 test:tester fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/bucket.py", line 392, in PUT resp = req.get_response(self.app) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500)test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_first_put_fail test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_first_put_fail ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_v4_with_body test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_v4_with_body ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_v4_with_body_bad_hash test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_v4_with_body_bad_hash ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_ami_location test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_ami_location ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_canned_acl test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_canned_acl ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_location test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_location ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_location_error test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_location_error ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_location_invalid_xml test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_location_invalid_xml ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_mixed_case_location test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_mixed_case_location ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_strange_location test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketNoACL.test_bucket_PUT_with_strange_location ... ok test.unit.common.middleware.s3api.test_s3api.TestListingMiddleware.test_s3_etag_in_json test.unit.common.middleware.s3api.test_s3api.TestListingMiddleware.test_s3_etag_in_json ... ok test.unit.common.middleware.s3api.test_s3api.TestListingMiddleware.test_s3_etag_non_json test.unit.common.middleware.s3api.test_s3api.TestListingMiddleware.test_s3_etag_non_json ... ok test.unit.common.middleware.s3api.test_utils.TestS3Timestamp.test_from_isoformat test.unit.common.middleware.s3api.test_utils.TestS3Timestamp.test_from_isoformat ... ok test.unit.common.middleware.s3api.test_utils.TestS3Timestamp.test_from_s3xmlformat test.unit.common.middleware.s3api.test_utils.TestS3Timestamp.test_from_s3xmlformat ... ok test.unit.common.middleware.s3api.test_utils.TestS3Timestamp.test_s3xmlformat test.unit.common.middleware.s3api.test_utils.TestS3Timestamp.test_s3xmlformat ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddlewareWithEC.test_COPY_with_invalid_ranges test.unit.common.middleware.test_copy.TestServerSideCopyMiddlewareWithEC.test_COPY_with_invalid_ranges ... ok test.unit.common.middleware.test_copy.TestServerSideCopyMiddlewareWithEC.test_COPY_with_single_range test.unit.common.middleware.test_copy.TestServerSideCopyMiddlewareWithEC.test_COPY_with_single_range ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_anonymous_is_authorized_for_permitted_referrer test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_anonymous_is_authorized_for_permitted_referrer ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_anonymous_is_not_authorized_for_unknown_reseller_prefix test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_anonymous_is_not_authorized_for_unknown_reseller_prefix ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_anonymous_options_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_anonymous_options_allowed ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_anonymous_with_validtoken_authorized_for_permitted_referrer test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_anonymous_with_validtoken_authorized_for_permitted_referrer ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_auth_scheme test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_auth_scheme ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_blank_reseller_prefix test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_blank_reseller_prefix ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_confirmed_identity_is_authorized test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_confirmed_identity_is_authorized ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_confirmed_identity_is_not_authorized test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_confirmed_identity_is_not_authorized ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_robust test.unit.cli.test_relinker.TestRelinker.test_cleanup_old_part_robust ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_denied_responses test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_denied_responses ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_detect_reseller_request test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_detect_reseller_request ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_identified_options_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_identified_options_allowed ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_invalid_request_authorized test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_invalid_request_authorized ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_invalid_request_non_authorized test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_invalid_request_non_authorized ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_override_asked_for_and_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_override_asked_for_and_allowed ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_override_asked_for_but_not_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_override_asked_for_but_not_allowed ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_override_default_allowed test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_override_default_allowed ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_project_domain_id_sysmeta_not_set test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_project_domain_id_sysmeta_not_set ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_project_domain_id_sysmeta_set test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_project_domain_id_sysmeta_set ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_project_domain_id_sysmeta_set_to_unknown test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_project_domain_id_sysmeta_set_to_unknown ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_project_domain_id_sysmeta_set_unknown_with_v2 test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_project_domain_id_sysmeta_set_unknown_with_v2 ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_reseller_prefix_added_underscore test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_reseller_prefix_added_underscore ... ok test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_reseller_prefix_not_added_double_underscores test.unit.common.middleware.test_keystoneauth.SwiftAuthMultiple.test_reseller_prefix_not_added_double_underscores ... ok test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_invalid_character test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_invalid_character ... ok test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_invalid_length test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_invalid_length ... ok test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_invalid_regexp test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_invalid_regexp ... ok test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_maximum_length_from_config test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_maximum_length_from_config ... ok test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_valid_length_and_character test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_valid_length_and_character ... ok test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_valid_regexp test.unit.common.middleware.test_name_check.TestNameCheckMiddleware.test_valid_regexp ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_delete_marker_over_object_success test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_delete_marker_over_object_success ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_delete_marker_over_versioned_object_success test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_delete_marker_over_versioned_object_success ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_delete_object_with_versioning_never_enabled test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_delete_object_with_versioning_never_enabled ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_denied_DELETE_of_versioned_object test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_denied_DELETE_of_versioned_object ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_put_delete_marker_no_object_success test.unit.common.middleware.test_object_versioning.ObjectVersioningTestDelete.test_put_delete_marker_no_object_success ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_get_with_if_modified_since test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_get_with_if_modified_since ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_older_object_in_new_partition test.unit.cli.test_relinker.TestRelinker.test_cleanup_older_object_in_new_partition ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches_alternate_etag_non_slo test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches_alternate_etag_non_slo ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches_alternate_etag_non_slo_after_refetch test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches_alternate_etag_non_slo_after_refetch ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches_and_range test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_matches_and_range ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches_alternate_etag_non_slo test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches_alternate_etag_non_slo ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches_alternate_etag_non_slo_after_refetch test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches_alternate_etag_non_slo_after_refetch ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches_manifest_json_md5 test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_match_mismatches_manifest_json_md5 ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_modified_since_ancient_date test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_modified_since_ancient_date ... ok swift: Using crc32c_kern implementation for CRC32C. fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'}swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_with_fullcontrol_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_with_owner_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_with_owner_permission ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_modified_since_last_modified test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_modified_since_last_modified ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_modified_since_now test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_modified_since_now ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_matches test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_matches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_matches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_matches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_matches_no_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_matches_no_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_mismatches test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_mismatches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_mismatches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_mismatches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_mismatches_json_md5 test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_none_match_mismatches_json_md5 ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_unmodified_since_ancient_date test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_unmodified_since_ancient_date ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_unmodified_since_last_modified test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_unmodified_since_last_modified ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_unmodified_since_now test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_if_unmodified_since_now ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_matches test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_matches ... ok fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 249, in DELETE resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2452, in get_response return self.get_acl_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_missing test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_missing ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_multipart test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_multipart ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_matches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_matches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_mismatches test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_mismatches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_mismatches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_mismatches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_mismatches_alternate_etag_miss test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_mismatches_alternate_etag_miss ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_mismatches_without_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_match_mismatches_without_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_none_match_matches test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_none_match_matches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_none_match_matches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_none_match_matches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_none_match_mismatches test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_none_match_mismatches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_none_match_mismatches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_manifest_get_if_none_match_mismatches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_old_swift_if_match_matches_and_range test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_old_swift_if_match_matches_and_range ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_range_resume_download test.unit.common.middleware.test_slo.TestSloConditionalGetNewManifest.test_range_resume_download ... ok test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_etag_is_hash_of_segment_etags test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_etag_is_hash_of_segment_etags ... ok test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_get_manifest_passthrough test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_get_manifest_passthrough ... ok test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_head_manifest_is_efficient test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_head_manifest_is_efficient ... ok test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_if_match_etag_not_matching test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_if_match_etag_not_matching ... ok test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_if_match_etag_not_matching_with_override test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_if_match_etag_not_matching_with_override ... ok test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_if_none_match_etag_matching test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_if_none_match_etag_matching ... ok test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_if_none_match_etag_matching_with_override test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_if_none_match_etag_matching_with_override ... ok test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_zero_byte_manifest test.unit.common.middleware.test_slo.TestSloHeadOldManifest.test_zero_byte_manifest ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_ec_symlink_range_unsatisfiable_can_redirect_to_target test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_ec_symlink_range_unsatisfiable_can_redirect_to_target ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_non_symlink test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_non_symlink ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_static_link_mismatched_etag test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_static_link_mismatched_etag ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_static_link_to_symlink test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_static_link_to_symlink ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_static_link_to_symlink_fails test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_static_link_to_symlink_fails ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink_not_found test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink_not_found ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink_to_reserved_object test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink_to_reserved_object ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink_to_reserved_symlink test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink_to_reserved_symlink ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink_with_account test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_symlink_with_account ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_target_object test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_target_object ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_target_object_not_found test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_target_object_not_found ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Start tag expected, '<' not found, line 1, column 1 (, line 1) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_target_object_range_not_satisfiable test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_get_target_object_range_not_satisfiable ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_head_symlink test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_head_symlink ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_head_symlink_with_account test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_head_symlink_with_account ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_head_target_object test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_head_target_object ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_non_symlink_post test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_non_symlink_post ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_location_invalid_xml test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_location_invalid_xml ... ok test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_strange_location test.unit.common.middleware.s3api.test_bucket.TestS3ApiBucketAcl.test_bucket_PUT_with_strange_location ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_set_symlink_POST_fail test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_set_symlink_POST_fail ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_sym_to_sym_to_target test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_sym_to_sym_to_target ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_change_symloopmax test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_change_symloopmax ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_chunked_put test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_chunked_put ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_chunked_put_error test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_chunked_put_error ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_info test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_info ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_post test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_post ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_post_but_fail_at_server test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_post_but_fail_at_server ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_bad_account_header test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_bad_account_header ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_bad_object_header test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_bad_object_header ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_different_account test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_different_account ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_leading_slash test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_leading_slash ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_non_zero_length test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_non_zero_length ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_with_prevalidated_etag test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_with_prevalidated_etag ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_with_prevalidated_etag_sysmeta_incomplete test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_put_with_prevalidated_etag_sysmeta_incomplete ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_error test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_error ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_to_non_existing_object test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_to_non_existing_object ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_to_non_existing_object_override test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_to_non_existing_object_override ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_content_type test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_content_type ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Start tag expected, '<' not found, line 1, column 1 (, line 1) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Expecting an element , got nothing, line 1 fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_headers_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_headers_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_headers_with_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_headers_with_match ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_headers_with_not_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_headers_with_not_match ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_range test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_range ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_range_invalid test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_range_invalid ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_range_unsatisfiable test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUpload.test_upload_part_copy_range_unsatisfiable ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_abort_multipart_upload_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_abort_multipart_upload_acl_with_fullcontrol_permission ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_etag test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_etag ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_etag_explicit_content_type test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_etag_explicit_content_type ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_etag_target_missing_content_type test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_etag_target_missing_content_type ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_quoted_etag test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_quoted_etag ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_unmatched_etag test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_simple_put_with_unmatched_etag ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_too_deep test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symlink_too_deep ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symloop_max_config test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_symloop_max_config ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_validate_and_prep_request_headers test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_validate_and_prep_request_headers ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_validate_and_prep_request_headers_invalid_format test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_validate_and_prep_request_headers_invalid_format ... ok test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_validate_and_prep_request_headers_points_to_itself test.unit.common.middleware.test_symlink.TestSymlinkMiddleware.test_validate_and_prep_request_headers_points_to_itself ... ok test.unit.common.test_base_storage_server.TestBaseStorageServer.test_OPTIONS test.unit.common.test_base_storage_server.TestBaseStorageServer.test_OPTIONS ... ok test.unit.common.test_base_storage_server.TestBaseStorageServer.test_OPTIONS_error test.unit.common.test_base_storage_server.TestBaseStorageServer.test_OPTIONS_error ... ok test.unit.common.test_base_storage_server.TestBaseStorageServer.test_allowed_methods test.unit.common.test_base_storage_server.TestBaseStorageServer.test_allowed_methods ... ok test.unit.common.test_base_storage_server.TestBaseStorageServer.test_server_type test.unit.common.test_base_storage_server.TestBaseStorageServer.test_server_type ... ok test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_can_not_override_method test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_can_not_override_method ... ok test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_can_not_override_status test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_can_not_override_status ... ok test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_cannot_remove_labels test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_cannot_remove_labels ... ok test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_extra_labels test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_extra_labels ... ok test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_get_200 test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_get_200 ... ok test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_head_500 test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_head_500 ... ok test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_head_507_exception test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_head_507_exception ... ok test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_really_can_not_override_method test.unit.common.test_base_storage_server.TestLabeledTimingStatsDecorator.test_labeled_timing_stats_really_can_not_override_method ... ok test.unit.common.test_db_auditor.TestAuditor.test_database_auditor test.unit.common.test_db_auditor.TestAuditor.test_database_auditor ... ok test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0158 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/c/%3C%27sub%27%20%22dir%22%3E/object" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 200 159 "-" "-" "-" 0.0185 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/c" 400 21 "-" "-" "-" 0.0003 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/jsonc" 201 - "-" "-" "-" 0.0155 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/jsonc" 200 2 "-" "-" "-" 0.0020 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/jsonc/0" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/jsonc/1" 201 - "-" "-" "-" 0.0125 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/jsonc/2" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0084 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0183 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0022 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0144 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0137 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/jsonc" 201 - "-" "-" "-" 0.0171 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/jsonc/0" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/p/a/jsonc/1" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:03 +0000] "GET /sda1/p/a/jsonc" 200 234 "-" "-" "-" 0.0173 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0155 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US-TX-A" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US-TX-B" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/-UK" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/-CH" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 36 "-" "-" "-" 0.0122 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0119 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/0" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/1" 201 - "-" "-" "-" 0.0165 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/2" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 4 "-" "-" "-" 0.0204 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0125 "-" 1824541 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0195 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/0" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/1" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/2" 201 - "-" "-" "-" 0.0002 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0150 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0178 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0279 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0035 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US~~TX~~A" 201 - "-" "-" "-" 0.0242 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US~~TX~~B" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US~~OK~~A" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US~~OK~~B" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US~~OK~Tulsa~~A" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US~~OK~Tulsa~~B" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US~~UT~~A" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/US~~UT~~~B" 201 - "-" "-" "-" 0.0002 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 102 "-" "-" "-" 0.0035 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 102 "-" "-" "-" 0.0123 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 24 "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 24 "-" "-" "-" 0.0222 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 150 "-" "-" "-" 0.0061 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 150 "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 251 "-" "-" "-" 0.0144 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 251 "-" "-" "-" 0.0020 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 126 "-" "-" "-" 0.0106 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0154 "-" 1824541 2test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_errors test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_errors ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_not_supported test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_not_supported ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_other_params test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_other_params ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_sharded_subshard_state_listing test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_sharded_subshard_state_listing ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_sharded_subshard_state_updating test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_sharded_subshard_state_updating ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_unsharded_root_state_listing test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_unsharded_root_state_listing ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_unsharded_root_state_updating test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_unsharded_root_state_updating ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_unsharded_subshard_state_listing test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_unsharded_subshard_state_listing ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_unsharded_subshard_state_updating test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_namespaces_unsharded_subshard_state_updating ... ok test.unit.common.test_db_auditor.TestAuditor.test_one_audit_pass test.unit.common.test_db_auditor.TestAuditor.test_one_audit_pass ... ok test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx55c7761c9bc54c47b8e53-0068c57070) test ERROR: Container GET returning 503 for (200, 503, 503) (txn: tx55c7761c9bc54c47b8e53-0068c57070) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx8dac554e1e3741c8bb771-0068c57070) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx8dac554e1e3741c8bb771-0068c57070) test ERROR: ERROR with Container server 10.0.0.3:1003/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx8dac554e1e3741c8bb771-0068c57070) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx8dac554e1e3741c8bb771-0068c57070) test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx8dac554e1e3741c8bb771-0068c57070) test ERROR: Container GET returning 503 for (200, 503, 503) (txn: tx8dac554e1e3741c8bb771-0068c57070) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Found 8 objects in shard (state=unsharded), total = 8 (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9992&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1032 (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: Setting object count to 1032 (txn: txd624a135733a4157b1d1e-0068c57073) test DEBUG: GET listing from 3 shards for: /v1/a/c?reverse=true&format=json&states=listing (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: Get listing from /v1/.shards_a/c_?reverse=true&format=json&limit=10000&marker=&end_marker=pie {'X-Backend-Record-Type': 'auto'} (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: Get listing from /v1/.shards_a/c_pie?reverse=true&format=json&limit=10000&marker=&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: tx4c904f133ef64905826e4-0068c57073)test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_empty_shard_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_empty_shard_no_memcache ... ok test INFO: Processing files for policy platinum under /tmp/tmpg9gv40tp/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpg9gv40tp/node/sda1/objects/163/b0b/a312f73e4a02b5f9529c9f2355b00b0b/1757769841.99835.data to /tmp/tmpg9gv40tp/node/sda1/objects/326/b0b/a312f73e4a02b5f9529c9f2355b00b0b/1757769841.99835.data test DEBUG: Run listdir on /tmp/tmpg9gv40tp/node/sda1/objects/326 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:02 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpg9gv40tp/node/sda1 (cleanup=True) test DEBUG: Removed /tmp/tmpg9gv40tp/node/sda1/objects/163/b0b/a312f73e4a02b5f9529c9f2355b00b0b/1757769841.99835.data test DEBUG: Run listdir on /tmp/tmpg9gv40tp/node/sda1/objects/163 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:02 09/13/25 GMT (0:00:00.004452 elapsed) test INFO: Processing files for policy platinum under /tmp/tmpl_5yozn3/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpl_5yozn3/node/sda1/objects/87/c7b/5798cef2a88d053b0e2d4c642c562c7b/1757769842.05861.data to /tmp/tmpl_5yozn3/node/sda1/objects/175/c7b/5798cef2a88d053b0e2d4c642c562c7b/1757769842.05861.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:02 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpl_5yozn3/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpl_5yozn3/node/sda1/objects/175 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmpl_5yozn3/node/sda1/objects/87/c7b/5798cef2a88d053b0e2d4c642c562c7b/1757769842.05861.data test DEBUG: Run listdir on /tmp/tmpl_5yozn3/node/sda1/objects/87 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:03 09/13/25 GMT (0:00:01.015941 elapsed) test INFO: Processing files for policy platinum under /tmp/tmpaulbwssz/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpaulbwssz/node/sda1/objects/2/de8/023cb69e92f60a48e7f9ac6a4b197de8/1757769843.15564.data to /tmp/tmpaulbwssz/node/sda1/objects/4/de8/023cb69e92f60a48e7f9ac6a4b197de8/1757769843.15564.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:03 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpaulbwssz/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpaulbwssz/node/sda1/objects/4 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmpaulbwssz/node/sda1/objects/2/de8/023cb69e92f60a48e7f9ac6a4b197de8/1757769843.15564.data test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:03 09/13/25 GMT (0:00:00.117350 elapsed) test INFO: Processing files for policy platinum under /tmp/tmptpia8l8e/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmptpia8l8e/node/sda1/objects/132/1d8/841258ba93a605601ba29d048034a1d8/1757769843.36681.data to /tmp/tmptpia8l8e/node/sda1/objects/264/1d8/841258ba93a605601ba29d048034a1d8/1757769843.36681.data test DEBUG: Run listdir on /tmp/tmptpia8l8e/node/sda1/objects/264 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:03 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmptpia8l8e/node/sda1 (cleanup=True) test DEBUG: Removed /tmp/tmptpia8l8e/node/sda1/objects/132/1d8/841258ba93a605601ba29d048034a1d8/1757769843.36681.data test DEBUG: Run listdir on /tmp/tmptpia8l8e/node/sda1/objects/132 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:04 09/13/25 GMT (0:00:01.018338 elapsed) test INFO: Processing files for policy platinum under /tmp/tmp7vsefepd/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp7vsefepd/node/sda1/objects/17/f15/110647de50a7c1ff3c32a70abe746f15/1757769844.45034.data to /tmp/tmp7vsefepd/node/sda1/objects/34/f15/110647de50a7c1ff3c32a70abe746f15/1757769844.45034.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:04 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp7vsefepd/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmp7vsefepd/node/sda1/objects/34 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmp7vsefepd/node/sda1/objects/17/f15/110647de50a7c1ff3c32a70abe746f15/1757769844.45034.data test DEBUG: Run listdir on /tmp/tmp7vsefepd/node/sda1/objects/17 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:04 09/13/25 GMT (0:00:00.014501 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:04 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpt7kndoei/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpt7kndoei/node/sda1/objects/356 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking (cleanup) created link: /tmp/tmpt7kndoei/node/sda1/objects/178/eee/b23834e0f3f6c3cb21f8d55b481c8eee/1757769844.57891.data to /tmp/tmpt7kndoei/node/sda1/objects/356/eee/b23834e0f3f6c3cb21f8d55b481c8eee/1757769844.57891.data test DEBUG: Removed /tmp/tmpt7kndoei/node/sda1/objects/178/eee/b23834e0f3f6c3cb21f8d55b481c8eee/1757769844.57891.data test DEBUG: Run listdir on /tmp/tmpt7kndoei/node/sda1/objects/178 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 1 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:04 09/13/25 GMT (0:00:00.030620 elapsed) test INFO: Processing files for policy platinum under /tmp/tmp5fh3v87u/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp5fh3v87u/node/sda1/objects/1/4bb/01b2d585111371079e8ac92c6a79c4bb/1757769844.69504.ts to /tmp/tmp5fh3v87u/node/sda1/objects/3/4bb/01b2d585111371079e8ac92c6a79c4bb/1757769844.69504.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors)test.unit.cli.test_relinker.TestRelinker.test_cleanup_reapable test.unit.cli.test_relinker.TestRelinker.test_cleanup_reapable ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_relinked_ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_relinked_ok ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_remove_fails test.unit.cli.test_relinker.TestRelinker.test_cleanup_remove_fails ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_same_object_different_inode_in_new_partition test.unit.cli.test_relinker.TestRelinker.test_cleanup_same_object_different_inode_in_new_partition ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'Content-Md5': 'ud0C7/g6K1j77RpgTDYdwQ==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'b9dd02eff83a2b58fbed1a604c361dc1', 'Content-Length': '120'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_without_md5 test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_without_md5 ... ok test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_without_permission test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_without_permission ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_existing_part_number_greater_than_max_parts_allowed test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_existing_part_number_greater_than_max_parts_allowed ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_huge_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_huge_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_invalid_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_invalid_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_out_of_range_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_out_of_range_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_zero_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_GET_zero_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_huge_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_huge_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_invalid_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_invalid_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_out_of_range_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_out_of_range_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_zero_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEAD.test_mpu_HEAD_zero_part_num ... ok test.unit.common.middleware.s3api.test_object_lock.TestS3ApiObjectLock.test_get_object_lock test.unit.common.middleware.s3api.test_object_lock.TestS3ApiObjectLock.test_get_object_lock ... ok test.unit.common.middleware.s3api.test_object_lock.TestS3ApiObjectLock.test_put_object_lock test.unit.common.middleware.s3api.test_object_lock.TestS3ApiObjectLock.test_put_object_lock ... ok test.unit.common.middleware.s3api.test_s3request.TestSigV4Request.test_controller_allow_multipart_uploads test.unit.common.middleware.s3api.test_s3request.TestSigV4Request.test_controller_allow_multipart_uploads ... ok test.unit.common.middleware.s3api.test_s3request.TestSigV4Request.test_controller_for_multipart_upload_requests test.unit.common.middleware.s3api.test_s3request.TestSigV4Request.test_controller_for_multipart_upload_requests ... ok test.unit.common.middleware.s3api.test_s3request.TestSigV4Request.test_init_header_authorization test.unit.common.middleware.s3api.test_s3request.TestSigV4Request.test_init_header_authorization ... ok test.unit.common.middleware.s3api.test_s3request.TestSigV4Request.test_init_query_authorization test.unit.common.middleware.s3api.test_s3request.TestSigV4Request.test_init_query_authorization ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_tenant_dict test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_tenant_dict ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_tenant_id test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_tenant_id ... ok test INFO: - - 13/Sep/2025/13/23/59 POST /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0002 FA - 1757769839.253927946 1757769839.254114389 0 - test INFO: - - 13/Sep/2025/13/23/59 POST /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0007 - - 1757769839.253889799 1757769839.254606009 0 - test INFO: - - 13/Sep/2025/13/23/59 PUT /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0002 FA - 1757769839.256107092 1757769839.256310225 0 - test INFO: - - 13/Sep/2025/13/23/59 POST /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0007 - - 1757769839.256067991 1757769839.256784439 0 - test INFO: - - 13/Sep/2025/13/23/59 DELETE /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0002 FA - 1757769839.265298128 1757769839.265480518 0 - test INFO: - - 13/Sep/2025/13/23/59 POST /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0007 - - 1757769839.265258074 1757769839.265963316 0 - test INFO: - - 13/Sep/2025/13/23/59 HEAD /v1/a/c/sub_get HTTP/1.0 200 - FakeApp - - - - - - 0.0002 FA - 1757769839.275938988 1757769839.276132584 0 - test INFO: - - 13/Sep/2025/13/23/59 GET /v1/a/test/obj HTTP/1.0 200 - Swift - - - - - - 0.0002 SSC - 1757769839.276507616 1757769839.276749372 0 - test INFO: - - 13/Sep/2025/13/23/59 HEAD /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0001 FA - 1757769839.277146816 1757769839.277270794 0 - test INFO: - - 13/Sep/2025/13/23/59 PUT /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0110 - - 1757769839.275799990 1757769839.286832571 - - test INFO: - - 13/Sep/2025/13/23/59 GET /v1/a/c/sub_get HTTP/1.0 200 - FakeApp - - - - - - 0.0003 FA - 1757769839.288702250 1757769839.288986206 0 - test INFO: - - 13/Sep/2025/13/23/59 GET /v1/a/test/obj HTTP/1.0 200 - Swift - - - - - - 0.0002 SSC - 1757769839.289315939 1757769839.289502621 0 - test INFO: - - 13/Sep/2025/13/23/59 GET /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0002 FA - 1757769839.289864302 1757769839.290029764 0 - test INFO: - - 13/Sep/2025/13/23/59 PUT /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0019 - - 1757769839.288583755 1757769839.290446520 - - test INFO: - - 13/Sep/2025/13/23/59 POST /v1/a/c/sub_get HTTP/1.0 200 - FakeApp - - - - - - 0.0002 FA - 1757769839.296344519 1757769839.296530008 0 - test INFO: - - 13/Sep/2025/13/23/59 GET /v1/a/test/obj HTTP/1.0 200 - Swift - - - - - - 0.0002 SSC - 1757769839.296912432 1757769839.297109604 0 - test INFO: - - 13/Sep/2025/13/23/59 POST /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0001 FA - 1757769839.297496557 1757769839.297619104 0 - test INFO: - - 13/Sep/2025/13/23/59 PUT /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0018 - - 1757769839.296224594 1757769839.298048973 - - test INFO: - - 13/Sep/2025/13/23/59 PUT /v1/a/c/sub_get HTTP/1.0 200 - FakeApp - - - - - - 0.0002 FA - 1757769839.307464600 1757769839.307686567 0 - test INFO: - - 13/Sep/2025/13/23/59 GET /v1/a/test/obj HTTP/1.0 200 - Swift - - - - - - 0.0002 SSC - 1757769839.308058023 1757769839.308247089 0 - test INFO: - - 13/Sep/2025/13/23/59 PUT /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0002 FA - 1757769839.308621407 1757769839.308797836 0 - test INFO: - - 13/Sep/2025/13/23/59 PUT /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0019 - - 1757769839.307341099 1757769839.309249163 - - test INFO: - - 13/Sep/2025/13/23/59 DELETE /v1/a/c/sub_get HTTP/1.0 200 - FakeApp - - - - - - 0.0007 FA - 1757769839.331457138 1757769839.332174063 0 - test INFO: - - 13/Sep/2025/13/23/59 GET /v1/a/test/obj HTTP/1.0 200 - Swift - - - - - - 0.0002 SSC - 1757769839.332618713 1757769839.332855463 0 - test INFO: - - 13/Sep/2025/13/23/59 DELETE /v1/a/c/sub_put HTTP/1.0 200 - FakeApp - - - - - - 0.0001 FA - 1757769839.333256721 1757769839.333378315 0 - test INFO: - - 13/Sep/2025/13/23/59 PUT /v1/a/c/o HTTP/1.0 200 - - - - - - - - 0.0029 - - 1757769839.330906153 1757769839.333813429 - - fake INFO: - - 13/Sep/2025/13/23/59 GET /v1/a/c/o%3Ftemp_url_sig%3Ddeadbeefdeadbeef...%26temp_url_expires%3D1757770839 HTTP/1.0 404 - - - - - - - - 0.0002 - - 1757769839.612764835 1757769839.612915993 - - test-ic DEBUG: -> 2014-05-27T20:54:11 GET http://127.0.0.1%3Fformat%3Djson 200 123 345 1401224050.98 1401224051.98 1.0 - test-ic DEBUG: -> 2014-05-27T20:54:11 HEAD http://127.0.0.1%3Fformat%3Djson 200 123 345 1401224050.98 1401224051.98 1.0 - test WARNING: Skipping /tmp/tmppd60kmub/devices3/device_is_file/data because [Errno 20] Not a directory: '/tmp/tmppd60kmub/devices3/device_is_file/data' test WARNING: Skipping /tmp/tmppd60kmub/devices4/device/data because test WARNING: Skipping device as it is not mounted test WARNING: Skipping /tmp/tmpsj31kk_v/asdf/data because [Errno 20] Not a directory: '/tmp/tmpsj31kk_v/asdf/data' test WARNING: Skipping /tmp/tmpsj31kk_v/asdf/data because [Errno 20] Not a directory: '/tmp/tmpsj31kk_v/asdf/data' test WARNING: Skipping drive as it is not mounted test WARNING: Skipping asdf as it is not mounted test WARNING: Skipping /tmp/tmpeis3b9ay/asdf/data because [Errno 20] Not a directory: '/tmp/tmpeis3b9ay/asdf/data' test INFO: Using crc32c_anycrc implementation for CRC32C. test WARNING: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test INFO: Using crc32c_isal implementation for CRC32C. test WARNING: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test INFO: Using crc32c_kern implementation for CRC32C. test WARNING: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test INFO: Using crc32c_kern implementation for CRC32C. test INFO: Using crc64nvme_anycrc implementation for CRC64NVME. test INFO: Using crc32c_kern implementation for CRC32C. test INFO: Using crc64nvme_isal implementation for CRC64NVME. test DEBUG: 0 audit watcher(s) loaded test WARNING: Quarantined object /tmp/tmph1nagpe5/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/made-up-filename: Expected directory, found file at /tmp/tmph1nagpe5/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099 test ERROR: ERROR Object /tmp/tmph1nagpe5/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099 failed audit and was quarantined: Expected directory, found file at /tmp/tmph1nagpe5/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099 test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:04 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1125.99, bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 512.94, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.20 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 0, "10240": 0, "OVER": 0}test.unit.obj.test_auditor.TestAuditor.test_expired_object_is_ignored test.unit.obj.test_auditor.TestAuditor.test_expired_object_is_ignored ... ok test.unit.obj.test_auditor.TestAuditor.test_expired_object_is_ignored_with_zero_byte_fps test.unit.obj.test_auditor.TestAuditor.test_expired_object_is_ignored_with_zero_byte_fps ... ok test.unit.obj.test_auditor.TestAuditor.test_failsafe_object_audit_will_swallow_errors_in_tests test.unit.obj.test_auditor.TestAuditor.test_failsafe_object_audit_will_swallow_errors_in_tests ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_with_version_id_but_not_enabled test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_with_version_id_but_not_enabled ... ok swift: Using crc32c_kern implementation for CRC32C. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_with_write_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_with_write_permission ... ok swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_abort_multipart_upload_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_abort_multipart_upload_acl_with_write_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_abort_multipart_upload_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_abort_multipart_upload_acl_without_permission ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'Content-Md5': 'ud0C7/g6K1j77RpgTDYdwQ==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'b9dd02eff83a2b58fbed1a604c361dc1', 'Content-Length': '120'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID"}}}' test DEBUG: Error on keystone reply: 201 b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID"}}}' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"name": "TENANT_NAME"}}}}' test DEBUG: Error on keystone reply: 201 b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"name": "TENANT_NAME"}}}}' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID"}}}}'test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_tenant_name test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_tenant_name ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_token_dict test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_token_dict ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_user_dict test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_user_dict ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_user_id test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_user_id ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_user_name test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_user_name ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_user_roles test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_missing_user_roles ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_not_json test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_not_json ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_valid_but_bad_json test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_bad_reply_valid_but_bad_json ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_fail_to_connect_to_keystone test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_fail_to_connect_to_keystone ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_no_s3_creds_defers_to_auth_middleware test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_no_s3_creds_defers_to_auth_middleware ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_unauthorized_token test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestBad.test_unauthorized_token ... ok test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_camel_to_snake test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_camel_to_snake ... ok test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_mktime test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_mktime ... ok test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_mktime_weird_tz test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_mktime_weird_tz ... ok test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_snake_to_camel test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_snake_to_camel ... ok test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_validate_bucket_name test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_validate_bucket_name ... ok test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_validate_bucket_name_with_dns_compliant_bucket_names_false test.unit.common.middleware.s3api.test_utils.TestS3ApiUtils.test_validate_bucket_name_with_dns_compliant_bucket_names_false ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_bad_application_quota test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_bad_application_quota ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_bogus_count_quota_is_ignored test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_bogus_count_quota_is_ignored ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_bogus_quota_is_ignored test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_bogus_quota_is_ignored ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_container_request_ignores_attempt_to_set_count_quotas test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_container_request_ignores_attempt_to_set_count_quotas ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_container_request_ignores_attempt_to_set_quotas test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_container_request_ignores_attempt_to_set_quotas ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_count_quotas test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_count_quotas ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_count_quotas_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_count_quotas_reseller ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_count_quotas_with_remove_header test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_count_quotas_with_remove_header ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_count_quotas_with_remove_header_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_count_quotas_with_remove_header_reseller ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_quotas test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_quotas ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_quotas_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_quotas_reseller ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_quotas_with_remove_header test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_quotas_with_remove_header ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_quotas_with_remove_header_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_delete_quotas_with_remove_header_reseller ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota_legacy test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota_legacy ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota_reseller ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota_reseller_copy_from test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota_reseller_copy_from ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota_reseller_copy_verb test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_bytes_quota_reseller_copy_verb ... ok test INFO: Starting relinker (cleanup=True) using 1 workers: 17:46:39 11/20/86 GMT test INFO: Processing files for policy platinum under /tmp/tmp5fh3v87u/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmp5fh3v87u/node/sda1/objects/3 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Run listdir on /tmp/tmp5fh3v87u/node/sda1/objects/1 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:04 09/13/25 GMT (0:00:00 elapsed) test INFO: Processing files for policy platinum under /tmp/tmp7g_0h6gd/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp7g_0h6gd/node/sda1/objects/117/6cf/75d135eeb062f66b12f1585e8b4b16cf/1757769844.81311.data to /tmp/tmp7g_0h6gd/node/sda1/objects/235/6cf/75d135eeb062f66b12f1585e8b4b16cf/1757769844.81311.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:04 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp7g_0h6gd/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmp7g_0h6gd/node/sda1/objects/235 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmp7g_0h6gd/node/sda1/objects/117/6cf/75d135eeb062f66b12f1585e8b4b16cf/1757769844.81311.data test DEBUG: Run listdir on /tmp/tmp7g_0h6gd/node/sda1/objects/117 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:04 09/13/25 GMT (0:00:00.029420 elapsed) test INFO: Processing files for policy platinum under /tmp/tmpedbahkh2/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpedbahkh2/node/sda1/objects/183/22b/b7881f111d52750dd0f5d90546fd722b/1757769845.00000.meta to /tmp/tmpedbahkh2/node/sda1/objects/367/22b/b7881f111d52750dd0f5d90546fd722b/1757769845.00000.meta test DEBUG: Relinking created link: /tmp/tmpedbahkh2/node/sda1/objects/183/22b/b7881f111d52750dd0f5d90546fd722b/1757769844.96354.data to /tmp/tmpedbahkh2/node/sda1/objects/367/22b/b7881f111d52750dd0f5d90546fd722b/1757769844.96354.data test DEBUG: Run listdir on /tmp/tmpedbahkh2/node/sda1/objects/367 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (2 files, 2 linked, 0 removed, 0 errors) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:04 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpedbahkh2/node/sda1 (cleanup=True) test WARNING: Error cleaning up /tmp/tmpedbahkh2/node/sda1/objects/183/22b/b7881f111d52750dd0f5d90546fd722b/1757769845.00000.meta: OSError() test DEBUG: Removed /tmp/tmpedbahkh2/node/sda1/objects/183/22b/b7881f111d52750dd0f5d90546fd722b/1757769844.96354.data test DEBUG: Run listdir on /tmp/tmpedbahkh2/node/sda1/objects/183 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 0/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (2 files, 0 linked, 1 removed, 1 errors) test INFO: Finished relinker (cleanup=True): 13:24:05 09/13/25 GMT (0:00:00.035171 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:05 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpr29yxyym/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpr29yxyym/node/sda1/objects/451 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test WARNING: Error relinking (cleanup): failed to relink /tmp/tmpr29yxyym/node/sda1/objects/225/dcd/e1a5d48cab2eb5f58242427889a95dcd/1757769845.08062.data to /tmp/tmpr29yxyym/node/sda1/objects/451/dcd/e1a5d48cab2eb5f58242427889a95dcd/1757769845.08062.data: [Errno 17] File exists: '/tmp/tmpr29yxyym/node/sda1/objects/225/dcd/e1a5d48cab2eb5f58242427889a95dcd/1757769845.08062.data' -> '/tmp/tmpr29yxyym/node/sda1/objects/451/dcd/e1a5d48cab2eb5f58242427889a95dcd/1757769845.08062.data' test DEBUG: Run listdir on /tmp/tmpr29yxyym/node/sda1/objects/225 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=True): 13:24:05 09/13/25 GMT (0:00:00.017053 elapsed) test INFO: Processing files for policy platinum under /tmp/tmp5uimf7zq/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp5uimf7zq/node/sda1/objects/198/11e/c694d5a9f0b92300c47f5edc8964911e/1757769845.17284.data to /tmp/tmp5uimf7zq/node/sda1/objects/397/11e/c694d5a9f0b92300c47f5edc8964911e/1757769845.17284.data test DEBUG: Run listdir on /tmp/tmp5uimf7zq/node/sda1/objects/397 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_cleanup_second_quartile_no_rehash test.unit.cli.test_relinker.TestRelinker.test_cleanup_second_quartile_no_rehash ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_ts_existing_newer_data_files test.unit.cli.test_relinker.TestRelinker.test_cleanup_ts_existing_newer_data_files ... ok test.unit.cli.test_relinker.TestRelinker.test_cleanup_two_files_need_linking test.unit.cli.test_relinker.TestRelinker.test_cleanup_two_files_need_linking ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota_reseller ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_no_multipart test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_no_multipart ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_with_fullcontrol_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_with_fullcontrol_permission ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota_reseller_copy_from test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota_reseller_copy_from ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_with_owner_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_with_owner_permission ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota_reseller_copy_verb test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_count_quota_reseller_copy_verb ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_multiple_quota_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_multiple_quota_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_per_policy_quota test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_per_policy_quota ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_authorized_legacy test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_authorized_legacy ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_bytes_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_bytes_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_bytes_on_empty_account_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_bytes_on_empty_account_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_count_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_count_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_count_not_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_count_not_authorized ... ok test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0116 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 400 9 "-" "-" "-" 0.0092 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 507 - "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:04 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0143 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0135 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0092 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0013 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0263 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 400 36 "-" "-" "-" 0.0011 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 400 35 "-" "-" "-" 0.0090 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0117 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0136 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0094 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 192 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 192 "-" "-" "-" 0.0101 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 202 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 202 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 63 "-" "-" "-" 0.0013 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 63 "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 323 "-" "-" "-" 0.0013 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0112 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0021 "-" 1824541 2 test DEBUG: Unlinked retiring db '/tmp/tmp91kwqech/tmp_test_container_server_ContainerController/sda1/containers/p/61c/b6a56f59d3a8b4d57e122a32d715b61c/b6a56f59d3a8b4d57e122a32d715b61c.db' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 285 "-" "-" "-" 0.0018 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 1672 "-" "-" "-" 0.0097 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0156 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0106 "-" 1824541 2 test DEBUG: Unlinked retiring db '/tmp/tmp1g8j7_xr/tmp_test_container_server_ContainerController/sda1/containers/p/61c/b6a56f59d3a8b4d57e122a32d715b61c/b6a56f59d3a8b4d57e122a32d715b61c.db' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 285 "-" "-" "-" 0.0098 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 1672 "-" "-" "-" 0.0018 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0120 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 277 "-" "-" "-" 0.0139 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0018 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0018 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0144 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 277 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0018 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0099 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0156 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0097 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 285 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0018 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0119 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0099 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 285 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0153 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/jsonc" 201 - "-" "-" "-" 0.0191 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/jsonc/Sp%C3%A4tzle" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/jsonc/%E3%83%A9%E3%83%BC%E3%83%A1%E3%83%B3" 201 - "-" "-" "-" 0.0003 "-" 1824541 2test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_non_ascii test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_non_ascii ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_objects_of_different_policies test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_objects_of_different_policies ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_over_limit test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_over_limit ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_path test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_path ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_count_on_empty_account_not_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_count_on_empty_account_not_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_not_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_exceed_quota_not_authorized ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_plain test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_plain ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_prefix test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_prefix ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_invalid_count_quotas_on_object test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_invalid_count_quotas_on_object ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_invalid_policy_quota test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_invalid_policy_quota ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_invalid_quotas test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_invalid_quotas ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_invalid_request_exception test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_invalid_request_exception ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_no_info_quota test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_no_info_quota ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_no_quotas test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_no_quotas ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_not_exceed_bytes_quota test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_not_exceed_bytes_quota ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_not_exceed_count_quota test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_not_exceed_count_quota ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_obj_request_ignores_attempt_to_set_count_quotas test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_obj_request_ignores_attempt_to_set_count_quotas ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_obj_request_ignores_attempt_to_set_quotas test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_obj_request_ignores_attempt_to_set_quotas ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_count_quota_obj_post_still_works test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_count_quota_obj_post_still_works ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_container_create_still_works test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_container_create_still_works ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_container_post_still_works test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_container_post_still_works ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_count_container_create_still_works test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_count_container_create_still_works ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_count_container_post_still_works test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_count_container_post_still_works ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_obj_post_still_works test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_over_quota_obj_post_still_works ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_policy_quota_translation test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_policy_quota_translation ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_policy_quota_translation_legacy_loses test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_policy_quota_translation_legacy_loses ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_unauthorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_unauthorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_authorized_legacy test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_authorized_legacy ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_count_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_count_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_count_not_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_count_not_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_not_authorized test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_under_quota_not_authorized ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_count_quota_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_count_quota_reseller ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_count_quotas_admin test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_count_quotas_admin ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_policy_count_quota_admin test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_policy_count_quota_admin ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_list_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_list_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_policy_count_quota_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_policy_count_quota_reseller ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_policy_quota_admin test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_policy_quota_admin ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_policy_quota_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_policy_quota_reseller ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_quotas_non_admin_fails test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_quotas_non_admin_fails ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_quotas_reseller test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_quotas_reseller ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_quotas_reseller_legacy test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_quotas_reseller_legacy ... ok test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_quotas_reseller_legacy_loses test.unit.common.middleware.test_account_quotas.TestAccountQuota.test_valid_quotas_reseller_legacy_loses ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_500_resp test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_500_resp ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_bad_content_type test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_bad_content_type ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_encoding_type_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_encoding_type_error ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_bad_file_over_twice_max_length test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_bad_file_over_twice_max_length ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_bad_file_too_long test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_bad_file_too_long ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_bad_path test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_bad_path ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_call_and_content_type test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_call_and_content_type ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_container_delete test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_container_delete ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_container_delete_retry_and_fails test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_container_delete_retry_and_fails ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_container_delete_retry_and_success test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_container_delete_retry_and_success ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_get_objs test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_get_objs ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_max_failures test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_max_failures ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_no_body test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_no_body ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_no_files_in_body test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_no_files_in_body ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_too_many_newlines test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_too_many_newlines ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_unauth test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_unauth ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_uses_predefined_object_errors test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_uses_predefined_object_errors ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_works_extra_newlines_extra_quoting test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_works_extra_newlines_extra_quoting ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_works_unicode test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_works_unicode ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_works_with_DELETE_verb test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_works_with_DELETE_verb ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_works_with_POST_verb test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_bulk_delete_works_with_POST_verb ... ok test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_concurrency_set test.unit.common.middleware.test_bulk.TestConcurrentDelete.test_concurrency_set ... ok test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_allow_reserved_names test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_allow_reserved_names ... ok test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_duplicate_headers_not_removed test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_duplicate_headers_not_removed ... ok test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_location_header_fixed test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_location_header_fixed ... ok test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_ok_header test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_ok_header ... ok test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_reserved_header_removed_inbound test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_reserved_header_removed_inbound ... ok test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_reserved_header_removed_outbound test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_reserved_header_removed_outbound ... ok test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_reserved_header_shunt_bypassed_inbound test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_reserved_header_shunt_bypassed_inbound ... ok test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_reserved_header_shunted_inbound test.unit.common.middleware.test_gatekeeper.TestGatekeeper.test_reserved_header_shunted_inbound ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_GET_and_HEAD_registered test.unit.common.middleware.test_helpers.TestFakeSwift.test_GET_and_HEAD_registered ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_GET_registered test.unit.common.middleware.test_helpers.TestFakeSwift.test_GET_registered ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_GET_registered_overrides_uploaded test.unit.common.middleware.test_helpers.TestFakeSwift.test_GET_registered_overrides_uploaded ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_GET_registered_with_query_string test.unit.common.middleware.test_helpers.TestFakeSwift.test_GET_registered_with_query_string ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_POST test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_POST ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_error_reading_body test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_error_reading_body ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_uploaded test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_uploaded ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_uploaded_with_query_string test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_uploaded_with_query_string ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_with_footers_callback test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_with_footers_callback ... ok Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/greenpool.py", line 87, in _spawn_n_impl func(*args, **kwargs) ~~~~^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/x_profile/profile_model.py", line 273, in dump_profile profiler.dump_stats(tmpfn) ~~~~~~~~~~~~~~~~~~~^^^^^^^ File "/usr/lib/python3.13/profile.py", line 395, in dump_stats with open(file, 'wb') as f: ~~~~^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpvask6x47/log/swift/profile/default.profile1824522.tmp' Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/greenpool.py", line 87, in _spawn_n_impl func(*args, **kwargs) ~~~~^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/x_profile/profile_model.py", line 273, in dump_profile profiler.dump_stats(tmpfn) ~~~~~~~~~~~~~~~~~~~^^^^^^^ File "/usr/lib/python3.13/profile.py", line 395, in dump_stats with open(file, 'wb') as f: ~~~~^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmp9alumy7z/log/swift/profile/default.profile1824522.tmp' Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/greenpool.py", line 87, in _spawn_n_impl func(*args, **kwargs) ~~~~^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/x_profile/profile_model.py", line 273, in dump_profile profiler.dump_stats(tmpfn) ~~~~~~~~~~~~~~~~~~~^^^^^^^ File "/usr/lib/python3.13/profile.py", line 395, in dump_stats with open(file, 'wb') as f: ~~~~^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpl26gtgzl/log/swift/profile/default.profile1824522.tmp' test DEBUG: Run listdir on /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects/0 test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:04 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1294.94, bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplm0g8l_i/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 561.26, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.19 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ZBF) test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test INFO: Object audit (ZBF). Since Sun Sep 14 03:24:04 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1251.66, bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test INFO: Object audit (ZBF) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 565.42, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.17 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: Run listdir on /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects/0 test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ZBF) test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test INFO: Object audit (ZBF). Since Sun Sep 14 03:24:04 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1498.50, bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp7x6xeu4w/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test INFO: Object audit (ZBF) "once" mode completed: 0.01s. Total quarantined: 0, Total errors: 0, Total files/sec: 105.90, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.03 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test ERROR: ERROR Trying to audit /tmp/tmpbtm58ixi/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/auditor.py", line 238, in failsafe_object_audit self.object_audit(location) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/auditor.py", line 258, in object_audit df = diskfile_mgr.get_diskfile_from_audit_location(location) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1542, in get_diskfile_from_audit_location return self.diskfile_cls.from_hash_dir( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'function' object has no attribute 'from_hash_dir' test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test ERROR: ERROR Trying to audit /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/auditor.py", line 238, in failsafe_object_audit self.object_audit(location) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/auditor.py", line 258, in object_audit df = diskfile_mgr.get_diskfile_from_audit_location(location) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1542, in get_diskfile_from_audit_location return self.diskfile_cls.from_hash_dir( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'function' object has no attribute 'from_hash_dir' test DEBUG: Skipping the update of recently changed /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.jsontest.unit.obj.test_auditor.TestAuditor.test_generic_exception_handling test.unit.obj.test_auditor.TestAuditor.test_generic_exception_handling ... ok test.unit.obj.test_auditor.TestAuditor.test_inprogress_rsync_tempfiles_get_cleaned_up test.unit.obj.test_auditor.TestAuditor.test_inprogress_rsync_tempfiles_get_cleaned_up ... ok test.unit.obj.test_auditor.TestAuditor.test_non_reclaimable_tombstone test.unit.obj.test_auditor.TestAuditor.test_non_reclaimable_tombstone ... ok test.unit.obj.test_auditor.TestAuditor.test_non_reclaimable_tombstone_with_custom_reclaim_age test.unit.obj.test_auditor.TestAuditor.test_non_reclaimable_tombstone_with_custom_reclaim_age ... ok test.unit.obj.test_auditor.TestAuditor.test_object_audit_adds_metadata_checksums test.unit.obj.test_auditor.TestAuditor.test_object_audit_adds_metadata_checksums ... ok test.unit.obj.test_auditor.TestAuditor.test_object_audit_checks_EC_fragments test.unit.obj.test_auditor.TestAuditor.test_object_audit_checks_EC_fragments ... ok test.unit.obj.test_auditor.TestAuditor.test_object_audit_diff_data test.unit.obj.test_auditor.TestAuditor.test_object_audit_diff_data ... ok test.unit.obj.test_auditor.TestAuditor.test_object_audit_extra_data test.unit.obj.test_auditor.TestAuditor.test_object_audit_extra_data ... ok test.unit.obj.test_auditor.TestAuditor.test_object_audit_no_meta test.unit.obj.test_auditor.TestAuditor.test_object_audit_no_meta ... ok test.unit.obj.test_auditor.TestAuditor.test_object_audit_will_not_swallow_errors_in_tests test.unit.obj.test_auditor.TestAuditor.test_object_audit_will_not_swallow_errors_in_tests ... ok test.unit.obj.test_auditor.TestAuditor.test_object_run_fast_track_all test.unit.obj.test_auditor.TestAuditor.test_object_run_fast_track_all ... ok test.unit.obj.test_auditor.TestAuditor.test_object_run_fast_track_non_zero test.unit.obj.test_auditor.TestAuditor.test_object_run_fast_track_non_zero ... ok test.unit.obj.test_auditor.TestAuditor.test_object_run_fast_track_zero test.unit.obj.test_auditor.TestAuditor.test_object_run_fast_track_zero ... ok test.unit.obj.test_auditor.TestAuditor.test_object_run_fast_track_zero_check_closed test.unit.obj.test_auditor.TestAuditor.test_object_run_fast_track_zero_check_closed ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_with_query_string_POST test.unit.common.middleware.test_helpers.TestFakeSwift.test_PUT_with_query_string_POST ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_allowed_methods test.unit.common.middleware.test_helpers.TestFakeSwift.test_allowed_methods ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_call_accessors test.unit.common.middleware.test_helpers.TestFakeSwift.test_call_accessors ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_capture_unexpected_calls test.unit.common.middleware.test_helpers.TestFakeSwift.test_capture_unexpected_calls ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_not_registered test.unit.common.middleware.test_helpers.TestFakeSwift.test_not_registered ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_object_GET_updated_with_storage_policy test.unit.common.middleware.test_helpers.TestFakeSwift.test_object_GET_updated_with_storage_policy ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_range test.unit.common.middleware.test_helpers.TestFakeSwift.test_range ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_range_ignore_range_header test.unit.common.middleware.test_helpers.TestFakeSwift.test_range_ignore_range_header ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_range_ignore_range_header_ignored test.unit.common.middleware.test_helpers.TestFakeSwift.test_range_ignore_range_header_ignored ... ok test.unit.common.middleware.test_helpers.TestFakeSwift.test_range_ignore_range_header_old_swift test.unit.common.middleware.test_helpers.TestFakeSwift.test_range_ignore_range_header_old_swift ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_for_invalid_referrer test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_for_invalid_referrer ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_for_invalid_reseller_prefix test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_for_invalid_reseller_prefix ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_for_referrer_without_rlistings test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_for_referrer_without_rlistings ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_for_unauthorized_user test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_for_unauthorized_user ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_same_user_and_tenant test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_fails_same_user_and_tenant ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_as_owner_for_insensitive_operator_role test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_as_owner_for_insensitive_operator_role ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_as_owner_for_operator_role test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_as_owner_for_operator_role ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_container_sync test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_container_sync ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_insensitive_reseller_admin test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_insensitive_reseller_admin ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_project_id_user_in_roles test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_project_id_user_in_roles ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_project_name_user_in_roles test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_project_name_user_in_roles ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_referrer_with_obj test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_referrer_with_obj ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_referrer_with_rlistings test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_referrer_with_rlistings ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_reseller_admin test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_reseller_admin ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_tenant_id_user_in_roles test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_tenant_id_user_in_roles ... ok test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/jsonc" 200 268 "-" "-" "-" 0.0216 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/p/a/jsonc" 200 22 "-" "-" "-" 0.0140 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/obj_default_0" 201 - "-" "-" "-" 0.0006 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/obj_default_1" 201 - "-" "-" "-" 0.0061 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/obj_default_2" 201 - "-" "-" "-" 0.0005 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/obj_default_3" 201 - "-" "-" "-" 0.0003 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/obj_default_4" 201 - "-" "-" "-" 0.0003 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/obj_default_5" 201 - "-" "-" "-" 0.0003 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/obj_default_6" 201 - "-" "-" "-" 0.0003 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/obj_default_7" 201 - "-" "-" "-" 0.0003 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/p/a/c/obj_default_8" 201 - "-" "-" "-" 0.0004 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_default_9" 201 - "-" "-" "-" 0.0019 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_default_10" 201 - "-" "-" "-" 0.0004 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_0" 201 - "-" "-" "-" 0.0003 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_1" 201 - "-" "-" "-" 0.0003 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_2" 201 - "-" "-" "-" 0.0003 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_3" 201 - "-" "-" "-" 0.0003 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_4" 201 - "-" "-" "-" 0.0003 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_5" 201 - "-" "-" "-" 0.0002 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_6" 201 - "-" "-" "-" 0.0002 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_7" 201 - "-" "-" "-" 0.0005 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_8" 201 - "-" "-" "-" 0.0003 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/obj_1_9" 201 - "-" "-" "-" 0.0003 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 155 "-" "-" "-" 0.0132 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 155 "-" "-" "-" 0.0020 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 80 "-" "-" "-" 0.0221 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0019 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 400 40 "-" "-" "-" 0.0010 "-" 1824541 3 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 412 22 "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/US/TX" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/US/TX/B" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/US/OK" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/US/OK/B" 201 - "-" "-" "-" 0.0082 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/US/UT/A" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 242 "-" "-" "-" 0.0152 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/plainc" 201 - "-" "-" "-" 0.0133 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 204 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/plainc/0" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/plainc/1" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/plainc/2" 201 - "-" "-" "-" 0.0126 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0195 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/p/a/plainc" 204 - "-" "-" "-" 0.0038 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0020 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0059 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0020 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0079 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0060 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0067 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0131 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0138 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0078 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0066 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0020 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0116 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/a1" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/b1" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/a2" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/b2" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/a3" 201 - "-" "-" "-" 0.0002 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c/b3" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 9 "-" "-" "-" 0.0100 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0103 "-" 1824541 2test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_auditing test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_auditing ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_errors test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_errors ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_from_compacted_shard test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_from_compacted_shard ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_include_deleted test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_include_deleted ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_using_state_aliases test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_using_state_aliases ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_with_format_header test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_shard_ranges_with_format_header ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_override_deleted_for_namespaces test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_override_deleted_for_namespaces ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_without_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_DELETE_without_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET ... ok test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:05 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpmpmd7ass/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmpmpmd7ass/node/sda1/objects/351 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmpmpmd7ass/node/sda1/objects/175/4c1/afd6d8c514d138cf18759095b54ce4c1/1757769845.31203.ts test DEBUG: Run listdir on /tmp/tmpmpmd7ass/node/sda1/objects/175 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (0 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:05 09/13/25 GMT (0:00:00.029858 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:05 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp_7xjo5_1/node/sda1 (cleanup=True) test DEBUG: Relinking (cleanup) created link: /tmp/tmp_7xjo5_1/node/sda1/objects/113/278/71c724422f6d1381de5307f782a02278/1757769845.43102.data to /tmp/tmp_7xjo5_1/node/sda1/objects/227/278/71c724422f6d1381de5307f782a02278/1757769845.43102.data test DEBUG: Relinking (cleanup) created link: /tmp/tmp_7xjo5_1/node/sda1/objects/113/278/71c724422f6d1381de5307f782a02278/1757769846.00000.meta to /tmp/tmp_7xjo5_1/node/sda1/objects/227/278/71c724422f6d1381de5307f782a02278/1757769846.00000.meta test DEBUG: Removed /tmp/tmp_7xjo5_1/node/sda1/objects/113/278/71c724422f6d1381de5307f782a02278/1757769846.00000.meta test DEBUG: Removed /tmp/tmp_7xjo5_1/node/sda1/objects/113/278/71c724422f6d1381de5307f782a02278/1757769845.43102.data test DEBUG: Run listdir on /tmp/tmp_7xjo5_1/node/sda1/objects/227 test DEBUG: Run listdir on /tmp/tmp_7xjo5_1/node/sda1/objects/113 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (2 files, 2 linked, 2 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:05 09/13/25 GMT (0:00:00.043378 elapsed) test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift-foo/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift-foo/relinker.recon' test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:05 09/13/25 GMT test INFO: Finished relinker (cleanup=False): 13:24:05 09/13/25 GMT (0:00:00.000472 elapsed) Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_conf_file test.unit.cli.test_relinker.TestRelinker.test_conf_file ... ok test.unit.cli.test_relinker.TestRelinker.test_devices_filter_filtering test.unit.cli.test_relinker.TestRelinker.test_devices_filter_filtering ... ok test.unit.cli.test_relinker.TestRelinker.test_hook_pre_post_device_locking test.unit.cli.test_relinker.TestRelinker.test_hook_pre_post_device_locking ... ok test.unit.cli.test_relinker.TestRelinker.test_rehashing test.unit.cli.test_relinker.TestRelinker.test_rehashing ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_all_policies test.unit.cli.test_relinker.TestRelinker.test_relink_all_policies ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_cleanup test.unit.cli.test_relinker.TestRelinker.test_relink_cleanup ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_both_in_older_part_powers test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_both_in_older_part_powers ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_file test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_file ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_is_linked_to_part_power test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_is_linked_to_part_power ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_is_linked_to_part_power_minus_1 test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_is_linked_to_part_power_minus_1 ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_existing_part_number_greater_than_max_parts_allowed test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_existing_part_number_greater_than_max_parts_allowed ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET ... ok swift-ring-builder set_zone [ set_zone --region --zone --ip --port --replication-ip --replication-port --device --meta [--yes] Where , and are replication ip, hostname and port. Any of the options are optional in both cases. Resets the devices' zones. No partitions will be reassigned to or from the device until after running 'rebalance'. This is so you can make multiple device changes and rebalance them all just once. Option --yes assume a yes response to all questions. swift-ring-builder validate Just runs the validation routines on the ring. swift-ring-builder version swift-ring-builder write_builder [min_part_hours] Recreate a builder from a ring file (lossy) if you lost your builder backups. (Protip: don't lose your builder backups). [min_part_hours] is one of those numbers lost to the builder, you can change it with set_min_part_hours. swift-ring-builder write_ring Just rewrites the distributable ring file. This is done automatically after a successful rebalance, so really this is only useful after one or more 'set_info' calls when no rebalance is needed but you want to send out the new device information. The can be of the form:: drz-:R:/ _ Where and are replication ip and port. Any part is optional, but you must include at least one part. Examples:: d74 Matches the device id 74 r4 Matches devices in region 4 z1 Matches devices in zone 1 z1-1.2.3.4 Matches devices in zone 1 with the ip 1.2.3.4 1.2.3.4 Matches devices in any zone with the ip 1.2.3.4 z1:5678 Matches devices in zone 1 using port 5678 :5678 Matches devices that use port 5678 R5.6.7.8 Matches devices that use replication ip 5.6.7.8 R:5678 Matches devices that use replication port 5678 1.2.3.4R5.6.7.8 Matches devices that use ip 1.2.3.4 and replication ip 5.6.7.8 /sdb1 Matches devices with the device name sdb1 _shiny Matches devices with shiny in the meta data _"snet: 5.6.7.8" Matches devices with snet: 5.6.7.8 in the meta data [::1] Matches devices in any zone with the ip ::1 z1-[::1]:5678 Matches devices in zone 1 with ip ::1 and port 5678 Most specific example:: d74r4z1-1.2.3.4:5678/sdb1_"snet: 5.6.7.8" Nerd explanation: All items require their single character prefix except the ip, in which case the - is optional unless the device id or zone is also included. Quick list: add cancel_increase_partition_power create dispersion finish_increase_partition_power increase_partition_power list_parts prepare_increase_partition_power pretend_min_part_hours_passed rebalance remove search set_info set_min_part_hours set_overload set_region set_replicas set_weight set_zone validate version write_builder write_ring Exit codes: 0 = operation successful 1 = operation completed with warnings 2 = error Problem occurred while reading builder file: /tmp/tmpi9q81gn3/tmp_933bnh8. Generic error occurred Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 6.00. Dispersion is now 0.00 ------------------------------------------------------------------------------- NOTE: Balance of 6.00 indicates you should push this ring, wait at least 1 hours, and rebalance/repush. ------------------------------------------------------------------------------- Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 6.00. Dispersion is now 0.00 ------------------------------------------------------------------------------- NOTE: Balance of 6.00 indicates you should push this ring, wait at least 1 hours, and rebalance/repush. ------------------------------------------------------------------------------- Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Device d4r1z1-127.0.0.1:6200R127.0.0.1:6200/sdb_"" with 1.0 weight got id 4 Device d5r1z1-127.0.0.1:6200R127.0.0.1:6200/sdc_"" with 1.0 weight got id 5 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 109.38. Dispersion is now 0.00 ------------------------------------------------------------------------------- NOTE: Balance of 109.38 indicates you should push this ring, wait at least 1 hours, and rebalance/repush. ------------------------------------------------------------------------------- d0r0z0-127.0.0.1:6200R127.0.0.1:6200/sda1_"some meta data" marked for removal and will be removed next rebalance. Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 48 (75.00%) partitions. Balance is now 100.00. Dispersion is now 0.00 ------------------------------------------------------------------------------- NOTE: Balance of 100.00 indicates you should push this ring, wait at least 1 hours, and rebalance/repush. ------------------------------------------------------------------------------- Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 No partitions could be reassigned. There is no need to do so at this time Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 24 (37.50%) partitions. Balance is now 1.04. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 Reassigned 192 (300.00%) partitions. Balance is now 0.00. Dispersion is now 0.00 Defaulting to --format-version=1. This ensures the ring written will be readable by older versions of Swift. In a future release, the default will change to --format-version=2 DEBUG: New builder; performing initial balance New builder; performing initial balance DEBUG: Planning 3.0 on (1,) Planning 3.0 on (1,) DEBUG: Planning 3.0 on (1, 1) Planning 3.0 on (1, 1) DEBUG: Planning 3.0 on (1, 1, '10.1.1.1') Planning 3.0 on (1, 1, '10.1.1.1') DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 0) Planning 0.75 on (1, 1, '10.1.1.1', 0) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 1) Planning 0.75 on (1, 1, '10.1.1.1', 1) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 2) Planning 0.75 on (1, 1, '10.1.1.1', 2) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 3) Planning 0.75 on (1, 1, '10.1.1.1', 3) DEBUG: r1z1-10.1.1.1/sda wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sda wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdb wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sdb wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdc wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sdc wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdd wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sdd wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: 768 new parts and 0 removed parts from replica-count change 768 new parts and 0 removed parts from replica-count change DEBUG: Gather start is 151 (Last start was 0) Gather start is 151 (Last start was 0) DEBUG: Gathered 768 parts Gathered 768 parts DEBUG: Placed 40/0 onto dev r1z1-10.1.1.1/sdd Placed 40/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 40/1 onto dev r1z1-10.1.1.1/sdc Placed 40/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 40/2 onto dev r1z1-10.1.1.1/sda Placed 40/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 88/0 onto dev r1z1-10.1.1.1/sdb Placed 88/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 88/1 onto dev r1z1-10.1.1.1/sdd Placed 88/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 88/2 onto dev r1z1-10.1.1.1/sdc Placed 88/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 139/0 onto dev r1z1-10.1.1.1/sda Placed 139/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 139/1 onto dev r1z1-10.1.1.1/sdb Placed 139/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 139/2 onto dev r1z1-10.1.1.1/sdd Placed 139/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 84/0 onto dev r1z1-10.1.1.1/sdc Placed 84/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 84/1 onto dev r1z1-10.1.1.1/sda Placed 84/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 84/2 onto dev r1z1-10.1.1.1/sdb Placed 84/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 111/0 onto dev r1z1-10.1.1.1/sdd Placed 111/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 111/1 onto dev r1z1-10.1.1.1/sdc Placed 111/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 111/2 onto dev r1z1-10.1.1.1/sda Placed 111/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 130/0 onto dev r1z1-10.1.1.1/sdb Placed 130/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 130/1 onto dev r1z1-10.1.1.1/sdd Placed 130/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 130/2 onto dev r1z1-10.1.1.1/sdc Placed 130/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 107/0 onto dev r1z1-10.1.1.1/sda Placed 107/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 107/1 onto dev r1z1-10.1.1.1/sdb Placed 107/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 107/2 onto dev r1z1-10.1.1.1/sdd Placed 107/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 113/0 onto dev r1z1-10.1.1.1/sdc Placed 113/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 113/1 onto dev r1z1-10.1.1.1/sda Placed 113/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 113/2 onto dev r1z1-10.1.1.1/sdb Placed 113/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 25/0 onto dev r1z1-10.1.1.1/sdd Placed 25/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 25/1 onto dev r1z1-10.1.1.1/sdc Placed 25/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 25/2 onto dev r1z1-10.1.1.1/sda Placed 25/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 34/0 onto dev r1z1-10.1.1.1/sdb Placed 34/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 34/1 onto dev r1z1-10.1.1.1/sdd Placed 34/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 34/2 onto dev r1z1-10.1.1.1/sdc Placed 34/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 32/0 onto dev r1z1-10.1.1.1/sda Placed 32/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 32/1 onto dev r1z1-10.1.1.1/sdb Placed 32/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 32/2 onto dev r1z1-10.1.1.1/sdd Placed 32/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 145/0 onto dev r1z1-10.1.1.1/sdc Placed 145/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 145/1 onto dev r1z1-10.1.1.1/sda Placed 145/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 145/2 onto dev r1z1-10.1.1.1/sdb Placed 145/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 15/0 onto dev r1z1-10.1.1.1/sdd Placed 15/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 15/1 onto dev r1z1-10.1.1.1/sdc Placed 15/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 15/2 onto dev r1z1-10.1.1.1/sda Placed 15/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 43/0 onto dev r1z1-10.1.1.1/sdb Placed 43/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 43/1 onto dev r1z1-10.1.1.1/sdd Placed 43/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 43/2 onto dev r1z1-10.1.1.1/sdc Placed 43/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 154/0 onto dev r1z1-10.1.1.1/sda Placed 154/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 154/1 onto dev r1z1-10.1.1.1/sdb Placed 154/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 154/2 onto dev r1z1-10.1.1.1/sdd Placed 154/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 183/0 onto dev r1z1-10.1.1.1/sdc Placed 183/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 183/1 onto dev r1z1-10.1.1.1/sda Placed 183/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 183/2 onto dev r1z1-10.1.1.1/sdb Placed 183/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 80/0 onto dev r1z1-10.1.1.1/sdd Placed 80/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 80/1 onto dev r1z1-10.1.1.1/sdc Placed 80/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 80/2 onto dev r1z1-10.1.1.1/sda Placed 80/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 140/0 onto dev r1z1-10.1.1.1/sdb Placed 140/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 140/1 onto dev r1z1-10.1.1.1/sdd Placed 140/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 140/2 onto dev r1z1-10.1.1.1/sdc Placed 140/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 176/0 onto dev r1z1-10.1.1.1/sda Placed 176/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 176/1 onto dev r1z1-10.1.1.1/sdb Placed 176/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 176/2 onto dev r1z1-10.1.1.1/sdd Placed 176/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 120/0 onto dev r1z1-10.1.1.1/sdc Placed 120/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 120/1 onto dev r1z1-10.1.1.1/sda Placed 120/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 120/2 onto dev r1z1-10.1.1.1/sdb Placed 120/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 128/0 onto dev r1z1-10.1.1.1/sdd Placed 128/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 128/1 onto dev r1z1-10.1.1.1/sdc Placed 128/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 128/2 onto dev r1z1-10.1.1.1/sda Placed 128/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 197/0 onto dev r1z1-10.1.1.1/sdb Placed 197/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 197/1 onto dev r1z1-10.1.1.1/sdd Placed 197/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 197/2 onto dev r1z1-10.1.1.1/sdc Placed 197/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 86/0 onto dev r1z1-10.1.1.1/sda Placed 86/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 86/1 onto dev r1z1-10.1.1.1/sdb Placed 86/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 86/2 onto dev r1z1-10.1.1.1/sdd Placed 86/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 180/0 onto dev r1z1-10.1.1.1/sdc Placed 180/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 180/1 onto dev r1z1-10.1.1.1/sda Placed 180/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 180/2 onto dev r1z1-10.1.1.1/sdb Placed 180/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 85/0 onto dev r1z1-10.1.1.1/sdd Placed 85/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 85/1 onto dev r1z1-10.1.1.1/sdc Placed 85/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 85/2 onto dev r1z1-10.1.1.1/sda Placed 85/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 190/0 onto dev r1z1-10.1.1.1/sdb Placed 190/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 190/1 onto dev r1z1-10.1.1.1/sdd Placed 190/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 190/2 onto dev r1z1-10.1.1.1/sdc Placed 190/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 168/0 onto dev r1z1-10.1.1.1/sda Placed 168/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 168/1 onto dev r1z1-10.1.1.1/sdb Placed 168/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 168/2 onto dev r1z1-10.1.1.1/sdd Placed 168/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 74/0 onto dev r1z1-10.1.1.1/sdc Placed 74/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 74/1 onto dev r1z1-10.1.1.1/sda Placed 74/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 74/2 onto dev r1z1-10.1.1.1/sdb Placed 74/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 9/0 onto dev r1z1-10.1.1.1/sdd Placed 9/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 9/1 onto dev r1z1-10.1.1.1/sdc Placed 9/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 9/2 onto dev r1z1-10.1.1.1/sda Placed 9/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 90/0 onto dev r1z1-10.1.1.1/sdb Placed 90/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 90/1 onto dev r1z1-10.1.1.1/sdd Placed 90/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 90/2 onto dev r1z1-10.1.1.1/sdc Placed 90/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 232/0 onto dev r1z1-10.1.1.1/sda Placed 232/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 232/1 onto dev r1z1-10.1.1.1/sdb Placed 232/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 232/2 onto dev r1z1-10.1.1.1/sdd Placed 232/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 87/0 onto dev r1z1-10.1.1.1/sdc Placed 87/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 87/1 onto dev r1z1-10.1.1.1/sda Placed 87/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 87/2 onto dev r1z1-10.1.1.1/sdb Placed 87/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 19/0 onto dev r1z1-10.1.1.1/sdd Placed 19/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 19/1 onto dev r1z1-10.1.1.1/sdc Placed 19/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 19/2 onto dev r1z1-10.1.1.1/sda Placed 19/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 216/0 onto dev r1z1-10.1.1.1/sdb Placed 216/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 216/1 onto dev r1z1-10.1.1.1/sdd Placed 216/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 216/2 onto dev r1z1-10.1.1.1/sdc Placed 216/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 199/0 onto dev r1z1-10.1.1.1/sda Placed 199/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 199/1 onto dev r1z1-10.1.1.1/sdb Placed 199/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 199/2 onto dev r1z1-10.1.1.1/sdd Placed 199/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 159/0 onto dev r1z1-10.1.1.1/sdc Placed 159/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 159/1 onto dev r1z1-10.1.1.1/sda Placed 159/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 159/2 onto dev r1z1-10.1.1.1/sdb Placed 159/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 218/0 onto dev r1z1-10.1.1.1/sdd Placed 218/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 218/1 onto dev r1z1-10.1.1.1/sdc Placed 218/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 218/2 onto dev r1z1-10.1.1.1/sda Placed 218/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 220/0 onto dev r1z1-10.1.1.1/sdb Placed 220/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 220/1 onto dev r1z1-10.1.1.1/sdd Placed 220/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 220/2 onto dev r1z1-10.1.1.1/sdc Placed 220/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 110/0 onto dev r1z1-10.1.1.1/sda Placed 110/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 110/1 onto dev r1z1-10.1.1.1/sdb Placed 110/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 110/2 onto dev r1z1-10.1.1.1/sdd Placed 110/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 166/0 onto dev r1z1-10.1.1.1/sdc Placed 166/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 166/1 onto dev r1z1-10.1.1.1/sda Placed 166/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 166/2 onto dev r1z1-10.1.1.1/sdb Placed 166/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 182/0 onto dev r1z1-10.1.1.1/sdd Placed 182/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 182/1 onto dev r1z1-10.1.1.1/sdc Placed 182/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 182/2 onto dev r1z1-10.1.1.1/sda Placed 182/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 33/0 onto dev r1z1-10.1.1.1/sdb Placed 33/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 33/1 onto dev r1z1-10.1.1.1/sdd Placed 33/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 33/2 onto dev r1z1-10.1.1.1/sdc Placed 33/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 171/0 onto dev r1z1-10.1.1.1/sda Placed 171/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 171/1 onto dev r1z1-10.1.1.1/sdb Placed 171/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 171/2 onto dev r1z1-10.1.1.1/sdd Placed 171/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 148/0 onto dev r1z1-10.1.1.1/sdc Placed 148/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 148/1 onto dev r1z1-10.1.1.1/sda Placed 148/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 148/2 onto dev r1z1-10.1.1.1/sdb Placed 148/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 115/0 onto dev r1z1-10.1.1.1/sdd Placed 115/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 115/1 onto dev r1z1-10.1.1.1/sdc Placed 115/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 115/2 onto dev r1z1-10.1.1.1/sda Placed 115/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 208/0 onto dev r1z1-10.1.1.1/sdb Placed 208/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 208/1 onto dev r1z1-10.1.1.1/sdd Placed 208/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 208/2 onto dev r1z1-10.1.1.1/sdc Placed 208/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 101/0 onto dev r1z1-10.1.1.1/sda Placed 101/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 101/1 onto dev r1z1-10.1.1.1/sdb Placed 101/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 101/2 onto dev r1z1-10.1.1.1/sdd Placed 101/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 142/0 onto dev r1z1-10.1.1.1/sdc Placed 142/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 142/1 onto dev r1z1-10.1.1.1/sda Placed 142/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 142/2 onto dev r1z1-10.1.1.1/sdb Placed 142/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 254/0 onto dev r1z1-10.1.1.1/sdd Placed 254/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 254/1 onto dev r1z1-10.1.1.1/sdc Placed 254/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 254/2 onto dev r1z1-10.1.1.1/sda Placed 254/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 45/0 onto dev r1z1-10.1.1.1/sdb Placed 45/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 45/1 onto dev r1z1-10.1.1.1/sdd Placed 45/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 45/2 onto dev r1z1-10.1.1.1/sdc Placed 45/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 81/0 onto dev r1z1-10.1.1.1/sda Placed 81/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 81/1 onto dev r1z1-10.1.1.1/sdb Placed 81/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 81/2 onto dev r1z1-10.1.1.1/sdd Placed 81/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 106/0 onto dev r1z1-10.1.1.1/sdc Placed 106/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 106/1 onto dev r1z1-10.1.1.1/sda Placed 106/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 106/2 onto dev r1z1-10.1.1.1/sdb Placed 106/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 177/0 onto dev r1z1-10.1.1.1/sdd Placed 177/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 177/1 onto dev r1z1-10.1.1.1/sdc Placed 177/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 177/2 onto dev r1z1-10.1.1.1/sda Placed 177/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 37/0 onto dev r1z1-10.1.1.1/sdb Placed 37/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 37/1 onto dev r1z1-10.1.1.1/sdd Placed 37/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 37/2 onto dev r1z1-10.1.1.1/sdc Placed 37/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 89/0 onto dev r1z1-10.1.1.1/sda Placed 89/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 89/1 onto dev r1z1-10.1.1.1/sdb Placed 89/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 89/2 onto dev r1z1-10.1.1.1/sdd Placed 89/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 21/0 onto dev r1z1-10.1.1.1/sdc Placed 21/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 21/1 onto dev r1z1-10.1.1.1/sda Placed 21/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 21/2 onto dev r1z1-10.1.1.1/sdb Placed 21/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 122/0 onto dev r1z1-10.1.1.1/sdd Placed 122/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 122/1 onto dev r1z1-10.1.1.1/sdc Placed 122/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 122/2 onto dev r1z1-10.1.1.1/sda Placed 122/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 181/0 onto dev r1z1-10.1.1.1/sdb Placed 181/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 181/1 onto dev r1z1-10.1.1.1/sdd Placed 181/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 181/2 onto dev r1z1-10.1.1.1/sdc Placed 181/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 77/0 onto dev r1z1-10.1.1.1/sda Placed 77/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 77/1 onto dev r1z1-10.1.1.1/sdb Placed 77/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 77/2 onto dev r1z1-10.1.1.1/sdd Placed 77/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 41/0 onto dev r1z1-10.1.1.1/sdc Placed 41/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 41/1 onto dev r1z1-10.1.1.1/sda Placed 41/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 41/2 onto dev r1z1-10.1.1.1/sdb Placed 41/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 247/0 onto dev r1z1-10.1.1.1/sdd Placed 247/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 247/1 onto dev r1z1-10.1.1.1/sdc Placed 247/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 247/2 onto dev r1z1-10.1.1.1/sda Placed 247/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 103/0 onto dev r1z1-10.1.1.1/sdb Placed 103/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 103/1 onto dev r1z1-10.1.1.1/sdd Placed 103/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 103/2 onto dev r1z1-10.1.1.1/sdc Placed 103/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 146/0 onto dev r1z1-10.1.1.1/sda Placed 146/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 146/1 onto dev r1z1-10.1.1.1/sdb Placed 146/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 146/2 onto dev r1z1-10.1.1.1/sdd Placed 146/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 20/0 onto dev r1z1-10.1.1.1/sdc Placed 20/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 20/1 onto dev r1z1-10.1.1.1/sda Placed 20/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 20/2 onto dev r1z1-10.1.1.1/sdb Placed 20/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 214/0 onto dev r1z1-10.1.1.1/sdd Placed 214/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 214/1 onto dev r1z1-10.1.1.1/sdc Placed 214/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 214/2 onto dev r1z1-10.1.1.1/sda Placed 214/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 223/0 onto dev r1z1-10.1.1.1/sdb Placed 223/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 223/1 onto dev r1z1-10.1.1.1/sdd Placed 223/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 223/2 onto dev r1z1-10.1.1.1/sdc Placed 223/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 118/0 onto dev r1z1-10.1.1.1/sda Placed 118/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 118/1 onto dev r1z1-10.1.1.1/sdb Placed 118/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 118/2 onto dev r1z1-10.1.1.1/sdd Placed 118/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 76/0 onto dev r1z1-10.1.1.1/sdc Placed 76/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 76/1 onto dev r1z1-10.1.1.1/sda Placed 76/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 76/2 onto dev r1z1-10.1.1.1/sdb Placed 76/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 38/0 onto dev r1z1-10.1.1.1/sdd Placed 38/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 38/1 onto dev r1z1-10.1.1.1/sdc Placed 38/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 38/2 onto dev r1z1-10.1.1.1/sda Placed 38/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 151/0 onto dev r1z1-10.1.1.1/sdb Placed 151/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 151/1 onto dev r1z1-10.1.1.1/sdd Placed 151/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 151/2 onto dev r1z1-10.1.1.1/sdc Placed 151/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 152/0 onto dev r1z1-10.1.1.1/sda Placed 152/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 152/1 onto dev r1z1-10.1.1.1/sdb Placed 152/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 152/2 onto dev r1z1-10.1.1.1/sdd Placed 152/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 248/0 onto dev r1z1-10.1.1.1/sdc Placed 248/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 248/1 onto dev r1z1-10.1.1.1/sda Placed 248/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 248/2 onto dev r1z1-10.1.1.1/sdb Placed 248/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 14/0 onto dev r1z1-10.1.1.1/sdd Placed 14/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 14/1 onto dev r1z1-10.1.1.1/sdc Placed 14/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 14/2 onto dev r1z1-10.1.1.1/sda Placed 14/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 202/0 onto dev r1z1-10.1.1.1/sdb Placed 202/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 202/1 onto dev r1z1-10.1.1.1/sdd Placed 202/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 202/2 onto dev r1z1-10.1.1.1/sdc Placed 202/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 205/0 onto dev r1z1-10.1.1.1/sda Placed 205/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 205/1 onto dev r1z1-10.1.1.1/sdb Placed 205/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 205/2 onto dev r1z1-10.1.1.1/sdd Placed 205/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 46/0 onto dev r1z1-10.1.1.1/sdc Placed 46/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 46/1 onto dev r1z1-10.1.1.1/sda Placed 46/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 46/2 onto dev r1z1-10.1.1.1/sdb Placed 46/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 134/0 onto dev r1z1-10.1.1.1/sdd Placed 134/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 134/1 onto dev r1z1-10.1.1.1/sdc Placed 134/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 134/2 onto dev r1z1-10.1.1.1/sda Placed 134/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 200/0 onto dev r1z1-10.1.1.1/sdb Placed 200/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 200/1 onto dev r1z1-10.1.1.1/sdd Placed 200/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 200/2 onto dev r1z1-10.1.1.1/sdc Placed 200/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 100/0 onto dev r1z1-10.1.1.1/sda Placed 100/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 100/1 onto dev r1z1-10.1.1.1/sdb Placed 100/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 100/2 onto dev r1z1-10.1.1.1/sdd Placed 100/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 184/0 onto dev r1z1-10.1.1.1/sdc Placed 184/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 184/1 onto dev r1z1-10.1.1.1/sda Placed 184/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 184/2 onto dev r1z1-10.1.1.1/sdb Placed 184/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 78/0 onto dev r1z1-10.1.1.1/sdd Placed 78/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 78/1 onto dev r1z1-10.1.1.1/sdc Placed 78/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 78/2 onto dev r1z1-10.1.1.1/sda Placed 78/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 250/0 onto dev r1z1-10.1.1.1/sdb Placed 250/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 250/1 onto dev r1z1-10.1.1.1/sdd Placed 250/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 250/2 onto dev r1z1-10.1.1.1/sdc Placed 250/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 198/0 onto dev r1z1-10.1.1.1/sda Placed 198/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 198/1 onto dev r1z1-10.1.1.1/sdb Placed 198/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 198/2 onto dev r1z1-10.1.1.1/sdd Placed 198/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 243/0 onto dev r1z1-10.1.1.1/sdc Placed 243/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 243/1 onto dev r1z1-10.1.1.1/sda Placed 243/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 243/2 onto dev r1z1-10.1.1.1/sdb Placed 243/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 161/0 onto dev r1z1-10.1.1.1/sdd Placed 161/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 161/1 onto dev r1z1-10.1.1.1/sdc Placed 161/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 161/2 onto dev r1z1-10.1.1.1/sda Placed 161/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 235/0 onto dev r1z1-10.1.1.1/sdb Placed 235/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 235/1 onto dev r1z1-10.1.1.1/sdd Placed 235/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 235/2 onto dev r1z1-10.1.1.1/sdc Placed 235/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 204/0 onto dev r1z1-10.1.1.1/sda Placed 204/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 204/1 onto dev r1z1-10.1.1.1/sdb Placed 204/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 204/2 onto dev r1z1-10.1.1.1/sdd Placed 204/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 59/0 onto dev r1z1-10.1.1.1/sdc Placed 59/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 59/1 onto dev r1z1-10.1.1.1/sda Placed 59/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 59/2 onto dev r1z1-10.1.1.1/sdb Placed 59/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 94/0 onto dev r1z1-10.1.1.1/sdd Placed 94/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 94/1 onto dev r1z1-10.1.1.1/sdc Placed 94/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 94/2 onto dev r1z1-10.1.1.1/sda Placed 94/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 239/0 onto dev r1z1-10.1.1.1/sdb Placed 239/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 239/1 onto dev r1z1-10.1.1.1/sdd Placed 239/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 239/2 onto dev r1z1-10.1.1.1/sdc Placed 239/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 57/0 onto dev r1z1-10.1.1.1/sda Placed 57/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 57/1 onto dev r1z1-10.1.1.1/sdb Placed 57/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 57/2 onto dev r1z1-10.1.1.1/sdd Placed 57/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 170/0 onto dev r1z1-10.1.1.1/sdc Placed 170/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 170/1 onto dev r1z1-10.1.1.1/sda Placed 170/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 170/2 onto dev r1z1-10.1.1.1/sdb Placed 170/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 23/0 onto dev r1z1-10.1.1.1/sdd Placed 23/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 23/1 onto dev r1z1-10.1.1.1/sdc Placed 23/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 23/2 onto dev r1z1-10.1.1.1/sda Placed 23/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 18/0 onto dev r1z1-10.1.1.1/sdb Placed 18/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 18/1 onto dev r1z1-10.1.1.1/sdd Placed 18/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 18/2 onto dev r1z1-10.1.1.1/sdc Placed 18/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 71/0 onto dev r1z1-10.1.1.1/sda Placed 71/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 71/1 onto dev r1z1-10.1.1.1/sdb Placed 71/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 71/2 onto dev r1z1-10.1.1.1/sdd Placed 71/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 246/0 onto dev r1z1-10.1.1.1/sdc Placed 246/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 246/1 onto dev r1z1-10.1.1.1/sda Placed 246/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 246/2 onto dev r1z1-10.1.1.1/sdb Placed 246/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 56/0 onto dev r1z1-10.1.1.1/sdd Placed 56/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 56/1 onto dev r1z1-10.1.1.1/sdc Placed 56/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 56/2 onto dev r1z1-10.1.1.1/sda Placed 56/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 72/0 onto dev r1z1-10.1.1.1/sdb Placed 72/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 72/1 onto dev r1z1-10.1.1.1/sdd Placed 72/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 72/2 onto dev r1z1-10.1.1.1/sdc Placed 72/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 233/0 onto dev r1z1-10.1.1.1/sda Placed 233/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 233/1 onto dev r1z1-10.1.1.1/sdb Placed 233/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 233/2 onto dev r1z1-10.1.1.1/sdd Placed 233/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 162/0 onto dev r1z1-10.1.1.1/sdc Placed 162/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 162/1 onto dev r1z1-10.1.1.1/sda Placed 162/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 162/2 onto dev r1z1-10.1.1.1/sdb Placed 162/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 61/0 onto dev r1z1-10.1.1.1/sdd Placed 61/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 61/1 onto dev r1z1-10.1.1.1/sdc Placed 61/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 61/2 onto dev r1z1-10.1.1.1/sda Placed 61/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 137/0 onto dev r1z1-10.1.1.1/sdb Placed 137/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 137/1 onto dev r1z1-10.1.1.1/sdd Placed 137/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 137/2 onto dev r1z1-10.1.1.1/sdc Placed 137/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 133/0 onto dev r1z1-10.1.1.1/sda Placed 133/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 133/1 onto dev r1z1-10.1.1.1/sdb Placed 133/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 133/2 onto dev r1z1-10.1.1.1/sdd Placed 133/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 156/0 onto dev r1z1-10.1.1.1/sdc Placed 156/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 156/1 onto dev r1z1-10.1.1.1/sda Placed 156/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 156/2 onto dev r1z1-10.1.1.1/sdb Placed 156/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 195/0 onto dev r1z1-10.1.1.1/sdd Placed 195/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 195/1 onto dev r1z1-10.1.1.1/sdc Placed 195/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 195/2 onto dev r1z1-10.1.1.1/sda Placed 195/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 209/0 onto dev r1z1-10.1.1.1/sdb Placed 209/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 209/1 onto dev r1z1-10.1.1.1/sdd Placed 209/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 209/2 onto dev r1z1-10.1.1.1/sdc Placed 209/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 65/0 onto dev r1z1-10.1.1.1/sda Placed 65/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 65/1 onto dev r1z1-10.1.1.1/sdb Placed 65/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 65/2 onto dev r1z1-10.1.1.1/sdd Placed 65/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 121/0 onto dev r1z1-10.1.1.1/sdc Placed 121/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 121/1 onto dev r1z1-10.1.1.1/sda Placed 121/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 121/2 onto dev r1z1-10.1.1.1/sdb Placed 121/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 83/0 onto dev r1z1-10.1.1.1/sdd Placed 83/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 83/1 onto dev r1z1-10.1.1.1/sdc Placed 83/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 83/2 onto dev r1z1-10.1.1.1/sda Placed 83/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 186/0 onto dev r1z1-10.1.1.1/sdb Placed 186/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 186/1 onto dev r1z1-10.1.1.1/sdd Placed 186/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 186/2 onto dev r1z1-10.1.1.1/sdc Placed 186/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 42/0 onto dev r1z1-10.1.1.1/sda Placed 42/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 42/1 onto dev r1z1-10.1.1.1/sdb Placed 42/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 42/2 onto dev r1z1-10.1.1.1/sdd Placed 42/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 66/0 onto dev r1z1-10.1.1.1/sdc Placed 66/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 66/1 onto dev r1z1-10.1.1.1/sda Placed 66/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 66/2 onto dev r1z1-10.1.1.1/sdb Placed 66/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 16/0 onto dev r1z1-10.1.1.1/sdd Placed 16/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 16/1 onto dev r1z1-10.1.1.1/sdc Placed 16/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 16/2 onto dev r1z1-10.1.1.1/sda Placed 16/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 102/0 onto dev r1z1-10.1.1.1/sdb Placed 102/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 102/1 onto dev r1z1-10.1.1.1/sdd Placed 102/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 102/2 onto dev r1z1-10.1.1.1/sdc Placed 102/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 155/0 onto dev r1z1-10.1.1.1/sda Placed 155/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 155/1 onto dev r1z1-10.1.1.1/sdb Placed 155/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 155/2 onto dev r1z1-10.1.1.1/sdd Placed 155/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 153/0 onto dev r1z1-10.1.1.1/sdc Placed 153/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 153/1 onto dev r1z1-10.1.1.1/sda Placed 153/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 153/2 onto dev r1z1-10.1.1.1/sdb Placed 153/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 206/0 onto dev r1z1-10.1.1.1/sdd Placed 206/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 206/1 onto dev r1z1-10.1.1.1/sdc Placed 206/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 206/2 onto dev r1z1-10.1.1.1/sda Placed 206/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 187/0 onto dev r1z1-10.1.1.1/sdb Placed 187/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 187/1 onto dev r1z1-10.1.1.1/sdd Placed 187/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 187/2 onto dev r1z1-10.1.1.1/sdc Placed 187/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 234/0 onto dev r1z1-10.1.1.1/sda Placed 234/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 234/1 onto dev r1z1-10.1.1.1/sdb Placed 234/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 234/2 onto dev r1z1-10.1.1.1/sdd Placed 234/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 240/0 onto dev r1z1-10.1.1.1/sdc Placed 240/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 240/1 onto dev r1z1-10.1.1.1/sda Placed 240/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 240/2 onto dev r1z1-10.1.1.1/sdb Placed 240/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 70/0 onto dev r1z1-10.1.1.1/sdd Placed 70/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 70/1 onto dev r1z1-10.1.1.1/sdc Placed 70/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 70/2 onto dev r1z1-10.1.1.1/sda Placed 70/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 222/0 onto dev r1z1-10.1.1.1/sdb Placed 222/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 222/1 onto dev r1z1-10.1.1.1/sdd Placed 222/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 222/2 onto dev r1z1-10.1.1.1/sdc Placed 222/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 163/0 onto dev r1z1-10.1.1.1/sda Placed 163/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 163/1 onto dev r1z1-10.1.1.1/sdb Placed 163/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 163/2 onto dev r1z1-10.1.1.1/sdd Placed 163/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 210/0 onto dev r1z1-10.1.1.1/sdc Placed 210/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 210/1 onto dev r1z1-10.1.1.1/sda Placed 210/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 210/2 onto dev r1z1-10.1.1.1/sdb Placed 210/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 191/0 onto dev r1z1-10.1.1.1/sdd Placed 191/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 191/1 onto dev r1z1-10.1.1.1/sdc Placed 191/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 191/2 onto dev r1z1-10.1.1.1/sda Placed 191/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 58/0 onto dev r1z1-10.1.1.1/sdb Placed 58/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 58/1 onto dev r1z1-10.1.1.1/sdd Placed 58/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 58/2 onto dev r1z1-10.1.1.1/sdc Placed 58/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 237/0 onto dev r1z1-10.1.1.1/sda Placed 237/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 237/1 onto dev r1z1-10.1.1.1/sdb Placed 237/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 237/2 onto dev r1z1-10.1.1.1/sdd Placed 237/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 164/0 onto dev r1z1-10.1.1.1/sdc Placed 164/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 164/1 onto dev r1z1-10.1.1.1/sda Placed 164/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 164/2 onto dev r1z1-10.1.1.1/sdb Placed 164/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 225/0 onto dev r1z1-10.1.1.1/sdd Placed 225/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 225/1 onto dev r1z1-10.1.1.1/sdc Placed 225/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 225/2 onto dev r1z1-10.1.1.1/sda Placed 225/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 149/0 onto dev r1z1-10.1.1.1/sdb Placed 149/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 149/1 onto dev r1z1-10.1.1.1/sdd Placed 149/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 149/2 onto dev r1z1-10.1.1.1/sdc Placed 149/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 96/0 onto dev r1z1-10.1.1.1/sda Placed 96/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 96/1 onto dev r1z1-10.1.1.1/sdb Placed 96/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 96/2 onto dev r1z1-10.1.1.1/sdd Placed 96/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 63/0 onto dev r1z1-10.1.1.1/sdc Placed 63/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 63/1 onto dev r1z1-10.1.1.1/sda Placed 63/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 63/2 onto dev r1z1-10.1.1.1/sdb Placed 63/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 211/0 onto dev r1z1-10.1.1.1/sdd Placed 211/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 211/1 onto dev r1z1-10.1.1.1/sdc Placed 211/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 211/2 onto dev r1z1-10.1.1.1/sda Placed 211/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 126/0 onto dev r1z1-10.1.1.1/sdb Placed 126/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 126/1 onto dev r1z1-10.1.1.1/sdd Placed 126/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 126/2 onto dev r1z1-10.1.1.1/sdc Placed 126/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 117/0 onto dev r1z1-10.1.1.1/sda Placed 117/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 117/1 onto dev r1z1-10.1.1.1/sdb Placed 117/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 117/2 onto dev r1z1-10.1.1.1/sdd Placed 117/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 169/0 onto dev r1z1-10.1.1.1/sdc Placed 169/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 169/1 onto dev r1z1-10.1.1.1/sda Placed 169/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 169/2 onto dev r1z1-10.1.1.1/sdb Placed 169/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 231/0 onto dev r1z1-10.1.1.1/sdd Placed 231/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 231/1 onto dev r1z1-10.1.1.1/sdc Placed 231/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 231/2 onto dev r1z1-10.1.1.1/sda Placed 231/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 217/0 onto dev r1z1-10.1.1.1/sdb Placed 217/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 217/1 onto dev r1z1-10.1.1.1/sdd Placed 217/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 217/2 onto dev r1z1-10.1.1.1/sdc Placed 217/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 238/0 onto dev r1z1-10.1.1.1/sda Placed 238/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 238/1 onto dev r1z1-10.1.1.1/sdb Placed 238/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 238/2 onto dev r1z1-10.1.1.1/sdd Placed 238/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 5/0 onto dev r1z1-10.1.1.1/sdc Placed 5/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 5/1 onto dev r1z1-10.1.1.1/sda Placed 5/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 5/2 onto dev r1z1-10.1.1.1/sdb Placed 5/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 12/0 onto dev r1z1-10.1.1.1/sdd Placed 12/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 12/1 onto dev r1z1-10.1.1.1/sdc Placed 12/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 12/2 onto dev r1z1-10.1.1.1/sda Placed 12/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 249/0 onto dev r1z1-10.1.1.1/sdb Placed 249/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 249/1 onto dev r1z1-10.1.1.1/sdd Placed 249/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 249/2 onto dev r1z1-10.1.1.1/sdc Placed 249/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 179/0 onto dev r1z1-10.1.1.1/sda Placed 179/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 179/1 onto dev r1z1-10.1.1.1/sdb Placed 179/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 179/2 onto dev r1z1-10.1.1.1/sdd Placed 179/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 104/0 onto dev r1z1-10.1.1.1/sdc Placed 104/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 104/1 onto dev r1z1-10.1.1.1/sda Placed 104/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 104/2 onto dev r1z1-10.1.1.1/sdb Placed 104/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 157/0 onto dev r1z1-10.1.1.1/sdd Placed 157/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 157/1 onto dev r1z1-10.1.1.1/sdc Placed 157/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 157/2 onto dev r1z1-10.1.1.1/sda Placed 157/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 226/0 onto dev r1z1-10.1.1.1/sdb Placed 226/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 226/1 onto dev r1z1-10.1.1.1/sdd Placed 226/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 226/2 onto dev r1z1-10.1.1.1/sdc Placed 226/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 4/0 onto dev r1z1-10.1.1.1/sda Placed 4/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 4/1 onto dev r1z1-10.1.1.1/sdb Placed 4/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 4/2 onto dev r1z1-10.1.1.1/sdd Placed 4/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 150/0 onto dev r1z1-10.1.1.1/sdc Placed 150/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 150/1 onto dev r1z1-10.1.1.1/sda Placed 150/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 150/2 onto dev r1z1-10.1.1.1/sdb Placed 150/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 229/0 onto dev r1z1-10.1.1.1/sdd Placed 229/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 229/1 onto dev r1z1-10.1.1.1/sdc Placed 229/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 229/2 onto dev r1z1-10.1.1.1/sda Placed 229/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 143/0 onto dev r1z1-10.1.1.1/sdb Placed 143/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 143/1 onto dev r1z1-10.1.1.1/sdd Placed 143/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 143/2 onto dev r1z1-10.1.1.1/sdc Placed 143/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 135/0 onto dev r1z1-10.1.1.1/sda Placed 135/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 135/1 onto dev r1z1-10.1.1.1/sdb Placed 135/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 135/2 onto dev r1z1-10.1.1.1/sdd Placed 135/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 194/0 onto dev r1z1-10.1.1.1/sdc Placed 194/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 194/1 onto dev r1z1-10.1.1.1/sda Placed 194/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 194/2 onto dev r1z1-10.1.1.1/sdb Placed 194/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 116/0 onto dev r1z1-10.1.1.1/sdd Placed 116/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 116/1 onto dev r1z1-10.1.1.1/sdc Placed 116/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 116/2 onto dev r1z1-10.1.1.1/sda Placed 116/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 252/0 onto dev r1z1-10.1.1.1/sdb Placed 252/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 252/1 onto dev r1z1-10.1.1.1/sdd Placed 252/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 252/2 onto dev r1z1-10.1.1.1/sdc Placed 252/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 28/0 onto dev r1z1-10.1.1.1/sda Placed 28/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 28/1 onto dev r1z1-10.1.1.1/sdb Placed 28/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 28/2 onto dev r1z1-10.1.1.1/sdd Placed 28/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 54/0 onto dev r1z1-10.1.1.1/sdc Placed 54/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 54/1 onto dev r1z1-10.1.1.1/sda Placed 54/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 54/2 onto dev r1z1-10.1.1.1/sdb Placed 54/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 112/0 onto dev r1z1-10.1.1.1/sdd Placed 112/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 112/1 onto dev r1z1-10.1.1.1/sdc Placed 112/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 112/2 onto dev r1z1-10.1.1.1/sda Placed 112/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 7/0 onto dev r1z1-10.1.1.1/sdb Placed 7/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 7/1 onto dev r1z1-10.1.1.1/sdd Placed 7/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 7/2 onto dev r1z1-10.1.1.1/sdc Placed 7/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 47/0 onto dev r1z1-10.1.1.1/sda Placed 47/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 47/1 onto dev r1z1-10.1.1.1/sdb Placed 47/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 47/2 onto dev r1z1-10.1.1.1/sdd Placed 47/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 3/0 onto dev r1z1-10.1.1.1/sdc Placed 3/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 3/1 onto dev r1z1-10.1.1.1/sda Placed 3/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 3/2 onto dev r1z1-10.1.1.1/sdb Placed 3/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 62/0 onto dev r1z1-10.1.1.1/sdd Placed 62/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 62/1 onto dev r1z1-10.1.1.1/sdc Placed 62/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 62/2 onto dev r1z1-10.1.1.1/sda Placed 62/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 174/0 onto dev r1z1-10.1.1.1/sdb Placed 174/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 174/1 onto dev r1z1-10.1.1.1/sdd Placed 174/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 174/2 onto dev r1z1-10.1.1.1/sdc Placed 174/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 6/0 onto dev r1z1-10.1.1.1/sda Placed 6/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 6/1 onto dev r1z1-10.1.1.1/sdb Placed 6/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 6/2 onto dev r1z1-10.1.1.1/sdd Placed 6/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 10/0 onto dev r1z1-10.1.1.1/sdc Placed 10/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 10/1 onto dev r1z1-10.1.1.1/sda Placed 10/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 10/2 onto dev r1z1-10.1.1.1/sdb Placed 10/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 60/0 onto dev r1z1-10.1.1.1/sdd Placed 60/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 60/1 onto dev r1z1-10.1.1.1/sdc Placed 60/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 60/2 onto dev r1z1-10.1.1.1/sda Placed 60/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 147/0 onto dev r1z1-10.1.1.1/sdb Placed 147/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 147/1 onto dev r1z1-10.1.1.1/sdd Placed 147/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 147/2 onto dev r1z1-10.1.1.1/sdc Placed 147/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 141/0 onto dev r1z1-10.1.1.1/sda Placed 141/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 141/1 onto dev r1z1-10.1.1.1/sdb Placed 141/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 141/2 onto dev r1z1-10.1.1.1/sdd Placed 141/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 244/0 onto dev r1z1-10.1.1.1/sdc Placed 244/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 244/1 onto dev r1z1-10.1.1.1/sda Placed 244/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 244/2 onto dev r1z1-10.1.1.1/sdb Placed 244/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 160/0 onto dev r1z1-10.1.1.1/sdd Placed 160/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 160/1 onto dev r1z1-10.1.1.1/sdc Placed 160/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 160/2 onto dev r1z1-10.1.1.1/sda Placed 160/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 224/0 onto dev r1z1-10.1.1.1/sdb Placed 224/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 224/1 onto dev r1z1-10.1.1.1/sdd Placed 224/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 224/2 onto dev r1z1-10.1.1.1/sdc Placed 224/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 119/0 onto dev r1z1-10.1.1.1/sda Placed 119/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 119/1 onto dev r1z1-10.1.1.1/sdb Placed 119/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 119/2 onto dev r1z1-10.1.1.1/sdd Placed 119/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 11/0 onto dev r1z1-10.1.1.1/sdc Placed 11/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 11/1 onto dev r1z1-10.1.1.1/sda Placed 11/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 11/2 onto dev r1z1-10.1.1.1/sdb Placed 11/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 48/0 onto dev r1z1-10.1.1.1/sdd Placed 48/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 48/1 onto dev r1z1-10.1.1.1/sdc Placed 48/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 48/2 onto dev r1z1-10.1.1.1/sda Placed 48/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 185/0 onto dev r1z1-10.1.1.1/sdb Placed 185/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 185/1 onto dev r1z1-10.1.1.1/sdd Placed 185/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 185/2 onto dev r1z1-10.1.1.1/sdc Placed 185/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 221/0 onto dev r1z1-10.1.1.1/sda Placed 221/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 221/1 onto dev r1z1-10.1.1.1/sdb Placed 221/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 221/2 onto dev r1z1-10.1.1.1/sdd Placed 221/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 51/0 onto dev r1z1-10.1.1.1/sdc Placed 51/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 51/1 onto dev r1z1-10.1.1.1/sda Placed 51/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 51/2 onto dev r1z1-10.1.1.1/sdb Placed 51/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 201/0 onto dev r1z1-10.1.1.1/sdd Placed 201/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 201/1 onto dev r1z1-10.1.1.1/sdc Placed 201/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 201/2 onto dev r1z1-10.1.1.1/sda Placed 201/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 17/0 onto dev r1z1-10.1.1.1/sdb Placed 17/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 17/1 onto dev r1z1-10.1.1.1/sdd Placed 17/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 17/2 onto dev r1z1-10.1.1.1/sdc Placed 17/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 219/0 onto dev r1z1-10.1.1.1/sda Placed 219/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 219/1 onto dev r1z1-10.1.1.1/sdb Placed 219/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 219/2 onto dev r1z1-10.1.1.1/sdd Placed 219/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 30/0 onto dev r1z1-10.1.1.1/sdc Placed 30/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 30/1 onto dev r1z1-10.1.1.1/sda Placed 30/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 30/2 onto dev r1z1-10.1.1.1/sdb Placed 30/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 22/0 onto dev r1z1-10.1.1.1/sdd Placed 22/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 22/1 onto dev r1z1-10.1.1.1/sdc Placed 22/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 22/2 onto dev r1z1-10.1.1.1/sda Placed 22/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 29/0 onto dev r1z1-10.1.1.1/sdb Placed 29/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 29/1 onto dev r1z1-10.1.1.1/sdd Placed 29/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 29/2 onto dev r1z1-10.1.1.1/sdc Placed 29/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 212/0 onto dev r1z1-10.1.1.1/sda Placed 212/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 212/1 onto dev r1z1-10.1.1.1/sdb Placed 212/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 212/2 onto dev r1z1-10.1.1.1/sdd Placed 212/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 196/0 onto dev r1z1-10.1.1.1/sdc Placed 196/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 196/1 onto dev r1z1-10.1.1.1/sda Placed 196/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 196/2 onto dev r1z1-10.1.1.1/sdb Placed 196/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 125/0 onto dev r1z1-10.1.1.1/sdd Placed 125/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 125/1 onto dev r1z1-10.1.1.1/sdc Placed 125/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 125/2 onto dev r1z1-10.1.1.1/sda Placed 125/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 99/0 onto dev r1z1-10.1.1.1/sdb Placed 99/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 99/1 onto dev r1z1-10.1.1.1/sdd Placed 99/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 99/2 onto dev r1z1-10.1.1.1/sdc Placed 99/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 98/0 onto dev r1z1-10.1.1.1/sda Placed 98/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 98/1 onto dev r1z1-10.1.1.1/sdb Placed 98/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 98/2 onto dev r1z1-10.1.1.1/sdd Placed 98/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 165/0 onto dev r1z1-10.1.1.1/sdc Placed 165/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 165/1 onto dev r1z1-10.1.1.1/sda Placed 165/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 165/2 onto dev r1z1-10.1.1.1/sdb Placed 165/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 95/0 onto dev r1z1-10.1.1.1/sdd Placed 95/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 95/1 onto dev r1z1-10.1.1.1/sdc Placed 95/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 95/2 onto dev r1z1-10.1.1.1/sda Placed 95/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 35/0 onto dev r1z1-10.1.1.1/sdb Placed 35/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 35/1 onto dev r1z1-10.1.1.1/sdd Placed 35/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 35/2 onto dev r1z1-10.1.1.1/sdc Placed 35/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 127/0 onto dev r1z1-10.1.1.1/sda Placed 127/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 127/1 onto dev r1z1-10.1.1.1/sdb Placed 127/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 127/2 onto dev r1z1-10.1.1.1/sdd Placed 127/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 26/0 onto dev r1z1-10.1.1.1/sdc Placed 26/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 26/1 onto dev r1z1-10.1.1.1/sda Placed 26/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 26/2 onto dev r1z1-10.1.1.1/sdb Placed 26/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 13/0 onto dev r1z1-10.1.1.1/sdd Placed 13/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 13/1 onto dev r1z1-10.1.1.1/sdc Placed 13/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 13/2 onto dev r1z1-10.1.1.1/sda Placed 13/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 27/0 onto dev r1z1-10.1.1.1/sdb Placed 27/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 27/1 onto dev r1z1-10.1.1.1/sdd Placed 27/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 27/2 onto dev r1z1-10.1.1.1/sdc Placed 27/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 36/0 onto dev r1z1-10.1.1.1/sda Placed 36/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 36/1 onto dev r1z1-10.1.1.1/sdb Placed 36/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 36/2 onto dev r1z1-10.1.1.1/sdd Placed 36/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 251/0 onto dev r1z1-10.1.1.1/sdc Placed 251/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 251/1 onto dev r1z1-10.1.1.1/sda Placed 251/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 251/2 onto dev r1z1-10.1.1.1/sdb Placed 251/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 207/0 onto dev r1z1-10.1.1.1/sdd Placed 207/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 207/1 onto dev r1z1-10.1.1.1/sdc Placed 207/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 207/2 onto dev r1z1-10.1.1.1/sda Placed 207/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 173/0 onto dev r1z1-10.1.1.1/sdb Placed 173/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 173/1 onto dev r1z1-10.1.1.1/sdd Placed 173/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 173/2 onto dev r1z1-10.1.1.1/sdc Placed 173/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 192/0 onto dev r1z1-10.1.1.1/sda Placed 192/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 192/1 onto dev r1z1-10.1.1.1/sdb Placed 192/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 192/2 onto dev r1z1-10.1.1.1/sdd Placed 192/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 82/0 onto dev r1z1-10.1.1.1/sdc Placed 82/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 82/1 onto dev r1z1-10.1.1.1/sda Placed 82/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 82/2 onto dev r1z1-10.1.1.1/sdb Placed 82/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 172/0 onto dev r1z1-10.1.1.1/sdd Placed 172/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 172/1 onto dev r1z1-10.1.1.1/sdc Placed 172/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 172/2 onto dev r1z1-10.1.1.1/sda Placed 172/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 8/0 onto dev r1z1-10.1.1.1/sdb Placed 8/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 8/1 onto dev r1z1-10.1.1.1/sdd Placed 8/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 8/2 onto dev r1z1-10.1.1.1/sdc Placed 8/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 189/0 onto dev r1z1-10.1.1.1/sda Placed 189/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 189/1 onto dev r1z1-10.1.1.1/sdb Placed 189/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 189/2 onto dev r1z1-10.1.1.1/sdd Placed 189/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 123/0 onto dev r1z1-10.1.1.1/sdc Placed 123/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 123/1 onto dev r1z1-10.1.1.1/sda Placed 123/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 123/2 onto dev r1z1-10.1.1.1/sdb Placed 123/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 167/0 onto dev r1z1-10.1.1.1/sdd Placed 167/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 167/1 onto dev r1z1-10.1.1.1/sdc Placed 167/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 167/2 onto dev r1z1-10.1.1.1/sda Placed 167/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 228/0 onto dev r1z1-10.1.1.1/sdb Placed 228/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 228/1 onto dev r1z1-10.1.1.1/sdd Placed 228/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 228/2 onto dev r1z1-10.1.1.1/sdc Placed 228/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 67/0 onto dev r1z1-10.1.1.1/sda Placed 67/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 67/1 onto dev r1z1-10.1.1.1/sdb Placed 67/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 67/2 onto dev r1z1-10.1.1.1/sdd Placed 67/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 193/0 onto dev r1z1-10.1.1.1/sdc Placed 193/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 193/1 onto dev r1z1-10.1.1.1/sda Placed 193/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 193/2 onto dev r1z1-10.1.1.1/sdb Placed 193/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 2/0 onto dev r1z1-10.1.1.1/sdd Placed 2/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 2/1 onto dev r1z1-10.1.1.1/sdc Placed 2/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 2/2 onto dev r1z1-10.1.1.1/sda Placed 2/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 138/0 onto dev r1z1-10.1.1.1/sdb Placed 138/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 138/1 onto dev r1z1-10.1.1.1/sdd Placed 138/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 138/2 onto dev r1z1-10.1.1.1/sdc Placed 138/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 0/0 onto dev r1z1-10.1.1.1/sda Placed 0/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 0/1 onto dev r1z1-10.1.1.1/sdb Placed 0/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 0/2 onto dev r1z1-10.1.1.1/sdd Placed 0/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 69/0 onto dev r1z1-10.1.1.1/sdc Placed 69/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 69/1 onto dev r1z1-10.1.1.1/sda Placed 69/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 69/2 onto dev r1z1-10.1.1.1/sdb Placed 69/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 230/0 onto dev r1z1-10.1.1.1/sdd Placed 230/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 230/1 onto dev r1z1-10.1.1.1/sdc Placed 230/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 230/2 onto dev r1z1-10.1.1.1/sda Placed 230/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 105/0 onto dev r1z1-10.1.1.1/sdb Placed 105/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 105/1 onto dev r1z1-10.1.1.1/sdd Placed 105/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 105/2 onto dev r1z1-10.1.1.1/sdc Placed 105/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 114/0 onto dev r1z1-10.1.1.1/sda Placed 114/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 114/1 onto dev r1z1-10.1.1.1/sdb Placed 114/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 114/2 onto dev r1z1-10.1.1.1/sdd Placed 114/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 39/0 onto dev r1z1-10.1.1.1/sdc Placed 39/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 39/1 onto dev r1z1-10.1.1.1/sda Placed 39/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 39/2 onto dev r1z1-10.1.1.1/sdb Placed 39/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 175/0 onto dev r1z1-10.1.1.1/sdd Placed 175/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 175/1 onto dev r1z1-10.1.1.1/sdc Placed 175/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 175/2 onto dev r1z1-10.1.1.1/sda Placed 175/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 24/0 onto dev r1z1-10.1.1.1/sdb Placed 24/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 24/1 onto dev r1z1-10.1.1.1/sdd Placed 24/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 24/2 onto dev r1z1-10.1.1.1/sdc Placed 24/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 188/0 onto dev r1z1-10.1.1.1/sda Placed 188/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 188/1 onto dev r1z1-10.1.1.1/sdb Placed 188/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 188/2 onto dev r1z1-10.1.1.1/sdd Placed 188/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 227/0 onto dev r1z1-10.1.1.1/sdc Placed 227/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 227/1 onto dev r1z1-10.1.1.1/sda Placed 227/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 227/2 onto dev r1z1-10.1.1.1/sdb Placed 227/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 55/0 onto dev r1z1-10.1.1.1/sdd Placed 55/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 55/1 onto dev r1z1-10.1.1.1/sdc Placed 55/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 55/2 onto dev r1z1-10.1.1.1/sda Placed 55/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 73/0 onto dev r1z1-10.1.1.1/sdb Placed 73/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 73/1 onto dev r1z1-10.1.1.1/sdd Placed 73/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 73/2 onto dev r1z1-10.1.1.1/sdc Placed 73/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 97/0 onto dev r1z1-10.1.1.1/sda Placed 97/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 97/1 onto dev r1z1-10.1.1.1/sdb Placed 97/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 97/2 onto dev r1z1-10.1.1.1/sdd Placed 97/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 52/0 onto dev r1z1-10.1.1.1/sdc Placed 52/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 52/1 onto dev r1z1-10.1.1.1/sda Placed 52/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 52/2 onto dev r1z1-10.1.1.1/sdb Placed 52/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 236/0 onto dev r1z1-10.1.1.1/sdd Placed 236/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 236/1 onto dev r1z1-10.1.1.1/sdc Placed 236/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 236/2 onto dev r1z1-10.1.1.1/sda Placed 236/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 49/0 onto dev r1z1-10.1.1.1/sdb Placed 49/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 49/1 onto dev r1z1-10.1.1.1/sdd Placed 49/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 49/2 onto dev r1z1-10.1.1.1/sdc Placed 49/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 136/0 onto dev r1z1-10.1.1.1/sda Placed 136/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 136/1 onto dev r1z1-10.1.1.1/sdb Placed 136/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 136/2 onto dev r1z1-10.1.1.1/sdd Placed 136/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 124/0 onto dev r1z1-10.1.1.1/sdc Placed 124/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 124/1 onto dev r1z1-10.1.1.1/sda Placed 124/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 124/2 onto dev r1z1-10.1.1.1/sdb Placed 124/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 91/0 onto dev r1z1-10.1.1.1/sdd Placed 91/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 91/1 onto dev r1z1-10.1.1.1/sdc Placed 91/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 91/2 onto dev r1z1-10.1.1.1/sda Placed 91/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 129/0 onto dev r1z1-10.1.1.1/sdb Placed 129/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 129/1 onto dev r1z1-10.1.1.1/sdd Placed 129/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 129/2 onto dev r1z1-10.1.1.1/sdc Placed 129/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 1/0 onto dev r1z1-10.1.1.1/sda Placed 1/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 1/1 onto dev r1z1-10.1.1.1/sdb Placed 1/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 1/2 onto dev r1z1-10.1.1.1/sdd Placed 1/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 44/0 onto dev r1z1-10.1.1.1/sdc Placed 44/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 44/1 onto dev r1z1-10.1.1.1/sda Placed 44/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 44/2 onto dev r1z1-10.1.1.1/sdb Placed 44/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 203/0 onto dev r1z1-10.1.1.1/sdd Placed 203/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 203/1 onto dev r1z1-10.1.1.1/sdc Placed 203/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 203/2 onto dev r1z1-10.1.1.1/sda Placed 203/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 109/0 onto dev r1z1-10.1.1.1/sdb Placed 109/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 109/1 onto dev r1z1-10.1.1.1/sdd Placed 109/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 109/2 onto dev r1z1-10.1.1.1/sdc Placed 109/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 93/0 onto dev r1z1-10.1.1.1/sda Placed 93/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 93/1 onto dev r1z1-10.1.1.1/sdb Placed 93/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 93/2 onto dev r1z1-10.1.1.1/sdd Placed 93/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 213/0 onto dev r1z1-10.1.1.1/sdc Placed 213/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 213/1 onto dev r1z1-10.1.1.1/sda Placed 213/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 213/2 onto dev r1z1-10.1.1.1/sdb Placed 213/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 75/0 onto dev r1z1-10.1.1.1/sdd Placed 75/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 75/1 onto dev r1z1-10.1.1.1/sdc Placed 75/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 75/2 onto dev r1z1-10.1.1.1/sda Placed 75/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 255/0 onto dev r1z1-10.1.1.1/sdb Placed 255/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 255/1 onto dev r1z1-10.1.1.1/sdd Placed 255/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 255/2 onto dev r1z1-10.1.1.1/sdc Placed 255/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 241/0 onto dev r1z1-10.1.1.1/sda Placed 241/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 241/1 onto dev r1z1-10.1.1.1/sdb Placed 241/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 241/2 onto dev r1z1-10.1.1.1/sdd Placed 241/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 64/0 onto dev r1z1-10.1.1.1/sdc Placed 64/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 64/1 onto dev r1z1-10.1.1.1/sda Placed 64/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 64/2 onto dev r1z1-10.1.1.1/sdb Placed 64/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 242/0 onto dev r1z1-10.1.1.1/sdd Placed 242/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 242/1 onto dev r1z1-10.1.1.1/sdc Placed 242/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 242/2 onto dev r1z1-10.1.1.1/sda Placed 242/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 53/0 onto dev r1z1-10.1.1.1/sdb Placed 53/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 53/1 onto dev r1z1-10.1.1.1/sdd Placed 53/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 53/2 onto dev r1z1-10.1.1.1/sdc Placed 53/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 131/0 onto dev r1z1-10.1.1.1/sda Placed 131/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 131/1 onto dev r1z1-10.1.1.1/sdb Placed 131/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 131/2 onto dev r1z1-10.1.1.1/sdd Placed 131/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 31/0 onto dev r1z1-10.1.1.1/sdc Placed 31/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 31/1 onto dev r1z1-10.1.1.1/sda Placed 31/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 31/2 onto dev r1z1-10.1.1.1/sdb Placed 31/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 245/0 onto dev r1z1-10.1.1.1/sdd Placed 245/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 245/1 onto dev r1z1-10.1.1.1/sdc Placed 245/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 245/2 onto dev r1z1-10.1.1.1/sda Placed 245/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 79/0 onto dev r1z1-10.1.1.1/sdb Placed 79/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 79/1 onto dev r1z1-10.1.1.1/sdd Placed 79/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 79/2 onto dev r1z1-10.1.1.1/sdc Placed 79/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 253/0 onto dev r1z1-10.1.1.1/sda Placed 253/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 253/1 onto dev r1z1-10.1.1.1/sdb Placed 253/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 253/2 onto dev r1z1-10.1.1.1/sdd Placed 253/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 68/0 onto dev r1z1-10.1.1.1/sdc Placed 68/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 68/1 onto dev r1z1-10.1.1.1/sda Placed 68/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 68/2 onto dev r1z1-10.1.1.1/sdb Placed 68/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 92/0 onto dev r1z1-10.1.1.1/sdd Placed 92/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 92/1 onto dev r1z1-10.1.1.1/sdc Placed 92/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 92/2 onto dev r1z1-10.1.1.1/sda Placed 92/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 108/0 onto dev r1z1-10.1.1.1/sdb Placed 108/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 108/1 onto dev r1z1-10.1.1.1/sdd Placed 108/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 108/2 onto dev r1z1-10.1.1.1/sdc Placed 108/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 215/0 onto dev r1z1-10.1.1.1/sda Placed 215/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 215/1 onto dev r1z1-10.1.1.1/sdb Placed 215/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 215/2 onto dev r1z1-10.1.1.1/sdd Placed 215/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 158/0 onto dev r1z1-10.1.1.1/sdc Placed 158/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 158/1 onto dev r1z1-10.1.1.1/sda Placed 158/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 158/2 onto dev r1z1-10.1.1.1/sdb Placed 158/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 132/0 onto dev r1z1-10.1.1.1/sdd Placed 132/0 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 132/1 onto dev r1z1-10.1.1.1/sdc Placed 132/1 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 132/2 onto dev r1z1-10.1.1.1/sda Placed 132/2 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 144/0 onto dev r1z1-10.1.1.1/sdb Placed 144/0 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 144/1 onto dev r1z1-10.1.1.1/sdd Placed 144/1 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 144/2 onto dev r1z1-10.1.1.1/sdc Placed 144/2 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 178/0 onto dev r1z1-10.1.1.1/sda Placed 178/0 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 178/1 onto dev r1z1-10.1.1.1/sdb Placed 178/1 onto dev r1z1-10.1.1.1/sdb DEBUG: Placed 178/2 onto dev r1z1-10.1.1.1/sdd Placed 178/2 onto dev r1z1-10.1.1.1/sdd DEBUG: Placed 50/0 onto dev r1z1-10.1.1.1/sdc Placed 50/0 onto dev r1z1-10.1.1.1/sdc DEBUG: Placed 50/1 onto dev r1z1-10.1.1.1/sda Placed 50/1 onto dev r1z1-10.1.1.1/sda DEBUG: Placed 50/2 onto dev r1z1-10.1.1.1/sdb Placed 50/2 onto dev r1z1-10.1.1.1/sdb DEBUG: Assigned 768 parts Assigned 768 parts DEBUG: Finished rebalance plan after 1 attempts Finished rebalance plan after 1 attempts DEBUG: Planning 3.0 on (1,) DEBUG: Planning 3.0 on (1,) Planning 3.0 on (1,) DEBUG: Planning 3.0 on (1, 1) DEBUG: Planning 3.0 on (1, 1) Planning 3.0 on (1, 1) DEBUG: Planning 3.0 on (1, 1, '10.1.1.1') DEBUG: Planning 3.0 on (1, 1, '10.1.1.1') Planning 3.0 on (1, 1, '10.1.1.1') DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 0) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 0) Planning 0.75 on (1, 1, '10.1.1.1', 0) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 1) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 1) Planning 0.75 on (1, 1, '10.1.1.1', 1) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 2) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 2) Planning 0.75 on (1, 1, '10.1.1.1', 2) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 3) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 3) Planning 0.75 on (1, 1, '10.1.1.1', 3) DEBUG: r1z1-10.1.1.1/sda wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sda wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sda wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdb wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdb wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sdb wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdc wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdc wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sdc wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdd wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdd wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sdd wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: 0 new parts and 0 removed parts from replica-count change DEBUG: 0 new parts and 0 removed parts from replica-count change 0 new parts and 0 removed parts from replica-count change DEBUG: Gather start is 233 (Last start was 151) DEBUG: Gather start is 233 (Last start was 151) Gather start is 233 (Last start was 151) DEBUG: Unable to finish rebalance plan after 1 attempts DEBUG: Unable to finish rebalance plan after 1 attempts Unable to finish rebalance plan after 1 attempts DEBUG: Planning 3.0 on (1,) DEBUG: Planning 3.0 on (1,) DEBUG: Planning 3.0 on (1,) Planning 3.0 on (1,) DEBUG: Planning 3.0 on (1, 1) DEBUG: Planning 3.0 on (1, 1) DEBUG: Planning 3.0 on (1, 1) Planning 3.0 on (1, 1) DEBUG: Planning 3.0 on (1, 1, '10.1.1.1') DEBUG: Planning 3.0 on (1, 1, '10.1.1.1') DEBUG: Planning 3.0 on (1, 1, '10.1.1.1') Planning 3.0 on (1, 1, '10.1.1.1') DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 0) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 0) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 0) Planning 0.75 on (1, 1, '10.1.1.1', 0) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 1) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 1) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 1) Planning 0.75 on (1, 1, '10.1.1.1', 1) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 2) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 2) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 2) Planning 0.75 on (1, 1, '10.1.1.1', 2) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 3) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 3) DEBUG: Planning 0.75 on (1, 1, '10.1.1.1', 3) Planning 0.75 on (1, 1, '10.1.1.1', 3) DEBUG: r1z1-10.1.1.1/sda wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sda wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sda wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sda wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdb wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdb wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdb wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sdb wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdc wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdc wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdc wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sdc wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdd wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdd wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: r1z1-10.1.1.1/sdd wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload r1z1-10.1.1.1/sdd wants 0.75 and is weighted for 0.75 so therefore requires 0.0 overload DEBUG: 0 new parts and 0 removed parts from replica-count change DEBUG: 0 new parts and 0 removed parts from replica-count change DEBUG: 0 new parts and 0 removed parts from replica-count change 0 new parts and 0 removed parts from replica-count change DEBUG: Gather start is 233 (Last start was 151) DEBUG: Gather start is 233 (Last start was 151) DEBUG: Gather start is 233 (Last start was 151) Gather start is 233 (Last start was 151) DEBUG: Unable to finish rebalance plan after 1 attempts DEBUG: Unable to finish rebalance plan after 1 attempts DEBUG: Unable to finish rebalance plan after 1 attempts Unable to finish rebalance plan after 1 attempts test.unit.cli.test_ringbuilder.TestRebalanceCommand.test_debug test.unit.cli.test_ringbuilder.TestRebalanceCommand.test_debug ... ok test.unit.cli.test_ringbuilder.TestRebalanceCommand.test_rebalance_warning_appears test.unit.cli.test_ringbuilder.TestRebalanceCommand.test_rebalance_warning_appears ... ok test.unit.cli.test_ringbuilder.TestRebalanceCommand.test_rebalance_warning_with_overload test.unit.cli.test_ringbuilder.TestRebalanceCommand.test_rebalance_warning_with_overload ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_check_crypto_meta test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_check_crypto_meta ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_check_key test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_check_key ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_decryption_context test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_decryption_context ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_decryption_context_non_zero_offset test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_decryption_context_non_zero_offset ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_encryption_context test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_encryption_context ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_iv test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_iv ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_random_key test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_create_random_key ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_decrypt_range test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_decrypt_range ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_enc_dec_large_chunks test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_enc_dec_large_chunks ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_enc_dec_small_chunks test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_enc_dec_small_chunks ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_get_crypto_meta test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_get_crypto_meta ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_unwrap_bad_key test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_unwrap_bad_key ... ok test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_wrap_unwrap_key test.unit.common.middleware.crypto.test_crypto_utils.TestCrypto.test_wrap_unwrap_key ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_app_exception_v3 test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_app_exception_v3 ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_filter_v3 test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_filter_v3 ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_get_root_secret test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_get_root_secret ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_get_root_secret_from_external_file test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_get_root_secret_from_external_file ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_get_root_secret_legacy_key_id test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_get_root_secret_legacy_key_id ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_get_root_secret_multiple_keys test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_get_root_secret_multiple_keys ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_bad_auth_url test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_bad_auth_url ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_bad_user_domain_name test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_bad_user_domain_name ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_config_file_and_params test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_config_file_and_params ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_connect_failure_auth_url test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_connect_failure_auth_url ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_key_algorithm test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_key_algorithm ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_key_format test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_key_format ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_key_id test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_key_id ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_key_length test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_key_length ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_password test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_password ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_username test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_invalid_username ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_none_key test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_none_key ... ok test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_nonexistent_key_id test.unit.common.middleware.crypto.test_kms_keymaster.TestKmsKeymaster.test_mocked_castellan_keymanager_nonexistent_key_id ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_auth_uris test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_auth_uris ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorization_nova_toconnect test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorization_nova_toconnect ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorize_with_access_key test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorize_with_access_key ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorize_with_access_key_and_unquote_chars test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorize_with_access_key_and_unquote_chars ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorize_with_unicode_access_key test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorize_with_unicode_access_key ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized_bytes test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized_bytes ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized_http test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized_http ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized_trailing_slash test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized_trailing_slash ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized_v3 test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_authorized_v3 ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_bad_auth_uris test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_bad_auth_uris ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_http_timeout test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_http_timeout ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_http_timeout_option test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_http_timeout_option ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_insecure test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_insecure ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_insecure_option test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_insecure_option ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_no_path_request test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_no_path_request ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_nukes_auth_headers test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_nukes_auth_headers ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_reseller_prefix test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_reseller_prefix ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_secret_is_cached test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_secret_is_cached ... ok test DEBUG: Error on keystone reply: 201 b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID"}}}}' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}}' test DEBUG: Error on keystone reply: 201 b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}}' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Error on keystone reply: 201 b'{"access": {"token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Error on keystone reply: 201 b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Error on keystone reply: 201 b'{"access": {"user": {"username": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID"}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Error on keystone reply: 201 b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID"}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'' test DEBUG: Error on keystone reply: 201 b'' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{}' test DEBUG: Error on keystone reply: 201 b'{}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'[]' test DEBUG: Error on keystone reply: 201 b'[]' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'null' test DEBUG: Error on keystone reply: 201 b'null' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'"foo"' test DEBUG: Error on keystone reply: 201 b'"foo"' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'1' test DEBUG: Error on keystone reply: 201 b'1' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'true' test DEBUG: Error on keystone reply: 201 b'true' - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Received error, rejecting request with error: 400 Bad Request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: No authorization details from s3api. skipping. test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone reply error: status=403 reason=None test DEBUG: Received error, rejecting request with error: 401 Unauthorized test DEBUG: tenant mismatch: BLAN_a != tenant_id test DEBUG: allow user with role(s) admin,swiftoperator as account admin test DEBUG: allow user with role(s) admin,swiftoperator as account admin test DEBUG: allowing proxy 127.0.0.1 for container-sync test DEBUG: User tenant_id has reseller admin authorizing test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:* allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:* allowed in ACL authorizing. test DEBUG: authorizing http://example.com/index.html via referer ACL test DEBUG: Names allowed in acls. test DEBUG: authorizing http://example.com/index.html via referer ACL test DEBUG: User tenant_id has reseller admin authorizing test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:* allowed in ACL authorizing. test DEBUG: Names allowed in acls.test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_tenant_name_user_in_roles test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_tenant_name_user_in_roles ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_user_role_in_roles test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_user_role_in_roles ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_wildcard_tenant_user_in_roles test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_authorize_succeeds_for_wildcard_tenant_user_in_roles ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_cross_tenant_authorization_allow_names test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_cross_tenant_authorization_allow_names ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_cross_tenant_authorization_failure test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_cross_tenant_authorization_failure ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_cross_tenant_authorization_success test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_cross_tenant_authorization_success ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_delete_own_account_not_allowed test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_delete_own_account_not_allowed ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_delete_own_account_when_reseller_allowed test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_delete_own_account_when_reseller_allowed ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_get_project_domain_id test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_get_project_domain_id ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_identity_set_up_at_call test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_identity_set_up_at_call ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_keystone_identity test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_keystone_identity ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_names_allowed_in_acls_inside_default_domain test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_names_allowed_in_acls_inside_default_domain ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_names_allowed_in_acls_inside_default_domain_with_config test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_names_allowed_in_acls_inside_default_domain_with_config ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_names_disallowed_in_acls_inside_default_domain test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_names_disallowed_in_acls_inside_default_domain ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_names_disallowed_in_acls_outside_default_domain test.unit.common.middleware.test_keystoneauth.TestAuthorize.test_names_disallowed_in_acls_outside_default_domain ... ok test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACL.test_is_name_allowed_in_acl_with_token_scoped_to_other_tenant test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACL.test_is_name_allowed_in_acl_with_token_scoped_to_other_tenant ... ok test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACL.test_is_name_allowed_in_acl_with_token_scoped_to_tenant test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACL.test_is_name_allowed_in_acl_with_token_scoped_to_tenant ... ok test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACL.test_is_name_allowed_in_acl_with_unscoped_token test.unit.common.middleware.test_keystoneauth.TestIsNameAllowedInACL.test_is_name_allowed_in_acl_with_unscoped_token ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningVersionAPIWhileDisabled.test_DELETE_current_version test.unit.common.middleware.test_object_versioning.ObjectVersioningVersionAPIWhileDisabled.test_DELETE_current_version ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningVersionAPIWhileDisabled.test_POST_error_versioning_disabled test.unit.common.middleware.test_object_versioning.ObjectVersioningVersionAPIWhileDisabled.test_POST_error_versioning_disabled ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningVersionAPIWhileDisabled.test_PUT_version_versioning_disbaled test.unit.common.middleware.test_object_versioning.ObjectVersioningVersionAPIWhileDisabled.test_PUT_version_versioning_disbaled ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_big_non_slo test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_big_non_slo ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_fails test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_fails ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_finds_old test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_finds_old ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_small_non_slo test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_small_non_slo ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_tombstone test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_beyond_manifest_refetch_tombstone ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_bogus_content_range test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_bogus_content_range ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_includes_whole_manifest test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_includes_whole_manifest ... ok test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_includes_whole_range_manifest test.unit.common.middleware.test_slo.TestOldSwiftWithRanges.test_old_swift_range_get_includes_whole_range_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_manifest_with_x_open_expired_part_num test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_manifest_with_x_open_expired_part_num ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_non_integer_part_number_invalid test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_non_integer_part_number_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_out_of_range_part_number test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_out_of_range_part_number ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_num_with_repeated_segments test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_num_with_repeated_segments ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_number test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_number ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_number_data_manifest test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_number_data_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_number_large_manifest test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_number_large_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_number_sub_slo test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_get_part_number_sub_slo ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_negative_part_number_invalid_on_subrange test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_negative_part_number_invalid_on_subrange ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_non_integer_part_number_invalid test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_non_integer_part_number_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_out_of_range_part_number test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_out_of_range_part_number ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_out_of_range_part_number_on_subrange test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_out_of_range_part_number_on_subrange ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number_data_manifest test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number_data_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number_refetch_path test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number_refetch_path ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number_subrange test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number_subrange ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number_zero_invalid test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_head_part_number_zero_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_negative_part_number_invalid test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_negative_part_number_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_exceeds_max_manifest_segments_is_ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_exceeds_max_manifest_segments_is_ok ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_ignored_for_manifest_get test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_ignored_for_manifest_get ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_ignored_for_non_slo_object test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_ignored_for_non_slo_object ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_ignored_for_non_slo_object_with_range test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_ignored_for_non_slo_object_with_range ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_sub_ranges_manifest test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_sub_ranges_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_with_range_segments test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_with_range_segments ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_zero_byte_manifest test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_zero_byte_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_zero_invalid test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_zero_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_zero_invalid_on_subrange test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_part_number_zero_invalid_on_subrange ... ok test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_range_with_part_number_is_error test.unit.common.middleware.test_slo.TestPartNumberLegacyManifest.test_range_with_part_number_is_error ... ok test.unit.common.middleware.test_slo.TestSloDataSegments.test_bunches_of_data_segments test.unit.common.middleware.test_slo.TestSloDataSegments.test_bunches_of_data_segments ... ok test.unit.common.middleware.test_slo.TestSloDataSegments.test_data_segment_sandwich test.unit.common.middleware.test_slo.TestSloDataSegments.test_data_segment_sandwich ... ok test.unit.common.middleware.test_slo.TestSloDataSegments.test_leading_data_segment test.unit.common.middleware.test_slo.TestSloDataSegments.test_leading_data_segment ... ok test.unit.common.middleware.test_slo.TestSloDataSegments.test_trailing_data_segment test.unit.common.middleware.test_slo.TestSloDataSegments.test_trailing_data_segment ... ok test.unit.common.middleware.test_slo.TestSloGetRawOldManifest.test_get_raw_manifest test.unit.common.middleware.test_slo.TestSloGetRawOldManifest.test_get_raw_manifest ... ok test.unit.common.middleware.test_slo.TestSloGetRawOldManifest.test_get_raw_manifest_passthrough_with_ranges test.unit.common.middleware.test_slo.TestSloGetRawOldManifest.test_get_raw_manifest_passthrough_with_ranges ... ok test.unit.common.middleware.test_tempauth.TestAccountAcls.test_account_acl_failures test.unit.common.middleware.test_tempauth.TestAccountAcls.test_account_acl_failures ... ok test.unit.common.middleware.test_tempauth.TestAccountAcls.test_account_acl_success test.unit.common.middleware.test_tempauth.TestAccountAcls.test_account_acl_success ... ok test.unit.common.middleware.test_tempauth.TestAccountAcls.test_acl_syntax_verification test.unit.common.middleware.test_tempauth.TestAccountAcls.test_acl_syntax_verification ... ok test.unit.common.middleware.test_tempauth.TestAccountAcls.test_acls_propagate_to_sysmeta test.unit.common.middleware.test_tempauth.TestAccountAcls.test_acls_propagate_to_sysmeta ... ok test.unit.common.middleware.test_tempauth.TestAccountAcls.test_admin_privileges test.unit.common.middleware.test_tempauth.TestAccountAcls.test_admin_privileges ... ok test.unit.common.middleware.test_tempauth.TestAccountAcls.test_bad_acls_get_denied test.unit.common.middleware.test_tempauth.TestAccountAcls.test_bad_acls_get_denied ... ok test.unit.common.middleware.test_tempauth.TestAccountAcls.test_readonly_privileges test.unit.common.middleware.test_tempauth.TestAccountAcls.test_readonly_privileges ... ok test.unit.common.middleware.test_tempauth.TestAccountAcls.test_readwrite_privileges test.unit.common.middleware.test_tempauth.TestAccountAcls.test_readwrite_privileges ... ok test.unit.common.middleware.test_tempauth.TestAccountAcls.test_user_gets_best_acl test.unit.common.middleware.test_tempauth.TestAccountAcls.test_user_gets_best_acl ... ok test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_call test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_call ... ok test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_combine_body_qs test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_combine_body_qs ... ok test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_dump_checkpoint test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_dump_checkpoint ... ok test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_int_values test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_int_values ... ok test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_renew_profile test.unit.common.middleware.test_xprofile.TestProfileMiddleware.test_renew_profile ... ok test.unit.common.test_base_storage_server.TestTimingStatsDecorators.test_timing_stats test.unit.common.test_base_storage_server.TestTimingStatsDecorators.test_timing_stats ... ok test.unit.common.test_exceptions.TestExceptions.test_client_exception test.unit.common.test_exceptions.TestExceptions.test_client_exception ... ok test.unit.common.test_exceptions.TestExceptions.test_replication_exception test.unit.common.test_exceptions.TestExceptions.test_replication_exception ... ok test.unit.common.test_exceptions.TestExceptions.test_replication_lock_timeout test.unit.common.test_exceptions.TestExceptions.test_replication_lock_timeout ... ok test.unit.common.test_registry.TestSwiftInfo.test_get_swift_admin_info test.unit.common.test_registry.TestSwiftInfo.test_get_swift_admin_info ... ok test.unit.common.test_registry.TestSwiftInfo.test_get_swift_admin_info_with_disallowed_sections test.unit.common.test_registry.TestSwiftInfo.test_get_swift_admin_info_with_disallowed_sections ... ok test.unit.common.test_registry.TestSwiftInfo.test_get_swift_admin_info_with_disallowed_sub_sections test.unit.common.test_registry.TestSwiftInfo.test_get_swift_admin_info_with_disallowed_sub_sections ... ok test.unit.common.test_registry.TestSwiftInfo.test_get_swift_info test.unit.common.test_registry.TestSwiftInfo.test_get_swift_info ... ok test.unit.common.test_registry.TestSwiftInfo.test_get_swift_info_with_disallowed_sections test.unit.common.test_registry.TestSwiftInfo.test_get_swift_info_with_disallowed_sections ... ok test.unit.common.test_registry.TestSwiftInfo.test_get_swift_info_with_unmatched_disallowed_sections test.unit.common.test_registry.TestSwiftInfo.test_get_swift_info_with_unmatched_disallowed_sections ... ok test.unit.common.test_registry.TestSwiftInfo.test_register_swift_admin_info test.unit.common.test_registry.TestSwiftInfo.test_register_swift_admin_info ... ok test.unit.common.test_registry.TestSwiftInfo.test_register_swift_info test.unit.common.test_registry.TestSwiftInfo.test_register_swift_info ... ok test.unit.common.test_registry.TestSwiftInfo.test_register_swift_info_import_from_utils test.unit.common.test_registry.TestSwiftInfo.test_register_swift_info_import_from_utils ... ok test.unit.common.test_statsd_client.TestStatsdClient.test_init_host test.unit.common.test_statsd_client.TestStatsdClient.test_init_host ... ok test.unit.common.test_statsd_client.TestStatsdClient.test_init_host_is_none test.unit.common.test_statsd_client.TestStatsdClient.test_init_host_is_none ... ok test.unit.common.test_statsd_client.TestStatsdClient.test_statsd_set_prefix_deprecation test.unit.common.test_statsd_client.TestStatsdClient.test_statsd_set_prefix_deprecation ... ok test.unit.common.test_swob.TestConditionalIfModifiedSince.test_absent test.unit.common.test_swob.TestConditionalIfModifiedSince.test_absent ... ok test.unit.common.test_swob.TestConditionalIfModifiedSince.test_before test.unit.common.test_swob.TestConditionalIfModifiedSince.test_before ... ok test.unit.common.test_swob.TestConditionalIfModifiedSince.test_greater test.unit.common.test_swob.TestConditionalIfModifiedSince.test_greater ... ok test.unit.common.test_swob.TestConditionalIfModifiedSince.test_out_of_range_is_ignored test.unit.common.test_swob.TestConditionalIfModifiedSince.test_out_of_range_is_ignored ... ok test.unit.common.test_swob.TestConditionalIfModifiedSince.test_same test.unit.common.test_swob.TestConditionalIfModifiedSince.test_same ... ok test.unit.common.test_swob.TestTransferEncoding.test_is_chunked test.unit.common.test_swob.TestTransferEncoding.test_is_chunked ... ok test.unit.common.test_utils.TestShardRange.test_constants test.unit.common.test_utils.TestShardRange.test_constants ... ok test.unit.common.test_utils.TestShardRange.test_copy test.unit.common.test_utils.TestShardRange.test_copy ... ok test.unit.common.test_utils.TestShardRange.test_deleted_setter test.unit.common.test_utils.TestShardRange.test_deleted_setter ... ok test.unit.common.test_utils.TestShardRange.test_epoch_setter test.unit.common.test_utils.TestShardRange.test_epoch_setter ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_gap_in_shards_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_gap_in_shards_no_memcache ... ok test.unit.common.test_utils.TestShardRange.test_find_ancestors test.unit.common.test_utils.TestShardRange.test_find_ancestors ... ok test.unit.common.test_utils.TestShardRange.test_find_root test.unit.common.test_utils.TestShardRange.test_find_root ... ok test.unit.common.test_utils.TestShardRange.test_increment_meta test.unit.common.test_utils.TestShardRange.test_increment_meta ... ok test.unit.common.test_utils.TestShardRange.test_is_child_of test.unit.common.test_utils.TestShardRange.test_is_child_of ... ok test.unit.common.test_utils.TestShardRange.test_make_path test.unit.common.test_utils.TestShardRange.test_make_path ... ok test.unit.common.test_utils.TestShardRange.test_meta_timestamp_setter test.unit.common.test_utils.TestShardRange.test_meta_timestamp_setter ... ok test.unit.common.test_utils.TestShardRange.test_min_max_bounds test.unit.common.test_utils.TestShardRange.test_min_max_bounds ... ok test.unit.common.test_utils.TestShardRange.test_name test.unit.common.test_utils.TestShardRange.test_name ... ok test.unit.common.test_utils.TestShardRange.test_name_validation test.unit.common.test_utils.TestShardRange.test_name_validation ... ok test.unit.common.test_utils.TestShardRange.test_repr test.unit.common.test_utils.TestShardRange.test_repr ... ok test.unit.common.test_utils.TestShardRange.test_resolve_state test.unit.common.test_utils.TestShardRange.test_resolve_state ... ok test.unit.common.test_utils.TestShardRange.test_row_count test.unit.common.test_utils.TestShardRange.test_row_count ... ok test.unit.common.test_utils.TestShardRange.test_set_deleted test.unit.common.test_utils.TestShardRange.test_set_deleted ... ok test.unit.common.test_utils.TestShardRange.test_shard_range_initialisation test.unit.common.test_utils.TestShardRange.test_shard_range_initialisation ... ok test.unit.common.test_utils.TestShardRange.test_sort_key test.unit.common.test_utils.TestShardRange.test_sort_key ... ok test.unit.common.test_utils.TestShardRange.test_sort_key_order test.unit.common.test_utils.TestShardRange.test_sort_key_order ... ok test.unit.common.test_utils.TestShardRange.test_state_setter test.unit.common.test_utils.TestShardRange.test_state_setter ... ok test.unit.common.test_utils.TestShardRange.test_state_timestamp_setter test.unit.common.test_utils.TestShardRange.test_state_timestamp_setter ... ok test.unit.common.test_utils.TestShardRange.test_timestamp_setter test.unit.common.test_utils.TestShardRange.test_timestamp_setter ... ok test.unit.common.test_utils.TestShardRange.test_to_from_dict test.unit.common.test_utils.TestShardRange.test_to_from_dict ... ok test.unit.common.test_utils.TestShardRange.test_update_meta test.unit.common.test_utils.TestShardRange.test_update_meta ... ok test.unit.common.test_utils.TestShardRange.test_update_state test.unit.common.test_utils.TestShardRange.test_update_state ... ok test.unit.common.test_utils.TestShardRange.test_update_tombstones test.unit.common.test_utils.TestShardRange.test_update_tombstones ... ok test.unit.common.test_utils.TestSocketStringParser.test_socket_string_parser test.unit.common.test_utils.TestSocketStringParser.test_socket_string_parser ... ok test.unit.common.test_utils.TestUtils.test_backwards test.unit.common.test_utils.TestUtils.test_backwards ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_with_version_id_but_not_enabled test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_with_version_id_but_not_enabled ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_with_write_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_with_write_permission ... ok test.unit.common.test_utils.TestUtils.test_base64_str test.unit.common.test_utils.TestUtils.test_base64_str ... ok test.unit.common.test_utils.TestUtils.test_cache_from_env test.unit.common.test_utils.TestUtils.test_cache_from_env ... ok test.unit.common.test_utils.TestUtils.test_cap_length test.unit.common.test_utils.TestUtils.test_cap_length ... ok test.unit.common.test_utils.TestUtils.test_clean_content_type test.unit.common.test_utils.TestUtils.test_clean_content_type ... ok test.unit.common.test_utils.TestUtils.test_clean_up_daemon_hygene test.unit.common.test_utils.TestUtils.test_clean_up_daemon_hygene ... ok test.unit.common.test_utils.TestUtils.test_drain_and_close test.unit.common.test_utils.TestUtils.test_drain_and_close ... ok test.unit.common.test_utils.TestUtils.test_drain_and_close_with_limit test.unit.common.test_utils.TestUtils.test_drain_and_close_with_limit ... ok test.unit.common.test_utils.TestUtils.test_drop_privileges test.unit.common.test_utils.TestUtils.test_drop_privileges ... ok test.unit.common.test_utils.TestUtils.test_drop_privileges_no_setgroups test.unit.common.test_utils.TestUtils.test_drop_privileges_no_setgroups ... ok test.unit.common.test_utils.TestUtils.test_dump_recon_cache test.unit.common.test_utils.TestUtils.test_dump_recon_cache ... ok test.unit.common.test_utils.TestUtils.test_dump_recon_cache_permission_denied test.unit.common.test_utils.TestUtils.test_dump_recon_cache_permission_denied ... ok test.unit.common.test_utils.TestUtils.test_dump_recon_cache_set_owner test.unit.common.test_utils.TestUtils.test_dump_recon_cache_set_owner ... ok test.unit.common.test_utils.TestUtils.test_extract_swift_bytes test.unit.common.test_utils.TestUtils.test_extract_swift_bytes ... ok test.unit.common.test_utils.TestUtils.test_find_namespace test.unit.common.test_utils.TestUtils.test_find_namespace ... ok test.unit.common.test_utils.TestUtils.test_friendly_close_exploding_body test.unit.common.test_utils.TestUtils.test_friendly_close_exploding_body ... ok test.unit.common.test_utils.TestUtils.test_friendly_close_large_body test.unit.common.test_utils.TestUtils.test_friendly_close_large_body ... ok test.unit.common.test_utils.TestUtils.test_friendly_close_small_body test.unit.common.test_utils.TestUtils.test_friendly_close_small_body ... ok test.unit.common.test_utils.TestUtils.test_fsync_dir test.unit.common.test_utils.TestUtils.test_fsync_dir ... ok test.unit.common.test_utils.TestUtils.test_generate_trans_id test.unit.common.test_utils.TestUtils.test_generate_trans_id ... ok test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0043 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 1287 "-" "-" "-" 0.0124 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 1274 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 633 "-" "-" "-" 0.0018 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 1287 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 1274 "-" "-" "-" 0.0109 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 633 "-" "-" "-" 0.0068 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0144 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0061 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 400 9 "-" "-" "-" 0.0012 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 412 22 "-" "-" "-" 0.0001 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 507 - "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:05 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0105 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0059 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/.shards_a/c_f" 201 - "-" "-" "-" 0.0080 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/.shards_a/c_f" 202 - "-" "-" "-" 0.0099 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0209 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0078 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0151 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0098 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0069 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0095 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0041 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0166 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0219 "-" 1824541 2 test DEBUG: Unlinked retiring db '/tmp/tmpae2qkj8z/tmp_test_container_server_ContainerController/sda1/containers/p/189/b0d72ea4144f5f4c7f596aa4fe1f3189/b0d72ea4144f5f4c7f596aa4fe1f3189.db' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0157 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0059 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0142 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0104 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 2662 "-" "-" "-" 0.0091 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 2662 "-" "-" "-" 0.0046 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 1332 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 2662 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0097 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 2662 "-" "-" "-" 0.0044 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0101 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0099 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0033 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0139 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0102 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0062 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0107 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0024 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0076 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0035 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0097 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0060 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0076 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0051 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0025 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 53 "-" "-" "-" 0.0072 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf'test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_override_deleted_for_shard_ranges test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_override_deleted_for_shard_ranges ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_override_deleted_for_shard_ranges_db_unlinked test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_override_deleted_for_shard_ranges_db_unlinked ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_override_deleted_ignored_for_objects test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_with_override_deleted_ignored_for_objects ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_xml test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_GET_xml ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_has_content_length test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_has_content_length ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_accept test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_accept ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_content_type test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_content_type ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_format test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_format ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_partition test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_invalid_partition ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_not_found test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_not_found ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_timestamp_with_offset test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_HEAD_timestamp_with_offset ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_OPTIONS test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_OPTIONS ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_metadata test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_metadata ... ok test.unit.common.test_utils.TestUtils.test_get_db_files test.unit.common.test_utils.TestUtils.test_get_db_files ... ok test.unit.common.test_utils.TestUtils.test_get_my_ppid test.unit.common.test_utils.TestUtils.test_get_my_ppid ... ok test.unit.common.test_utils.TestUtils.test_get_partition_for_hash test.unit.common.test_utils.TestUtils.test_get_partition_for_hash ... ok test.unit.common.test_utils.TestUtils.test_get_partition_from_path test.unit.common.test_utils.TestUtils.test_get_partition_from_path ... ok test.unit.common.test_utils.TestUtils.test_get_redirect_data test.unit.common.test_utils.TestUtils.test_get_redirect_data ... ok test.unit.common.test_utils.TestUtils.test_get_trans_id_time test.unit.common.test_utils.TestUtils.test_get_trans_id_time ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Start tag expected, '<' not found, line 1, column 1 (, line 1) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Using identity: {'user': ('42', 'usr'), 'tenant': ('1', 'acct'), 'roles': ['admin'], 'service_roles': [], 'user_domain': (None, None), 'project_domain': (None, None), 'auth_version': 0} test DEBUG: tenant mismatch: AUTH_acct != 1 test DEBUG: Using identity: {'user': (None, None), 'tenant': (None, None), 'roles': [], 'service_roles': [], 'user_domain': (None, None), 'project_domain': (None, None), 'auth_version': 0} test DEBUG: tenant mismatch: AUTH_foo != None test DEBUG: Using identity: {'user': (None, None), 'tenant': (None, None), 'roles': [], 'service_roles': [], 'user_domain': (None, None), 'project_domain': (None, None), 'auth_version': 0} test DEBUG: tenant mismatch: AUTH_foo != None test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Authorizing as anonymous test DEBUG: Authorizing from an overriding middleware test ERROR: ERROR Could not get container info /tmp/tmp8cvgfsru/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test ERROR: ERROR Could not get container info /tmp/tmp8cvgfsru/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test ERROR: ERROR Could not get container info /tmp/tmpy8hk1j3l/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test INFO: Since Thu Jan 1 14:00:00 1970: container audits: 0 passed audit, 1 failed audit test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test ERROR: ERROR Could not get container info /tmp/tmpy8hk1j3l/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test INFO: Begin container audit pass. test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test INFO: Container audit pass completed: 0.02s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon'test.unit.common.test_db_auditor.TestAuditor.test_run_forever test.unit.common.test_db_auditor.TestAuditor.test_run_forever ... ok test.unit.common.test_utils.TestUtils.test_get_valid_utf8_str test.unit.common.test_utils.TestUtils.test_get_valid_utf8_str ... ok test.unit.common.test_utils.TestUtils.test_get_zero_indexed_base_string test.unit.common.test_utils.TestUtils.test_get_zero_indexed_base_string ... ok test.unit.common.test_utils.TestUtils.test_hash_path test.unit.common.test_utils.TestUtils.test_hash_path ... ok test.unit.common.test_utils.TestUtils.test_human_readable test.unit.common.test_utils.TestUtils.test_human_readable ... ok test.unit.common.test_utils.TestUtils.test_is_file_older test.unit.common.test_utils.TestUtils.test_is_file_older ... ok test.unit.common.test_utils.TestUtils.test_ismount_parent_path_error test.unit.common.test_utils.TestUtils.test_ismount_parent_path_error ... ok test.unit.common.test_utils.TestUtils.test_ismount_path_does_not_exist test.unit.common.test_utils.TestUtils.test_ismount_path_does_not_exist ... ok test.unit.common.test_utils.TestUtils.test_ismount_path_error test.unit.common.test_utils.TestUtils.test_ismount_path_error ... ok test.unit.common.test_utils.TestUtils.test_ismount_path_is_root test.unit.common.test_utils.TestUtils.test_ismount_path_is_root ... ok test.unit.common.test_utils.TestUtils.test_ismount_path_is_symlink test.unit.common.test_utils.TestUtils.test_ismount_path_is_symlink ... ok test.unit.common.test_utils.TestUtils.test_ismount_path_not_mount test.unit.common.test_utils.TestUtils.test_ismount_path_not_mount ... ok test.unit.common.test_utils.TestUtils.test_ismount_raw_parent_path_error test.unit.common.test_utils.TestUtils.test_ismount_raw_parent_path_error ... ok test.unit.common.test_utils.TestUtils.test_ismount_raw_path_error test.unit.common.test_utils.TestUtils.test_ismount_raw_path_error ... ok test.unit.common.test_utils.TestUtils.test_ismount_successes_dev test.unit.common.test_utils.TestUtils.test_ismount_successes_dev ... ok test.unit.common.test_utils.TestUtils.test_ismount_successes_ino test.unit.common.test_utils.TestUtils.test_ismount_successes_ino ... ok test.unit.common.test_utils.TestUtils.test_ismount_successes_stubfile test.unit.common.test_utils.TestUtils.test_ismount_successes_stubfile ... ok test.unit.common.test_utils.TestUtils.test_last_modified_date_to_timestamp test.unit.common.test_utils.TestUtils.test_last_modified_date_to_timestamp ... ok test.unit.common.test_utils.TestUtils.test_last_modified_date_to_timestamp_when_system_not_UTC test.unit.common.test_utils.TestUtils.test_last_modified_date_to_timestamp_when_system_not_UTC ... ok test.unit.common.test_utils.TestUtils.test_link_fd_to_path_errno_not_EEXIST_or_ENOENT test.unit.common.test_utils.TestUtils.test_link_fd_to_path_errno_not_EEXIST_or_ENOENT ... ok test.unit.common.test_utils.TestUtils.test_link_fd_to_path_linkat_success test.unit.common.test_utils.TestUtils.test_link_fd_to_path_linkat_success ... ok test.unit.common.test_utils.TestUtils.test_link_fd_to_path_runs_out_of_retries test.unit.common.test_utils.TestUtils.test_link_fd_to_path_runs_out_of_retries ... ok test.unit.common.test_utils.TestUtils.test_link_fd_to_path_target_exists test.unit.common.test_utils.TestUtils.test_link_fd_to_path_target_exists ... ok test.unit.common.test_utils.TestUtils.test_linkat_race_dir_not_exists test.unit.common.test_utils.TestUtils.test_linkat_race_dir_not_exists ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=0-3', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_Range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_Range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_Range_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_Range_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: FORCED_TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "acc\u00e9ss", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: {"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}} test DEBUG: Error on keystone reply: 201 {"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}} - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: {"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}} test DEBUG: Error on keystone reply: 201 {"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}} - rejecting request test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Not a path query: /, skipping. test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: No authorization details from s3api. skipping. test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test INFO: Caching s3tokens for 20 seconds test DEBUG: Calling S3Token middleware. test DEBUG: Cached creds valid test DEBUG: Connecting with tenant: tenant_id test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test INFO: Caching s3tokens for 20 seconds test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}'test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_secret_sets_cache test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_secret_sets_cache ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_tolerate_missing_token_id test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_tolerate_missing_token_id ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_unicode_path test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_unicode_path ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_without_auth_storage_token test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_without_auth_storage_token ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_without_authorization test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestGood.test_without_authorization ... ok test.unit.common.middleware.test_copy.TestServerSideCopyHeartbeat.test_copy_with_heartbeat_failure test.unit.common.middleware.test_copy.TestServerSideCopyHeartbeat.test_copy_with_heartbeat_failure ... ok test DEBUG: Skipping the update of recently changed /tmp/tmplzvjmj4_/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 1, Total files/sec: 563.30, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.33 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test DEBUG: Rsync tempfile: /tmp/tmpw7i9tkwq/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/.1757769844.48624.data.9ILVBL test DEBUG: 0 audit watcher(s) loaded test DEBUG: Rsync tempfile: /tmp/tmpw7i9tkwq/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/.1757769844.48624.data.9ILVBL test DEBUG: Rsync tempfile: /tmp/tmpw7i9tkwq/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/.1757769844.48624.data.9ILVBL test WARNING: Unexpected file /tmp/tmpw7i9tkwq/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/.random.crazy.file: Invalid Timestamp value in filename '.random.crazy.file' test DEBUG: Run listdir on /tmp/tmpwqqs_a1v/tmp_test_object_auditor/node/sda/objects/0 test DEBUG: Run listdir on /tmp/tmpbvnulz2k/tmp_test_object_auditor/node/sda/objects/0 test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test WARNING: Quarantined object /tmp/tmpxw2oe2ck/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef/1757769844.63346#1#d.data: Invalid EC metadata at offset 0x850 test ERROR: ERROR Object /tmp/tmpxw2oe2ck/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef failed audit and was quarantined: Invalid EC metadata at offset 0x850 test DEBUG: 0 audit watcher(s) loaded test WARNING: Quarantined object /tmp/tmpxw2oe2ck/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef/1757769844.65901#1#d.data: Invalid EC metadata at offset 0x10a0 test ERROR: ERROR Object /tmp/tmpxw2oe2ck/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef failed audit and was quarantined: Invalid EC metadata at offset 0x10a0 test DEBUG: 0 audit watcher(s) loaded test WARNING: Quarantined object /tmp/tmpxw2oe2ck/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef/1757769844.68701#1#d.data: Invalid EC metadata at offset 0x0 test ERROR: ERROR Object /tmp/tmpxw2oe2ck/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef failed audit and was quarantined: Invalid EC metadata at offset 0x0 test DEBUG: 0 audit watcher(s) loaded test WARNING: Quarantined object /tmp/tmpbum2ggit/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769844.70203.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 9d0ef2e3d00a0793bd4c5f31b8ad9e8a do not match test ERROR: ERROR Object /tmp/tmpbum2ggit/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099 failed audit and was quarantined: ETag 92ffae115f60c288e713127114be5091 and file's md5 9d0ef2e3d00a0793bd4c5f31b8ad9e8a do not match test DEBUG: 0 audit watcher(s) loaded test WARNING: Quarantined object /tmp/tmp9d1of6cj/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769844.72841.data: metadata content-length 1024 does not match actual object size 1034 test ERROR: ERROR Object /tmp/tmp9d1of6cj/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099 failed audit and was quarantined: metadata content-length 1024 does not match actual object size 1034 test DEBUG: 0 audit watcher(s) loaded test WARNING: Quarantined object /tmp/tmp9d1of6cj/tmp_test_object_auditor/node/sda/objects-1/0/afa/f0f82cb05e7789e626b96765bf243afa/1757769844.73171.data: metadata content-length 1024 does not match actual object size 1034 test ERROR: ERROR Object /tmp/tmp9d1of6cj/tmp_test_object_auditor/node/sda/objects-1/0/afa/f0f82cb05e7789e626b96765bf243afa failed audit and was quarantined: metadata content-length 1024 does not match actual object size 1034 test DEBUG: 0 audit watcher(s) loaded test WARNING: Quarantined object /tmp/tmp9d1of6cj/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef/1757769844.73811#1#d.data: metadata content-length 592 does not match actual object size 602 test ERROR: ERROR Object /tmp/tmp9d1of6cj/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef failed audit and was quarantined: metadata content-length 592 does not match actual object size 602 test DEBUG: 0 audit watcher(s) loaded test WARNING: Quarantined object /tmp/tmpfqxcxj3r/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769844.74625.data: Exception reading metadata: Ran out of input test ERROR: ERROR Object /tmp/tmpfqxcxj3r/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099 failed audit and was quarantined: Exception reading metadata: Ran out of input test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL - parallel, sda) test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test INFO: Object audit (ALL - parallel, sda) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 0.00, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.00 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ZBF - sda) test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpo4x0l7dy/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test INFO: Object audit (ZBF - sda) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 0.00, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.00test.unit.obj.test_auditor.TestAuditor.test_object_run_logging test.unit.obj.test_auditor.TestAuditor.test_object_run_logging ... ok test.unit.obj.test_auditor.TestAuditor.test_object_run_once_multi_devices test.unit.obj.test_auditor.TestAuditor.test_object_run_once_multi_devices ... ok test.unit.obj.test_auditor.TestAuditor.test_object_run_once_no_sda test.unit.obj.test_auditor.TestAuditor.test_object_run_once_no_sda ... ok test DEBUG: Updating recon for sda1 test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:05 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp07gfa7zo/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp07gfa7zo/node/sda1/objects/115/81c/7353c0705544ab7678918c65dd0a181c/1757769845.90912.data to /tmp/tmp07gfa7zo/node/sda1/objects/230/81c/7353c0705544ab7678918c65dd0a181c/1757769845.90912.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:05 09/13/25 GMT (0:00:00.002993 elapsed) test INFO: Starting relinker (cleanup=True) using 1 workers: 13:24:05 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp07gfa7zo/node/sda1 (cleanup=True) test DEBUG: Run listdir on /tmp/tmp07gfa7zo/node/sda1/objects/230 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Removed /tmp/tmp07gfa7zo/node/sda1/objects/115/81c/7353c0705544ab7678918c65dd0a181c/1757769845.90912.data test DEBUG: Run listdir on /tmp/tmp07gfa7zo/node/sda1/objects/115 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=True) (1 files, 0 linked, 1 removed, 0 errors) test INFO: Finished relinker (cleanup=True): 13:24:05 09/13/25 GMT (0:00:00.014567 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test DEBUG: Updating recon test WARNING: No policy found to increase the partition power. test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.002718 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test DEBUG: Updating recon test INFO: 0 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.015319 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test DEBUG: Updating recon test WARNING: No policy found to increase the partition power. test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.012617 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test DEBUG: Updating recon test INFO: 0 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.015330 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test DEBUG: Updating recon test INFO: 0 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.015562 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test DEBUG: Updating recon test WARNING: No policy found to increase the partition power. test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.012157 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test DEBUG: Updating recon test WARNING: No policy found to increase the partition power. test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.017536 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test DEBUG: Updating recon test WARNING: No policy found to increase the partition power. test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.015985 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpl6ez2_q1/node/sda1 (cleanup=False) test DEBUG: Relinking: tolerating different inodes for tombstone with same timestamp: /tmp/tmpl6ez2_q1/node/sda1/objects/232/53b/e8584f874669c5638132a012bda4a53b/1757769846.38943.ts to /tmp/tmpl6ez2_q1/node/sda1/objects/464/53b/e8584f874669c5638132a012bda4a53b/1757769846.38943.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/3 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/3 test DEBUG: Relinking: tolerating different inodes for tombstone with same timestamp: /tmp/tmpl6ez2_q1/node/sda1/objects/58/53b/e8584f874669c5638132a012bda4a53b/1757769846.38943.ts to /tmp/tmpl6ez2_q1/node/sda1/objects/464/53b/e8584f874669c5638132a012bda4a53b/1757769846.38943.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 3/3 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 3 hash dirs processed (cleanup=False) (3 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.015845 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpleidzqqf/node/sda1 (cleanup=False) test DEBUG: Relinking: tolerating different inodes for tombstone with same timestamp: /tmp/tmpleidzqqf/node/sda1/objects/182/504/b6e61889af6b205514798a9e8b4f6504/1757769846.47967.ts to /tmp/tmpleidzqqf/node/sda1/objects/365/504/b6e61889af6b205514798a9e8b4f6504/1757769846.47967.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.011144 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpxyefv260/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking: tolerating different inodes for tombstone with same timestamp: /tmp/tmpxyefv260/node/sda1/objects/90/656/b42009a08f83e2150ae066196841b656/1757769846.55991.ts to /tmp/tmpxyefv260/node/sda1/objects/360/656/b42009a08f83e2150ae066196841b656/1757769846.55991.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 2 hash dirs processed (cleanup=False) (2 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.010622 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmph8nadeyl/node/sda1 (cleanup=False) test DEBUG: Relinking: tolerating different inodes for tombstone with same timestamp: /tmp/tmph8nadeyl/node/sda1/objects/172/6b9/acc01c5390931f913e35a757ed6636b9/1757769846.64348.ts to /tmp/tmph8nadeyl/node/sda1/objects/345/6b9/acc01c5390931f913e35a757ed6636b9/1757769846.64348.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 2 hash dirs processed (cleanup=False) (2 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.012692 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpthy2f2et/node/sda1 (cleanup=False) test DEBUG: Relinking: tolerating different inodes for tombstone with same timestamp: /tmp/tmpthy2f2et/node/sda1/objects/226/cb9/e2bff5424fd9ac3999a16c00c20cbcb9/1757769846.70766.ts to /tmp/tmpthy2f2et/node/sda1/objects/453/cb9/e2bff5424fd9ac3999a16c00c20cbcb9/1757769846.70766.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 2 hash dirs processed (cleanup=False) (2 files, 0 linked, 0 removed, 0 errors)test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_is_linked_to_part_power_minus_2_err test.unit.cli.test_relinker.TestRelinker.test_relink_conflicting_ts_is_linked_to_part_power_minus_2_err ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_data_meta_files test.unit.cli.test_relinker.TestRelinker.test_relink_data_data_meta_files ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_existing_meta_files test.unit.cli.test_relinker.TestRelinker.test_relink_data_existing_meta_files ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_existing_older_data_files_no_cleanup test.unit.cli.test_relinker.TestRelinker.test_relink_data_existing_older_data_files_no_cleanup ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_existing_older_meta_files test.unit.cli.test_relinker.TestRelinker.test_relink_data_existing_older_meta_files ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_file test.unit.cli.test_relinker.TestRelinker.test_relink_data_file ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_existing_newer_data_files test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_existing_newer_data_files ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_existing_newer_ts_files test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_existing_newer_ts_files ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_existing_ts_files test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_existing_ts_files ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_files test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_files ... ok test DEBUG: user tenant_name:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:* allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_name allowed in ACL: allowme authorizing test DEBUG: Names allowed in acls. test DEBUG: user *:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user *:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user *:* allowed in ACL authorizing. test DEBUG: User tenant_name:user_name is not allowed to delete its own account test DEBUG: User tenant_id has reseller admin authorizing test DEBUG: Using identity: {'user': ('user_id', 'user_name'), 'tenant': ('test', 'tenant_name'), 'roles': ['reselleradmin'], 'service_roles': [], 'user_domain': (None, None), 'project_domain': (None, None), 'auth_version': 0} test DEBUG: User test has reseller admin authorizing test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_name:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_name allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: user tenant_id:user_id allowed in ACL authorizing. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. test DEBUG: Names allowed in acls. Sun Sep 14 03:24:06 2025 /tmp/tmpvask6x47/log/swift/profile/default.profile1824522 Sun Sep 14 03:24:06 2025 /tmp/tmpvask6x47/log/swift/profile/default.profile123 Sun Sep 14 03:24:06 2025 /tmp/tmpvask6x47/log/swift/profile/default.profile456 45 function calls in 0.001 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 9 0.001 0.000 0.001 0.000 profile:0(import os;os.getcwd();) 9 0.000 0.000 0.000 0.000 :0(exec) 9 0.000 0.000 0.000 0.000 :0(getcwd) 9 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 9 0.000 0.000 0.000 0.000 :0(setprofile) test ERROR: ERROR: swift.cache could not be found in env! test ERROR: ERROR: swift.cache could not be found in env! test WARNING: Unable to perform fsync() on directory /tmp/tmpnfmrjezz: Bad file descriptor Unable to locate some_not_real_function in libc. Leaving as a no-op. test.unit.common.test_utils.TestUtils.test_load_libc_function test.unit.common.test_utils.TestUtils.test_load_libc_function ... ok test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0155 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0082 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0059 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0052 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0072 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0082 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:05 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0003 "-" 1824541 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0195 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0105 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/xmlc" 201 - "-" "-" "-" 0.0159 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/xmlc/0" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/xmlc/1" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/xmlc/2" 201 - "-" "-" "-" 0.0087 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0118 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0013 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0144 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0110 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0144 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0022 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0103 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0155 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0133 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0021 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0156 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 400 21 "-" "-" "-" 0.0080 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 406 - "-" "-" "-" 0.0003 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 400 34 "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/./a/c" 400 20 "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 404 - "-" "-" "-" 0.0003 "-" 1824541 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0114 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0143 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0297 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0140 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0102 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0076 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0236 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0097 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0133 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0014 "-" 1824541 -test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_no_timestamp_update test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_no_timestamp_update ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_sys_metadata test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_HEAD_sys_metadata ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_huge_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_huge_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_invalid_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_invalid_part_num ... ok test.unit.common.test_utils.TestUtils.test_load_pkg_resource test.unit.common.test_utils.TestUtils.test_load_pkg_resource ... skipped 'pkg_resources loading is only available on python 3.7 and earlier' test.unit.common.test_utils.TestUtils.test_load_recon_cache test.unit.common.test_utils.TestUtils.test_load_recon_cache ... ok test.unit.common.test_utils.TestUtils.test_lock_file test.unit.common.test_utils.TestUtils.test_lock_file ... ok test.unit.common.test_utils.TestUtils.test_lock_file_held_on_unlink test.unit.common.test_utils.TestUtils.test_lock_file_held_on_unlink ... ok test.unit.common.test_utils.TestUtils.test_lock_file_no_unlink_if_fail test.unit.common.test_utils.TestUtils.test_lock_file_no_unlink_if_fail ... ok test.unit.common.test_utils.TestUtils.test_lock_file_unlinked_after_open test.unit.common.test_utils.TestUtils.test_lock_file_unlinked_after_open ... ok test.unit.common.test_utils.TestUtils.test_lock_path test.unit.common.test_utils.TestUtils.test_lock_path ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_after_DELETE_not_found test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_after_DELETE_not_found ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_ignores_policy_change test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_ignores_policy_change ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_insufficient_space test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_insufficient_space ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_invalid_container_sync_to test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_invalid_container_sync_to ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_invalid_partition test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_invalid_partition ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_reset_container_sync test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_reset_container_sync ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_ts_files test.unit.cli.test_relinker.TestRelinker.test_relink_data_meta_ts_files ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_timestamp_not_float test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_POST_timestamp_not_float ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_metadata test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_metadata ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_object_timing_metrics test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_object_timing_metrics ... ok test INFO: Begin container audit pass. test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test ERROR: ERROR Could not get container info /tmp/tmp1zzd8b20/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR auditing: Timeout (Nones) test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR auditing: Timeout (Nones) test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR auditing: Timeout (Nones) test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR auditing: Timeout (Nones) test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR auditing: Timeout (Nones) test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR auditing: Timeout (Nones) test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit pass. test ERROR: ERROR auditing: Timeout (Nones) test INFO: Container audit pass completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container audit "once" mode test ERROR: ERROR Could not get container info /tmp/tmp_318r5gp/tmp_test_database_auditor/fail2.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueErrortest.unit.common.test_db_auditor.TestAuditor.test_run_once test.unit.common.test_db_auditor.TestAuditor.test_run_once ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_disabled test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_disabled ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_dogstatsd test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_dogstatsd ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_dogstatsd_no_labels test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_dogstatsd_no_labels ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_dogstatsd_sample_rate test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_dogstatsd_sample_rate ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_graphite test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_graphite ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_graphite_no_labels test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_graphite_no_labels ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_graphite_sample_rate test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_graphite_sample_rate ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_influxdb test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_influxdb ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_influxdb_no_labels test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_influxdb_no_labels ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_maxuploads ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_maxuploads_over_default test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_maxuploads_over_default ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPswift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_Response test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_Response ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.test_utils.TestUtils.test_lock_path_class test.unit.common.test_utils.TestUtils.test_lock_path_class ... ok test.unit.common.test_utils.TestUtils.test_lock_path_invalid_limit test.unit.common.test_utils.TestUtils.test_lock_path_invalid_limit ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:01 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_out_of_range_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_out_of_range_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_zero_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_GET_zero_part_num ... ok test.unit.common.test_utils.TestUtils.test_lock_path_name test.unit.common.test_utils.TestUtils.test_lock_path_name ... ok test.unit.common.test_utils.TestUtils.test_lock_path_num_sleeps test.unit.common.test_utils.TestUtils.test_lock_path_num_sleeps ... ok test.unit.common.test_utils.TestUtils.test_majority_size test.unit.common.test_utils.TestUtils.test_majority_size ... ok test.unit.common.test_utils.TestUtils.test_make_db_file_path test.unit.common.test_utils.TestUtils.test_make_db_file_path ... ok test.unit.common.test_utils.TestUtils.test_makedirs_count test.unit.common.test_utils.TestUtils.test_makedirs_count ... ok test.unit.common.test_utils.TestUtils.test_md5_with_data test.unit.common.test_utils.TestUtils.test_md5_with_data ... ok test.unit.common.test_utils.TestUtils.test_md5_without_data test.unit.common.test_utils.TestUtils.test_md5_without_data ... ok test.unit.common.test_utils.TestUtils.test_mkdirs test.unit.common.test_utils.TestUtils.test_mkdirs ... ok test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0093 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0032 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0177 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0016 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0089 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0016 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0010 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0031 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0024 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c/" 404 - "-" "-" "-" 0.0008 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0112 "-" 1824541 4 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824541 4 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0132 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824541 4 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0114 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824541 4 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824541 4 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0013 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824541 4 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/./a/c" 400 20 "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0155 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0120 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0187 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 400 26 "-" "-" "-" 0.0001 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0241 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0108 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0100 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0193 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0100 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0100 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0020 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0137 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0122 "-" 1824541 2 test INFO: - - - [01/Jan/1970:00:16:40 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" - "-" 1824541 2 test INFO: - - - [01/Jan/1970:00:16:40 +0000] "GET /sda1/p/a/c" 200 117 "-" "-" "-" - "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0157 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c/obj_0" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c/obj_1" 201 - "-" "-" "-" 0.0081 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0129 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0122 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 200 1683 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 200 1683 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:06 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 332 "-" "-" "-" 0.0135 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 340 "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 676 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 330 "-" "-" "-" 0.0096 "-" 1824541 2test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_shard_ranges test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_shard_ranges ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_influxdb_sample_rate test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_influxdb_sample_rate ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_librato test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_librato ... ok test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.007502 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpdjg56w47/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpdjg56w47/node/sda1/objects/61/803/3df33a227948ff03ff4bf869592c8803/1757769848.76049.meta to /tmp/tmpdjg56w47/node/sda1/objects/123/803/3df33a227948ff03ff4bf869592c8803/1757769848.76049.meta test DEBUG: Relinking created link: /tmp/tmpdjg56w47/node/sda1/objects/61/803/3df33a227948ff03ff4bf869592c8803/1757769847.76049.data to /tmp/tmpdjg56w47/node/sda1/objects/123/803/3df33a227948ff03ff4bf869592c8803/1757769847.76049.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (2 files, 2 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.003333 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp62_njwlt/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking created link: /tmp/tmp62_njwlt/node/sda1/objects/97/d67/61271c168c963acbe2463c9c8a3a2d67/1757769846.83568.data to /tmp/tmp62_njwlt/node/sda1/objects/194/d67/61271c168c963acbe2463c9c8a3a2d67/1757769846.83568.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (2 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.007439 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpafjzwe35/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking created link: /tmp/tmpafjzwe35/node/sda1/objects/65/5b6/417bd7223e98f73be0d937d27fffd5b6/1757769847.89250.data to /tmp/tmpafjzwe35/node/sda1/objects/130/5b6/417bd7223e98f73be0d937d27fffd5b6/1757769847.89250.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.007388 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:06 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpmblwtrca/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking created link: /tmp/tmpmblwtrca/node/sda1/objects/55/158/37d16eb3c49cb4868df67005e4234158/1757769848.95341.meta to /tmp/tmpmblwtrca/node/sda1/objects/111/158/37d16eb3c49cb4868df67005e4234158/1757769848.95341.meta test DEBUG: Relinking created link: /tmp/tmpmblwtrca/node/sda1/objects/55/158/37d16eb3c49cb4868df67005e4234158/1757769846.95341.data to /tmp/tmpmblwtrca/node/sda1/objects/111/158/37d16eb3c49cb4868df67005e4234158/1757769846.95341.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (2 files, 2 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:06 09/13/25 GMT (0:00:00.011669 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:07 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp_bfah9a0/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp_bfah9a0/node/sda1/objects/96/4a6/609a32deaa62187f0b96aaee13b5b4a6/1757769847.05733.data to /tmp/tmp_bfah9a0/node/sda1/objects/193/4a6/609a32deaa62187f0b96aaee13b5b4a6/1757769847.05733.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:07 09/13/25 GMT (0:00:00.002937 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:07 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpphar9np9/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking created link: /tmp/tmpphar9np9/node/sda1/objects/55/1ad/3785ba38da0ca02e86d40c25149781ad/1757769849.13814.meta to /tmp/tmpphar9np9/node/sda1/objects/111/1ad/3785ba38da0ca02e86d40c25149781ad/1757769849.13814.meta test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:07 09/13/25 GMT (0:00:00.003383 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:07 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp0u8p2ez4/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:07 09/13/25 GMT (0:00:00.003132 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:07 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmplk1o8e48/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:07 09/13/25 GMT (0:00:00.015448 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:07 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp4i6arks3/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp4i6arks3/node/sda1/objects/18/8c6/127866232b1fbf7ea26f3b5231f588c6/1757769847.46796.data to /tmp/tmp4i6arks3/node/sda1/objects/36/8c6/127866232b1fbf7ea26f3b5231f588c6/1757769847.46796.data test DEBUG: Relinking created link: /tmp/tmp4i6arks3/node/sda1/objects/18/8c6/127866232b1fbf7ea26f3b5231f588c6/1757769848.46796.meta to /tmp/tmp4i6arks3/node/sda1/objects/36/8c6/127866232b1fbf7ea26f3b5231f588c6/1757769848.46796.meta test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (2 files, 2 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:07 09/13/25 GMT (0:00:00.019359 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:07 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpmrqt46z1/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpmrqt46z1/node/sda1/objects/117/13c/75fb04145ed768416001db8d406ad13c/1757769849.57264.ts to /tmp/tmpmrqt46z1/node/sda1/objects/235/13c/75fb04145ed768416001db8d406ad13c/1757769849.57264.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:07 09/13/25 GMT (0:00:00.003165 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:07 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpe7hakaau/node/sda1 (cleanup=False)test.unit.cli.test_relinker.TestRelinker.test_relink_data_ts_meta_files test.unit.cli.test_relinker.TestRelinker.test_relink_data_ts_meta_files ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_librato_no_labels test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_librato_no_labels ... ok test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 330 "-" "-" "-" 0.0099 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 670 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 670 "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0018 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1021 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1021 "-" "-" "-" 0.0140 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1323 "-" "-" "-" 0.0084 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1323 "-" "-" "-" 0.0055 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 657 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 657 "-" "-" "-" 0.0083 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1339 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1339 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 318 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 318 "-" "-" "-" 0.0178 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 324 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 324 "-" "-" "-" 0.0138 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 340 "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 340 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0100 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1353 "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1017 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0101 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1017 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0061 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 677 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0177 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 677 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1351 "-" "-" "-" 0.0179 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0143 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1353 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1017 "-" "-" "-" 0.0095 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1017 "-" "-" "-" 0.0138 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 677 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1351 "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 677 "-" "-" "-" 0.0141 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 676 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 676 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1021 "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1021 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 685 "-" "-" "-" 0.0100 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 685 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0095 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0013 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0115 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0018 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0255 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0185 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0224 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0183 "-" 1824541 2 test DEBUG: Unlinked retiring db '/tmp/tmpb1lvh0te/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0020 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0265 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1337 "-" "-" "-" 0.0139 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1353 "-" "-" "-" 0.0262 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 1347 "-" "-" "-" 0.0296 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 340 "-" "-" "-" 0.0265 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0180 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0179 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c/" 200 1017 "-" "-" "-" 0.0138 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c/" 200 330 "-" "-" "-" 0.0020 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c/" 200 330 "-" "-" "-" 0.0178 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c/" 200 1017 "-" "-" "-" 0.0020 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf'test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_shards_timing_metrics test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_shards_timing_metrics ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_sys_metadata test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_sys_metadata ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_to_sharding_container test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_GET_to_sharding_container ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:02 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_huge_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_huge_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_invalid_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_invalid_part_num ... ok test DEBUG: Relinking created link: /tmp/tmpe7hakaau/node/sda1/objects/52/c96/346f263f219e2720f60f4df83cfe5c96/1757769848.67818.ts to /tmp/tmpe7hakaau/node/sda1/objects/104/c96/346f263f219e2720f60f4df83cfe5c96/1757769848.67818.ts test DEBUG: Relinking created link: /tmp/tmpe7hakaau/node/sda1/objects/52/c96/346f263f219e2720f60f4df83cfe5c96/1757769849.67818.meta to /tmp/tmpe7hakaau/node/sda1/objects/104/c96/346f263f219e2720f60f4df83cfe5c96/1757769849.67818.meta test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (2 files, 2 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:07 09/13/25 GMT (0:00:00.015472 elapsed) Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_relink_device_filter test.unit.cli.test_relinker.TestRelinker.test_relink_device_filter ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_HEAD_put_timestamp_updates test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_HEAD_put_timestamp_updates ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx3bfe3d47db0241419cc22-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx3bfe3d47db0241419cc22-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd18185d04f6d4987af345-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx02528f4bba68477d96ace-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx975ab89fa30e42f1abf52-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx975ab89fa30e42f1abf52-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx2efff8214ffe481f996b4-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "txa1b9ace72fe64b74b7643-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 412 - "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx5ad46339228149e6a1840-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 412 - "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx5ad46339228149e6a1840-0068c57073" "proxy-server 1824514" 0.0089 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx5ad46339228149e6a1840-0068c57073) proxy DEBUG: Ignoring 412 from primary (txn: tx5ad46339228149e6a1840-0068c57073) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 412 - "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx5ad46339228149e6a1840-0068c57073" "proxy-server 1824514" 0.0089 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx5ad46339228149e6a1840-0068c57073) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx3e1d5932d582498d99006-0068c57073" "proxy-server 1824514" 0.0093 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "txaf438a57590c4fd09bd2b-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 304 - "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx05627202ed5b472e93116-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 304 - "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx05627202ed5b472e93116-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 304 - "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx05627202ed5b472e93116-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txda4dfc9e6198491ea6fe3-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx7d4d008969354b4f84f1a-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 304 - "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "txfeaa3b18e3bd49b98543a-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 304 - "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "txfeaa3b18e3bd49b98543a-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 304 - "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "txfeaa3b18e3bd49b98543a-0068c57073" "proxy-server 1824514" 0.0158 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx92e6d63435634a218e68d-0068c57073" "proxy-server 1824514" 0.0051 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx139c8715af3e444f952d6-0068c57073" "proxy-server 1824514" 0.0095 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx23f5ed6f75b64e899be5e-0068c57073" "proxy-server 1824514" 0.0031 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "GET /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "GET http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx23f5ed6f75b64e899be5e-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txce09f515749142a1bb356-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx77fef81b596b4f4fa9ef6-0068c57073" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx32e35f8fc23e4ae5aab49-0068c57073" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx687b91861968481db4840-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "txde8b8519713b44eb8284e-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx6aeefcbeb603470094d6d-0068c57073" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txccc01faeee9b462496624-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx4366973dbeba473e87365-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 412 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "txe00394081ce343629cb57-0068c57073" "proxy-server 1824514" 0.0006 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 412 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "txe00394081ce343629cb57-0068c57073" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdh1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 412 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "txe00394081ce343629cb57-0068c57073" "proxy-server 1824514" 0.0047 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txe82fbbaa7e6b4b44b3bcd-0068c57073" "proxy-server 1824514" 0.0055 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx3bb84273096a4ba19408d-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 304 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx325ce4d7e8d146ebac120-0068c57073" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfef860e199464c269ee32-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "txa99a2a7e1cb1456982603-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdg1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 304 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx658297fe6ab744ff85054-0068c57073" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx93be9459ff8f47d7b98bb-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/3/a/b4eabb9f7a4848e2acfdd5849e59c5a0" 204 - "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0" "tx7ede27e8ddc042a885dec-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdi1/2/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" 200 92 "HEAD http://localhost:8080/v1/a/b4eabb9f7a4848e2acfdd5849e59c5a0/o" "tx1731dc70b87c492e9a914-0068c57073" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txccd4b84c92784998a18ea-0068c57073" "proxy-server 1824514" 0.0012 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/1/a/de2b0190d436461586c3f8888098af7b" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/de2b0190d436461586c3f8888098af7b" "txccd4b84c92784998a18ea-0068c57073" "container-server 1824514" 0.0093 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sdb1/1/a/de2b0190d436461586c3f8888098af7b" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/de2b0190d436461586c3f8888098af7b" "txccd4b84c92784998a18ea-0068c57073" "container-server 1824514" 0.0011 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/0/a/de2b0190d436461586c3f8888098af7b" 201 - "PUT http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b" "txccd4b84c92784998a18ea-0068c57073" "proxy-server 1824514" 0.0487 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sdb1/0/a/de2b0190d436461586c3f8888098af7b" 201 - "PUT http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b" "txccd4b84c92784998a18ea-0068c57073" "proxy-server 1824514" 0.0298 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txcbe34734b50343339d345-0068c57073" "proxy-server 1824514" 0.0102 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/0/a/de2b0190d436461586c3f8888098af7b" 204 - "HEAD http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b" "txcbe34734b50343339d345-0068c57073" "proxy-server 1824514" 0.0093 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe9491263eaef43c58a5e8-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/0/a/de2b0190d436461586c3f8888098af7b" 204 - "HEAD http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b" "tx837747da73ff486eab445-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sdb1/0/a/de2b0190d436461586c3f8888098af7b/o" 201 - "PUT http://foo:8080/sdc1/0/a/de2b0190d436461586c3f8888098af7b/o" "txe726f26337b440d383afd-0068c57073" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sdc1/0/a/de2b0190d436461586c3f8888098af7b/o" 201 - "PUT http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b/o" "txe726f26337b440d383afd-0068c57073" "proxy-server 1824514" 0.0135 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/0/a/de2b0190d436461586c3f8888098af7b/o" 201 - "PUT http://foo:8080/sdd1/0/a/de2b0190d436461586c3f8888098af7b/o" "txe726f26337b440d383afd-0068c57073" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sdd1/0/a/de2b0190d436461586c3f8888098af7b/o" 201 - "PUT http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b/o" "txe726f26337b440d383afd-0068c57073" "proxy-server 1824514" 0.0242 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4796bb3cbe554f88b652d-0068c57073" "proxy-server 1824514" 0.0019 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/0/a/de2b0190d436461586c3f8888098af7b" 204 - "HEAD http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b" "txcf109f9b1371410298395-0068c57073" "proxy-server 1824514" 0.0111 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sda1/0/a/de2b0190d436461586c3f8888098af7b/o" 201 - "POST http://foo:8080/sdd1/0/a/de2b0190d436461586c3f8888098af7b/o" "txe4fcb616c00142cbb2a7e-0068c57073" "object-server 1824514" 0.0005 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "PUT /sdb1/0/a/de2b0190d436461586c3f8888098af7b/o" 201 - "POST http://foo:8080/sdc1/0/a/de2b0190d436461586c3f8888098af7b/o" "txe4fcb616c00142cbb2a7e-0068c57073" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "POST /sdd1/0/a/de2b0190d436461586c3f8888098af7b/o" 202 76 "POST http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b/o" "txe4fcb616c00142cbb2a7e-0068c57073" "proxy-server 1824514" 0.0220 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "POST /sdc1/0/a/de2b0190d436461586c3f8888098af7b/o" 202 76 "POST http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b/o" "txe4fcb616c00142cbb2a7e-0068c57073" "proxy-server 1824514" 0.0237 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txf79fa00d2ca04305b3498-0068c57073" "proxy-server 1824514" 0.0013 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/1/a/7e1880b3ad48455fafe06d3297fdcbbf" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" "txf79fa00d2ca04305b3498-0068c57073" "container-server 1824514" 0.0010 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "PUT /sdb1/1/a/7e1880b3ad48455fafe06d3297fdcbbf" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" "txf79fa00d2ca04305b3498-0068c57073" "container-server 1824514" 0.0091 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 201 - "PUT http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "txf79fa00d2ca04305b3498-0068c57073" "proxy-server 1824514" 0.0242 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "PUT /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 201 - "PUT http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "txf79fa00d2ca04305b3498-0068c57073" "proxy-server 1824514" 0.0371 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx52af679b5b004619a5130-0068c57074" "proxy-server 1824514" 0.0018 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx52af679b5b004619a5130-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6701a5e6d27241cbb3bd3-0068c57074" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/0/a/de2b0190d436461586c3f8888098af7b" 204 - "HEAD http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b" "txa1d04931869741d78702c-0068c57074" "proxy-server 1824514" 0.0143 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdd1/0/a/de2b0190d436461586c3f8888098af7b/o" 200 24 "GET http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b/o" "tx14243e828f3a4ad59ec85-0068c57074" "proxy-server 1824514" 0.0129 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdc1/0/a/de2b0190d436461586c3f8888098af7b/o" 200 24 "GET http://foo:8080/v1/a/de2b0190d436461586c3f8888098af7b/o" "tx14243e828f3a4ad59ec85-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx1a6eb0d2f5dd44f9962ea-0068c57074" "proxy-server 1824514" 0.0142 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://foo:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "txa2373d390ea4480888680-0068c57074" "proxy-server 1824514" 0.0137 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "PUT /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 201 - "PUT http://foo:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx8b9f715f33d545969f6c2-0068c57074" "proxy-server 1824514" 0.0425 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "PUT /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 201 - "PUT http://foo:8080/sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx8b9f715f33d545969f6c2-0068c57074" "object-server 1824514" 0.0005 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "PUT /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 201 - "PUT http://foo:8080/sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx8b9f715f33d545969f6c2-0068c57074" "object-server 1824514" 0.0005 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "PUT /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 201 - "PUT http://foo:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx8b9f715f33d545969f6c2-0068c57074" "proxy-server 1824514" 0.0708 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "PUT /sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 201 - "PUT http://foo:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx8b9f715f33d545969f6c2-0068c57074" "proxy-server 1824514" 0.0700 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txa87b60f06fc941039b420-0068c57074" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx268f3904644241ddabff9-0068c57074" "proxy-server 1824514" 0.0023 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx71b63d8134ee41fa96218-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx71b63d8134ee41fa96218-0068c57074" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx112dc9f775e540aebcf99-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "txd3d99034167c4502a2f85-0068c57074" "proxy-server 1824514" 0.0022 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "txf5576d100b654cca9ab26-0068c57074" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx48cb8ea31bee44d8b7cd5-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx42c76f9ccbd541ed9c9ea-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx92ede53db1774656b62c2-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx92ede53db1774656b62c2-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx36f44027a2fe40dcb2e6a-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx85ba208072f64b979b78f-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "txce4e676ba4ea492b959d9-0068c57074" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txa4d4fe7c106042ce86219-0068c57074" "proxy-server 1824514" 0.0133 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 200 155 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf?format=json&states=listing" "txa4d4fe7c106042ce86219-0068c57074" "proxy-server 1824514" 0.0103 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb372c7428556446a88d1f-0068c57074" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 200 155 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf?format=json&states=listing" "txb372c7428556446a88d1f-0068c57074" "proxy-server 1824514" 0.0024 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txa0f68822b5aa418aa0c17-0068c57074" "proxy-server 1824514" 0.0093 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx6a34cfeb6db9476e85190-0068c57074" "proxy-server 1824514" 0.0094 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "txb133a9637b7b47b7b5bca-0068c57074" "proxy-server 1824514" 0.0089 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "txb133a9637b7b47b7b5bca-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txe696dd07617f4df396347-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx5fcd3c28cac04c1a99c86-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx97c397730cf34c539f07b-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx97c397730cf34c539f07b-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx5632d5864640430a87e6d-0068c57074" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "txadc4a358bf3c4f46982d5-0068c57074" "proxy-server 1824514" 0.0055 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 412 - "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx0d1c45f184e9440ebd294-0068c57074" "proxy-server 1824514" 0.0169 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 412 - "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx0d1c45f184e9440ebd294-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx0d1c45f184e9440ebd294-0068c57074) proxy DEBUG: Ignoring 412 from primary (txn: tx0d1c45f184e9440ebd294-0068c57074) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 412 - "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx0d1c45f184e9440ebd294-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx0d1c45f184e9440ebd294-0068c57074) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx1addcfa10dbe4f78932b8-0068c57074" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "txba18a31805ec45d5aa088-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 304 - "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx9e1f0b5d31e84cf1873aa-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 304 - "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx9e1f0b5d31e84cf1873aa-0068c57074" "proxy-server 1824514" 0.0168 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 304 - "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx9e1f0b5d31e84cf1873aa-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txf12f651c02d949f5b74d6-0068c57074" "proxy-server 1824514" 0.0135 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx3cce8e313c4648cb9f0b4-0068c57074" "proxy-server 1824514" 0.0130 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 304 - "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx78bd003eb9264fb099cfd-0068c57074" "proxy-server 1824514" 0.0110 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 304 - "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx78bd003eb9264fb099cfd-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 304 - "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx78bd003eb9264fb099cfd-0068c57074" "proxy-server 1824514" 0.0154 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb91314de227b44a08b66d-0068c57074" "proxy-server 1824514" 0.0040 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx8c5be0d12b5848f293db5-0068c57074" "proxy-server 1824514" 0.0016 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx63174d3b3c5747a68ebc2-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "GET /sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "GET http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx63174d3b3c5747a68ebc2-0068c57074" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx9f14ca0751ee4b9989dfb-0068c57074" "proxy-server 1824514" 0.0135 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "txbca3708a0c944df2b687e-0068c57074" "proxy-server 1824514" 0.0096 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx398282141ca544529ed08-0068c57074" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb9dfd2b051d34f209198b-0068c57074" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx704849d8a85b44f6aeb39-0068c57074" "proxy-server 1824514" 0.0017 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx33a0e7770b1d40fdac7d2-0068c57074" "proxy-server 1824514" 0.0018 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txe14145ad690a41058b962-0068c57074" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "txa883a10a3b954939873d6-0068c57074" "proxy-server 1824514" 0.0073 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 412 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "txddd59f82a5904436896e3-0068c57074" "proxy-server 1824514" 0.0006 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 412 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "txddd59f82a5904436896e3-0068c57074" "proxy-server 1824514" 0.0024 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 412 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "txddd59f82a5904436896e3-0068c57074" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx415879fce3ff4c0582b0c-0068c57074" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx62828bb6c288459f8ab6d-0068c57074" "proxy-server 1824514" 0.0155 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdh1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 304 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx349ab4d3484a41e0a2231-0068c57075" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx5912dd5bdecd494faac26-0068c57075" "proxy-server 1824514" 0.0142 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx39ffa5ac79dc4b16a3e3f-0068c57075" "proxy-server 1824514" 0.0134 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdg1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 304 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "txf72cca44e38d420e87a2f-0068c57075" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb32d9cc207254137a2a61-0068c57075" "proxy-server 1824514" 0.0033 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/2/a/7e1880b3ad48455fafe06d3297fdcbbf" 204 - "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf" "tx8fe9e4a8a2f347058303e-0068c57075" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdi1/0/a/7e1880b3ad48455fafe06d3297fdcbbf/o" 200 92 "HEAD http://localhost:8080/v1/a/7e1880b3ad48455fafe06d3297fdcbbf/o" "tx1ce3a7be87734132aaeab-0068c57075" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa684465ee1564a6bbe1de-0068c57075" "proxy-server 1824514" 0.0012 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdb1/1/a/3b70e2a2c8a843258034977a61e6fa6c" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/3b70e2a2c8a843258034977a61e6fa6c" "txa684465ee1564a6bbe1de-0068c57075" "container-server 1824514" 0.0011 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/1/a/3b70e2a2c8a843258034977a61e6fa6c" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/3b70e2a2c8a843258034977a61e6fa6c" "txa684465ee1564a6bbe1de-0068c57075" "container-server 1824514" 0.0012 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/2/a/3b70e2a2c8a843258034977a61e6fa6c" 201 - "PUT http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c" "txa684465ee1564a6bbe1de-0068c57075" "proxy-server 1824514" 0.0464 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdb1/2/a/3b70e2a2c8a843258034977a61e6fa6c" 201 - "PUT http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c" "txa684465ee1564a6bbe1de-0068c57075" "proxy-server 1824514" 0.0721 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txdeaefcf4625b46d0af7bd-0068c57075" "proxy-server 1824514" 0.0092 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/2/a/3b70e2a2c8a843258034977a61e6fa6c" 204 - "HEAD http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c" "txdeaefcf4625b46d0af7bd-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx184ab53e46524e52994d7-0068c57075" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/2/a/3b70e2a2c8a843258034977a61e6fa6c" 204 - "HEAD http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c" "tx3d956c02ee234e71b8eb8-0068c57075" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdh1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" 201 - "PUT http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c/o" "txe3e4b8df9f42436880242-0068c57075" "proxy-server 1824514" 0.0444 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/2/a/3b70e2a2c8a843258034977a61e6fa6c/o" 201 - "PUT http://foo:8080/sdg1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" "txe3e4b8df9f42436880242-0068c57075" "object-server 1824514" 0.0005 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdb1/2/a/3b70e2a2c8a843258034977a61e6fa6c/o" 201 - "PUT http://foo:8080/sdi1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" "txe3e4b8df9f42436880242-0068c57075" "object-server 1824514" 0.0004 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdi1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" 201 - "PUT http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c/o" "txe3e4b8df9f42436880242-0068c57075" "proxy-server 1824514" 0.0654 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdg1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" 201 - "PUT http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c/o" "txe3e4b8df9f42436880242-0068c57075" "proxy-server 1824514" 0.0666 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa9563ff2a74f4db4987a1-0068c57075" "proxy-server 1824514" 0.0020 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/2/a/3b70e2a2c8a843258034977a61e6fa6c" 204 - "HEAD http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c" "tx989725a1cff24053901bf-0068c57075" "proxy-server 1824514" 0.0111 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/2/a/3b70e2a2c8a843258034977a61e6fa6c/o" 201 - "POST http://foo:8080/sdi1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" "tx7bb39ba8fbc64544b5ca0-0068c57075" "object-server 1824514" 0.0004 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "POST /sdi1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" 202 76 "POST http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c/o" "tx7bb39ba8fbc64544b5ca0-0068c57075" "proxy-server 1824514" 0.0136 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "POST /sdh1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" 202 76 "POST http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c/o" "tx7bb39ba8fbc64544b5ca0-0068c57075" "proxy-server 1824514" 0.0260 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdb1/2/a/3b70e2a2c8a843258034977a61e6fa6c/o" 201 - "POST http://foo:8080/sdg1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" "tx7bb39ba8fbc64544b5ca0-0068c57075" "object-server 1824514" 0.0004 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "POST /sdg1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" 202 76 "POST http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c/o" "tx7bb39ba8fbc64544b5ca0-0068c57075" "proxy-server 1824514" 0.0282 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx4b20c30110b84968b2777-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdb1/1/a/aa9e7578d720448a82a961ed76d79b2c" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" "tx4b20c30110b84968b2777-0068c57075" "container-server 1824514" 0.0132 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/1/a/aa9e7578d720448a82a961ed76d79b2c" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" "tx4b20c30110b84968b2777-0068c57075" "container-server 1824514" 0.0010 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 201 - "PUT http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx4b20c30110b84968b2777-0068c57075" "proxy-server 1824514" 0.0391 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 201 - "PUT http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx4b20c30110b84968b2777-0068c57075" "proxy-server 1824514" 0.0290 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx028a5add3efb4bd9a7939-0068c57075" "proxy-server 1824514" 0.0100 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx028a5add3efb4bd9a7939-0068c57075" "proxy-server 1824514" 0.0012 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc780966be240441ab4194-0068c57075" "proxy-server 1824514" 0.0171 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/2/a/3b70e2a2c8a843258034977a61e6fa6c" 204 - "HEAD http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c" "txaefdc2902e89451bb8191-0068c57075" "proxy-server 1824514" 0.0177 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "GET /sdi1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" 200 92 "GET http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c/o" "tx6e9af813edb84073bc8ac-0068c57075" "proxy-server 1824514" 0.0090 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "GET /sdh1/3/a/3b70e2a2c8a843258034977a61e6fa6c/o" 200 92 "GET http://foo:8080/v1/a/3b70e2a2c8a843258034977a61e6fa6c/o" "tx6e9af813edb84073bc8ac-0068c57075" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa9af1704d77b4ed9b1e2a-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://foo:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx97e468b2a94845678c165-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c/o" 201 - "PUT http://foo:8080/sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx8a2c0d9139f94318ac674-0068c57075" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 201 - "PUT http://foo:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx8a2c0d9139f94318ac674-0068c57075" "proxy-server 1824514" 0.0184 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c/o" 201 - "PUT http://foo:8080/sdc1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx8a2c0d9139f94318ac674-0068c57075" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "PUT /sdc1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 201 - "PUT http://foo:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx8a2c0d9139f94318ac674-0068c57075" "proxy-server 1824514" 0.0315 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb1811ea7320b4a55a984d-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx25f512900b234ed38cb7d-0068c57075" "proxy-server 1824514" 0.0102 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "GET /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "txdbe9e3d74da54c2a8b60a-0068c57075" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txecbf3610ca404e4185cda-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx629c371a334c45578f1b5-0068c57075" "proxy-server 1824514" 0.0122 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx8a6911508d7d474f8c3ba-0068c57075" "proxy-server 1824514" 0.0046 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7febd865ac0a4239837bf-0068c57075" "proxy-server 1824514" 0.0100 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx623466a46c19438ab6f3d-0068c57075" "proxy-server 1824514" 0.0073 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "GET /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "txeb5215c91ded4273849fe-0068c57075" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0cebaed3983e4c26ab529-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx8715c32b961341559ffd9-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdc1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx17d27e6874ad4ef6861a4-0068c57075" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx4d3e681fd1e04808abb8c-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "GET /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 200 155 "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c?format=json&states=listing" "tx4d3e681fd1e04808abb8c-0068c57075" "proxy-server 1824514" 0.0021 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txc6627b01dd214a30b6b30-0068c57075" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "GET /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 200 155 "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c?format=json&states=listing" "txc6627b01dd214a30b6b30-0068c57075" "proxy-server 1824514" 0.0141 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx70ba1ee4009241698bdf9-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "txbb69374d68df47f8a47b8-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "GET /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx43438a78e8494abea7079-0068c57075" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx72a1c75dd96c4506b7c29-0068c57075" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx52c83c3384b04a1ba639b-0068c57075" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:05 +0000] "GET /sdc1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx9543beac7b5647d5b47d2-0068c57075" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7ffad15aacaf43968cacb-0068c57075" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx7145fa47dfd6471683519-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "GET /sdc1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 412 - "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx9974405241bf4fe19c536-0068c57076" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "GET /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 412 - "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx9974405241bf4fe19c536-0068c57076" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfcea953977194b5e8570d-0068c57076" "proxy-server 1824514" 0.0054 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx756ca65eddef42d19939c-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "GET /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 304 - "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx3a53ae7b00a34576b69e1-0068c57076" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx84e445f1676447b1b6508-0068c57076" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx57d8234f38dc4e239a5fe-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "GET /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 304 - "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx2e246e80433e47419adfa-0068c57076" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx5acf2940960f4eafb48ba-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx8cc28f13eb1b4e32a8c26-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "GET /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "GET http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx418f4d995c2d459bb5b7f-0068c57076" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx32600dfc3941451281f13-0068c57076" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx95b0885ac7184baba8f05-0068c57076" "proxy-server 1824514" 0.0011 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx566647cb642745d1b5cd3-0068c57076" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx910b1770374145e1b2c7f-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx4a198c292858416b8d187-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdc1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx2e7ad107ff5e4c07a8fa4-0068c57076" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd47724d7bf374130b65bf-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "txdbf3f33eb3204e8a8d18a-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdc1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 412 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx674cf49e7f884af69c558-0068c57076" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 412 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx674cf49e7f884af69c558-0068c57076" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6ed0bf653a9f43399eb09-0068c57076" "proxy-server 1824514" 0.0047 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx84173d6ba64148ed8c98a-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 304 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "tx5ba04c74233c47de9651b-0068c57076" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txbcb35eb1bb294a8486f54-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx85c7ccef665146df92afc-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdc1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 304 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "txcc22e8a9474d4a68827c0-0068c57076" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx144dddadbbe8499f8b916-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/0/a/aa9e7578d720448a82a961ed76d79b2c" 204 - "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c" "tx38e88e5adf61471eb1e6b-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdd1/2/a/aa9e7578d720448a82a961ed76d79b2c/o" 200 24 "HEAD http://localhost:8080/v1/a/aa9e7578d720448a82a961ed76d79b2c/o" "txb5e33b69beca4399bb99d-0068c57076" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3f20733dbfed4711a330b-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdb1/1/a/559e7028fa7c4633bc3857a856c3df2d" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/559e7028fa7c4633bc3857a856c3df2d" "tx3f20733dbfed4711a330b-0068c57076" "container-server 1824514" 0.0089 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/1/a/559e7028fa7c4633bc3857a856c3df2d" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/559e7028fa7c4633bc3857a856c3df2d" "tx3f20733dbfed4711a330b-0068c57076" "container-server 1824514" 0.0011 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/0/a/559e7028fa7c4633bc3857a856c3df2d" 201 - "PUT http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d" "tx3f20733dbfed4711a330b-0068c57076" "proxy-server 1824514" 0.0479 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdb1/0/a/559e7028fa7c4633bc3857a856c3df2d" 201 - "PUT http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d" "tx3f20733dbfed4711a330b-0068c57076" "proxy-server 1824514" 0.0323 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7a6714dc33044772ac41f-0068c57076" "proxy-server 1824514" 0.0140 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/559e7028fa7c4633bc3857a856c3df2d" 204 - "HEAD http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d" "tx7a6714dc33044772ac41f-0068c57076" "proxy-server 1824514" 0.0011 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc870b69a830744c2b1b33-0068c57076" "proxy-server 1824514" 0.0140 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/559e7028fa7c4633bc3857a856c3df2d" 204 - "HEAD http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d" "tx12d9cdb43aad4f2a9a682-0068c57076" "proxy-server 1824514" 0.0174 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdb1/0/a/559e7028fa7c4633bc3857a856c3df2d/o" 201 - "PUT http://foo:8080/sdd1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx116866a2d2f844bd9bda1-0068c57076" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdd1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" 201 - "PUT http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx116866a2d2f844bd9bda1-0068c57076" "proxy-server 1824514" 0.0138 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/0/a/559e7028fa7c4633bc3857a856c3df2d/o" 201 - "PUT http://foo:8080/sdc1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx116866a2d2f844bd9bda1-0068c57076" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdc1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" 201 - "PUT http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx116866a2d2f844bd9bda1-0068c57076" "proxy-server 1824514" 0.0264 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txaf4b2e6e5379464f890e8-0068c57076" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/559e7028fa7c4633bc3857a856c3df2d" 204 - "HEAD http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d" "tx10584b4a0865412da039b-0068c57076" "proxy-server 1824514" 0.0113 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/0/a/559e7028fa7c4633bc3857a856c3df2d/o" 201 - "POST http://foo:8080/sdd1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx268fafb760574ceeb992d-0068c57076" "object-server 1824514" 0.0004 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdb1/0/a/559e7028fa7c4633bc3857a856c3df2d/o" 201 - "POST http://foo:8080/sdc1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx268fafb760574ceeb992d-0068c57076" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "POST /sdd1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" 202 76 "POST http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx268fafb760574ceeb992d-0068c57076" "proxy-server 1824514" 0.0245 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "POST /sdc1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" 202 76 "POST http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx268fafb760574ceeb992d-0068c57076" "proxy-server 1824514" 0.0188 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6f9fcb00f5934a55a74aa-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdb1/1/a/bf48aeed245e4ab49e55816390686adc" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/bf48aeed245e4ab49e55816390686adc" "tx6f9fcb00f5934a55a74aa-0068c57076" "container-server 1824514" 0.0010 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/1/a/bf48aeed245e4ab49e55816390686adc" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/bf48aeed245e4ab49e55816390686adc" "tx6f9fcb00f5934a55a74aa-0068c57076" "container-server 1824514" 0.0010 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 201 - "PUT http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx6f9fcb00f5934a55a74aa-0068c57076" "proxy-server 1824514" 0.0449 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 201 - "PUT http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx6f9fcb00f5934a55a74aa-0068c57076" "proxy-server 1824514" 0.0413 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd6cb8efaf9204c4f858e9-0068c57076" "proxy-server 1824514" 0.0020 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "txd6cb8efaf9204c4f858e9-0068c57076" "proxy-server 1824514" 0.0012 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe51944f0f0224c158a3e1-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/0/a/559e7028fa7c4633bc3857a856c3df2d" 204 - "HEAD http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d" "tx8b4112d460d249018f660-0068c57076" "proxy-server 1824514" 0.0114 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "GET /sdd1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" 200 24 "GET http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx086a7c5832bd4792a42f0-0068c57076" "proxy-server 1824514" 0.0089 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "GET /sdc1/1/a/559e7028fa7c4633bc3857a856c3df2d/o" 200 24 "GET http://foo:8080/v1/a/559e7028fa7c4633bc3857a856c3df2d/o" "tx086a7c5832bd4792a42f0-0068c57076" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6c839dfd6baf4d8cb58a6-0068c57076" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://foo:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "txd67d68d23b6f4c1c89e54-0068c57076" "proxy-server 1824514" 0.0012 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdb1/0/a/bf48aeed245e4ab49e55816390686adc/o" 201 - "PUT http://foo:8080/sdd1/0/a/bf48aeed245e4ab49e55816390686adc/o" "tx8c382e7df9184bc99ca12-0068c57076" "object-server 1824514" 0.0005 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sda1/0/a/bf48aeed245e4ab49e55816390686adc/o" 201 - "PUT http://foo:8080/sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" "tx8c382e7df9184bc99ca12-0068c57076" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdd1/0/a/bf48aeed245e4ab49e55816390686adc/o" 201 - "PUT http://foo:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx8c382e7df9184bc99ca12-0068c57076" "proxy-server 1824514" 0.0154 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "PUT /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 201 - "PUT http://foo:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx8c382e7df9184bc99ca12-0068c57076" "proxy-server 1824514" 0.0329 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txf4462b1f1ec647b0b91de-0068c57076" "proxy-server 1824514" 0.0100 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx384291d686934d2d96a33-0068c57076" "proxy-server 1824514" 0.0023 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "GET /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx2b77f2c900714a699d20c-0068c57076" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txf1d3e7bcdf984add81fcd-0068c57076" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "txbeeef82a4a894f38b9974-0068c57076" "proxy-server 1824514" 0.0023 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:06 +0000] "HEAD /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "txc1c8b56c18d44fbd8d7e0-0068c57076" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx57473ca5412d450c80a8e-0068c57076" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx7cccee19b590428ba52d8-0068c57077" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx0eabe7a178064f85a1d92-0068c57077" "proxy-server 1824514" 0.0127 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txae31eaf84d3f40f3bd262-0068c57077" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx57413bf2b2124cf2b61db-0068c57077" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx51d2a43614694ee2ad93d-0068c57077" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txec82b5d0fd1e45c39bf0a-0068c57077" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 200 155 "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc?format=json&states=listing" "txec82b5d0fd1e45c39bf0a-0068c57077" "proxy-server 1824514" 0.0104 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd80a7f9de4de4c9ab78aa-0068c57077" "proxy-server 1824514" 0.0134 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 200 155 "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc?format=json&states=listing" "txd80a7f9de4de4c9ab78aa-0068c57077" "proxy-server 1824514" 0.0144 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx3dbec6d8cf8041dbbbd21-0068c57077" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "txf1877d2b68e74e9f92027-0068c57077" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "txd44b84aad42a4bc5b3451-0068c57077" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx8eeb413e37f94091aa6fa-0068c57077" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx9c5bce07bdb443158ddff-0068c57077" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx379fdade2ad64b4c9879d-0068c57077" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx4e9773f394e1402693510-0068c57077" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx576e21b6c4e8453d8ea83-0068c57077" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 412 - "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx278847bdee2e4cdcb671e-0068c57077" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdd1/0/a/bf48aeed245e4ab49e55816390686adc/o" 412 - "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx278847bdee2e4cdcb671e-0068c57077" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx04c87b631d1a425ab2b94-0068c57077" "proxy-server 1824514" 0.0135 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx97782da5620d4039b2c03-0068c57077" "proxy-server 1824514" 0.0094 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdd1/0/a/bf48aeed245e4ab49e55816390686adc/o" 304 - "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx11fb09714c42434cbf013-0068c57077" "proxy-server 1824514" 0.0127 "-" 1824514 1test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_copy_encrypted_to_unencrypted test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_copy_encrypted_to_unencrypted ... ok test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 710.54, Total bytes/sec: 7105.38, Auditing time: 0.00, Rate: 0.24 test INFO: Object audit stats: {"10": 1, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test WARNING: Quarantined object /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects/0/556/13c397663e4b7013166025ba7209a556/1757769844.85419.data: metadata content-length 10 does not match actual object size 20 test ERROR: ERROR Object /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects/0/556/13c397663e4b7013166025ba7209a556 failed audit and was quarantined: metadata content-length 10 does not match actual object size 20 test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpz6tzwgmp/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.09s. Total quarantined: 1, Total errors: 0, Total files/sec: 21.27, Total bytes/sec: 106.37, Auditing time: 0.09, Rate: 0.98 test INFO: Object audit stats: {"10": 2, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test WARNING: Quarantined object /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769844.96065.data: metadata content-length 1024 does not match actual object size 1034 test ERROR: ERROR Object /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects/0/099/2f714cd91b0e5d803cde2012b01d7099 failed audit and was quarantined: metadata content-length 1024 does not match actual object size 1034 test DEBUG: Skipping the update of recently changed /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzpnbvfqb/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.00s. Total quarantined: 1, Total errors: 0, Total files/sec: 606.38, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.33 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:04 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1387.46, bytes/sec: 1420763.25, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:04 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 19.34, bytes/sec: 19802.06, Total time: 0.05, Auditing time: 0.00, Rate: 0.01 test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test WARNING: Quarantined object /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef/1757769844.98286#1#d.data: Metadata failed validation test ERROR: ERROR DiskFile /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef/1757769844.98286#1#d.data close failure: [Errno 2] No such file or directory: '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef' -> '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/quarantined/objects-2/1423afe67e928cd1053f896ed1b7b3ef' : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3248, in _check_frag self._diskfile.policy.pyeclib_driver.get_metadata(frag) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/usr/lib/python3/dist-packages/pyeclib/ec_iface.py", line 360, in get_metadata return self.ec_lib_reference.get_metadata(fragment, formatted) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/pyeclib/core.py", line 129, in get_metadata fragment_metadata = pyeclib_c.get_metadata(self.handle, fragment, formatted) pyeclib.ec_iface.ECInvalidFragmentMetadata: pyeclib_c_get_metadata ERROR: Fragment integrity check failed. Please inspect syslog for liberasurecode error report. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 856, in renamer os.rename(old, new) ~~~~~~~~~^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef' -> '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/quarantined/objects-2/1423afe67e928cd1053f896ed1b7b3ef' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2414, in close self._handle_close_quarantine() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3281, in _handle_close_quarantine self._check_frag(self.frag_buf) ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3254, in _check_frag self._quarantine(msg) ~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2382, in _quarantine self._quarantined_dir = self.manager.quarantine_renamer( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ self._device_path, self._data_file) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 360, in quarantine_renamer renamer(from_dir, to_dir, fsync=False) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 859, in renamer os.rename(old, new) ~~~~~~~~~^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef' -> '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/quarantined/objects-2/1423afe67e928cd1053f896ed1b7b3ef' test INFO: Object audit (ALL). Since Sun Sep 14 03:24:05 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 19.59, bytes/sec: 20059.72, Total time: 0.10, Auditing time: 0.05, Rate: 0.50 test INFO: Object audit (ALL) "once" mode completed: 0.10s. Total quarantined: 0, Total errors: 0, Total files/sec: 28.80, Total bytes/sec: 29495.63, Auditing time: 0.10, Rate: 0.97 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 3, "10240": 0, "OVER": 0} test INFO: Begin object audit "once" mode (ALL - parallel, sda,sdb) test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL - parallel, sda,sdb). Since Sun Sep 14 03:24:05 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 67.98, bytes/sec: 71281142.81, Total time: 0.01, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test INFO: Object audit (ALL - parallel, sda,sdb). Since Sun Sep 14 03:24:05 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 19.23, bytes/sec: 19689.94, Total time: 0.07, Auditing time: 0.01, Rate: 0.21 test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test WARNING: Quarantined object /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef/1757769844.98286#1#d.data: Metadata failed validation test ERROR: ERROR Trying to audit /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3248, in _check_frag self._diskfile.policy.pyeclib_driver.get_metadata(frag) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^ File "/usr/lib/python3/dist-packages/pyeclib/ec_iface.py", line 360, in get_metadata return self.ec_lib_reference.get_metadata(fragment, formatted) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/pyeclib/core.py", line 129, in get_metadata fragment_metadata = pyeclib_c.get_metadata(self.handle, fragment, formatted) pyeclib.ec_iface.ECInvalidFragmentMetadata: pyeclib_c_get_metadata ERROR: Fragment integrity check failed. Please inspect syslog for liberasurecode error report. During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 856, in renamer os.rename(old, new) ~~~~~~~~~^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef' -> '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/quarantined/objects-2/1423afe67e928cd1053f896ed1b7b3ef' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/auditor.py", line 238, in failsafe_object_audit self.object_audit(location) ~~~~~~~~~~~~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/auditor.py", line 274, in object_audit for chunk in reader: ^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2446, in __next__ return self._get_next_item() ~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 5231, in _get_next_item return super(CooperativeIterator, self)._get_next_item() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2442, in _get_next_item return next(self.wrapped_iter) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2204, in _inner_iter self._update_checks(chunk) ~~~~~~~~~~~~~~~~~~~^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3273, in _update_checks self._check_frag(self.frag_buf[cursor:cursor + self.frag_size]) ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3254, in _check_frag self._quarantine(msg) ~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2382, in _quarantine self._quarantined_dir = self.manager.quarantine_renamer( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ self._device_path, self._data_file) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 360, in quarantine_renamer renamer(from_dir, to_dir, fsync=False) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 859, in renamer os.rename(old, new) ~~~~~~~~~^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/0/3ef/1423afe67e928cd1053f896ed1b7b3ef' -> '/tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/quarantined/objects-2/1423afe67e928cd1053f896ed1b7b3ef' test INFO: Object audit (ALL - parallel, sda,sdb). Since Sun Sep 14 03:24:05 2025: Locally: 0 passed, 0 quarantined, 1 errors, files/sec: 0.00, bytes/sec: 0.00, Total time: 0.11, Auditing time: 0.07, Rate: 0.57 test INFO: Object audit (ALL - parallel, sda,sdb) "once" mode completed: 0.12s. Total quarantined: 0, Total errors: 1, Total files/sec: 25.84, Total bytes/sec: 9041442.16, Auditing time: 0.11, Rate: 0.97 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 4, "10240": 0, "OVER": 2} test INFO: Begin object audit "once" mode (ALL - parallel, sda,sdb) test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL - parallel, sda,sdb). Since Sun Sep 14 03:24:05 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 21.00, bytes/sec: 22015770.85, Total time: 0.05, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test INFO: Object audit (ALL - parallel, sda,sdb). Since Sun Sep 14 03:24:05 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 20.84, bytes/sec: 21338.80, Total time: 0.10, Auditing time: 0.05, Rate: 0.49 test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.jsontest.unit.obj.test_auditor.TestAuditor.test_object_run_once_pass test.unit.obj.test_auditor.TestAuditor.test_object_run_once_pass ... ok test.unit.obj.test_auditor.TestAuditor.test_object_run_recon_cache test.unit.obj.test_auditor.TestAuditor.test_object_run_recon_cache ... ok test.unit.obj.test_auditor.TestAuditor.test_reclaimable_tombstone test.unit.obj.test_auditor.TestAuditor.test_reclaimable_tombstone ... ok test.unit.obj.test_auditor.TestAuditor.test_reclaimable_tombstone_with_custom_reclaim_age test.unit.obj.test_auditor.TestAuditor.test_reclaimable_tombstone_with_custom_reclaim_age ... ok test.unit.obj.test_auditor.TestAuditor.test_reclaimable_tombstone_with_zero_byte_fps test.unit.obj.test_auditor.TestAuditor.test_reclaimable_tombstone_with_zero_byte_fps ... ok test.unit.obj.test_auditor.TestAuditor.test_rsync_tempfile_timeout_auto_option test.unit.obj.test_auditor.TestAuditor.test_rsync_tempfile_timeout_auto_option ... ok test.unit.obj.test_auditor.TestAuditor.test_run_audit_once test.unit.obj.test_auditor.TestAuditor.test_run_audit_once ... ok test.unit.obj.test_auditor.TestAuditor.test_run_audit_once_zbfps test.unit.obj.test_auditor.TestAuditor.test_run_audit_once_zbfps ... ok test.unit.obj.test_auditor.TestAuditor.test_run_parallel_audit test.unit.obj.test_auditor.TestAuditor.test_run_parallel_audit ... ok test.unit.obj.test_auditor.TestAuditor.test_run_parallel_audit_once test.unit.obj.test_auditor.TestAuditor.test_run_parallel_audit_once ... ok test.unit.obj.test_auditor.TestAuditor.test_run_parallel_audit_once_failed_fork test.unit.obj.test_auditor.TestAuditor.test_run_parallel_audit_once_failed_fork ... ok test.unit.obj.test_auditor.TestAuditor.test_sleeper test.unit.obj.test_auditor.TestAuditor.test_sleeper ... ok test.unit.obj.test_auditor.TestAuditor.test_with_inaccessible_object_location test.unit.obj.test_auditor.TestAuditor.test_with_inaccessible_object_location ... ok test.unit.obj.test_auditor.TestAuditor.test_with_only_tombstone test.unit.obj.test_auditor.TestAuditor.test_with_only_tombstone ... ok test.unit.obj.test_auditor.TestAuditor.test_with_tombstone_and_data test.unit.obj.test_auditor.TestAuditor.test_with_tombstone_and_data ... ok test.unit.obj.test_auditor.TestAuditor.test_worker_conf_parms test.unit.obj.test_auditor.TestAuditor.test_worker_conf_parms ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_bad_policy_change test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_bad_policy_change ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_bad_policy_specified test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_bad_policy_specified ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_container_timing_metrics test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_container_timing_metrics ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_good_policy_specified test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_good_policy_specified ... ok Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_relink_device_filter_invalid test.unit.cli.test_relinker.TestRelinker.test_relink_device_filter_invalid ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_existing_data_meta_older_ts_files test.unit.cli.test_relinker.TestRelinker.test_relink_existing_data_meta_older_ts_files ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_existing_data_meta_ts_files test.unit.cli.test_relinker.TestRelinker.test_relink_existing_data_meta_ts_files ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_insufficient_space test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_insufficient_space ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_invalid_partition test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_invalid_partition ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx83eeb8b2542341b482274-0068c57077" "proxy-server 1824514" 0.0054 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "txd3d9fba3263746b59712d-0068c57077" "proxy-server 1824514" 0.0094 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 304 - "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx128efdd8c6c944838a957-0068c57077" "proxy-server 1824514" 0.0087 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7338b457975d4c5dbdf59-0068c57077" "proxy-server 1824514" 0.0092 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx2bbaef679a2843a587dd5-0068c57077" "proxy-server 1824514" 0.0093 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "GET /sdd1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "GET http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx924c118482db469da32d9-0068c57077" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6ea11a4473034cfeb5f6a-0068c57077" "proxy-server 1824514" 0.0222 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx1e59ef4bc54a441ab4f91-0068c57077" "proxy-server 1824514" 0.0096 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "txde6faf1f8d3645d7bb178-0068c57077" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txe3988c0e350e4490baae9-0068c57077" "proxy-server 1824514" 0.0095 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx444b89199d3f4db686f43-0068c57077" "proxy-server 1824514" 0.0095 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "txa9ece8c27cee401fb5f63-0068c57077" "proxy-server 1824514" 0.0087 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx86a4f14877414e4190006-0068c57077" "proxy-server 1824514" 0.0095 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "txbd71d26b47c94d6ab0710-0068c57077" "proxy-server 1824514" 0.0095 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdd1/0/a/bf48aeed245e4ab49e55816390686adc/o" 412 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx686c4111ab854949a4b25-0068c57077" "proxy-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 412 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx686c4111ab854949a4b25-0068c57077" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfcf4727e71b9406c822f4-0068c57077" "proxy-server 1824514" 0.0133 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx1052ae48cdc84b60876fd-0068c57077" "proxy-server 1824514" 0.0133 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdd1/0/a/bf48aeed245e4ab49e55816390686adc/o" 304 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "txd1c44fd83e884ddaba421-0068c57077" "proxy-server 1824514" 0.0167 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb33a7f67bac64ad8aa2be-0068c57077" "proxy-server 1824514" 0.0134 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "txbda1c0a7731b4ae3a016a-0068c57077" "proxy-server 1824514" 0.0135 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdc1/0/a/bf48aeed245e4ab49e55816390686adc/o" 304 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "txdf4719a9fb13487c85ca7-0068c57077" "proxy-server 1824514" 0.0127 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx1daf0f3009c54d9b8d3d5-0068c57077" "proxy-server 1824514" 0.0147 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/0/a/bf48aeed245e4ab49e55816390686adc" 204 - "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc" "tx838eda9a91fa4252abdf3-0068c57077" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdd1/0/a/bf48aeed245e4ab49e55816390686adc/o" 200 24 "HEAD http://localhost:8080/v1/a/bf48aeed245e4ab49e55816390686adc/o" "tx3ba97ffe5ee04d11a1595-0068c57077" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx300fd83b72c44dccbb8a5-0068c57077" "proxy-server 1824514" 0.0012 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "PUT /sda1/1/a/6f0af8e540354d08861bfce58a78ae83" 201 - "PUT http://127.0.0.1:60751/sdb1/1/a/6f0af8e540354d08861bfce58a78ae83" "tx300fd83b72c44dccbb8a5-0068c57077" "container-server 1824514" 0.0010 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "PUT /sdb1/1/a/6f0af8e540354d08861bfce58a78ae83" 201 - "PUT http://127.0.0.1:40941/sda1/1/a/6f0af8e540354d08861bfce58a78ae83" "tx300fd83b72c44dccbb8a5-0068c57077" "container-server 1824514" 0.0010 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "PUT /sdb1/1/a/6f0af8e540354d08861bfce58a78ae83" 201 - "PUT http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83" "tx300fd83b72c44dccbb8a5-0068c57077" "proxy-server 1824514" 0.0563 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "PUT /sda1/1/a/6f0af8e540354d08861bfce58a78ae83" 201 - "PUT http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83" "tx300fd83b72c44dccbb8a5-0068c57077" "proxy-server 1824514" 0.0368 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx26db1730a00b4642a6881-0068c57077" "proxy-server 1824514" 0.0018 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/1/a/6f0af8e540354d08861bfce58a78ae83" 204 - "HEAD http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83" "tx26db1730a00b4642a6881-0068c57077" "proxy-server 1824514" 0.0012 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7d35d515a2ed4f82893da-0068c57077" "proxy-server 1824514" 0.0337 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "HEAD /sda1/1/a/6f0af8e540354d08861bfce58a78ae83" 204 - "HEAD http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83" "txe3092409e5314052990b0-0068c57077" "proxy-server 1824514" 0.0136 "-" 1824514 3test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_no_policy_change test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_no_policy_change ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_no_policy_for_existing_default test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_no_policy_for_existing_default ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_out_of_range_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_out_of_range_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_part_num ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_maxuploads_over_max_32bit_int test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_maxuploads_over_max_32bit_int ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_negative_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_negative_maxuploads ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_no_policy_for_existing_non_default test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_no_policy_for_existing_non_default ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_no_policy_specified test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_no_policy_specified ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 156, in GET return self.GETorHEAD(req) ~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 109, in GETorHEAD resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2445, in get_response resp = self.acl_handler.handle_acl( app, method, container, obj, headers) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 96, in handle_acl return ah._handle_acl(app, method) ~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 145, in _handle_acl resp = self.req.get_acl_response(app, 'HEAD', container, obj, headers, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middlewareswift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_version_id ... ok test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:08 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpa53k2e6p/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking created link: /tmp/tmpa53k2e6p/node/sda1/objects/94/787/5e4926bb80c80794205b25e26d434787/1757769850.01220.meta to /tmp/tmpa53k2e6p/node/sda1/objects/188/787/5e4926bb80c80794205b25e26d434787/1757769850.01220.meta test DEBUG: Relinking created link: /tmp/tmpa53k2e6p/node/sda1/objects/94/787/5e4926bb80c80794205b25e26d434787/1757769849.01220.data to /tmp/tmpa53k2e6p/node/sda1/objects/188/787/5e4926bb80c80794205b25e26d434787/1757769849.01220.data test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (2 files, 2 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:08 09/13/25 GMT (0:00:00.015591 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:08 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp574s4cc2/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Relinking created link: /tmp/tmp574s4cc2/node/sda1/objects/79/1ea/4f653a9772e3ba06660e706fabef61ea/1757769850.11329.ts to /tmp/tmp574s4cc2/node/sda1/objects/158/1ea/4f653a9772e3ba06660e706fabef61ea/1757769850.11329.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:08 09/13/25 GMT (0:00:00.019610 elapsed) Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_relink_files_per_second test.unit.cli.test_relinker.TestRelinker.test_relink_files_per_second ... ok test.unit.common.middleware.test_copy.TestServerSideCopyHeartbeat.test_copy_with_heartbeat_success test.unit.common.middleware.test_copy.TestServerSideCopyHeartbeat.test_copy_with_heartbeat_success ... ok test.unit.common.middleware.test_keystoneauth.ResellerInInfo.test_defaults test.unit.common.middleware.test_keystoneauth.ResellerInInfo.test_defaults ... ok test.unit.common.middleware.test_keystoneauth.ResellerInInfo.test_multiple test.unit.common.middleware.test_keystoneauth.ResellerInInfo.test_multiple ... ok test.unit.common.middleware.test_keystoneauth.TestSetProjectDomain.test_set_project_domain_id_existing_account_unknown_domain test.unit.common.middleware.test_keystoneauth.TestSetProjectDomain.test_set_project_domain_id_existing_account_unknown_domain ... ok test.unit.common.middleware.test_keystoneauth.TestSetProjectDomain.test_set_project_domain_id_existing_known_domain test.unit.common.middleware.test_keystoneauth.TestSetProjectDomain.test_set_project_domain_id_existing_known_domain ... ok test.unit.common.middleware.test_keystoneauth.TestSetProjectDomain.test_set_project_domain_id_existing_v2_account test.unit.common.middleware.test_keystoneauth.TestSetProjectDomain.test_set_project_domain_id_existing_v2_account ... ok test.unit.common.middleware.test_keystoneauth.TestSetProjectDomain.test_set_project_domain_id_new_account test.unit.common.middleware.test_keystoneauth.TestSetProjectDomain.test_set_project_domain_id_new_account ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_account_ratelimit test.unit.common.middleware.test_ratelimit.TestRateLimit.test_account_ratelimit ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_already_handled test.unit.common.middleware.test_ratelimit.TestRateLimit.test_already_handled ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_call_invalid_path test.unit.common.middleware.test_ratelimit.TestRateLimit.test_call_invalid_path ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_call_non_swift_api_path test.unit.common.middleware.test_ratelimit.TestRateLimit.test_call_non_swift_api_path ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_get_maxrate test.unit.common.middleware.test_ratelimit.TestRateLimit.test_get_maxrate ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_get_ratelimitable_key_tuples test.unit.common.middleware.test_ratelimit.TestRateLimit.test_get_ratelimitable_key_tuples ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_memcached_container_info_dict test.unit.common.middleware.test_ratelimit.TestRateLimit.test_memcached_container_info_dict ... ok test INFO: - - - [13/Sep/2025:13:24:07 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0184 "-" 1824541 2 test INFO: - - - [01/Jan/1970:00:16:40 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" - "-" 1824541 2 test INFO: - - - [01/Jan/1970:00:16:40 +0000] "GET /sda1/p/a/c" 200 664 "-" "-" "-" - "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:07 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0120 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0138 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0097 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0024 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0100 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:07 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0140 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0097 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/unsharded" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 200 134 "-" "-" "-" 0.0030 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/sharding" 201 - "-" "-" "-" 0.0049 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 200 134 "-" "-" "-" 0.0114 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/racing_update" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 200 134 "-" "-" "-" 0.0120 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 200 134 "-" "-" "-" 0.0197 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0032 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0236 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0013 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0142 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0005 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0105 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0021 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 409 - "-" "-" "-" 0.0011 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 409 - "-" "-" "-" 0.0030 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 409 - "-" "-" "-" 0.0012 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 409 - "-" "-" "-" 0.0011 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0513 "-" 1824541 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 400 45 "-" "-" "-" 0.0003 "-" 1824541 nada test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [01/Jan/1970:00:16:40 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" - "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0138 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824541 3 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/./a/c" 400 20 "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0237 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0014 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0100 "-" 1824541 3 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0222 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0117 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0010 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0315 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0152 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0109 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 400 28 "-" "-" "-" 0.0175 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 400 28 "-" "-" "-" 0.0014 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 400 28 "-" "-" "-" 0.0014 "-" 1824541 -test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_non_utf8_metadata test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_non_utf8_metadata ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_obj_not_found test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_obj_not_found ... ok Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_relink_first_quartile_no_rehash test.unit.cli.test_relinker.TestRelinker.test_relink_first_quartile_no_rehash ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_link_already_exists test.unit.cli.test_relinker.TestRelinker.test_relink_link_already_exists ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_link_already_exists_but_different_inode test.unit.cli.test_relinker.TestRelinker.test_relink_link_already_exists_but_different_inode ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_link_target_disappears test.unit.cli.test_relinker.TestRelinker.test_relink_link_target_disappears ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_listdir_error test.unit.cli.test_relinker.TestRelinker.test_relink_listdir_error ... ok test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmped_bq_zk/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL - parallel, sda,sdb) "once" mode completed: 0.10s. Total quarantined: 0, Total errors: 0, Total files/sec: 20.68, Total bytes/sec: 10855183.75, Auditing time: 0.09, Rate: 0.98 test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:05 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1336.62, bytes/sec: 12029.55, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 567.72, Total bytes/sec: 5109.47, Auditing time: 0.00, Rate: 0.18 test INFO: Object audit stats: {"10": 1, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ZBF) test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test INFO: Object audit (ZBF). Since Sun Sep 14 03:24:05 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1425.66, bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test INFO: Object audit (ZBF) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 563.45, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.15 test INFO: Object audit stats: {"10": 1, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL - parallel, sda) test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL - parallel, sda). Since Sun Sep 14 03:24:05 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1299.35, bytes/sec: 11694.16, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL - parallel, sda) "once" mode completed: 0.00s. Total quarantined: 0, Total errors: 0, Total files/sec: 564.81, Total bytes/sec: 5083.32, Auditing time: 0.00, Rate: 0.18 test INFO: Object audit stats: {"10": 1, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: 0 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ZBF - sda) test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test INFO: Object audit (ZBF - sda). Since Sun Sep 14 03:24:05 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 144.05, bytes/sec: 0.00, Total time: 0.01, Auditing time: 0.00, Rate: 0.00 test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmp22zoi7em/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test INFO: Object audit (ZBF - sda) "once" mode completed: 0.01s. Total quarantined: 0, Total errors: 0, Total files/sec: 124.39, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.04 test INFO: Object audit stats: {"10": 1, "100": 0, "1024": 0, "10240": 0, "OVER": 0} test DEBUG: Run listdir on /tmp/tmpu1m05wdk/tmp_test_object_auditor/node/sda/objects/0 test DEBUG: Run listdir on /tmp/tmp99vug9va/tmp_test_object_auditor/node/sda/objects/0 test DEBUG: Run listdir on /tmp/tmpp5xad_vj/tmp_test_object_auditor/node/sda/objects/0 test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test DEBUG: 0 audit watcher(s) loaded test-TestECDiskFile ERROR: ERROR DiskFile /tmp/tmpoazf2vsz/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769845.83589#2#d.data close failure: Bad : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2414, in close self._handle_close_quarantine() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 5567, in mock_handle_close_quarantine raise Exception("Bad") Exception: Bad test.unit.obj.test_diskfile.TestECDiskFile.test_close_error test.unit.obj.test_diskfile.TestECDiskFile.test_close_error ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_commit test.unit.obj.test_diskfile.TestECDiskFile.test_commit ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_commit_fsync test.unit.obj.test_diskfile.TestECDiskFile.test_commit_fsync ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_commit_ignores_cleanup_ondisk_files_error test.unit.obj.test_diskfile.TestECDiskFile.test_commit_ignores_cleanup_ondisk_files_error ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_fsync_dir_IOError test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_fsync_dir_IOError ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_fsync_dir_OSError test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_fsync_dir_OSError ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_rename_EDQUOT_IOError test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_rename_EDQUOT_IOError ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_rename_ENOSPC_IOError test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_rename_ENOSPC_IOError ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_rename_OSError test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_rename_OSError ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_rename_other_IOError test.unit.obj.test_diskfile.TestECDiskFile.test_commit_raises_DiskFileError_for_rename_other_IOError ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_content_type_and_timestamp test.unit.obj.test_diskfile.TestECDiskFile.test_content_type_and_timestamp ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_content_type_not_open test.unit.obj.test_diskfile.TestECDiskFile.test_content_type_not_open ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_content_type_timestamp_not_open test.unit.obj.test_diskfile.TestECDiskFile.test_content_type_timestamp_not_open ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_create_close_oserror test.unit.obj.test_diskfile.TestECDiskFile.test_create_close_oserror ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_create_mkstemp_no_space test.unit.obj.test_diskfile.TestECDiskFile.test_create_mkstemp_no_space ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_create_prealloc test.unit.obj.test_diskfile.TestECDiskFile.test_create_prealloc ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_create_prealloc_oserror test.unit.obj.test_diskfile.TestECDiskFile.test_create_prealloc_oserror ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_create_unlink_cleanup_DiskFileNoSpace test.unit.obj.test_diskfile.TestECDiskFile.test_create_unlink_cleanup_DiskFileNoSpace ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_create_unlink_cleanup_logging test.unit.obj.test_diskfile.TestECDiskFile.test_create_unlink_cleanup_logging ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_create_unlink_cleanup_renamer_fails test.unit.obj.test_diskfile.TestECDiskFile.test_create_unlink_cleanup_renamer_fails ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_create_use_linkat_renamer_not_called test.unit.obj.test_diskfile.TestECDiskFile.test_create_use_linkat_renamer_not_called ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_data_file_errors_bad_frag_index test.unit.obj.test_diskfile.TestECDiskFile.test_data_file_errors_bad_frag_index ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_data_file_has_frag_index test.unit.obj.test_diskfile.TestECDiskFile.test_data_file_has_frag_index ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_data_timestamp test.unit.obj.test_diskfile.TestECDiskFile.test_data_timestamp ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_data_timestamp_not_open test.unit.obj.test_diskfile.TestECDiskFile.test_data_timestamp_not_open ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_delete test.unit.obj.test_diskfile.TestECDiskFile.test_delete ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_corners test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_corners ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_partial_closes test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_partial_closes ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_range_w_none test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_range_w_none ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_checks_only_aligned_frag_data test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_checks_only_aligned_frag_data ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_edges test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_edges ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_empty test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_empty ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_w_no_etag_quarantine test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_w_no_etag_quarantine ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_w_quarantine test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_app_iter_ranges_w_quarantine ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_concurrent_delete test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_concurrent_delete ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_concurrent_marked_durable test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_concurrent_marked_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_concurrent_writes test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_concurrent_writes ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_default_disallowed_metadata test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_default_disallowed_metadata ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_large_app_iter_ranges test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_large_app_iter_ranges ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_mkstemp_creates_dir test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_mkstemp_creates_dir ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_preserves_slo test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_preserves_slo ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_preserves_sysmeta test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_preserves_sysmeta ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_reader_iter test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_reader_iter ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_reader_iter_w_io_error test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_reader_iter_w_io_error ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_reader_iter_w_quarantine test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_reader_iter_w_quarantine ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_writer test.unit.obj.test_diskfile.TestECDiskFile.test_disk_file_writer ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_content_length test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_content_length ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_content_length_deleted test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_content_length_deleted ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_content_length_not_open test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_content_length_not_open ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_names test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_names ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_timestamp test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_timestamp ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_timestamp_deleted test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_timestamp_deleted ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_timestamp_not_open test.unit.obj.test_diskfile.TestECDiskFile.test_diskfile_timestamp_not_open ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_missing_frag_index test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_missing_frag_index ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_newer_non_durable_data_file test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_newer_non_durable_data_file ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_no_data_file test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_no_data_file ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_not_open test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_not_open ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "PUT /sdi1/0/a/6f0af8e540354d08861bfce58a78ae83/o" 201 - "PUT http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83/o" "tx98403b3025b342d3925a6-0068c57077" "proxy-server 1824514" 0.0464 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "PUT /sda1/1/a/6f0af8e540354d08861bfce58a78ae83/o" 201 - "PUT http://foo:8080/sdg1/0/a/6f0af8e540354d08861bfce58a78ae83/o" "tx98403b3025b342d3925a6-0068c57077" "object-server 1824514" 0.0005 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "PUT /sdg1/0/a/6f0af8e540354d08861bfce58a78ae83/o" 201 - "PUT http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83/o" "tx98403b3025b342d3925a6-0068c57077" "proxy-server 1824514" 0.0523 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "PUT /sdb1/1/a/6f0af8e540354d08861bfce58a78ae83/o" 201 - "PUT http://foo:8080/sdh1/0/a/6f0af8e540354d08861bfce58a78ae83/o" "tx98403b3025b342d3925a6-0068c57077" "object-server 1824514" 0.0206 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:07 +0000] "PUT /sdh1/0/a/6f0af8e540354d08861bfce58a78ae83/o" 201 - "PUT http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83/o" "tx98403b3025b342d3925a6-0068c57077" "proxy-server 1824514" 0.0758 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9580ce4dff5d41569d1da-0068c57077" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a/6f0af8e540354d08861bfce58a78ae83" 204 - "HEAD http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83" "txfb5d2475846848f187de0-0068c57078" "proxy-server 1824514" 0.0082 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sdb1/1/a/6f0af8e540354d08861bfce58a78ae83/o" 201 - "POST http://foo:8080/sdh1/0/a/6f0af8e540354d08861bfce58a78ae83/o" "tx7f432d45626c4ebcbb70a-0068c57078" "object-server 1824514" 0.0004 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "POST /sdh1/0/a/6f0af8e540354d08861bfce58a78ae83/o" 202 76 "POST http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83/o" "tx7f432d45626c4ebcbb70a-0068c57078" "proxy-server 1824514" 0.0238 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "POST /sdg1/0/a/6f0af8e540354d08861bfce58a78ae83/o" 202 76 "POST http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83/o" "tx7f432d45626c4ebcbb70a-0068c57078" "proxy-server 1824514" 0.0133 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/1/a/6f0af8e540354d08861bfce58a78ae83/o" 201 - "POST http://foo:8080/sdi1/0/a/6f0af8e540354d08861bfce58a78ae83/o" "tx7f432d45626c4ebcbb70a-0068c57078" "object-server 1824514" 0.0085 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "POST /sdi1/0/a/6f0af8e540354d08861bfce58a78ae83/o" 202 76 "POST http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83/o" "tx7f432d45626c4ebcbb70a-0068c57078" "proxy-server 1824514" 0.0236 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd57a4e31c9e742299a970-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sdb1/1/a/37223c099fef4482ae4b4a3c88da26ff" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" "txd57a4e31c9e742299a970-0068c57078" "container-server 1824514" 0.0011 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/1/a/37223c099fef4482ae4b4a3c88da26ff" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" "txd57a4e31c9e742299a970-0068c57078" "container-server 1824514" 0.0091 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" 201 - "PUT http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "txd57a4e31c9e742299a970-0068c57078" "proxy-server 1824514" 0.0408 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 201 - "PUT http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "txd57a4e31c9e742299a970-0068c57078" "proxy-server 1824514" 0.0252 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7e2f6167bb8d409f877f8-0068c57078" "proxy-server 1824514" 0.0019 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx7e2f6167bb8d409f877f8-0068c57078" "proxy-server 1824514" 0.0012 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3214e4a40f1341f7833e0-0068c57078" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a/6f0af8e540354d08861bfce58a78ae83" 204 - "HEAD http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83" "tx93845a980fac4f3780062-0068c57078" "proxy-server 1824514" 0.0108 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdi1/0/a/6f0af8e540354d08861bfce58a78ae83/o" 200 92 "GET http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83/o" "txa446e1c2b46f49c69ae2b-0068c57078" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdh1/0/a/6f0af8e540354d08861bfce58a78ae83/o" 200 92 "GET http://foo:8080/v1/a/6f0af8e540354d08861bfce58a78ae83/o" "txa446e1c2b46f49c69ae2b-0068c57078" "proxy-server 1824514" 0.0129 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf45e9d7bfbd747b48c8c4-0068c57078" "proxy-server 1824514" 0.0021 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://foo:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx47a506f6e13a4a52bd3c9-0068c57078" "proxy-server 1824514" 0.0138 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sdh1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 201 - "PUT http://foo:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx25a63186169a4a1799b10-0068c57078" "proxy-server 1824514" 0.0513 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 201 - "PUT http://foo:8080/sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx25a63186169a4a1799b10-0068c57078" "object-server 1824514" 0.0005 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 201 - "PUT http://foo:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx25a63186169a4a1799b10-0068c57078" "proxy-server 1824514" 0.0716 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 201 - "PUT http://foo:8080/sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx25a63186169a4a1799b10-0068c57078" "object-server 1824514" 0.0005 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "PUT /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 201 - "PUT http://foo:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx25a63186169a4a1799b10-0068c57078" "proxy-server 1824514" 0.0859 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx041d9d5623a74ad586af5-0068c57078" "proxy-server 1824514" 0.0135 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "txaa6a73f611654da99e118-0068c57078" "proxy-server 1824514" 0.0214 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdh1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx89aaec476aec4fcd9fa6d-0068c57078" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx89aaec476aec4fcd9fa6d-0068c57078" "proxy-server 1824514" 0.0008 "-" 1824514 3test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_when_not_durable test.unit.obj.test_diskfile.TestECDiskFile.test_durable_timestamp_when_not_durable ... ok test DEBUG: Cached keystone credentials test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"access": {"user": {"username": "S3_USER", "name": "S3_USER", "id": "USER_ID", "roles": [{"name": "swift-user"}, {"name": "_member_"}]}, "token": {"id": "TOKEN_ID", "tenant": {"id": "TENANT_ID", "name": "TENANT_NAME"}}}}' test DEBUG: Connecting with tenant: TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: No authorization details from s3api. skipping. test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: No authorization details from s3api. skipping. test WARNING: Inconsistent project domain id: unexpected_id in token vs test_id in account metadata. test WARNING: Inconsistent project domain id: unexpected_id in token vs test_id in account metadata. test WARNING: Inconsistent project domain id: unexpected_id in token vs test_id in account metadata. test WARNING: Inconsistent project domain id: None in token vs test_id in account metadata. test WARNING: Inconsistent project domain id: None in token vs test_id in account metadata. test WARNING: Inconsistent project domain id: None in token vs test_id in account metadata. test WARNING: Inconsistent project domain id: unexpected_id in token vs None in account metadata. test WARNING: Inconsistent project domain id: unexpected_id in token vs None in account metadata. test WARNING: Inconsistent project domain id: unexpected_id in token vs None in account metadata. ERROR: swift.cache could not be found in env! ERROR: swift.cache could not be found in env! ERROR: swift.cache could not be found in env! ERROR: swift.cache could not be found in env! ERROR: swift.cache could not be found in env! test.unit.common.middleware.test_ratelimit.TestRateLimit.test_no_memcache test.unit.common.middleware.test_ratelimit.TestRateLimit.test_no_memcache ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_blacklist test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_blacklist ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_max_rate_double test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_max_rate_double ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_max_rate_double_container test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_max_rate_double_container ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_max_rate_double_container_listing test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_max_rate_double_container_listing ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_max_rate_multiple_acc test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_max_rate_multiple_acc ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_old_memcache_format test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_old_memcache_format ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_old_white_black_list test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_old_white_black_list ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_set_incr test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_set_incr ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_whitelist_sysmeta test.unit.common.middleware.test_ratelimit.TestRateLimit.test_ratelimit_whitelist_sysmeta ... ok test.unit.common.middleware.test_ratelimit.TestRateLimit.test_restarting_memcache test.unit.common.middleware.test_ratelimit.TestRateLimit.test_restarting_memcache ... ok test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest ... ok test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_passthrough test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_passthrough ... ok test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_ratelimiting test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_ratelimiting ... ok test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_repeated_segments_uses_multi_range_requests test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_repeated_segments_uses_multi_range_requests ... ok test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_with_submanifest test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_with_submanifest ... ok test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_with_submanifest_bytes_in_content_type test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_get_manifest_with_submanifest_bytes_in_content_type ... ok test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_multiple_ranges_get_manifest test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_multiple_ranges_get_manifest ... ok test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_multiple_ranges_including_suffix_get_manifest test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_multiple_ranges_including_suffix_get_manifest ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_meta_file test.unit.cli.test_relinker.TestRelinker.test_relink_meta_file ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_without_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_DELETE_without_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET ... ok test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_range_get_manifest test.unit.common.middleware.test_slo.TestSloGetOldManifests.test_range_get_manifest ... ok test.unit.common.middleware.test_symlink.SymlinkVersioningTestCase.test_delete_latest_version_no_marker_success test.unit.common.middleware.test_symlink.SymlinkVersioningTestCase.test_delete_latest_version_no_marker_success ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.test_symlink.SymlinkVersioningTestCase.test_new_symlink_version_success test.unit.common.middleware.test_symlink.SymlinkVersioningTestCase.test_new_symlink_version_success ... ok fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_version_id_not_implemented test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_version_id_not_implemented ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_fullcontrol_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_read_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_read_permission ... ok test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_cancel_increase_partition_power test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_cancel_increase_partition_power ... ok fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_zero_part_num test.unit.common.middleware.s3api.test_multi_get.TestMpuGETorHEADAcl.test_mpu_HEAD_zero_part_num ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_list_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_list_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_encoding_type_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_encoding_type_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_maxuploads ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_maxuploads_over_default test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_maxuploads_over_default ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_maxuploads_over_max_32bit_int test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_maxuploads_over_max_32bit_int ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_negative_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_negative_maxuploads ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_paginated test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_paginated ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_str_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_str_maxuploads ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_delimiter ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_id_and_key_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_id_and_key_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_key_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_key_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_multi_chars_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_multi_chars_delimiter ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_prefix test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_prefix ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_prefix_and_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_with_prefix_and_delimiter ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_without_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_without_bucket ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_without_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_GET_without_segment_bucket ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_abort test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_abort ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_complete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_complete ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_initiate test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_multipart_uploads_initiate ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_upload_part_missing_key test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_upload_part_missing_key ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_upload_part_success test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_upload_part_success ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_upload_part_success_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_upload_part_success_mixed_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_upload_part_v4_bad_hash test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_bucket_upload_part_v4_bad_hash ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_mpu_complete_mixed_policy_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_mpu_complete_mixed_policy_with_if_none_match_star ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_mpu_retry_complete_mixed_policy_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_mpu_retry_complete_mixed_policy_with_if_none_match_star ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_mpu_retry_complete_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_mpu_retry_complete_with_if_none_match_star ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_encoding_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_encoding_type ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_encoding_type_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_encoding_type_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_max_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_max_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_negative_max_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_negative_max_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_negative_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_negative_part_number_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_over_max_32bit_int test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_over_max_32bit_int ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_over_max_32bit_int_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_over_max_32bit_int_part_number_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_over_max_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_over_max_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_over_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_over_part_number_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_same_max_marts_as_objects_num test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_same_max_marts_as_objects_num ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_str_max_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_str_max_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_str_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_str_part_number_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_with_part_number_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_with_part_number_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_without_encoding_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_list_parts_without_encoding_type ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_s3acl_with_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_s3acl_with_segment_bucket ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_s3acl_with_segment_bucket_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_s3acl_with_segment_bucket_mixed_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_s3acl_without_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_s3acl_without_segment_bucket ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_s3acl_without_segment_bucket_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_s3acl_without_segment_bucket_mixed_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_with_segment_bucket_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_with_segment_bucket_mixed_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_without_segment_bucket_make_public test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_without_segment_bucket_make_public ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_without_segment_bucket_same_acls test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_without_segment_bucket_same_acls ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_without_segment_bucket_same_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_mpu_initiate_without_segment_bucket_same_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multi_upload_empty_body test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multi_upload_empty_body ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_abort test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_abort ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_abort_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_abort_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_404_on_marker_delete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_404_on_marker_delete ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_409_on_marker_delete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_409_on_marker_delete ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_failure_with_heartbeat test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_failure_with_heartbeat ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_marker_ts_in_future test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_marker_ts_in_future ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_marker_ts_now test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_marker_ts_now ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_mixed_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_no_content_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_no_content_type ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_non_ascii test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_non_ascii ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_old_content_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_old_content_type ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_other_headers test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_other_headers ... ok test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_finalize_increase_partition_power test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_finalize_increase_partition_power ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_no_applicable_policy test.unit.cli.test_relinker.TestRelinker.test_relink_no_applicable_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_segment_too_small test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_segment_too_small ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_single_zero_length_segment test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_single_zero_length_segment ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_weird_host_name test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_weird_host_name ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_librato_sample_rate test.unit.common.test_statsd_client.TestGetLabeledStatsdClientOutput.test_statsd_methods_librato_sample_rate ... ok test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_methods_are_no_ops_when_not_enabled test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_methods_are_no_ops_when_not_enabled ... ok test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_increase_partition_power test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_increase_partition_power ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_heartbeat test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_heartbeat ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_match ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=0-3', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_Range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_Range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_Range_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_Range_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_modified_since test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_modified_since ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_not_mounted test.unit.cli.test_relinker.TestRelinker.test_relink_not_mounted ... ok test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_increase_partition_power_failed test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_increase_partition_power_failed ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_none_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_none_match ... ok test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_prepare_increase_partition_power test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_prepare_increase_partition_power ... ok test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_prepare_increase_partition_power_failed test.unit.common.ring.test_builder.TestPartPowerIncreaseV2.test_prepare_increase_partition_power_failed ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_none_match_star ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_str_maxuploads test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_str_maxuploads ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_delimiter ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_unmodified_since test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_with_if_unmodified_since ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_zero_length_final_segment test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_zero_length_final_segment ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx4a7b0ba41b034d63a05b6-0068c57078" "proxy-server 1824514" 0.0136 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx35d01cbd565841f6b7301-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txa7a9e2d92f08439c899c8-0068c57078" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0c3190edc4764128a289d-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" 200 380 "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff?format=json&states=listing" "tx0c3190edc4764128a289d-0068c57078" "proxy-server 1824514" 0.0122 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx00752579d93e4b1a8d9ef-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx0b3a2298be4543a1835f9-0068c57078" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx2dfc3656b2f64f4ab2896-0068c57078" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx2dfc3656b2f64f4ab2896-0068c57078" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb0a045eaff114626bc9d4-0068c57078" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx60984ad299e44e5593833-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdh1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx8557319d677d42e8b7fa9-0068c57078" "proxy-server 1824514" 0.0128 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx8557319d677d42e8b7fa9-0068c57078" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx3a888ededf4d48f2a0636-0068c57078" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx0c46f0770db2447bbcdb7-0068c57078" "proxy-server 1824514" 0.0133 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 412 - "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txac9547f3c792470391157-0068c57078" "proxy-server 1824514" 0.0129 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdh1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 412 - "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txac9547f3c792470391157-0068c57078" "proxy-server 1824514" 0.0007 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: txac9547f3c792470391157-0068c57078) proxy DEBUG: Ignoring 412 from primary (txn: txac9547f3c792470391157-0068c57078) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 412 - "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txac9547f3c792470391157-0068c57078" "proxy-server 1824514" 0.0007 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: txac9547f3c792470391157-0068c57078) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx3678440445c94ced88b82-0068c57078" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx6f64ed77e44c4593b553c-0068c57078" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdh1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 304 - "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx9cc93965bb284477ad5e4-0068c57078" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 304 - "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx9cc93965bb284477ad5e4-0068c57078" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 304 - "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx9cc93965bb284477ad5e4-0068c57078" "proxy-server 1824514" 0.0129 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txa09b32999120444c8a39c-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx339d98d061ec486d9712a-0068c57078" "proxy-server 1824514" 0.0136 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdh1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 304 - "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx02c8f2ba7c2a4798bb6c5-0068c57078" "proxy-server 1824514" 0.0089 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 304 - "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx02c8f2ba7c2a4798bb6c5-0068c57078" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 304 - "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx02c8f2ba7c2a4798bb6c5-0068c57078" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd719971a092443da9f200-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx66078c96945b4c3da0eda-0068c57078" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txfea0c90449504da594bcc-0068c57078" "proxy-server 1824514" 0.0049 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "GET /sdh1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "GET http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txfea0c90449504da594bcc-0068c57078" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx4eb80c8b73ce40408d8dd-0068c57078" "proxy-server 1824514" 0.0055 "-" 1824514 -test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_zero_segments test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_complete_zero_segments ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_s3acl_with_cached_seg_buck test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_s3acl_with_cached_seg_buck ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_with_checksum_algorithm test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_with_checksum_algorithm ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_with_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_with_segment_bucket ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_id_and_key_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_id_and_key_marker ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_key_marker test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_key_marker ... ok test-TestECDiskFile ERROR: Problem cleaning up /tmp/tmpav_9ksqi/tmp_test_obj_server_DiskFile/sda1/objects/0/786/cedbbf46699b0bc91f4708bc74618786 (): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3338, in _finalize_durable self.manager.cleanup_ondisk_files(self._datadir) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test-TestECDiskFile ERROR: Problem making data file durable /tmp/tmpgwlykq10/tmp_test_obj_server_DiskFile/sda1/objects/0/379/14bd8a682e2f7946b3ee7fc04fea5379/1757769845.90956#2#d.data ([Errno 21] Some IO Error): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3299, in _finalize_durable fsync_dir(self._datadir) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect IsADirectoryError: [Errno 21] Some IO Error test-TestECDiskFile ERROR: Problem making data file durable /tmp/tmpua7qp0g_/tmp_test_obj_server_DiskFile/sda1/objects/0/379/14bd8a682e2f7946b3ee7fc04fea5379/1757769845.92152#2#d.data ([Errno 100] Some Error): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3299, in _finalize_durable fsync_dir(self._datadir) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: [Errno 100] Some Error test-TestECDiskFile ERROR: No space left on device for /tmp/tmpmif2_sr9/tmp_test_obj_server_DiskFile/sda1/objects/0/5a3/5731c8682201c313091bd354b5f285a3/1757769845.93371#2#d.data ([Errno 122] EDQUOT): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3298, in _finalize_durable os.rename(data_file_path, durable_data_file_path) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: [Errno 122] EDQUOT test-TestECDiskFile ERROR: No space left on device for /tmp/tmp0mtqikmq/tmp_test_obj_server_DiskFile/sda1/objects/0/5a3/5731c8682201c313091bd354b5f285a3/1757769845.94982#2#d.data ([Errno 28] ENOSPC): [Errno 28] ENOSPC test-TestECDiskFile ERROR: Problem making data file durable /tmp/tmpv5uy2_mh/tmp_test_obj_server_DiskFile/sda1/objects/0/5a3/5731c8682201c313091bd354b5f285a3/1757769845.96224#2#d.data ([Errno 100] Some Error): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3298, in _finalize_durable os.rename(data_file_path, durable_data_file_path) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: [Errno 100] Some Error test-TestECDiskFile ERROR: Problem making data file durable /tmp/tmpu3idnwbg/tmp_test_obj_server_DiskFile/sda1/objects/0/5a3/5731c8682201c313091bd354b5f285a3/1757769845.97445#2#d.data ([Errno 21] Some other IO Error): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3298, in _finalize_durable os.rename(data_file_path, durable_data_file_path) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect IsADirectoryError: [Errno 21] Some other IO Error test-TestECDiskFile ERROR: Error removing tempfile: /tmp/tmpe5he5jd5/tmp_test_obj_server_DiskFile/sda1/tmp/tmpnh5diqja: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1887, in open fallocate(self._fd, self._size) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: [Errno 28] No space left on device During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3081, in create yield dfw.open() ~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1890, in open raise DiskFileNoSpace() swift.common.exceptions.DiskFileNoSpace During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1918, in close os.unlink(self._tmppath) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect FileNotFoundError: [Errno 2] No such file or directory test-TestECDiskFile WARNING: Quarantined object /tmp/tmpd8oym1k9/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769846.43818#2#d.data: Bytes read: 84, does not match metadata: 85 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpv4iw5580/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769846.88015#2#d.data: [Errno 5] Input/output error test-TestECDiskFile WARNING: Quarantined object /tmp/tmp2ckf9dt2/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769846.89184#2#d.data: Bytes read: 82, does not match metadata: 83 Problem cleaning up /tmp/tmp4o_8esgk/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099 Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2005, in _finalize_put self.manager.cleanup_ondisk_files(self._datadir) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 5951, in mock_cleanup raise OSError() OSError test.unit.obj.test_diskfile.TestECDiskFile.test_error_in_cleanup_ondisk_files test.unit.obj.test_diskfile.TestECDiskFile.test_error_in_cleanup_ondisk_files ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_exception_in_handle_close_quarantine test.unit.obj.test_diskfile.TestECDiskFile.test_exception_in_handle_close_quarantine ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_fragments test.unit.obj.test_diskfile.TestECDiskFile.test_fragments ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_fragments_available_when_not_durable test.unit.obj.test_diskfile.TestECDiskFile.test_fragments_available_when_not_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_fragments_not_open test.unit.obj.test_diskfile.TestECDiskFile.test_fragments_not_open ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_from_audit_location test.unit.obj.test_diskfile.TestECDiskFile.test_from_audit_location ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_from_audit_location_with_mismatched_hash test.unit.obj.test_diskfile.TestECDiskFile.test_from_audit_location_with_mismatched_hash ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_datafile_metadata test.unit.obj.test_diskfile.TestECDiskFile.test_get_datafile_metadata ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_datafile_metadata_not_opened test.unit.obj.test_diskfile.TestECDiskFile.test_get_datafile_metadata_not_opened ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_dev_path test.unit.obj.test_diskfile.TestECDiskFile.test_get_dev_path ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_metadata test.unit.obj.test_diskfile.TestECDiskFile.test_get_metadata ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_metadata_not_opened test.unit.obj.test_diskfile.TestECDiskFile.test_get_metadata_not_opened ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_metafile_metadata test.unit.obj.test_diskfile.TestECDiskFile.test_get_metafile_metadata ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_metafile_metadata_not_opened test.unit.obj.test_diskfile.TestECDiskFile.test_get_metafile_metadata_not_opened ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_tempfile_fallback_to_mkstemp test.unit.obj.test_diskfile.TestECDiskFile.test_get_tempfile_fallback_to_mkstemp ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_tempfile_use_linkat_os_open_called test.unit.obj.test_diskfile.TestECDiskFile.test_get_tempfile_use_linkat_os_open_called ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_without_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_without_bucket ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_get_tmpfile_os_open_other_exceptions_are_raised test.unit.obj.test_diskfile.TestECDiskFile.test_get_tmpfile_os_open_other_exceptions_are_raised ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_keep_cache test.unit.obj.test_diskfile.TestECDiskFile.test_keep_cache ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_killed_before_cleanup test.unit.obj.test_diskfile.TestECDiskFile.test_killed_before_cleanup ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_mount_checking test.unit.obj.test_diskfile.TestECDiskFile.test_mount_checking ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_not_opened test.unit.obj.test_diskfile.TestECDiskFile.test_not_opened ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_number_calls_to_cleanup_ondisk_files_during_create test.unit.obj.test_diskfile.TestECDiskFile.test_number_calls_to_cleanup_ondisk_files_during_create ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_number_calls_to_cleanup_ondisk_files_during_delete test.unit.obj.test_diskfile.TestECDiskFile.test_number_calls_to_cleanup_ondisk_files_during_delete ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_data_info_has_durable_key test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_data_info_has_durable_key ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_data_ts_meta test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_data_ts_meta ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_data_ts_meta_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_data_ts_meta_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_listdir_error test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_listdir_error ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_listdir_error_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_listdir_error_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_meta_data_ts test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_meta_data_ts ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_meta_data_ts_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_meta_data_ts_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_meta_ts_data test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_meta_ts_data ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_multiple_meta_data test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_multiple_meta_data ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_multiple_meta_data_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_multiple_meta_data_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_stale_meta_data test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_stale_meta_data ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_stale_meta_data_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_stale_meta_data_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_ts_meta_data test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_ts_meta_data ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_wayward_files_ignored test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_wayward_files_ignored ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_wayward_files_ignored_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_ondisk_search_loop_wayward_files_ignored_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_data_file_concurrently_unlinked test.unit.obj.test_diskfile.TestECDiskFile.test_open_data_file_concurrently_unlinked ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_deleted test.unit.obj.test_diskfile.TestECDiskFile.test_open_deleted ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_deleted_with_corrupt_tombstone test.unit.obj.test_diskfile.TestECDiskFile.test_open_deleted_with_corrupt_tombstone ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_expired test.unit.obj.test_diskfile.TestECDiskFile.test_open_expired ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_meta_file_concurrently_unlinked test.unit.obj.test_diskfile.TestECDiskFile.test_open_meta_file_concurrently_unlinked ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_most_recent_durable test.unit.obj.test_diskfile.TestECDiskFile.test_open_most_recent_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_most_recent_durable_legacy test.unit.obj.test_diskfile.TestECDiskFile.test_open_most_recent_durable_legacy ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_most_recent_missing_durable test.unit.obj.test_diskfile.TestECDiskFile.test_open_most_recent_missing_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_not_exist test.unit.obj.test_diskfile.TestECDiskFile.test_open_not_exist ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_not_expired test.unit.obj.test_diskfile.TestECDiskFile.test_open_not_expired ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_with_bad_fragment_preferences test.unit.obj.test_diskfile.TestECDiskFile.test_open_with_bad_fragment_preferencesswift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_with_fragment_preferences test.unit.obj.test_diskfile.TestECDiskFile.test_open_with_fragment_preferences ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_open_with_fragment_preferences_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_open_with_fragment_preferences_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_already_removed test.unit.obj.test_diskfile.TestECDiskFile.test_purge_already_removed ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_final_fragment_index_and_meta test.unit.obj.test_diskfile.TestECDiskFile.test_purge_final_fragment_index_and_meta ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_final_fragment_index_and_not_meta test.unit.obj.test_diskfile.TestECDiskFile.test_purge_final_fragment_index_and_not_meta ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_last_fragment_index test.unit.obj.test_diskfile.TestECDiskFile.test_purge_last_fragment_index ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_last_fragment_index_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_purge_last_fragment_index_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_non_existent_fragment_index test.unit.obj.test_diskfile.TestECDiskFile.test_purge_non_existent_fragment_index ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_old_timestamp_frag_index test.unit.obj.test_diskfile.TestECDiskFile.test_purge_old_timestamp_frag_index ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_old_tombstone test.unit.obj.test_diskfile.TestECDiskFile.test_purge_old_tombstone ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_one_fragment_index test.unit.obj.test_diskfile.TestECDiskFile.test_purge_one_fragment_index ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_tombstone test.unit.obj.test_diskfile.TestECDiskFile.test_purge_tombstone ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_purge_without_frag test.unit.obj.test_diskfile.TestECDiskFile.test_purge_without_frag ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_bad_content_length test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_bad_content_length ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_corrupt_xattrs test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_corrupt_xattrs ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_deleted_files test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_deleted_files ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:read:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_s3acl_and_keystone test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_s3acl_and_keystone ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_s3acl_and_unknown_user test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_s3acl_and_unknown_user ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_without_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_initiate_without_segment_bucket ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_invalid_md5 test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_invalid_md5 ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.cli.test_relinker.TestRelinker.test_relink_partition_filter test.unit.cli.test_relinker.TestRelinker.test_relink_partition_filter ... ok test-TestECDiskFile ERROR: ERROR DiskFile /tmp/tmpskemtgzy/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769847.10156#2#d.data close failure: a very special error : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2414, in close self._handle_close_quarantine() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 5777, in blow_up raise Exception('a very special error') Exception: a very special error test-TestECDiskFile WARNING: Quarantined object /tmp/tmpaq6rei2u/tmp_test_obj_server_DiskFile/sda1/objects/0/e48/47e08decfda915ff87e2b3f30f98ee48/1757769847.20894#2#d.data: Hash of name in metadata does not match directory name test-TestECDiskFile DEBUG: open(/tmp/tmpgjnn8xxu/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099, O_TMPFILE | O_WRONLY) failed: Operation not supported Falling back to using mkstemp() test-TestECDiskFile DEBUG: open(/tmp/tmpgjnn8xxu/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099, O_TMPFILE | O_WRONLY) failed: Is a directory Falling back to using mkstemp() test-TestECDiskFile DEBUG: open(/tmp/tmpgjnn8xxu/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099, O_TMPFILE | O_WRONLY) failed: Invalid argument Falling back to using mkstemp() test-TestECDiskFile DEBUG: Relinking /tmp/tmph8r7kxa5/tmp_test_obj_server_DiskFile/sda1/objects/931/c24/e8e79ba726c8c1324e164bd9a8b84c24/1757769847.39797#2.data to /tmp/tmph8r7kxa5/tmp_test_obj_server_DiskFile/sda1/objects/1863/c24/e8e79ba726c8c1324e164bd9a8b84c24/1757769847.39797#2.data due to next_part_power set test-TestECDiskFile ERROR: Problem making data file durable /tmp/tmph8r7kxa5/tmp_test_obj_server_DiskFile/sda1/objects/931/c24/e8e79ba726c8c1324e164bd9a8b84c24/1757769847.39797#2#d.data (): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3338, in _finalize_durable self.manager.cleanup_ondisk_files(self._datadir) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception test-TestECDiskFile DEBUG: Relinking /tmp/tmph8r7kxa5/tmp_test_obj_server_DiskFile/sda1/objects-1/659/dcd/a4d9f6f0200f56fcd48dce558f1e3dcd/1757769847.40788.data to /tmp/tmph8r7kxa5/tmp_test_obj_server_DiskFile/sda1/objects-1/1318/dcd/a4d9f6f0200f56fcd48dce558f1e3dcd/1757769847.40788.data due to next_part_power set test-TestECDiskFile WARNING: Quarantined object /tmp/tmpe82qhqpy/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769847.66970.ts: Metadata checksum mismatch for /tmp/tmpe82qhqpy/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769847.66970.ts: stored checksum='b'3e2b30f4df75d99fc6618316b9ccae2e'', computed='b'94aed04b11f4a95bf069706f10630448'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpaaug9_p2/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769847.98717#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769847.99999#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769847.99999#2#d.data'>: stored checksum='b'ecece931c939d47869b34aeb6bec0410'', computed='b'55daae384cbf72add5f9b9d30ac28c10'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.00230#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.00230#2#d.data'>: stored checksum='b'0ba3102711a5e936a89d75557fc88be2'', computed='b'1c8d27721f34c6e320995009eb60b937'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.01276#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.01276#2#d.data'>: stored checksum='b'd6660e941b53b54a2d499bc7511f1491'', computed='b'a78b2e2bb433dd85bcf58d7529b3d3e4'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.02415#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.02415#2#d.data'>: stored checksum='b'ea9472872ba7c139b47928e37e64cadd'', computed='b'cf8f04f441e356d819368befbea3257d'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.02645#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.02645#2#d.data'>: stored checksum='b'169264e016a5ae8f836abd6a24d9ba6f'', computed='b'c44e1f6c0df863a895803c41f77fcadb'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.03693#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.03693#2#d.data'>: stored checksum='b'ef682c999fb92ea9c4b5c11c7044033d'', computed='b'067c793ed8f2a109eba22c43de73b1f7'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769848.04953#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769848.04953#2#d.data'>: stored checksum='b'b6e4dafb33e68a4ce9505d95446ebd53'', computed='b'aa8d5b8c942683bacb24aada4d0c3338'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.05184#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.05184#2#d.data'>: stored checksum='b'7cf8472741097328e4d82924cfb3e78e'', computed='b'f533e765dbe654f6dcb6e8f8cb365d68'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.05402#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7fefeowv/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.05402#2#d.data'>: stored checksum='b'624c2b0e8ffa8a6a5c063ee303c82090'', computed='b'027605d0716b69b3c76b5f0299987758'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpezz42j9u/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769848.08750#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpwa6db258/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769848.11317#2#d.data: not stat-able: test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_fstat_oserror test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_fstat_oserror ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_hashdir_not_a_directory test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_hashdir_not_a_directory ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_hashdir_not_listable test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_hashdir_not_listable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_bad_name test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_bad_name ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_bad_x_delete_at test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_bad_x_delete_at ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_content_length test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_content_length ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_content_length_bad test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_content_length_bad ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_version_id_but_not_enabled test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_with_version_id_but_not_enabled ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_without_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_GET_without_permission ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.cli.test_relinker.TestRelinker.test_relink_policy_option test.unit.cli.test_relinker.TestRelinker.test_relink_policy_option ... ok 3 RLock(s) were not greened, to fix this error make sure you run eventlet.monkey_patch() before importing any other modules. fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Start tag expected, '<' not found, line 1, column 1 (, line 1) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Expecting an element , got nothing, line 1 fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'yes', 'X-Object-Sysmeta-S3Api-Content-Type': 'cat/picture', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_invalid_sha256 test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_invalid_sha256 ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_missing_part_with_heartbeat test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_missing_part_with_heartbeat ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_etag_mismatch test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_etag_mismatch ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_mixed_policy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_mixed_policy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_nothing_there test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_nothing_there ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_upload_id_mismatch test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_upload_id_mismatch ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_match ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_modified_since test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_modified_since ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_none_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_none_match ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_none_match_star test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_none_match_star ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_unmodified_since test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_retry_complete_with_if_unmodified_since ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_upper_sha256 test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_upload_upper_sha256 ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_uploads_list test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_multipart_uploads_list ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_upload_part test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_upload_part ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_upload_part_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_object_upload_part_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_headers_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_headers_error ... ok test.unit.common.test_utils.TestUtils.test_monkey_patch test.unit.common.test_utils.TestUtils.test_monkey_patch ... ok test.unit.common.test_utils.TestUtils.test_node_to_string test.unit.common.test_utils.TestUtils.test_node_to_string ... ok test.unit.common.test_utils.TestUtils.test_none_data_raises_type_error test.unit.common.test_utils.TestUtils.test_none_data_raises_type_error ... ok test.unit.common.test_utils.TestUtils.test_normalize_delete_at_timestamp test.unit.common.test_utils.TestUtils.test_normalize_delete_at_timestamp ... ok test.unit.common.test_utils.TestUtils.test_normalize_delete_at_timestamp_high_precision test.unit.common.test_utils.TestUtils.test_normalize_delete_at_timestamp_high_precision ... ok test.unit.common.test_utils.TestUtils.test_normalize_timestamp test.unit.common.test_utils.TestUtils.test_normalize_timestamp ... ok test.unit.common.test_utils.TestUtils.test_override_bytes_from_content_type test.unit.common.test_utils.TestUtils.test_override_bytes_from_content_type ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.test_utils.TestUtils.test_parse_content_type test.unit.common.test_utils.TestUtils.test_parse_content_type ... ok test.unit.common.test_utils.TestUtils.test_parse_db_filename test.unit.common.test_utils.TestUtils.test_parse_db_filename ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_headers_with_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_headers_with_match ... ok test.unit.common.test_utils.TestUtils.test_parse_header test.unit.common.test_utils.TestUtils.test_parse_header ... ok test.unit.common.test_utils.TestUtils.test_parse_header_non_token_chars_in_params test.unit.common.test_utils.TestUtils.test_parse_header_non_token_chars_in_params ... ok test.unit.common.test_utils.TestUtils.test_parse_header_quoted_string_in_params test.unit.common.test_utils.TestUtils.test_parse_header_quoted_string_in_params ... ok test.unit.common.test_utils.TestUtils.test_parse_headers_chars_in_params test.unit.common.test_utils.TestUtils.test_parse_headers_chars_in_params ... ok test.unit.common.test_utils.TestUtils.test_parse_options test.unit.common.test_utils.TestUtils.test_parse_options ... ok test.unit.common.test_utils.TestUtils.test_parse_options_errors test.unit.common.test_utils.TestUtils.test_parse_options_errors ... ok test.unit.common.test_utils.TestUtils.test_parse_override_options test.unit.common.test_utils.TestUtils.test_parse_override_options ... ok test.unit.common.test_utils.TestUtils.test_quorum_size test.unit.common.test_utils.TestUtils.test_quorum_size ... ok test.unit.common.test_utils.TestUtils.test_quote_bytes test.unit.common.test_utils.TestUtils.test_quote_bytes ... ok test.unit.common.test_utils.TestUtils.test_quote_unicode test.unit.common.test_utils.TestUtils.test_quote_unicode ... ok test.unit.common.test_utils.TestUtils.test_ratelimit_sleep test.unit.common.test_utils.TestUtils.test_ratelimit_sleep ... ok test.unit.common.test_utils.TestUtils.test_ratelimit_sleep_with_incr test.unit.common.test_utils.TestUtils.test_ratelimit_sleep_with_incr ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_headers_with_not_match test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_headers_with_not_match ... ok test.unit.common.test_utils.TestUtils.test_ratelimit_sleep_with_sleep test.unit.common.test_utils.TestUtils.test_ratelimit_sleep_with_sleep ... ok test.unit.common.test_utils.TestUtils.test_remove_directory test.unit.common.test_utils.TestUtils.test_remove_directory ... ok test.unit.common.test_utils.TestUtils.test_remove_file test.unit.common.test_utils.TestUtils.test_remove_file ... ok test.unit.common.test_utils.TestUtils.test_renamer_when_fsync_is_false test.unit.common.test_utils.TestUtils.test_renamer_when_fsync_is_false ... ok test.unit.common.test_utils.TestUtils.test_renamer_with_fsync_dir test.unit.common.test_utils.TestUtils.test_renamer_with_fsync_dir ... ok test.unit.common.test_utils.TestUtils.test_replace_partition_in_path test.unit.common.test_utils.TestUtils.test_replace_partition_in_path ... ok test.unit.common.test_utils.TestUtils.test_round_robin_iter test.unit.common.test_utils.TestUtils.test_round_robin_iter ... ok test.unit.common.test_utils.TestUtils.test_rsync_ip_ipv4_localhost test.unit.common.test_utils.TestUtils.test_rsync_ip_ipv4_localhost ... ok test.unit.common.test_utils.TestUtils.test_rsync_ip_ipv6_ipv4_compatible test.unit.common.test_utils.TestUtils.test_rsync_ip_ipv6_ipv4_compatible ... ok test.unit.common.test_utils.TestUtils.test_rsync_ip_ipv6_random_ip test.unit.common.test_utils.TestUtils.test_rsync_ip_ipv6_random_ip ... ok test.unit.common.test_utils.TestUtils.test_rsync_module_interpolation test.unit.common.test_utils.TestUtils.test_rsync_module_interpolation ... ok test.unit.common.test_utils.TestUtils.test_safe_json_loads test.unit.common.test_utils.TestUtils.test_safe_json_loads ... ok test.unit.common.test_utils.TestUtils.test_search_tree test.unit.common.test_utils.TestUtils.test_search_tree ... ok test.unit.common.test_utils.TestUtils.test_search_tree_conf_dir_pid_with_named_conf_match test.unit.common.test_utils.TestUtils.test_search_tree_conf_dir_pid_with_named_conf_match ... ok test.unit.common.test_utils.TestUtils.test_search_tree_conf_dir_with_named_conf_match test.unit.common.test_utils.TestUtils.test_search_tree_conf_dir_with_named_conf_match ... ok test.unit.common.test_utils.TestUtils.test_search_tree_with_directory_ext_match test.unit.common.test_utils.TestUtils.test_search_tree_with_directory_ext_match ... ok test.unit.common.test_utils.TestUtils.test_select_node_ip test.unit.common.test_utils.TestUtils.test_select_node_ip ... ok test.unit.common.test_utils.TestUtils.test_split_path test.unit.common.test_utils.TestUtils.test_split_path ... ok test.unit.common.test_utils.TestUtils.test_storage_directory test.unit.common.test_utils.TestUtils.test_storage_directory ... ok test.unit.common.test_utils.TestUtils.test_streq_const_time test.unit.common.test_utils.TestUtils.test_streq_const_time ... ok test.unit.common.test_utils.TestUtils.test_strict_b64decode test.unit.common.test_utils.TestUtils.test_strict_b64decode ... ok test.unit.common.test_utils.TestUtils.test_strict_b64decode_allow_line_breaks test.unit.common.test_utils.TestUtils.test_strict_b64decode_allow_line_breaks ... ok test.unit.common.test_utils.TestUtils.test_strict_b64decode_exact_size test.unit.common.test_utils.TestUtils.test_strict_b64decode_exact_size ... ok test.unit.common.test_utils.TestUtils.test_string_data_raises_type_error test.unit.common.test_utils.TestUtils.test_string_data_raises_type_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_range test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_range ... ok test.unit.common.test_utils.TestUtils.test_systemd_notify test.unit.common.test_utils.TestUtils.test_systemd_notify ... ok test.unit.common.test_utils.TestUtils.test_validate_device_partition test.unit.common.test_utils.TestUtils.test_validate_device_partition ... ok test.unit.common.test_utils.TestUtils.test_validate_hash_conf test.unit.common.test_utils.TestUtils.test_validate_hash_conf ... ok test.unit.common.test_utils.TestUtils.test_validate_sync_to test.unit.common.test_utils.TestUtils.test_validate_sync_to ... ok test.unit.common.test_utils.TestUtils.test_write_file test.unit.common.test_utils.TestUtils.test_write_file ... ok test.unit.common.utils.test_ipaddrs.TestExpandIPv6.test_expand_ipv6 test.unit.common.utils.test_ipaddrs.TestExpandIPv6.test_expand_ipv6 ... ok test.unit.common.utils.test_logs.TestNoopMutex.test_acquire_release_api test.unit.common.utils.test_logs.TestNoopMutex.test_acquire_release_api ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_range_invalid test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_range_invalid ... ok test.unit.common.utils.test_logs.TestNoopMutex.test_context_manager_api test.unit.common.utils.test_logs.TestNoopMutex.test_context_manager_api ... ok test.unit.common.ring.test_builder.TestRingBuilderDispersion.test_multiple_tier_dispersion test.unit.common.ring.test_builder.TestRingBuilderDispersion.test_multiple_tier_dispersion ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_range_unsatisfiable test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadNonUTC.test_upload_part_copy_range_unsatisfiable ... ok test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_read_no_sig_checker test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_read_no_sig_checker ... ok test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_read_sig_checker_bad test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_read_sig_checker_bad ... ok test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_read_sig_checker_ok test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_read_sig_checker_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_readline_sig_checker_ok_newline_is_end_of_chunk test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_readline_sig_checker_ok_newline_is_end_of_chunk ... ok test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_readline_sig_checker_ok_newline_is_midway_through_chunk test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_readline_sig_checker_ok_newline_is_midway_through_chunk ... ok test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_readline_sig_checker_ok_partial_line_read test.unit.common.middleware.s3api.test_s3request.TestChunkReader.test_readline_sig_checker_ok_partial_line_read ... ok test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0003 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0036 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/bashful" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0121 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy10" 201 - "-" "-" "-" 0.0093 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy10_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy20" 301 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy20_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy30" 301 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy30_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy40" 301 - "-" "-" "-" 0.0087 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy40_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy50" 201 - "-" "-" "-" 0.0092 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy50_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0093 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy60" 301 - "-" "-" "-" 0.0009 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy60_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy70" 201 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy70_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy80" 201 - "-" "-" "-" 0.0088 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpy80_no_header" 201 - "-" "-" "-" 0.0094 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpier10" 201 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpier10_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpier20" 301 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpier20_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpier30" 301 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpier30_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpier40" 301 - "-" "-" "-" 0.0009 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpier40_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:08 +0000] "PUT /sda1/p/a/c/grumpier50" 201 - "-" "-" "-" 0.0092 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpier50_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpier60" 301 - "-" "-" "-" 0.0052 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpier60_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpier70" 201 - "-" "-" "-" 0.0133 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpier70_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpier80" 201 - "-" "-" "-" 0.0009 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpier80_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey10" 201 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey10_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey20" 301 - "-" "-" "-" 0.0092 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey20_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey30" 301 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey30_no_header" 201 - "-" "-" "-" 0.0077 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey40" 301 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey40_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey50" 201 - "-" "-" "-" 0.0052 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey50_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_object_update_redirected_to_shard test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_object_update_redirected_to_shard ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_proxy_default_no_policy_for_existing_default test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_proxy_default_no_policy_for_existing_default ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET test.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET ... ok test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_methods_with_default_sample_rate test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_methods_with_default_sample_rate ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_methods_with_metric_prefix test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_methods_with_metric_prefix ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_reset_container_sync test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_reset_container_sync ... ok test-TestECDiskFile WARNING: Quarantined object /tmp/tmp9bai92ts/tmp_test_obj_server_DiskFile/sda1/objects/0/f9a/a5ef4798e2afeef2ce8b2f3e890d8f9a/made-up-filename: Expected directory, found file at /tmp/tmp9bai92ts/tmp_test_obj_server_DiskFile/sda1/objects/0/f9a/a5ef4798e2afeef2ce8b2f3e890d8f9a test-TestECDiskFile WARNING: Quarantined object /tmp/tmpw2_grqpq/tmp_test_obj_server_DiskFile/sda1/objects/0/f9a/a5ef4798e2afeef2ce8b2f3e890d8f9a/made-up-filename: Failed to list directory at /tmp/tmpw2_grqpq/tmp_test_obj_server_DiskFile/sda1/objects/0/f9a/a5ef4798e2afeef2ce8b2f3e890d8f9a test-TestECDiskFile WARNING: Quarantined object /tmp/tmpw2_grqpq/tmp_test_obj_server_DiskFile/sda1/objects/0/f9a/a5ef4798e2afeef2ce8b2f3e890d8f9a/made-up-filename: Failed to list directory at /tmp/tmpw2_grqpq/tmp_test_obj_server_DiskFile/sda1/objects/0/f9a/a5ef4798e2afeef2ce8b2f3e890d8f9a test-TestECDiskFile ERROR: Client path /a/c/1 does not match path stored in object metadata /a/c/1garbage test-TestECDiskFile ERROR: Client path /a/c/2 does not match path stored in object metadata /a/c/2garbage test-TestECDiskFile ERROR: Client path /a/c/3 does not match path stored in object metadata /a/c/3garbage test-TestECDiskFile ERROR: Client path /a/c/4 does not match path stored in object metadata /a/c/4garbage test-TestECDiskFile ERROR: Client path /a/c/5 does not match path stored in object metadata /a/c/5garbage test-TestECDiskFile ERROR: Client path /a/c/6 does not match path stored in object metadata /a/c/6garbage test-TestECDiskFile ERROR: Client path /a/c/7 does not match path stored in object metadata /a/c/7garbage test-TestECDiskFile ERROR: Client path /a/c/8 does not match path stored in object metadata /a/c/8garbage test-TestECDiskFile ERROR: Client path /a/c/8 does not match path stored in object metadata /a/c/8garbage test-TestECDiskFile WARNING: Quarantined object /tmp/tmpyw_tpryx/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769848.24785#2#d.data: bad metadata x-delete-at value bad integer test-TestECDiskFile WARNING: Quarantined object /tmp/tmpyw_tpryx/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.25030#2#d.data: bad metadata x-delete-at value bad integer test-TestECDiskFile WARNING: Quarantined object /tmp/tmpyw_tpryx/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.26100#2#d.data: bad metadata x-delete-at value bad integer test-TestECDiskFile WARNING: Quarantined object /tmp/tmpyw_tpryx/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.27151#2#d.data: bad metadata x-delete-at value bad integer test-TestECDiskFile WARNING: Quarantined object /tmp/tmpyw_tpryx/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.27383#2#d.data: bad metadata x-delete-at value bad integer test-TestECDiskFile WARNING: Quarantined object /tmp/tmpyw_tpryx/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.29171#2#d.data: bad metadata x-delete-at value bad integer test-TestECDiskFile WARNING: Quarantined object /tmp/tmpyw_tpryx/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769848.29393#2#d.data: bad metadata x-delete-at value bad integer test-TestECDiskFile WARNING: Quarantined object /tmp/tmpyw_tpryx/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.30446#2#d.data: bad metadata x-delete-at value bad integer test-TestECDiskFile WARNING: Quarantined object /tmp/tmpyw_tpryx/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.31880#2#d.data: bad metadata x-delete-at value bad integer test-TestECDiskFile WARNING: Quarantined object /tmp/tmpmgkmdl_q/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769848.33237#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpmgkmdl_q/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.33483#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpmgkmdl_q/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.34102#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpmgkmdl_q/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.35947#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpmgkmdl_q/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.36186#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpmgkmdl_q/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.37248#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpmgkmdl_q/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769848.38097#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpmgkmdl_q/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.38804#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpmgkmdl_q/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.39038#2#d.data: metadata content-length 1023 does not match actual object size 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpdvz85rpr/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769848.41570#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmpdvz85rpr/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.41810#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmpdvz85rpr/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.42860#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmpdvz85rpr/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.43982#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmpdvz85rpr/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.44225#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmpdvz85rpr/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.45287#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmpdvz85rpr/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769848.46735#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmpdvz85rpr/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.46965#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmpdvz85rpr/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.48062#2#d.data: bad metadata content-length value zero test-TestECDiskFile WARNING: Quarantined object /tmp/tmpa5kmzi9_/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769848.49362#2#d.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 dfbee243f1a2b1fc6663ff609231cc8c do not match test-TestECDiskFile WARNING: Quarantined object /tmp/tmpa5kmzi9_/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.50485#2#d.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 dfbee243f1a2b1fc6663ff609231cc8c do not matchtest.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_etag test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_etag ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_missing_name test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_missing_name ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_zero_byte test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_invalid_zero_byte ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_ioerror_enodata test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_ioerror_enodata ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_ioerror_euclean test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_ioerror_euclean ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_missing_content_length test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_missing_content_length ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_shard_range_autocreates_shard_container test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_shard_range_autocreates_shard_container ... ok test.unit.common.ring.test_builder.TestRingBuilderDispersion.test_rebalance_dispersion test.unit.common.ring.test_builder.TestRingBuilderDispersion.test_rebalance_dispersion ... ok test.unit.common.ring.test_builder.TestRingBuilderDispersion.test_weight_dispersion test.unit.common.ring.test_builder.TestRingBuilderDispersion.test_weight_dispersion ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_shard_range_json_in_body test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_shard_range_json_in_body ... ok test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_component_different_builder_order test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_component_different_builder_order ... ok test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:08 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp23z1qwh5/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:08 09/13/25 GMT (0:00:00.011161 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:08 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpz1j2jvoq/node/sda1 (cleanup=False) test WARNING: Error relinking: failed to relink /tmp/tmpz1j2jvoq/node/sda1/objects/242/5f4/f2c1cb02e334032a68d987bfe74565f4/1757769848.55876.data to /tmp/tmpz1j2jvoq/node/sda1/objects/485/5f4/f2c1cb02e334032a68d987bfe74565f4/1757769848.55876.data: [Errno 17] File exists: '/tmp/tmpz1j2jvoq/node/sda1/objects/242/5f4/f2c1cb02e334032a68d987bfe74565f4/1757769848.55876.data' -> '/tmp/tmpz1j2jvoq/node/sda1/objects/485/5f4/f2c1cb02e334032a68d987bfe74565f4/1757769848.55876.data' test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 0/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test WARNING: 1 hash dirs processed (cleanup=False) (1 files, 0 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=False): 13:24:08 09/13/25 GMT (0:00:00.011117 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:08 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmptt7ydboa/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:08 09/13/25 GMT (0:00:00.011183 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:08 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp6k67810v/node/sda1 (cleanup=False) test WARNING: Skipping /tmp/tmp6k67810v/node/sda1/objects because test DEBUG: Updating recon test WARNING: There were 1 errors listing partition directories test WARNING: 0 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 1 errors) test INFO: Finished relinker (cleanup=False): 13:24:08 09/13/25 GMT (0:00:00.014584 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:08 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp48gd1b57/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp48gd1b57/node/sda1/objects/43/34b/2b153d1297b57d4c8bc6010e8cfb034b/1757769848.81040.meta to /tmp/tmp48gd1b57/node/sda1/objects/86/34b/2b153d1297b57d4c8bc6010e8cfb034b/1757769848.81040.meta test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:08 09/13/25 GMT (0:00:00.015241 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:08 09/13/25 GMT test DEBUG: Updating recon test WARNING: No policy found to increase the partition power. test INFO: Finished relinker (cleanup=False): 13:24:08 09/13/25 GMT (0:00:00.014557 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpjo43or64/node/sda1 (cleanup=False) test WARNING: Skipping sda1 as it is not mounted test DEBUG: Updating recon test WARNING: 1 disks were unmounted test WARNING: 0 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.003104 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp27zjlch0/node/sda1 (cleanup=False) test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 0 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.015048 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp27zjlch0/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp27zjlch0/node/sda1/objects/196/10a/c4cbe23fb97201f56dfbb01ec3bb810a/1757769849.09276.data to /tmp/tmp27zjlch0/node/sda1/objects/393/10a/c4cbe23fb97201f56dfbb01ec3bb810a/1757769849.09276.data test DEBUG: Run listdir on /tmp/tmp27zjlch0/node/sda1/objects/393 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/3 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.018436 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp27zjlch0/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp27zjlch0/node/sda1/objects/202/543/caf3c09c8e19e7a45538906ef0c52543/1757769849.09276.data to /tmp/tmp27zjlch0/node/sda1/objects/405/543/caf3c09c8e19e7a45538906ef0c52543/1757769849.09276.data test DEBUG: Run listdir on /tmp/tmp27zjlch0/node/sda1/objects/405 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/3 test DEBUG: Relinking created link: /tmp/tmp27zjlch0/node/sda1/objects/140/aad/8c7e1bf90933482befb41b868b142aad/1757769849.09276.data to /tmp/tmp27zjlch0/node/sda1/objects/280/aad/8c7e1bf90933482befb41b868b142aad/1757769849.09276.data test DEBUG: Run listdir on /tmp/tmp27zjlch0/node/sda1/objects/280 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 3/3 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 2 hash dirs processed (cleanup=False) (2 files, 2 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.020988 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmp6pi6o0e4/node/sda1 (cleanup=False) test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 0 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.013514 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy gold under /tmp/tmp6pi6o0e4/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmp6pi6o0e4/node/sda1/objects/11/a43/0ba6ce65e747fcfaf0561b77c538fa43/1757769849.25772.data to /tmp/tmp6pi6o0e4/node/sda1/objects/23/a43/0ba6ce65e747fcfaf0561b77c538fa43/1757769849.25772.data test INFO: Step: relink Device: sda1 Policy: gold Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.003514 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy gold under /tmp/tmp6pi6o0e4/node/sda1 (cleanup=False) test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 0 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.003011 elapsed) Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_relink_second_quartile_does_rehash test.unit.cli.test_relinker.TestRelinker.test_relink_second_quartile_does_rehash ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_ts_data_meta_files test.unit.cli.test_relinker.TestRelinker.test_relink_ts_data_meta_files ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_ts_existing_newer_data_files test.unit.cli.test_relinker.TestRelinker.test_relink_ts_existing_newer_data_files ... ok test.unit.cli.test_relinker.TestRelinker.test_relink_ts_file test.unit.cli.test_relinker.TestRelinker.test_relink_ts_file ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_multi_chars_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_multi_chars_delimiter ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_prefix test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_prefix ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_batch_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_batch_reclaim ... ok test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_HEAD test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_HEAD ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_HEAD_Range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_HEAD_Range ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket0 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket1 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket2 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket3 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket4 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket5 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket6 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket7 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket8 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET_bucket_list test.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET_bucket_list ... ok test.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET_subresource test.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET_subresource ... ok test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_different_builders test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_different_builders ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:03 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_Response test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_Response ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_chexor test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_chexor ... ok test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpghd2gq45/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpghd2gq45/node/sda1/objects/103/c61/67b320f269cb556acf48b94486411c61/1757769850.53967.data to /tmp/tmpghd2gq45/node/sda1/objects/207/c61/67b320f269cb556acf48b94486411c61/1757769850.53967.data test DEBUG: Relinking created link: /tmp/tmpghd2gq45/node/sda1/objects/103/c61/67b320f269cb556acf48b94486411c61/1757769851.53967.meta to /tmp/tmpghd2gq45/node/sda1/objects/207/c61/67b320f269cb556acf48b94486411c61/1757769851.53967.meta test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (2 files, 2 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.014126 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpw6na2a1h/node/sda1 (cleanup=False) test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (0 files, 0 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.013373 elapsed) test INFO: Starting relinker (cleanup=False) using 1 workers: 13:24:09 09/13/25 GMT test INFO: Processing files for policy platinum under /tmp/tmpd1dhehex/node/sda1 (cleanup=False) test DEBUG: Relinking created link: /tmp/tmpd1dhehex/node/sda1/objects/23/71e/17e16e64e76d0f44a43b31375c43b71e/1757769849.73075.ts to /tmp/tmpd1dhehex/node/sda1/objects/47/71e/17e16e64e76d0f44a43b31375c43b71e/1757769849.73075.ts test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon test INFO: 1 hash dirs processed (cleanup=False) (1 files, 1 linked, 0 removed, 0 errors) test INFO: Finished relinker (cleanup=False): 13:24:09 09/13/25 GMT (0:00:00.031338 elapsed) Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_different_number_builders test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_different_number_builders ... ok test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_duplicate_builder_ids test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_duplicate_builder_ids ... ok test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_insufficient_builders test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_insufficient_builders ... ok Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_relinker_drop_privileges test.unit.cli.test_relinker.TestRelinker.test_relinker_drop_privileges ... ok test-TestECDiskFile WARNING: Quarantined object /tmp/tmpa5kmzi9_/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.51955#2#d.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 dfbee243f1a2b1fc6663ff609231cc8c do not match test-TestECDiskFile WARNING: Quarantined object /tmp/tmpa5kmzi9_/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.52189#2#d.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 dfbee243f1a2b1fc6663ff609231cc8c do not match test-TestECDiskFile WARNING: Quarantined object /tmp/tmpa5kmzi9_/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.53255#2#d.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 dfbee243f1a2b1fc6663ff609231cc8c do not match test-TestECDiskFile WARNING: Quarantined object /tmp/tmpa5kmzi9_/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.54306#2#d.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 dfbee243f1a2b1fc6663ff609231cc8c do not match test-TestECDiskFile WARNING: Quarantined object /tmp/tmpa5kmzi9_/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.55617#2#d.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 dfbee243f1a2b1fc6663ff609231cc8c do not match test-TestECDiskFile WARNING: Quarantined object /tmp/tmp6zzsw8vu/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769848.71310#2#d.data: missing name metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmp6zzsw8vu/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.72378#2#d.data: missing name metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmp6zzsw8vu/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.72617#2#d.data: missing name metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmp6zzsw8vu/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.73666#2#d.data: missing name metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmp6zzsw8vu/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.74707#2#d.data: missing name metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmp6zzsw8vu/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.74950#2#d.data: missing name metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmp6zzsw8vu/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769848.76412#2#d.data: missing name metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmp6zzsw8vu/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.76646#2#d.data: missing name metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmp6zzsw8vu/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.77710#2#d.data: missing name metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmpeb1tvgg6/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769848.79010#2#d.data: Bytes read: 0, does not match metadata: 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpeb1tvgg6/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.80076#2#d.data: Bytes read: 0, does not match metadata: 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpeb1tvgg6/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.81530#2#d.data: Bytes read: 0, does not match metadata: 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpeb1tvgg6/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.81765#2#d.data: Bytes read: 0, does not match metadata: 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpeb1tvgg6/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.83623#2#d.data: Bytes read: 0, does not match metadata: 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpeb1tvgg6/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.83846#2#d.data: Bytes read: 0, does not match metadata: 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmpeb1tvgg6/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.85290#2#d.data: Bytes read: 0, does not match metadata: 184 test-TestECDiskFile WARNING: Quarantined object /tmp/tmprge0im01/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769848.89152#2#d.data: Failed to open /tmp/tmprge0im01/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769848.89152#2#d.data: [Errno 61] -ENODATA fool! test-TestECDiskFile WARNING: Quarantined object /tmp/tmpz1eu1l7x/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769848.90827#2#d.data: Failed to open /tmp/tmpz1eu1l7x/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769848.90827#2#d.data: [Errno 117] -EUCLEAN fool! test-TestECDiskFile WARNING: Quarantined object /tmp/tmpzfk06h5q/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769848.92202#2#d.data: missing content-length in metadata test-TestECDiskFile WARNING: Quarantined object /tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769848.94308#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769848.94308#2#d.data'>: stored checksum='b'abc5a33a28d9814a8ae551d0c4f1b8a8'', computed='b'da0e2e036ad2eae09c1bf85de61fad9f'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.94553#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769848.94553#2#d.data'>: stored checksum='b'728c0ccd18e3adf91f89eed7ecb0f57c'', computed='b'8e9e7201ba7c9be2d0cd2890eeb17419'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.96426#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769848.96426#2#d.data'>: stored checksum='b'4ebed83807afb2b6b980a081b0c451ba'', computed='b'9aed90ed9ce8a39a349d1abb90cf51fd'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.96659#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769848.96659#2#d.data'>: stored checksum='b'509cad3424379ac06ae044035a80f73e'', computed='b'31345d41e86003b27a614c4ae33dd01c'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.97333#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769848.97333#2#d.data'>: stored checksum='b'03239e9635e17225f6fcb8c80ffd464f'', computed='b'b820dca4501f2165e3e69f85ab91334b'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.98387#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769848.98387#2#d.data'>: stored checksum='b'06665dd2b5c097799a6a21608aa111d5'', computed='b'7e007ad9ade9140c4d46639d7e5ea41d''test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_subtly_corrupt_xattrs test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_subtly_corrupt_xattrs ... ok test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_missing_builder_id test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_missing_builder_id ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_truncated_xattrs test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_truncated_xattrs ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_valids test.unit.obj.test_diskfile.TestECDiskFile.test_quarantine_valids ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_read_metadata test.unit.obj.test_diskfile.TestECDiskFile.test_read_metadata ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_create_broker test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_create_broker ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_prefix_and_delimiter test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_with_prefix_and_delimiter ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_without_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_without_bucket ... ok test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_older_builder test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_older_builder ... ok Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Worker (pid=1826030, devs=/some/device) completed in 0.1s with errors Worker (pid=1826036, devs=sdx) completed in 0.1s with errors test.unit.cli.test_relinker.TestRelinker.test_relinker_utils_get_hub test.unit.cli.test_relinker.TestRelinker.test_relinker_utils_get_hub ... ok test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_replica_count_changed test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_replica_count_changed ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_creation test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_creation ... ok test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_unchanged_builders test.unit.common.ring.test_composite_builder.TestComposeLoadComponents.test_load_components_unchanged_builders ... ok test.unit.common.ring.test_ring.TestRing.test_creation test.unit.common.ring.test_ring.TestRing.test_creation ... ok test-TestECDiskFile WARNING: Quarantined object /tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769848.98625#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769848.98625#2#d.data'>: stored checksum='b'2427c015931679d64a01d974629cebf1'', computed='b'64cecf93fe837b3d5351c5a111e38684'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.99753#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769848.99753#2#d.data'>: stored checksum='b'f740858a1107d9bd685b3bbfabfdaff5'', computed='b'449a335da340024b041fb22bddd83931'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769849.00815#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp09s8r6q4/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769849.00815#2#d.data'>: stored checksum='b'0d1e299b7e90ec10c32644b422a03f8d'', computed='b'0e2e7f14f70e3185017dde700657df19'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769849.02507#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/a39/c60a1e15b833ae922330ac083ae00a39/1757769849.02507#2#d.data'>: stored checksum='b'7850a0886b595a2de3ce11739329cb3d'', computed='b'6f87f61d13958a987fdae2eb9cd3adb3'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769849.03246#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/ca2/dbfdf486d87f1e60773117e44db03ca2/1757769849.03246#2#d.data'>: stored checksum='b'3019bdc8c226a41bfa663b9ca0d12651'', computed='b'333629b421d94dacd3d7999a3839cab1'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769849.04282#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/b56/c94e68f7e45d3f1b654fcafc096ceb56/1757769849.04282#2#d.data'>: stored checksum='b'50a5e9c21431621242933062da9a7043'', computed='b'8181e338e67a063defd9df544e338513'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769849.04523#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/d9e/ae41b82f683d7c319f3a97e6ef1bfd9e/1757769849.04523#2#d.data'>: stored checksum='b'407c6bc72883d294a595ef144b7fdff3'', computed='b'b4a306a7bb4329a1ea4e3d169fd5df95'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769849.05703#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/4c3/3e64605669922490266c1c95f7bbc4c3/1757769849.05703#2#d.data'>: stored checksum='b'32d0ff511bac6f3e182318b6a4f9029a'', computed='b'a0b59e41bc0801cefb60f6dd751eec13'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769849.06356#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/9ba/d6618a286c60efcea9fdadf7f0d9d9ba/1757769849.06356#2#d.data'>: stored checksum='b'74c39a81bd13aef1b88a46e60d0ef03f'', computed='b'4015ee59583cbd03b0352f1468273676'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769849.07689#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/b82/0770bee4bf2808aa5073114e367d0b82/1757769849.07689#2#d.data'>: stored checksum='b'cd01a2e3b55d56706466752684511a44'', computed='b'abbd7d5edfbf45c925b009c27c6800fa'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769849.08725#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769849.08725#2#d.data'>: stored checksum='b'f00aad80a0fd56401b205966b8f10896'', computed='b'ec39c34c612b53a39260329cf25f28a5'' test-TestECDiskFile WARNING: Quarantined object /tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769849.08952#2#d.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmpr2bhbxxx/tmp_test_obj_server_DiskFile/sda1/objects/0/e20/6628d731965178c0b633a3356d55ce20/1757769849.08952#2#d.data'>: stored checksum='b'1c665544d599d9e9b8a94e4ac8333e3b'', computed='b'538dfc281661cc20e96e29371c21dc92'' Filesystem at n/a does not support xattr Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 205, in _read_file_metadata metadata += xattr.getxattr( ~~~~~~~~~~~~~~^ fd, METADATA_KEY + str(key or '').encode('ascii')) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 4123, in mock_getxattr raise IOError(error_num, "Operation not supported") OSError: [Errno 95] Operation not supported test.unit.obj.test_diskfile.TestECDiskFile.test_read_metadata_no_xattr test.unit.obj.test_diskfile.TestECDiskFile.test_read_metadata_no_xattr ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_reader_ec_exception_causes_quarantine test.unit.obj.test_diskfile.TestECDiskFile.test_reader_ec_exception_causes_quarantine ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_reader_ec_exception_does_not_cause_quarantine test.unit.obj.test_diskfile.TestECDiskFile.test_reader_ec_exception_does_not_cause_quarantine ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_reader_frag_check_does_not_quarantine_if_its_not_binary test.unit.obj.test_diskfile.TestECDiskFile.test_reader_frag_check_does_not_quarantine_if_its_not_binary ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_reader_quarantines_corrupted_ec_archive test.unit.obj.test_diskfile.TestECDiskFile.test_reader_quarantines_corrupted_ec_archive ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_splice_to_wsockfd_blocks test.unit.obj.test_diskfile.TestECDiskFile.test_splice_to_wsockfd_blocks ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_sysmeta_frag_index_is_immutable test.unit.obj.test_diskfile.TestECDiskFile.test_sysmeta_frag_index_is_immutable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_tee_to_md5_pipe_length_mismatch test.unit.obj.test_diskfile.TestECDiskFile.test_tee_to_md5_pipe_length_mismatch ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_write_cleanup test.unit.obj.test_diskfile.TestECDiskFile.test_write_cleanup ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_write_cleanup_legacy_durable test.unit.obj.test_diskfile.TestECDiskFile.test_write_cleanup_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_write_cleanup_part_power_increase test.unit.obj.test_diskfile.TestECDiskFile.test_write_cleanup_part_power_increase ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata ... ok fake-swift DEBUG: checking permission: bucket9 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket0 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.cli.test_relinker.TestRelinker.test_state_file test.unit.cli.test_relinker.TestRelinker.test_state_file ... ok test.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET_without_bucket test.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET_without_bucket ... ok test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey60" 301 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey60_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey70" 201 - "-" "-" "-" 0.0053 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey70_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey80" 201 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey80_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/bashful" 301 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/dopey" 301 - "-" "-" "-" 0.0051 "-" 1824541 2 test DEBUG: Unlinked retiring db '/tmp/tmp05rm4szc/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest10" 201 - "-" "-" "-" 0.0052 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest10_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0057 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest20" 301 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest20_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest30" 301 - "-" "-" "-" 0.0052 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest30_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest40" 301 - "-" "-" "-" 0.0053 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest40_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest50" 201 - "-" "-" "-" 0.0093 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest50_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest60" 301 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest60_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest70" 201 - "-" "-" "-" 0.0078 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest70_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest80" 201 - "-" "-" "-" 0.0010 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c/grumpiest80_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0117 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0245 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0184 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/.shards_a/shard_c" 404 - "-" "-" "-" 0.0004 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/.shards_a/shard_c" 400 49 "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/.shards_a/shard_c" 201 - "-" "-" "-" 0.0124 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/.shards_a/shard_c" 202 - "-" "-" "-" 0.0019 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/.shards_a/shard_c" 202 - "-" "-" "-" 0.0138 "-" 1824541 1 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 404 - "-" "-" "-" 0.0004 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0116 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0102 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0020 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0100 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0137 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 400 74 "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 400 74 "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 400 69 "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 400 75 "-" "-" "-" 0.0083 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 400 35 "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0155 "-" 1824541 2 test DEBUG: Unlinked retiring db '/tmp/tmpv9fdcxd0/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0162 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:09 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0181 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0139 "-" 1824541 2test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_shard_range_to_deleted_container test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_shard_range_to_deleted_container ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_simulated_create_race test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_simulated_create_race ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_timestamp_not_float test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_timestamp_not_float ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_utf8 test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_PUT_utf8 ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_complete_rsync_works test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_complete_rsync_works ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_insufficient_space test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_insufficient_space ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_rsync_then_merge_works test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_rsync_then_merge_works ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_unknown_sync test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_unknown_sync ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_value_error_works test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_REPLICATE_value_error_works ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_UPDATE test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_UPDATE ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_UPDATE_autocreate test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_UPDATE_autocreate ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test__call__raise_timeout test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test__call__raise_timeout ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_account_update_account_override_deleted test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_account_update_account_override_deleted ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_account_update_mismatched_host_device test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_account_update_mismatched_host_device ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_acl_container test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_acl_container ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_change_storage_policy_via_DELETE_then_PUT test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_change_storage_policy_via_DELETE_then_PUT ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_db_file test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_db_file ... ok test-TestECDiskFile WARNING: Quarantined object /tmp/tmp9gf1vmxe/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769849.00000#2#d.data: Invalid EC metadata at offset 0x0 test-TestECDiskFile WARNING: Quarantined object /tmp/tmp9gf1vmxe/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769850.00000#2#d.data: Invalid EC metadata at offset 0x0 test-TestECDiskFile WARNING: Quarantined object /tmp/tmp9gf1vmxe/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769851.00000#2#d.data: Invalid EC metadata at offset 0x0 test-TestECDiskFile WARNING: Problem checking EC fragment /tmp/tmp_8isg610/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099: testing test-TestECDiskFile WARNING: Unexpected fragment data type (not quarantined) /tmp/tmplc_owq6j/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099: at offset 0x0 test-TestECDiskFile WARNING: Unexpected fragment data type (not quarantined) /tmp/tmplc_owq6j/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099: at offset 0x0 test-TestECDiskFile WARNING: Quarantined object /tmp/tmp_zjo9ezb/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769850.00000#2#d.data: Invalid EC metadata at offset 0x0 test-TestECDiskFile WARNING: Quarantined object /tmp/tmp_zjo9ezb/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769851.00000#2#d.data: Invalid EC metadata at offset 0x1ea test-TestECDiskFile WARNING: Quarantined object /tmp/tmp_zjo9ezb/tmp_test_obj_server_DiskFile/sda1/objects/0/099/2f714cd91b0e5d803cde2012b01d7099/1757769852.00000#2#d.data: Invalid EC metadata at offset 0x1ea test-TestECDiskFile DEBUG: Relinking /tmp/tmpm0kthl4z/tmp_test_obj_server_DiskFile/sda1/objects/0/c24/e8e79ba726c8c1324e164bd9a8b84c24/1757769849.31838#2.data to /tmp/tmpm0kthl4z/tmp_test_obj_server_DiskFile/sda1/objects/1863/c24/e8e79ba726c8c1324e164bd9a8b84c24/1757769849.31838#2.data due to next_part_power set test-TestECDiskFile DEBUG: Relinking /tmp/tmpm0kthl4z/tmp_test_obj_server_DiskFile/sda1/objects-1/0/dcd/a4d9f6f0200f56fcd48dce558f1e3dcd/1757769849.33136.data to /tmp/tmpm0kthl4z/tmp_test_obj_server_DiskFile/sda1/objects-1/1318/dcd/a4d9f6f0200f56fcd48dce558f1e3dcd/1757769849.33136.data due to next_part_power set No space left on device for n/a Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 285, in write_metadata xattr.setxattr(fd, METADATA_KEY + str(key or '').encode('ascii'), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ metastr[:xattr_size]) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 5172, in mock_setxattr_ENOSPC raise IOError(errno.ENOSPC, "No space left on device") OSError: [Errno 28] No space left on device No space left on device for n/a Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 285, in write_metadata xattr.setxattr(fd, METADATA_KEY + str(key or '').encode('ascii'), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ metastr[:xattr_size]) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 5175, in mock_setxattr_EDQUOT raise IOError(errno.EDQUOT, "Exceeded quota") OSError: [Errno 122] Exceeded quota test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_disk_full test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_disk_full ... ok Filesystem at n/a does not support xattr Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 285, in write_metadata xattr.setxattr(fd, METADATA_KEY + str(key or '').encode('ascii'), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ metastr[:xattr_size]) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 5160, in mock_setxattr raise IOError(error_num, "Operation not supported") OSError: [Errno 95] Operation not supported test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_no_xattr test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_no_xattr ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_with_content_type test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_with_content_type ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_with_content_type_removes_multiple_metas test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_with_content_type_removes_multiple_metas ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_with_content_type_removes_same_time_meta test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_with_content_type_removes_same_time_meta ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_with_older_content_type test.unit.obj.test_diskfile.TestECDiskFile.test_write_metadata_with_older_content_type ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_zero_copy_cache_dropping test.unit.obj.test_diskfile.TestECDiskFile.test_zero_copy_cache_dropping ... ok test.unit.obj.test_diskfile.TestECDiskFile.test_zero_copy_turns_off_when_md5_sockets_not_supported test.unit.obj.test_diskfile.TestECDiskFile.test_zero_copy_turns_off_when_md5_sockets_not_supported ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_get_delete_at_nodes test.unit.obj.test_expirer.TestExpirerConfig.test_get_delete_at_nodes ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_get_delete_at_nodes_no_ring test.unit.obj.test_expirer.TestExpirerConfig.test_get_delete_at_nodes_no_ring ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_account_and_container_default test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_account_and_container_default ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_account_and_container_legacy test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_account_and_container_legacy ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_config_default test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_config_default ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_config_legacy test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_config_legacy ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_config_legacy_no_logger_given test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_config_legacy_no_logger_given ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_container test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_container ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_container_legacy_config test.unit.obj.test_expirer.TestExpirerConfig.test_get_expirer_container_legacy_config ... ok test.unit.obj.test_expirer.TestExpirerConfig.test_is_expected_task_container test.unit.obj.test_expirer.TestExpirerConfig.test_is_expected_task_container ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_creates_empty_hashes test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_creates_empty_hashes ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_handoff test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_handoff ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_mixed test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_mixed ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_no_hashes test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_no_hashes ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_primary test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_primary ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_revert_only_tombstones test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_build_jobs_revert_only_tombstones ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_cleans_tmp test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_cleans_tmp ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_creates_datadir test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_creates_datadir ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_creates_datadir_error test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_creates_datadir_error ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_mount_check test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_mount_check ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_multi_device_skips_non_non_local_devs test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_multi_device_skips_non_non_local_devs ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_multi_device_skips_non_ring_devices test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_multi_device_skips_non_ring_devices ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_overrides test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_overrides ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_skips_invalid_paths test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_skips_invalid_paths ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_skips_non_ec_policy_and_device test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_skips_non_ec_policy_and_device ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_skips_non_local_devs_servers_per_port test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_collect_parts_skips_non_local_devs_servers_per_port ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_local_devices test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_local_devices ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_local_devices_with_no_ec_policy_env test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_local_devices_with_no_ec_policy_env ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_suffix_delta test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_suffix_delta ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_suffixes_in_sync test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_suffixes_in_sync ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_suffixes_to_sync test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_get_suffixes_to_sync ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_first_enables_handoffs_only test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_first_enables_handoffs_only ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_default test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_default ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_enabled test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_enabled ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_false_and_first_false test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_false_and_first_false ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_false_and_first_none test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_false_and_first_none ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_ignores_handoffs_first test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_ignores_handoffs_first ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_none_and_first_false test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_none_and_first_false ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_true_and_first_false test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_true_and_first_false ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_true_and_first_true test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_handoffs_only_true_and_first_true ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_iter_nodes_for_frag test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_iter_nodes_for_frag ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_handoff test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_handoff ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_primary_down test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_primary_down ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_primary_in_sync test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_primary_in_sync ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_primary_not_in_sync test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_primary_not_in_sync ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "txd7d9282c350a461582fb1-0068c57078" "proxy-server 1824514" 0.0054 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txbbadb3d4fab04db38f56a-0068c57078" "proxy-server 1824514" 0.0047 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx16f48899c4a241dfb7110-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx6f62af14d0324950ba4db-0068c57078" "proxy-server 1824514" 0.0016 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txf5018d760c884ff9b2113-0068c57078" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx34bddda0ae5e4af3a2b64-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx8efeb51989f24e17aaa31-0068c57078" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdg1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 412 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txb2c0aa94f60f48428fd8c-0068c57079" "proxy-server 1824514" 0.0006 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdh1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 412 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txb2c0aa94f60f48428fd8c-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 412 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txb2c0aa94f60f48428fd8c-0068c57079" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txa4e7d105dfc44e1ba5e9a-0068c57079" "proxy-server 1824514" 0.0056 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "txa3ab61067c2f40d688f92-0068c57079" "proxy-server 1824514" 0.0054 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdh1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 304 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "txaeb42eb7729d4acc97be9-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txefc699250f5c4e429604f-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx2fea9209f04a41edb658f-0068c57079" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 304 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx6104d8eca21d4aa99cd1e-0068c57079" "proxy-server 1824514" 0.0052 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx54a1c96809cd43a9b9675-0068c57079" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/2/a/37223c099fef4482ae4b4a3c88da26ff" 204 - "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff" "tx43956732e07f4cc88adc4-0068c57079" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdi1/2/a/37223c099fef4482ae4b4a3c88da26ff/o" 200 92 "HEAD http://localhost:8080/v1/a/37223c099fef4482ae4b4a3c88da26ff/o" "tx5bdc6f79875248b9a9ff6-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc486c7f81c254c4ebc1b1-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdb1/1/a/39079dd26483417b8e3e2adb57009ea2" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/39079dd26483417b8e3e2adb57009ea2" "txc486c7f81c254c4ebc1b1-0068c57079" "container-server 1824514" 0.0010 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/1/a/39079dd26483417b8e3e2adb57009ea2" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/39079dd26483417b8e3e2adb57009ea2" "txc486c7f81c254c4ebc1b1-0068c57079" "container-server 1824514" 0.0010 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdb1/0/a/39079dd26483417b8e3e2adb57009ea2" 201 - "PUT http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2" "txc486c7f81c254c4ebc1b1-0068c57079" "proxy-server 1824514" 0.0217 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/0/a/39079dd26483417b8e3e2adb57009ea2" 201 - "PUT http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2" "txc486c7f81c254c4ebc1b1-0068c57079" "proxy-server 1824514" 0.0352 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx30d03b910d6a4627adcf5-0068c57079" "proxy-server 1824514" 0.0060 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/0/a/39079dd26483417b8e3e2adb57009ea2" 204 - "HEAD http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2" "tx30d03b910d6a4627adcf5-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx679733fcbe8c4bf98fcae-0068c57079" "proxy-server 1824514" 0.0129 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/0/a/39079dd26483417b8e3e2adb57009ea2" 204 - "HEAD http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2" "txe386f66a582549c599b71-0068c57079" "proxy-server 1824514" 0.0031 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/0/a/39079dd26483417b8e3e2adb57009ea2/o" 201 - "PUT http://foo:8080/sdc1/1/a/39079dd26483417b8e3e2adb57009ea2/o" "tx4797c3a025784dd5887a6-0068c57079" "object-server 1824514" 0.0051 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdb1/0/a/39079dd26483417b8e3e2adb57009ea2/o" 201 - "PUT http://foo:8080/sdd1/1/a/39079dd26483417b8e3e2adb57009ea2/o" "tx4797c3a025784dd5887a6-0068c57079" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdc1/1/a/39079dd26483417b8e3e2adb57009ea2/o" 201 - "PUT http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2/o" "tx4797c3a025784dd5887a6-0068c57079" "proxy-server 1824514" 0.0264 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdd1/1/a/39079dd26483417b8e3e2adb57009ea2/o" 201 - "PUT http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2/o" "tx4797c3a025784dd5887a6-0068c57079" "proxy-server 1824514" 0.0278 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0ce5686bc50e470485f83-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/0/a/39079dd26483417b8e3e2adb57009ea2" 204 - "HEAD http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2" "txd4214b8e85fd46c3b4116-0068c57079" "proxy-server 1824514" 0.0075 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdb1/0/a/39079dd26483417b8e3e2adb57009ea2/o" 201 - "POST http://foo:8080/sdc1/1/a/39079dd26483417b8e3e2adb57009ea2/o" "tx102ca2b5d18a4307b3aba-0068c57079" "object-server 1824514" 0.0004 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/0/a/39079dd26483417b8e3e2adb57009ea2/o" 201 - "POST http://foo:8080/sdd1/1/a/39079dd26483417b8e3e2adb57009ea2/o" "tx102ca2b5d18a4307b3aba-0068c57079" "object-server 1824514" 0.0009 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "POST /sdc1/1/a/39079dd26483417b8e3e2adb57009ea2/o" 202 76 "POST http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2/o" "tx102ca2b5d18a4307b3aba-0068c57079" "proxy-server 1824514" 0.0144 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "POST /sdd1/1/a/39079dd26483417b8e3e2adb57009ea2/o" 202 76 "POST http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2/o" "tx102ca2b5d18a4307b3aba-0068c57079" "proxy-server 1824514" 0.0134 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx356a9f9e98cc4304b4f21-0068c57079" "proxy-server 1824514" 0.0056 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 201 - "PUT http://127.0.0.1:60751/sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx356a9f9e98cc4304b4f21-0068c57079" "container-server 1824514" 0.0091 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 201 - "PUT http://127.0.0.1:40941/sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx356a9f9e98cc4304b4f21-0068c57079" "container-server 1824514" 0.0012 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 201 - "PUT http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx356a9f9e98cc4304b4f21-0068c57079" "proxy-server 1824514" 0.0335 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 201 - "PUT http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx356a9f9e98cc4304b4f21-0068c57079" "proxy-server 1824514" 0.0217 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0d21716fc2fb4d709283b-0068c57079" "proxy-server 1824514" 0.0019 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx0d21716fc2fb4d709283b-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0079383517b845778a891-0068c57079" "proxy-server 1824514" 0.0073 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/0/a/39079dd26483417b8e3e2adb57009ea2" 204 - "HEAD http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2" "tx7dea6c59d28148a09c2c6-0068c57079" "proxy-server 1824514" 0.0025 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdc1/1/a/39079dd26483417b8e3e2adb57009ea2/o" 200 24 "GET http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2/o" "txdc7b03140a944b2d8ad09-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdd1/1/a/39079dd26483417b8e3e2adb57009ea2/o" 200 24 "GET http://foo:8080/v1/a/39079dd26483417b8e3e2adb57009ea2/o" "txdc7b03140a944b2d8ad09-0068c57079" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx466bd17aeab846eeafaad-0068c57079" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://foo:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx786c80f57e9d4b6a81627-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 201 - "PUT http://foo:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txb8b3d14c7d41469d8b183-0068c57079" "proxy-server 1824514" 0.0265 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 201 - "PUT http://foo:8080/sdi1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txb8b3d14c7d41469d8b183-0068c57079" "object-server 1824514" 0.0005 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 201 - "PUT http://foo:8080/sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txb8b3d14c7d41469d8b183-0068c57079" "object-server 1824514" 0.0046 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 201 - "PUT http://foo:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txb8b3d14c7d41469d8b183-0068c57079" "proxy-server 1824514" 0.0403 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "PUT /sdi1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 201 - "PUT http://foo:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txb8b3d14c7d41469d8b183-0068c57079" "proxy-server 1824514" 0.0394 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6f06ed923f6949f5b7d9e-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "txa1d81709dae54c04acfaa-0068c57079" "proxy-server 1824514" 0.0091 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx4f1ea3156662462395572-0068c57079" "proxy-server 1824514" 0.0033 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdi1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx4f1ea3156662462395572-0068c57079" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7d32f75f41114fd9b6b92-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "txa5567b84d960408c96af9-0068c57079" "proxy-server 1824514" 0.0106 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx7c2a22285cc14f75a4c15-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb9cb31f4dde14a85a30e8-0068c57079" "proxy-server 1824514" 0.0058 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 200 382 "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6?format=json&states=listing" "txb9cb31f4dde14a85a30e8-0068c57079" "proxy-server 1824514" 0.0061 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx69ae659a713a481695189-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "txaea4e28ff75846d095dfd-0068c57079" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdi1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txc9a46ee78cd0473c833dc-0068c57079" "proxy-server 1824514" 0.0043 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txc9a46ee78cd0473c833dc-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx71f118c581ab4398990d8-0068c57079" "proxy-server 1824514" 0.0024 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx652f1413ff164d9b9503f-0068c57079" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txc387868ab99f43e89225a-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txc387868ab99f43e89225a-0068c57079" "proxy-server 1824514" 0.0024 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx3af49c38cd624dd193ba9-0068c57079" "proxy-server 1824514" 0.0078 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "txea09ce1d9e234e51a2667-0068c57079" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 412 - "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx9393141fc170470da3fe9-0068c57079" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 412 - "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx9393141fc170470da3fe9-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx9393141fc170470da3fe9-0068c57079) proxy DEBUG: Ignoring 412 from primary (txn: tx9393141fc170470da3fe9-0068c57079) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdi1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 412 - "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx9393141fc170470da3fe9-0068c57079" "proxy-server 1824514" 0.0008 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx9393141fc170470da3fe9-0068c57079) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfda0acdcaf1347af97ce6-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "txd8602b5d466c43949e7b3-0068c57079" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 304 - "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx3d26fdf8c2fb4cdd83afb-0068c57079" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 304 - "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx3d26fdf8c2fb4cdd83afb-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdi1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 304 - "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx3d26fdf8c2fb4cdd83afb-0068c57079" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx200da2a2b0e14cdf9571b-0068c57079" "proxy-server 1824514" 0.0049 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx3ccd670f555241ca9cfa0-0068c57079" "proxy-server 1824514" 0.0070 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdi1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 304 - "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txaf95bec797c14fb08d776-0068c57079" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 304 - "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txaf95bec797c14fb08d776-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 304 - "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txaf95bec797c14fb08d776-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb208bbeb3650404e9fd9b-0068c57079" "proxy-server 1824514" 0.0015 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx23c7c94e72ef46e9a046b-0068c57079" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txcfb640a2ad4a4c7f9648b-0068c57079" "proxy-server 1824514" 0.0061 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "GET /sdi1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "GET http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txcfb640a2ad4a4c7f9648b-0068c57079" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx880c24afe758441495987-0068c57079" "proxy-server 1824514" 0.0059 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx2f6629f315634e8889ea1-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txa170c67dadf241b69cd25-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0e95c39ff1fd4e7095b4f-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx91f5cdf972b0441aa6a15-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txce19af4ce8c74619ab6de-0068c57079" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx400cdb264a9a47a4ba6b5-0068c57079" "proxy-server 1824514" 0.0074 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx3000ca6b236a436da3a39-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdi1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 412 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx336fa24ad16d43f882887-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_without_segment_bucket test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_GET_without_segment_bucket ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_abort test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_abort ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_primary_some_in_sync test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_primary_some_in_sync ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_cleanup test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_cleanup ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_cleanup_but_already_reclaimed test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_cleanup_but_already_reclaimed ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_cleanup_tombstone test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_cleanup_tombstone ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_complete test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_complete ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_does_cleanup_meta_pure_handoff test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_does_cleanup_meta_pure_handoff ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_does_not_cleanup_meta_also_primary test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_does_not_cleanup_meta_also_primary ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_does_not_cleanup_meta_new_data test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_does_not_cleanup_meta_new_data ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_is_handoff_fails test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_revert_is_handoff_fails ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_delete_db_does_not_clear_particular_sharding_meta test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_delete_db_does_not_clear_particular_sharding_meta ... ok test DEBUG: Updating recon for sda1 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Updating recon for sda1 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Updating recon for sda1 test INFO: Step: relink Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 1/2 test DEBUG: Updating recon for sda1 test INFO: Step: cleanup Device: sda1 Policy: platinum Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test INFO: Step: relink Device: sda1 Policy: ec Partitions: 1/2 test DEBUG: Updating recon for sda1 test INFO: Step: relink Device: sda1 Policy: ec Partitions: 1/2 test DEBUG: Updating recon for sda1 test INFO: Step: relink Device: sda1 Policy: ec Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test INFO: Step: cleanup Device: sda1 Policy: ec Partitions: 1/2 test DEBUG: Updating recon for sda1 test INFO: Step: cleanup Device: sda1 Policy: ec Partitions: 2/2 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 test DEBUG: Updating recon for sda1 Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_workers_children test.unit.cli.test_relinker.TestRelinker.test_workers_children ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_delete_object test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_delete_object ... ok Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 471, in fire_timers timer() ~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ cb(*args, **kw) ~~^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1115, in get_response status, headers, app_iter = self.call_application(application) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1099, in call_application app_iter = application(self.environ, start_response) File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_internal_client.py", line 889, in __call__ raise Exception() Exception Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 471, in fire_timers timer() ~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ cb(*args, **kw) ~~^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1115, in get_response status, headers, app_iter = self.call_application(application) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1099, in call_application app_iter = application(self.environ, start_response) File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_internal_client.py", line 889, in __call__ raise Exception() Exception Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 471, in fire_timers timer() ~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ cb(*args, **kw) ~~^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1115, in get_response status, headers, app_iter = self.call_application(application) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1099, in call_application app_iter = application(self.environ, start_response) File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_internal_client.py", line 889, in __call__ raise Exception() Exception Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/relinker.recon' test.unit.cli.test_relinker.TestRelinker.test_workers_parent test.unit.cli.test_relinker.TestRelinker.test_workers_parent ... ok fake-swift DEBUG: checking permission: bucket1 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket2 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket3 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket4 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket5 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket6 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket7 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket8 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket9 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket0 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket1 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket2 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket3 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket4 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:othertest.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET_without_owner_bucket test.unit.common.middleware.s3api.test_service.TestS3ApiServiceAcl.test_service_GET_without_owner_bucket ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_HEAD_with_content_length test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_HEAD_with_content_length ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_bogus_content_length test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_bogus_content_length ... ok test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_methods_with_no_default_sample_rate test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_methods_with_no_default_sample_rate ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_catcherrors test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_catcherrors ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_catcherrors_passthrough test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_catcherrors_passthrough ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_catcherrors_with_unexpected_error test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_catcherrors_with_unexpected_error ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_error_in_iterator test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_error_in_iterator ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_has_len test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_has_len ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_long_response_body test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_long_response_body ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_multiple_content_lengths test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_multiple_content_lengths ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_no_content_length test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_no_content_length ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_short_response_body test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_short_response_body ... ok test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_statsd_methods_legacy_disabled test.unit.common.test_statsd_client.TestGetStatsdClientOutput.test_statsd_methods_legacy_disabled ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_extra test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_extra ... ok test.unit.cli.test_relinker.TestRelinker.test_workers_parent_bubbles_up_errors test.unit.cli.test_relinker.TestRelinker.test_workers_parent_bubbles_up_errors ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_extra_length_limit test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_extra_length_limit ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_add_remove_names test.unit.common.test_storage_policy.TestStoragePolicies.test_add_remove_names ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_bind_ports_cache test.unit.common.test_storage_policy.TestStoragePolicies.test_bind_ports_cache ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_extra_quoted test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_extra_quoted ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_defaults test.unit.common.test_storage_policy.TestStoragePolicies.test_defaults ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_fail test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_fail ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_deprecate_policies test.unit.common.test_storage_policy.TestStoragePolicies.test_deprecate_policies ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_deprecated_default test.unit.common.test_storage_policy.TestStoragePolicies.test_deprecated_default ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_pass test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_pass ... ok test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_suffix test.unit.common.middleware.test_catch_errors.TestCatchErrors.test_trans_id_header_suffix ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_client_error_fetching_first_segment test.unit.common.middleware.test_dlo.TestDloGetManifest.test_client_error_fetching_first_segment ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_fetching_second_segment test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_fetching_second_segment ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_listing_container_HEAD test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_listing_container_HEAD ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_listing_container_first_listing_request test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_listing_container_first_listing_request ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_listing_container_second_listing_request test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_listing_container_second_listing_request ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_passthrough test.unit.common.middleware.test_dlo.TestDloGetManifest.test_error_passthrough ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_ec_fragment_size_cached test.unit.common.test_storage_policy.TestStoragePolicies.test_ec_fragment_size_cached ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_etag_comparison_ignores_quotes test.unit.common.middleware.test_dlo.TestDloGetManifest.test_etag_comparison_ignores_quotes ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_big_manifest test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_big_manifest ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_manifest test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_manifest ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_manifest_passthrough test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_manifest_passthrough ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_get_diskfile_manager test.unit.common.test_storage_policy.TestStoragePolicies.test_get_diskfile_manager ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_multi_range test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_multi_range ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_get_diskfile_manager_custom_diskfile test.unit.common.test_storage_policy.TestStoragePolicies.test_get_diskfile_manager_custom_diskfile ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_non_manifest_passthrough test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_non_manifest_passthrough ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_non_object_passthrough test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_non_object_passthrough ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_oversize_segment test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_oversize_segment ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_get_diskfile_manager_invalid_policy_config test.unit.common.test_storage_policy.TestStoragePolicies.test_get_diskfile_manager_invalid_policy_config ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_first_byte test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_first_byte ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_get_object_ring test.unit.common.test_storage_policy.TestStoragePolicies.test_get_object_ring ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_get_policy_string test.unit.common.test_storage_policy.TestStoragePolicies.test_get_policy_string ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_last_byte test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_last_byte ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_many_segments_satisfiability_unknown test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_many_segments_satisfiability_unknown ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_many_segments_satisfiable test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_many_segments_satisfiable ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_on_segment_boundaries test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_on_segment_boundaries ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_overlapping_end test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_overlapping_end ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_unsatisfiable test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_range_unsatisfiable ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_suffix_range test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_suffix_range ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_suffix_range_many_segments test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_suffix_range_many_segments ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_taking_too_long test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_taking_too_long ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_undersize_segment test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_undersize_segment ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_undersize_segment_range test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_undersize_segment_range ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_with_auth_overridden test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_with_auth_overridden ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_with_if_modified_since test.unit.common.middleware.test_dlo.TestDloGetManifest.test_get_with_if_modified_since ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_if_match_does_not_match test.unit.common.middleware.test_dlo.TestDloGetManifest.test_if_match_does_not_match ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_if_match_matches test.unit.common.middleware.test_dlo.TestDloGetManifest.test_if_match_matches ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_if_none_match_does_not_match test.unit.common.middleware.test_dlo.TestDloGetManifest.test_if_none_match_does_not_match ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_if_none_match_matches test.unit.common.middleware.test_dlo.TestDloGetManifest.test_if_none_match_matches ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_mismatched_etag_fetching_second_segment test.unit.common.middleware.test_dlo.TestDloGetManifest.test_mismatched_etag_fetching_second_segment ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_mismatched_length_fetching_second_segment test.unit.common.middleware.test_dlo.TestDloGetManifest.test_mismatched_length_fetching_second_segment ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_object_prefix_quoting test.unit.common.middleware.test_dlo.TestDloGetManifest.test_object_prefix_quoting ... ok test.unit.common.middleware.test_dlo.TestDloGetManifest.test_server_error_fetching_first_segment test.unit.common.middleware.test_dlo.TestDloGetManifest.test_server_error_fetching_first_segment ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftCall.test_environ_copy test.unit.common.middleware.test_helpers.TestFakeSwiftCall.test_environ_copy ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftCall.test_header_mutation test.unit.common.middleware.test_helpers.TestFakeSwiftCall.test_header_mutation ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftCall.test_init test.unit.common.middleware.test_helpers.TestFakeSwiftCall.test_init ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_get test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_get ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_none test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_none ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_put test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_put ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_double_check_trailing_delimiter test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_double_check_trailing_delimiter ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_put_elsewhere_fails test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_put_elsewhere_fails ... ok test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_put_to_own test.unit.common.middleware.test_keystoneauth.TestAuthorizeReaderSystem.test_reader_put_to_own ... ok test.unit.common.middleware.test_versioned_writes.TestSwiftInfo.test_registered_defaults test.unit.common.middleware.test_versioned_writes.TestSwiftInfo.test_registered_defaults ... ok test.unit.common.middleware.test_versioned_writes.TestSwiftInfo.test_registered_explicitly_set test.unit.common.middleware.test_versioned_writes.TestSwiftInfo.test_registered_explicitly_set ... ok test.unit.common.middleware.test_xprofile.Test_profile_log.test_clear test.unit.common.middleware.test_xprofile.Test_profile_log.test_clear ... ok test.unit.common.middleware.test_xprofile.Test_profile_log.test_dump_profile test.unit.common.middleware.test_xprofile.Test_profile_log.test_dump_profile ... ok test.unit.common.middleware.test_xprofile.Test_profile_log.test_get_all_pids test.unit.common.middleware.test_xprofile.Test_profile_log.test_get_all_pids ... ok test.unit.common.middleware.test_xprofile.Test_profile_log.test_get_logfiles test.unit.common.middleware.test_xprofile.Test_profile_log.test_get_logfiles ... ok test.unit.common.test_db.TestExampleBroker.test_commit_pending test.unit.common.test_db.TestExampleBroker.test_commit_pending ... ok test.unit.common.test_db.TestExampleBroker.test_delete_db test.unit.common.test_db.TestExampleBroker.test_delete_db ... ok test.unit.common.test_db.TestExampleBroker.test_get_info test.unit.common.test_db.TestExampleBroker.test_get_info ... ok test.unit.common.test_db.TestExampleBroker.test_get_max_row test.unit.common.test_db.TestExampleBroker.test_get_max_row ... ok test.unit.common.test_db.TestExampleBroker.test_get_raw_metadata test.unit.common.test_db.TestExampleBroker.test_get_raw_metadata ... ok test.unit.common.test_db.TestExampleBroker.test_get_syncs test.unit.common.test_db.TestExampleBroker.test_get_syncs ... ok test.unit.common.test_db.TestExampleBroker.test_maybe_get test.unit.common.test_db.TestExampleBroker.test_maybe_get ... ok test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_delete_with_objects test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_delete_with_objects ... ok test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_recreate_with_objects test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_recreate_with_objects ... ok test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_simple_delete test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_simple_delete ... ok test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_simple_recreate test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_simple_recreate ... ok test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_update_delete_no_status_change test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_update_delete_no_status_change ... ok test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_update_put_no_status_change test.unit.common.test_db.TestExampleBroker.test_merge_timestamps_update_put_no_status_change ... ok test.unit.common.test_db.TestExampleBroker.test_put_timestamp test.unit.common.test_db.TestExampleBroker.test_put_timestamp ... ok test.unit.common.test_db.TestExampleBroker.test_status_changed_at test.unit.common.test_db.TestExampleBroker.test_status_changed_at ... ok test.unit.common.test_error_limiter.TestErrorLimiter.test_increment test.unit.common.test_error_limiter.TestErrorLimiter.test_increment ... ok test.unit.common.test_error_limiter.TestErrorLimiter.test_init_bad_config test.unit.common.test_error_limiter.TestErrorLimiter.test_init_bad_config ... ok test.unit.common.test_error_limiter.TestErrorLimiter.test_init_config test.unit.common.test_error_limiter.TestErrorLimiter.test_init_config ... ok test.unit.common.test_error_limiter.TestErrorLimiter.test_is_limited test.unit.common.test_error_limiter.TestErrorLimiter.test_is_limited ... ok test.unit.common.test_error_limiter.TestErrorLimiter.test_node_key test.unit.common.test_error_limiter.TestErrorLimiter.test_node_key ... ok test.unit.common.test_internal_client.TestInternalClient.test_base_full_listing test.unit.common.test_internal_client.TestInternalClient.test_base_full_listing ... ok test.unit.common.test_internal_client.TestInternalClient.test_base_request_timeout test.unit.common.test_internal_client.TestInternalClient.test_base_request_timeout ... ok test.unit.common.test_internal_client.TestInternalClient.test_container_exists test.unit.common.test_internal_client.TestInternalClient.test_container_exists ... ok test.unit.common.test_internal_client.TestInternalClient.test_create_account test.unit.common.test_internal_client.TestInternalClient.test_create_account ... ok test.unit.common.test_internal_client.TestInternalClient.test_create_container test.unit.common.test_internal_client.TestInternalClient.test_create_container ... ok test.unit.common.test_internal_client.TestInternalClient.test_create_container_plumbing test.unit.common.test_internal_client.TestInternalClient.test_create_container_plumbing ... ok test.unit.common.test_internal_client.TestInternalClient.test_delete_account test.unit.common.test_internal_client.TestInternalClient.test_delete_account ... ok test.unit.common.test_internal_client.TestInternalClient.test_delete_container test.unit.common.test_internal_client.TestInternalClient.test_delete_container ... ok test.unit.common.test_internal_client.TestInternalClient.test_delete_container_plumbing test.unit.common.test_internal_client.TestInternalClient.test_delete_container_plumbing ... ok test.unit.common.test_internal_client.TestInternalClient.test_delete_object test.unit.common.test_internal_client.TestInternalClient.test_delete_object ... ok test.unit.common.test_internal_client.TestInternalClient.test_gatekeeper_not_loaded test.unit.common.test_internal_client.TestInternalClient.test_gatekeeper_not_loaded ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_account_info test.unit.common.test_internal_client.TestInternalClient.test_get_account_info ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_account_info_404 test.unit.common.test_internal_client.TestInternalClient.test_get_account_info_404 ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_account_metadata test.unit.common.test_internal_client.TestInternalClient.test_get_account_metadata ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_container_metadata test.unit.common.test_internal_client.TestInternalClient.test_get_container_metadata ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_metadadata_with_acceptable_status test.unit.common.test_internal_client.TestInternalClient.test_get_metadadata_with_acceptable_status ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_metadata test.unit.common.test_internal_client.TestInternalClient.test_get_metadata ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_metadata_extra_headers test.unit.common.test_internal_client.TestInternalClient.test_get_metadata_extra_headers ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_metadata_invalid_status test.unit.common.test_internal_client.TestInternalClient.test_get_metadata_invalid_status ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_object test.unit.common.test_internal_client.TestInternalClient.test_get_object ... ok test.unit.common.test_internal_client.TestInternalClient.test_get_object_metadata test.unit.common.test_internal_client.TestInternalClient.test_get_object_metadata ... ok test.unit.common.test_internal_client.TestInternalClient.test_init test.unit.common.test_internal_client.TestInternalClient.test_init ... ok test.unit.common.test_internal_client.TestInternalClient.test_init_allow_modify_pipeline test.unit.common.test_internal_client.TestInternalClient.test_init_allow_modify_pipeline ... ok test.unit.common.test_internal_client.TestInternalClient.test_iter_containers test.unit.common.test_internal_client.TestInternalClient.test_iter_containers ... ok test.unit.common.test_internal_client.TestInternalClient.test_iter_item_read_response_if_status_is_acceptable test.unit.common.test_internal_client.TestInternalClient.test_iter_item_read_response_if_status_is_acceptable ... ok test.unit.common.test_internal_client.TestInternalClient.test_iter_items test.unit.common.test_internal_client.TestInternalClient.test_iter_items ... ok test.unit.common.test_internal_client.TestInternalClient.test_iter_items_with_markers test.unit.common.test_internal_client.TestInternalClient.test_iter_items_with_markers ... ok test.unit.common.test_internal_client.TestInternalClient.test_iter_items_with_markers_and_prefix test.unit.common.test_internal_client.TestInternalClient.test_iter_items_with_markers_and_prefix ... ok test.unit.common.test_internal_client.TestInternalClient.test_iter_object_lines test.unit.common.test_internal_client.TestInternalClient.test_iter_object_lines ... ok test.unit.common.test_internal_client.TestInternalClient.test_iter_object_lines_404 test.unit.common.test_internal_client.TestInternalClient.test_iter_object_lines_404 ... ok test.unit.common.test_internal_client.TestInternalClient.test_iter_object_lines_compressed_object test.unit.common.test_internal_client.TestInternalClient.test_iter_object_lines_compressed_object ... ok test.unit.common.test_internal_client.TestInternalClient.test_iter_objects test.unit.common.test_internal_client.TestInternalClient.test_iter_objects ... ok test DEBUG: Found 8 objects in shard (state=unsharded), total = 8 (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: Get listing from /v1/.shards_a/c_ham?reverse=true&format=json&limit=9992&marker=i&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: Found 40 objects in shard (state=unsharded), total = 48 (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: Setting object count to 48 (txn: tx4c904f133ef64905826e4-0068c57073) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Found 0 objects in shard (state=unsharded), total = 40 (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9960&marker=h&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1064 (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: Setting object count to 1064 (txn: tx6d1b68a457b749669c9c2-0068c57074) test DEBUG: GET listing from 2 shards for: /v1/a/c?marker=koolaid&format=json&states=listing (txn: txc1a7748ed7ee44f0a8105-0068c57074) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txc1a7748ed7ee44f0a8105-0068c57074) test DEBUG: Get listing from /v1/.shards_a/c_pie?marker=koolaid&format=json&limit=10000&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txc1a7748ed7ee44f0a8105-0068c57074) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: txc1a7748ed7ee44f0a8105-0068c57074) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txc1a7748ed7ee44f0a8105-0068c57074) test DEBUG: Get listing from /v1/.shards_a/c_?marker=koolaid&format=json&limit=10000&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txc1a7748ed7ee44f0a8105-0068c57074) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1024 (txn: txc1a7748ed7ee44f0a8105-0068c57074) test DEBUG: GET listing from 2 shards for: /v1/a/c?marker=koolaid&reverse=true&format=json&states=listing (txn: tx74f062dfc9f64688babd8-0068c57074) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx74f062dfc9f64688babd8-0068c57074) test DEBUG: Get listing from /v1/.shards_a/c_pie?marker=koolaid&reverse=true&format=json&limit=10000&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: tx74f062dfc9f64688babd8-0068c57074) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: tx74f062dfc9f64688babd8-0068c57074) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx74f062dfc9f64688babd8-0068c57074) test DEBUG: Get listing from /v1/.shards_a/c_ham?marker=koolaid&reverse=true&format=json&limit=10000&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx74f062dfc9f64688babd8-0068c57074) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx74f062dfc9f64688babd8-0068c57074) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='onion', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Found 1 objects in shard (state=unsharded), total = 41 (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='rhubarb', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9959&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1065 (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Setting object count to 1065 (txn: tx6010eabde03049419e2c4-0068c57077) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='onion') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=onion%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='onion', upper='rhubarb') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=rhubarb%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Found 1 objects in shard (state=unsharded), total = 41 (txn: tx4bea1cac1c844dd7a20f4-0068c5707a)test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_gap_in_shards_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_gap_in_shards_with_memcache ... ok test ERROR: ERROR Could not get container info /tmp/tmp_318r5gp/tmp_test_database_auditor/fail1.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_auditor.py", line 140, in audit info = broker.get_info() File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_auditor.py", line 40, in get_info raise ValueError ValueError test DEBUG: Audit passed for test DEBUG: Audit passed for test DEBUG: Audit passed for test INFO: Container audit "once" mode completed: 0.03s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' Storage policy bad-policy uses an EC configuration known to harm data durability. Any data in this policy should be migrated. See https://bugs.launchpad.net/swift/+bug/1639691 for more information. Storage policy bad-policy uses an EC configuration known to harm data durability. Any data in this policy should be migrated. See https://bugs.launchpad.net/swift/+bug/1639691 for more information. test.unit.common.test_storage_policy.TestStoragePolicies.test_known_bad_ec_config test.unit.common.test_storage_policy.TestStoragePolicies.test_known_bad_ec_config ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_multiple_names test.unit.common.test_storage_policy.TestStoragePolicies.test_multiple_names ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_multiple_names_EC test.unit.common.test_storage_policy.TestStoragePolicies.test_multiple_names_EC ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_multiple_policies_with_no_policy_index_zero test.unit.common.test_storage_policy.TestStoragePolicies.test_multiple_policies_with_no_policy_index_zero ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_names_are_normalized test.unit.common.test_storage_policy.TestStoragePolicies.test_names_are_normalized ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_no_default test.unit.common.test_storage_policy.TestStoragePolicies.test_no_default ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_parse_storage_policies test.unit.common.test_storage_policy.TestStoragePolicies.test_parse_storage_policies ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_policies_type_attribute test.unit.common.test_storage_policy.TestStoragePolicies.test_policies_type_attribute ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_policy_baseclass_instantiate test.unit.common.test_storage_policy.TestStoragePolicies.test_policy_baseclass_instantiate ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_quorum_size_erasure_coding test.unit.common.test_storage_policy.TestStoragePolicies.test_quorum_size_erasure_coding ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_quorum_size_replication test.unit.common.test_storage_policy.TestStoragePolicies.test_quorum_size_replication ... ok test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0023 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0116 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0157 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/c" 400 26 "-" "-" "-" 0.0001 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:09 +0000] "PUT /sda1/p/a/b%27%5Cxe2%5Cx98%5Cx83%27" 201 - "-" "-" "-" 0.0116 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: - - - [13/Sep/2025:13:24:09 +0000] "REPLICATE /sda1/p/a/" 204 - "-" "-" "-" 0.0003 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: - - - [13/Sep/2025:13:24:09 +0000] "REPLICATE /sda1/p/a/" 204 - "-" "-" "-" 0.0003 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: - - - [13/Sep/2025:13:24:09 +0000] "REPLICATE /sda1/p/a/" 404 - "-" "-" "-" 0.0003 "-" 1824541 - test ERROR: ERROR __call__ error with REPLICATE /sda1/p/a/ : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 1023, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/swift/common/base_storage_server.py", line 71, in _timing_stats resp = func(ctrl, *args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 947, in REPLICATE ret = self.replicator_rpc.dispatch(post_args, args) File "/build/reproducible-path/swift-2.36.0/swift/common/db_replicator.py", line 903, in dispatch return getattr(self, op)( ~~~~~~~^^^^^^^^^^ AttributeError: 'ContainerReplicatorRpc' object has no attribute 'unknown_sync' test DEBUG: - - - [13/Sep/2025:13:24:09 +0000] "REPLICATE /sda1/p/a/" 500 714 "-" "-" "-" 0.0143 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: - - - [13/Sep/2025:13:24:10 +0000] "REPLICATE /sda1/p/a/" 400 49 "-" "-" "-" 0.0004 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "UPDATE /sda1/p/a/c" 400 41 "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "UPDATE /sda1/p/a/c" 202 - "-" "-" "-" 0.0218 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/a/c" 200 131 "-" "-" "-" 0.0021 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/.a/c" 404 - "-" "-" "-" 0.0004 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "UPDATE /sda1/p/.a/c" 202 - "-" "-" "-" 0.0161 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/.a/c" 200 131 "-" "-" "-" 0.0020 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test ERROR: ERROR __call__ error with PUT /sda1/p/a/c : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 1023, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_server.py", line 6149, in mock_put_method raise Exception() Exception test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0120 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test ERROR: ERROR Account update failed: different numbers of hosts and devices in request: "127.0.0.1:0" vs "sda1,sda2" test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0116 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0100 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0100 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0159 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c2" 204 - "-" "-" "-" 0.0093 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0107 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0019 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0133 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0024 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0099 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0146 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0060 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0105 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0018 "-" 1824541 4 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0093 "-" 1824541 4 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0155 "-" 1824541 4test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_change_to_default_storage_policy_via_DELETE_then_PUT test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_change_to_default_storage_policy_via_DELETE_then_PUT ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_content_type_on_HEAD test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_content_type_on_HEAD ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_correct_allowed_method test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_correct_allowed_method ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_create_reserved_namespace_container test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_create_reserved_namespace_container ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_create_reserved_object_in_container test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_create_reserved_object_in_container ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_creation test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_creation ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_delete_auto_create test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_delete_auto_create ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_reload_invalid_storage_policies test.unit.common.test_storage_policy.TestStoragePolicies.test_reload_invalid_storage_policies ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_singleton_passthrough test.unit.common.test_storage_policy.TestStoragePolicies.test_singleton_passthrough ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_split_policy_string test.unit.common.test_storage_policy.TestStoragePolicies.test_split_policy_string ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_storage_policies_as_dict_keys test.unit.common.test_storage_policy.TestStoragePolicies.test_storage_policies_as_dict_keys ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_storage_policy_get_info test.unit.common.test_storage_policy.TestStoragePolicies.test_storage_policy_get_info ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_deleted_headers test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_deleted_headers ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_delimiter_with_reserved test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_delimiter_with_reserved ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_storage_policy_ordering test.unit.common.test_storage_policy.TestStoragePolicies.test_storage_policy_ordering ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_storage_policy_repr test.unit.common.test_storage_policy.TestStoragePolicies.test_storage_policy_repr ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_swift_info test.unit.common.test_storage_policy.TestStoragePolicies.test_swift_info ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_defaults test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_defaults ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_indexes test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_indexes ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_names test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_names ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_type_default test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_type_default ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_type_invalid test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policies_type_invalid ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policy_params test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_policy_params ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_ring test.unit.common.test_storage_policy.TestStoragePolicies.test_validate_ring ... ok test.unit.common.test_storage_policy.TestStoragePolicies.test_wacky_int_names test.unit.common.test_storage_policy.TestStoragePolicies.test_wacky_int_names ... ok test.unit.common.test_utils.TestFallocate.test_arg_bounds test.unit.common.test_utils.TestFallocate.test_arg_bounds ... ok test.unit.common.test_utils.TestFallocate.test_fallocate test.unit.common.test_utils.TestFallocate.test_fallocate ... ok test.unit.common.test_utils.TestFallocate.test_fallocate_fatal_error test.unit.common.test_utils.TestFallocate.test_fallocate_fatal_error ... ok test.unit.common.test_utils.TestFallocate.test_fallocate_offset test.unit.common.test_utils.TestFallocate.test_fallocate_offset ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 412 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx336fa24ad16d43f882887-0068c57079" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 412 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx336fa24ad16d43f882887-0068c57079" "proxy-server 1824514" 0.0006 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx616d1c404dc447118efed-0068c57079" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "txd561f5230f7b47db9cbee-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdh1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 304 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txda1944c6ce4443ba9c9b8-0068c5707a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb0e5191aaa0c482ea2224-0068c5707a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "txe80fac5c015545ffa3f96-0068c5707a" "proxy-server 1824514" 0.0106 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 304 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "tx17f3c80a54a34df48017d-0068c5707a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txae73a131d50e4b81a10a6-0068c5707a" "proxy-server 1824514" 0.0091 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a/a8ba8111a6d044929b2b834ccc7c1bd6" 204 - "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6" "tx5a427ddafc884fe19c9e3-0068c5707a" "proxy-server 1824514" 0.0113 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdg1/2/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" 200 92 "HEAD http://localhost:8080/v1/a/a8ba8111a6d044929b2b834ccc7c1bd6/o" "txfc07e65a13e54206a34bf-0068c5707a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx160f02697d5641d6b5147-0068c5707a" "proxy-server 1824514" 0.0012 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdb1/1/a/292859879270477ea37b6fdbdf57e529" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/292859879270477ea37b6fdbdf57e529" "tx160f02697d5641d6b5147-0068c5707a" "container-server 1824514" 0.0012 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/1/a/292859879270477ea37b6fdbdf57e529" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/292859879270477ea37b6fdbdf57e529" "tx160f02697d5641d6b5147-0068c5707a" "container-server 1824514" 0.0010 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/2/a/292859879270477ea37b6fdbdf57e529" 201 - "PUT http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529" "tx160f02697d5641d6b5147-0068c5707a" "proxy-server 1824514" 0.0456 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdb1/2/a/292859879270477ea37b6fdbdf57e529" 201 - "PUT http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529" "tx160f02697d5641d6b5147-0068c5707a" "proxy-server 1824514" 0.0335 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb613296aa301423f8a14f-0068c5707a" "proxy-server 1824514" 0.0020 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/292859879270477ea37b6fdbdf57e529" 204 - "HEAD http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529" "txb613296aa301423f8a14f-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5a8bbee6674243309709a-0068c5707a" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/292859879270477ea37b6fdbdf57e529" 204 - "HEAD http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529" "txc0064945c51e41aaa969a-0068c5707a" "proxy-server 1824514" 0.0015 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdg1/2/a/292859879270477ea37b6fdbdf57e529/o" 201 - "PUT http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529/o" "txa9d844598f19454f8941b-0068c5707a" "proxy-server 1824514" 0.0236 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdb1/2/a/292859879270477ea37b6fdbdf57e529/o" 201 - "PUT http://foo:8080/sdh1/2/a/292859879270477ea37b6fdbdf57e529/o" "txa9d844598f19454f8941b-0068c5707a" "object-server 1824514" 0.0005 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/2/a/292859879270477ea37b6fdbdf57e529/o" 201 - "PUT http://foo:8080/sdi1/2/a/292859879270477ea37b6fdbdf57e529/o" "txa9d844598f19454f8941b-0068c5707a" "object-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdi1/2/a/292859879270477ea37b6fdbdf57e529/o" 201 - "PUT http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529/o" "txa9d844598f19454f8941b-0068c5707a" "proxy-server 1824514" 0.0363 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdh1/2/a/292859879270477ea37b6fdbdf57e529/o" 201 - "PUT http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529/o" "txa9d844598f19454f8941b-0068c5707a" "proxy-server 1824514" 0.0361 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx843688b8f01d49feaa990-0068c5707a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/2/a/292859879270477ea37b6fdbdf57e529" 204 - "HEAD http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529" "txacfb0e7c800a4440bd653-0068c5707a" "proxy-server 1824514" 0.0113 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "POST /sdh1/2/a/292859879270477ea37b6fdbdf57e529/o" 202 76 "POST http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529/o" "tx12152e30717f48f5bb7a9-0068c5707a" "proxy-server 1824514" 0.0144 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/2/a/292859879270477ea37b6fdbdf57e529/o" 201 - "POST http://foo:8080/sdi1/2/a/292859879270477ea37b6fdbdf57e529/o" "tx12152e30717f48f5bb7a9-0068c5707a" "object-server 1824514" 0.0045 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdb1/2/a/292859879270477ea37b6fdbdf57e529/o" 201 - "POST http://foo:8080/sdg1/2/a/292859879270477ea37b6fdbdf57e529/o" "tx12152e30717f48f5bb7a9-0068c5707a" "object-server 1824514" 0.0005 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "POST /sdg1/2/a/292859879270477ea37b6fdbdf57e529/o" 202 76 "POST http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529/o" "tx12152e30717f48f5bb7a9-0068c5707a" "proxy-server 1824514" 0.0126 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "POST /sdi1/2/a/292859879270477ea37b6fdbdf57e529/o" 202 76 "POST http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529/o" "tx12152e30717f48f5bb7a9-0068c5707a" "proxy-server 1824514" 0.0181 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txc791d3de9a334fae8d342-0068c5707a" "proxy-server 1824514" 0.0012 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdb1/1/a/d0ca56be2b4d4d3d947d2a38609acb1d" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txc791d3de9a334fae8d342-0068c5707a" "container-server 1824514" 0.0010 "-" 1824514 1test.unit.common.test_utils.TestFallocate.test_fallocate_silent_errors test.unit.common.test_utils.TestFallocate.test_fallocate_silent_errors ... ok test.unit.common.test_utils.TestFallocate.test_no_fallocates_available test.unit.common.test_utils.TestFallocate.test_no_fallocates_available ... ok test.unit.common.test_utils.TestFallocate.test_posix_fallocate_fallback test.unit.common.test_utils.TestFallocate.test_posix_fallocate_fallback ... ok test.unit.common.test_utils.TestFallocate.test_posix_fallocate_offset test.unit.common.test_utils.TestFallocate.test_posix_fallocate_offset ... ok test.unit.common.test_utils.TestFallocateReserve.test_all_reserved test.unit.common.test_utils.TestFallocateReserve.test_all_reserved ... ok test.unit.common.test_utils.TestFallocateReserve.test_all_space_reserved_pct test.unit.common.test_utils.TestFallocateReserve.test_all_space_reserved_pct ... ok test.unit.common.test_utils.TestFallocateReserve.test_disabled test.unit.common.test_utils.TestFallocateReserve.test_disabled ... ok test.unit.common.test_utils.TestFallocateReserve.test_enough_space test.unit.common.test_utils.TestFallocateReserve.test_enough_space ... ok test.unit.common.test_utils.TestFallocateReserve.test_enough_space_pct test.unit.common.test_utils.TestFallocateReserve.test_enough_space_pct ... ok test.unit.common.test_utils.TestFallocateReserve.test_enough_space_small_blocks test.unit.common.test_utils.TestFallocateReserve.test_enough_space_small_blocks ... ok test.unit.common.test_utils.TestFallocateReserve.test_free_space_under_reserve test.unit.common.test_utils.TestFallocateReserve.test_free_space_under_reserve ... ok test.unit.common.test_utils.TestFallocateReserve.test_not_enough_space test.unit.common.test_utils.TestFallocateReserve.test_not_enough_space ... ok test.unit.common.test_utils.TestFallocateReserve.test_not_enough_space_large test.unit.common.test_utils.TestFallocateReserve.test_not_enough_space_large ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 156, in GET return self.GETorHEAD(req) ~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 109, in GETorHEAD resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2445, in get_response resp = self.acl_handler.handle_acl( app, method, container, obj, headers) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 96, in handle_acl return ah._handle_acl(app, method) ~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 145, in _handle_acl resp = self.req.get_acl_response(app, 'HEAD', container, obj, headers, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:04 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_version_id ... ok test.unit.common.test_utils.TestFallocateReserve.test_not_enough_space_pct test.unit.common.test_utils.TestFallocateReserve.test_not_enough_space_pct ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_double_check_trailing_delimiter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_double_check_trailing_delimiter_non_slash ... ok test.unit.common.test_utils.TestFallocateReserve.test_not_enough_space_small_blocks test.unit.common.test_utils.TestFallocateReserve.test_not_enough_space_small_blocks ... ok test.unit.common.test_utils.TestFallocateReserve.test_zero_reserve test.unit.common.test_utils.TestFallocateReserve.test_zero_reserve ... ok test.unit.common.test_utils.TestFsync.test_fsync_bad_fullsync test.unit.common.test_utils.TestFsync.test_fsync_bad_fullsync ... ok test.unit.common.test_utils.TestFsync.test_fsync_f_fullsync test.unit.common.test_utils.TestFsync.test_fsync_f_fullsync ... ok test.unit.common.test_utils.TestFsync.test_fsync_no_fullsync test.unit.common.test_utils.TestFsync.test_fsync_no_fullsync ... ok test.unit.common.test_utils.TestFsync.test_no_fdatasync test.unit.common.test_utils.TestFsync.test_no_fdatasync ... ok test.unit.common.test_utils.TestFsync.test_yes_fdatasync test.unit.common.test_utils.TestFsync.test_yes_fdatasync ... ok test.unit.common.test_utils.TestGreenthreadSafeIterator.test_access_is_serialized test.unit.common.test_utils.TestGreenthreadSafeIterator.test_access_is_serialized ... ok test.unit.common.test_utils.TestGreenthreadSafeIterator.test_setup_works test.unit.common.test_utils.TestGreenthreadSafeIterator.test_setup_works ... ok test-TestECDiskFile WARNING: MD5 sockets not supported. splice() will not be used. test-TestECDiskFile WARNING: MD5 sockets not supported. splice() will not be used. test-TestECDiskFile WARNING: MD5 sockets not supported. splice() will not be used. test WARNING: expiring_objects_container_divisor is deprecated test WARNING: expiring_objects_account_name is deprecated; you need to migrate to the standard .expiring_objects account test WARNING: expiring_objects_container_divisor is deprecated test WARNING: expiring_objects_account_name is deprecated; you need to migrate to the standard .expiring_objects account test WARNING: expiring_objects_container_divisor is deprecated test WARNING: expiring_objects_account_name is deprecated; you need to migrate to the standard .expiring_objects account test WARNING: expiring_objects_container_divisor is deprecated test WARNING: expiring_objects_container_divisor is deprecated test WARNING: expiring_objects_container_divisor is deprecated test WARNING: expiring_objects_container_divisor is deprecated object-reconstructor DEBUG: Run listdir on /tmp/tmpiz70he_t/devices/sda/objects/0 object-reconstructor DEBUG: Run listdir on /tmp/tmpiz70he_t/devices/sda/objects/0 object-reconstructor INFO: Nothing reconstructed for 9.5367431640625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.7220458984375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.0531158447265625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.814697265625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.0531158447265625e-06 seconds. object-reconstructor ERROR: Unable to create /tmp/tmp8gmfh8l2/devices/sda/objects: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 1350, in collect_parts mkdirs(obj_path) ~~~~~~^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: kaboom! object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor WARNING: sda is not mounted object-reconstructor WARNING: sdb is not mounted object-reconstructor WARNING: sdb is not mounted object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 7.62939453125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 7.3909759521484375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.4836273193359375e-06 seconds. object-reconstructor ERROR: Unable to list partitions in '/tmp/tmpb1dom60w/devices/sda/objects': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 1356, in collect_parts partitions = os.listdir(obj_path) NotADirectoryError: [Errno 20] Not a directory: '/tmp/tmpb1dom60w/devices/sda/objects' object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.0067901611328125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.0067901611328125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.0531158447265625e-06 seconds. object-reconstructor DEBUG: Run listdir on /tmp/tmpqd2q0kvc/devices/sda/objects/1 object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor DEBUG: Run listdir on /tmp/tmpay4ln91e/devices/sda/objects/1 object-reconstructor INFO: Nothing reconstructed for 4.0531158447265625e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 7.3909759521484375e-06 seconds. object-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor INFO: Nothing reconstructed for 4.76837158203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.0067901611328125e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor WARNING: Ignored handoffs_first option in favor of handoffs_only. object-reconstructor INFO: Nothing reconstructed for 5.245208740234375e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor INFO: Nothing reconstructed for 3.814697265625e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. object-reconstructor INFO: Nothing reconstructed for 5.0067901611328125e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.4836273193359375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.0531158447265625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 7.152557373046875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.0:1000/sda/0 policy#0': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 920, in _get_suffixes_to_sync conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], job['partition'], 'REPLICATE', '', headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom!test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_suffix_call_errors test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_suffix_call_errors ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_sync_missing_durable test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_sync_missing_durable ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_sync_partner_unmounted test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_sync_partner_unmounted ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_will_not_revert_to_handoff test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_process_job_will_not_revert_to_handoff ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_reconstruct_removes_non_partition_files test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_reconstruct_removes_non_partition_files ... ok test.unit.common.test_utils.TestNamespace.test_bounds_serialization test.unit.common.test_utils.TestNamespace.test_bounds_serialization ... ok test.unit.common.test_utils.TestNamespace.test_comparisons test.unit.common.test_utils.TestNamespace.test_comparisons ... ok test.unit.common.test_utils.TestNamespace.test_contains test.unit.common.test_utils.TestNamespace.test_contains ... ok test.unit.common.test_utils.TestNamespace.test_end_marker test.unit.common.test_utils.TestNamespace.test_end_marker ... ok test.unit.common.test_utils.TestNamespace.test_entire_namespace test.unit.common.test_utils.TestNamespace.test_entire_namespace ... ok test.unit.common.test_utils.TestNamespace.test_expand test.unit.common.test_utils.TestNamespace.test_expand ... ok test.unit.common.test_utils.TestNamespace.test_includes test.unit.common.test_utils.TestNamespace.test_includes ... ok test.unit.common.test_utils.TestNamespace.test_lower_setter test.unit.common.test_utils.TestNamespace.test_lower_setter ... ok test.unit.common.test_utils.TestNamespace.test_name test.unit.common.test_utils.TestNamespace.test_name ... ok test.unit.common.test_utils.TestNamespace.test_name_unexpected_format test.unit.common.test_utils.TestNamespace.test_name_unexpected_format ... ok test.unit.cli.test_ring_builder_analyzer.TestRunScenario.test_it_runs test.unit.cli.test_ring_builder_analyzer.TestRunScenario.test_it_runs ... ok test.unit.common.middleware.s3api.test_cfg.TestS3ApiCfg.test_config test.unit.common.middleware.s3api.test_cfg.TestS3ApiCfg.test_config ... ok test.unit.common.test_utils.TestNamespace.test_total_ordering test.unit.common.test_utils.TestNamespace.test_total_ordering ... ok test.unit.common.test_utils.TestNamespace.test_unicode_name test.unit.common.test_utils.TestNamespace.test_unicode_name ... ok test.unit.common.test_utils.TestNamespace.test_upper_setter test.unit.common.test_utils.TestNamespace.test_upper_setter ... ok test.unit.common.ring.test_ring.TestRing.test_get_more_nodes test.unit.common.ring.test_ring.TestRing.test_get_more_nodes ... ok test.unit.common.test_wsgi.TestPipelineWrapper.test_insert_filter test.unit.common.test_wsgi.TestPipelineWrapper.test_insert_filter ... ok test.unit.common.test_wsgi.TestPipelineWrapper.test_startswith test.unit.common.test_wsgi.TestPipelineWrapper.test_startswith ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_get_and_validate_policy_index test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_get_and_validate_policy_index ... ok test.unit.common.test_wsgi.TestPipelineWrapper.test_startswith_no_filters test.unit.common.test_wsgi.TestPipelineWrapper.test_startswith_no_filters ... ok test.unit.common.test_wsgi.TestPipelineWrapper.test_str test.unit.common.test_wsgi.TestPipelineWrapper.test_str ... ok test.unit.common.test_wsgi.TestPipelineWrapper.test_str_unknown_filter test.unit.common.test_wsgi.TestPipelineWrapper.test_str_unknown_filter ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_initiate test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_multipart_uploads_initiate ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_upload_part_missing_key test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_bucket_upload_part_missing_key ... ok test.unit.common.ring.test_ring.TestRing.test_get_more_nodes_with_zero_weight_region test.unit.common.ring.test_ring.TestRing.test_get_more_nodes_with_zero_weight_region ... ok test.unit.common.ring.test_ring.TestRing.test_get_nodes test.unit.common.ring.test_ring.TestRing.test_get_nodes ... ok test.unit.common.utils.test_libc.Test_LibcWrapper.test_argument_plumbing test.unit.common.utils.test_libc.Test_LibcWrapper.test_argument_plumbing ... ok test.unit.common.utils.test_libc.Test_LibcWrapper.test_available_function test.unit.common.utils.test_libc.Test_LibcWrapper.test_available_function ... ok test.unit.common.utils.test_libc.Test_LibcWrapper.test_unavailable_function test.unit.common.utils.test_libc.Test_LibcWrapper.test_unavailable_function ... ok test.unit.common.ring.test_ring.TestRing.test_get_part test.unit.common.ring.test_ring.TestRing.test_get_part ... ok test.unit.common.ring.test_ring.TestRing.test_get_part_nodes test.unit.common.ring.test_ring.TestRing.test_get_part_nodes ... ok test.unit.common.ring.test_ring.TestRing.test_has_changed test.unit.common.ring.test_ring.TestRing.test_has_changed ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_insufficient_storage_mount_check_false test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_insufficient_storage_mount_check_false ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_GET_last_version test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_GET_last_version ... ok test.unit.obj.test_diskfile.TestDiskFile.test_close_error test.unit.obj.test_diskfile.TestDiskFile.test_close_error ... ok test.unit.obj.test_diskfile.TestDiskFile.test_commit test.unit.obj.test_diskfile.TestDiskFile.test_commit ... ok test.unit.obj.test_diskfile.TestDiskFile.test_commit_fsync test.unit.obj.test_diskfile.TestDiskFile.test_commit_fsync ... ok test.unit.obj.test_diskfile.TestDiskFile.test_commit_ignores_cleanup_ondisk_files_error test.unit.obj.test_diskfile.TestDiskFile.test_commit_ignores_cleanup_ondisk_files_error ... ok test.unit.obj.test_diskfile.TestDiskFile.test_content_type_and_timestamp test.unit.obj.test_diskfile.TestDiskFile.test_content_type_and_timestamp ... ok test.unit.obj.test_diskfile.TestDiskFile.test_content_type_not_open test.unit.obj.test_diskfile.TestDiskFile.test_content_type_not_open ... ok test.unit.obj.test_diskfile.TestDiskFile.test_content_type_timestamp_not_open test.unit.obj.test_diskfile.TestDiskFile.test_content_type_timestamp_not_open ... ok test.unit.obj.test_diskfile.TestDiskFile.test_create_close_oserror test.unit.obj.test_diskfile.TestDiskFile.test_create_close_oserror ... ok test.unit.obj.test_diskfile.TestDiskFile.test_create_mkstemp_no_space test.unit.obj.test_diskfile.TestDiskFile.test_create_mkstemp_no_space ... ok test.unit.obj.test_diskfile.TestDiskFile.test_create_prealloc test.unit.obj.test_diskfile.TestDiskFile.test_create_prealloc ... ok test.unit.obj.test_diskfile.TestDiskFile.test_create_prealloc_oserror test.unit.obj.test_diskfile.TestDiskFile.test_create_prealloc_oserror ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_insufficient_storage_mount_check_true test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_insufficient_storage_mount_check_true ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_invalid_method_doesnt_exist test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_invalid_method_doesnt_exist ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_invalid_method_is_not_public test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_invalid_method_is_not_public ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_list_allowed_methods test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_list_allowed_methods ... ok test.unit.obj.test_diskfile.TestDiskFile.test_create_unlink_cleanup_DiskFileNoSpace test.unit.obj.test_diskfile.TestDiskFile.test_create_unlink_cleanup_DiskFileNoSpace ... ok test.unit.obj.test_diskfile.TestDiskFile.test_create_unlink_cleanup_logging test.unit.obj.test_diskfile.TestDiskFile.test_create_unlink_cleanup_logging ... ok test.unit.obj.test_diskfile.TestDiskFile.test_create_unlink_cleanup_renamer_fails test.unit.obj.test_diskfile.TestDiskFile.test_create_unlink_cleanup_renamer_fails ... ok test.unit.obj.test_diskfile.TestDiskFile.test_create_use_linkat_renamer_not_called test.unit.obj.test_diskfile.TestDiskFile.test_create_use_linkat_renamer_not_called ... ok test.unit.obj.test_diskfile.TestDiskFile.test_data_timestamp test.unit.obj.test_diskfile.TestDiskFile.test_data_timestamp ... ok test.unit.obj.test_diskfile.TestDiskFile.test_data_timestamp_not_open test.unit.obj.test_diskfile.TestDiskFile.test_data_timestamp_not_open ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_listing_with_reserved test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_listing_with_reserved ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_log_line_format test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_log_line_format ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket5 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket6 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket7 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket8 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: checking permission: bucket9 None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:othertest:other fake-swift DEBUG: permission denined: 403 Forbidden test:tester OWNER fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift ERROR: While processing manifest /v1/AUTH_test/mancon/manifest, got 403 (

Forbidden

Access was denied to this reso...) while retrieving /v1/AUTH_test/c/seg_01 fake-swift ERROR: While processing manifest /v1/AUTH_test/mancon/manifest, got 403 (

Forbidden

Access was denied to this reso...) while retrieving /v1/AUTH_test/c/seg_02 fake-swift ERROR: Got status 404 listing container /AUTH_test/c fake-swift ERROR: Too many bytes for /v1/AUTH_test/mancon/manifest; truncating in /v1/AUTH_test/c/seg_03 with 5 bytes left fake-swift ERROR: While processing manifest /v1/AUTH_test/mancon/manifest, max LO GET time of 86400s exceeded fake-swift ERROR: Expected another 1 bytes for /v1/AUTH_test/mancon/manifest; closing connection fake-swift ERROR: Expected another 1 bytes for /v1/AUTH_test/mancon/manifest; closing connection fake-swift ERROR: Bad MD5 checksum for /v1/AUTH_test/c/seg_02 as part of /v1/AUTH_test/mancon/manifest: headers had a21075a36eeddd084e17611a238c7101, but object MD5 was actually 3902ee7e149eb8313a34757e89e21af6 fake-swift ERROR: Bad response length for /v1/AUTH_test/c/seg_02 as part of /v1/AUTH_test/mancon/manifest: headers had 5, but response length was actually 4 fake-swift ERROR: While processing manifest /v1/AUTH_test/mancon/manifest, got 503 (

Service Unavailable

The server is curren...) while retrieving /v1/AUTH_test/c/seg_01 test DEBUG: User tenant_id has system reader authorizing test DEBUG: tenant mismatch: AUTH_tenant_id2 != tenant_id test DEBUG: allow user with role(s) swiftoperator,admin as account admin test-ic DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.common.test_internal_client.TestInternalClient.test_load_from_config test.unit.common.test_internal_client.TestInternalClient.test_load_from_config ... ok test.unit.common.test_internal_client.TestInternalClient.test_load_from_config_with_global_conf test.unit.common.test_internal_client.TestInternalClient.test_load_from_config_with_global_conf ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_path test.unit.common.test_internal_client.TestInternalClient.test_make_path ... ok test.unit.obj.test_diskfile.TestDiskFile.test_delete test.unit.obj.test_diskfile.TestDiskFile.test_delete ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_path_exception test.unit.common.test_internal_client.TestInternalClient.test_make_path_exception ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_acceptable_status_not_2xx test.unit.common.test_internal_client.TestInternalClient.test_make_request_acceptable_status_not_2xx ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_calls_fobj_seek_each_try test.unit.common.test_internal_client.TestInternalClient.test_make_request_calls_fobj_seek_each_try ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_clears_txn_id_after_calling_app test.unit.common.test_internal_client.TestInternalClient.test_make_request_clears_txn_id_after_calling_app ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_codes test.unit.common.test_internal_client.TestInternalClient.test_make_request_codes ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_defaults_replication_network_header test.unit.common.test_internal_client.TestInternalClient.test_make_request_defaults_replication_network_header ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_error_case test.unit.common.test_internal_client.TestInternalClient.test_make_request_error_case ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_method_path_headers test.unit.common.test_internal_client.TestInternalClient.test_make_request_method_path_headers ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_request_exception test.unit.common.test_internal_client.TestInternalClient.test_make_request_request_exception ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_corners test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_corners ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_retries test.unit.common.test_internal_client.TestInternalClient.test_make_request_retries ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_partial_closes test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_partial_closes ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_sets_query_string test.unit.common.test_internal_client.TestInternalClient.test_make_request_sets_query_string ... ok test.unit.common.test_internal_client.TestInternalClient.test_make_request_sets_user_agent test.unit.common.test_internal_client.TestInternalClient.test_make_request_sets_user_agent ... ok test.unit.common.test_internal_client.TestInternalClient.test_set_account_metadata test.unit.common.test_internal_client.TestInternalClient.test_set_account_metadata ... ok test.unit.common.test_internal_client.TestInternalClient.test_set_account_metadata_plumbing test.unit.common.test_internal_client.TestInternalClient.test_set_account_metadata_plumbing ... ok test.unit.common.test_internal_client.TestInternalClient.test_set_container_metadata test.unit.common.test_internal_client.TestInternalClient.test_set_container_metadata ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_range_w_none test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_range_w_none ... ok test.unit.common.test_internal_client.TestInternalClient.test_set_container_metadata_plumbing test.unit.common.test_internal_client.TestInternalClient.test_set_container_metadata_plumbing ... ok test.unit.common.test_internal_client.TestInternalClient.test_set_metadata test.unit.common.test_internal_client.TestInternalClient.test_set_metadata ... ok test.unit.common.test_internal_client.TestInternalClient.test_set_object_metadata test.unit.common.test_internal_client.TestInternalClient.test_set_object_metadata ... ok test.unit.common.test_internal_client.TestInternalClient.test_set_object_metadata_plumbing test.unit.common.test_internal_client.TestInternalClient.test_set_object_metadata_plumbing ... ok test.unit.common.test_internal_client.TestInternalClient.test_upload_object test.unit.common.test_internal_client.TestInternalClient.test_upload_object ... ok test.unit.common.test_internal_client.TestInternalClient.test_upload_object_not_chunked test.unit.common.test_internal_client.TestInternalClient.test_upload_object_not_chunked ... ok test.unit.common.test_internal_client.TestInternalClient.test_upload_object_plumbing test.unit.common.test_internal_client.TestInternalClient.test_upload_object_plumbing ... ok test.unit.common.test_manager.TestManager.test_create test.unit.common.test_manager.TestManager.test_create ... ok test.unit.common.test_manager.TestManager.test_default_strict test.unit.common.test_manager.TestManager.test_default_strict ... ok test.unit.common.test_manager.TestManager.test_force_reload test.unit.common.test_manager.TestManager.test_force_reload ... ok test.unit.common.test_manager.TestManager.test_get_command test.unit.common.test_manager.TestManager.test_get_command ... ok test.unit.common.test_manager.TestManager.test_iter test.unit.common.test_manager.TestManager.test_iter ... ok test.unit.common.test_manager.TestManager.test_list_commands test.unit.common.test_manager.TestManager.test_list_commands ... ok test.unit.common.test_manager.TestManager.test_no_daemon test.unit.common.test_manager.TestManager.test_no_daemon ... ok test.unit.common.test_manager.TestManager.test_no_wait test.unit.common.test_manager.TestManager.test_no_wait ... ok test.unit.common.test_manager.TestManager.test_once test.unit.common.test_manager.TestManager.test_once ... ok test.unit.common.test_manager.TestManager.test_reload test.unit.common.test_manager.TestManager.test_reload ... ok test.unit.common.test_manager.TestManager.test_restart test.unit.common.test_manager.TestManager.test_restart ... ok test.unit.common.test_manager.TestManager.test_run_command test.unit.common.test_manager.TestManager.test_run_command ... ok test.unit.common.test_manager.TestManager.test_shutdown test.unit.common.test_manager.TestManager.test_shutdown ... ok test.unit.common.test_manager.TestManager.test_start test.unit.common.test_manager.TestManager.test_start ... ok test.unit.common.test_manager.TestManager.test_status test.unit.common.test_manager.TestManager.test_status ... ok test.unit.common.test_manager.TestManager.test_stop test.unit.common.test_manager.TestManager.test_stop ... ok test.unit.common.test_manager.TestManager.test_stop_kill_after_timeout test.unit.common.test_manager.TestManager.test_stop_kill_after_timeout ... ok test.unit.common.test_statsd_client.TestGetStatsdClientConfParsing.test_emit_legacy test.unit.common.test_statsd_client.TestGetStatsdClientConfParsing.test_emit_legacy ... ok test.unit.common.test_statsd_client.TestGetStatsdClientConfParsing.test_get_statsd_client_defaults test.unit.common.test_statsd_client.TestGetStatsdClientConfParsing.test_get_statsd_client_defaults ... ok test.unit.common.test_statsd_client.TestGetStatsdClientConfParsing.test_get_statsd_client_options test.unit.common.test_statsd_client.TestGetStatsdClientConfParsing.test_get_statsd_client_options ... ok test.unit.common.test_statsd_client.TestGetStatsdClientConfParsing.test_legacy_client_does_not_support_labels_kwarg test.unit.common.test_statsd_client.TestGetStatsdClientConfParsing.test_legacy_client_does_not_support_labels_kwarg ... ok test.unit.common.test_swob.TestRequest.test_401_invalid_path test.unit.common.test_swob.TestRequest.test_401_invalid_path ... ok test.unit.common.test_swob.TestRequest.test_401_non_keystone_auth_path test.unit.common.test_swob.TestRequest.test_401_non_keystone_auth_path ... ok test.unit.common.test_swob.TestRequest.test_401_unauthorized test.unit.common.test_swob.TestRequest.test_401_unauthorized ... ok test.unit.common.test_swob.TestRequest.test_401_valid_account_path test.unit.common.test_swob.TestRequest.test_401_valid_account_path ... ok test.unit.common.test_swob.TestRequest.test_401_www_authenticate_exists test.unit.common.test_swob.TestRequest.test_401_www_authenticate_exists ... ok test.unit.common.test_swob.TestRequest.test_401_www_authenticate_is_quoted test.unit.common.test_swob.TestRequest.test_401_www_authenticate_is_quoted ... ok test.unit.common.test_swob.TestRequest.test_accept_header test.unit.common.test_swob.TestRequest.test_accept_header ... ok test.unit.common.test_swob.TestRequest.test_allow_reserved_names test.unit.common.test_swob.TestRequest.test_allow_reserved_names ... ok test.unit.common.test_swob.TestRequest.test_as_referer test.unit.common.test_swob.TestRequest.test_as_referer ... ok test.unit.common.test_swob.TestRequest.test_bad_path_info_pop test.unit.common.test_swob.TestRequest.test_bad_path_info_pop ... ok test.unit.common.test_swob.TestRequest.test_bad_range test.unit.common.test_swob.TestRequest.test_bad_range ... ok test.unit.common.test_swob.TestRequest.test_blank test.unit.common.test_swob.TestRequest.test_blank ... ok test.unit.common.test_swob.TestRequest.test_blank_body_precedence test.unit.common.test_swob.TestRequest.test_blank_body_precedence ... ok test.unit.common.test_swob.TestRequest.test_blank_parsing test.unit.common.test_swob.TestRequest.test_blank_parsing ... ok test.unit.common.test_swob.TestRequest.test_blank_path_info_precedence test.unit.common.test_swob.TestRequest.test_blank_path_info_precedence ... ok test.unit.common.test_swob.TestRequest.test_blank_req_environ_property_args test.unit.common.test_swob.TestRequest.test_blank_req_environ_property_args ... ok test.unit.common.test_swob.TestRequest.test_copy_get test.unit.common.test_swob.TestRequest.test_copy_get ... ok test.unit.common.test_swob.TestRequest.test_datetime_properties test.unit.common.test_swob.TestRequest.test_datetime_properties ... ok test.unit.common.test_swob.TestRequest.test_get_response test.unit.common.test_swob.TestRequest.test_get_response ... ok test.unit.common.test_swob.TestRequest.test_invalid_req_environ_property_args test.unit.common.test_swob.TestRequest.test_invalid_req_environ_property_args ... ok test.unit.common.test_swob.TestRequest.test_message_length_just_content_length test.unit.common.test_swob.TestRequest.test_message_length_just_content_length ... ok test.unit.common.test_swob.TestRequest.test_message_length_transfer_encoding test.unit.common.test_swob.TestRequest.test_message_length_transfer_encoding ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges_edges test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges_edges ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges_empty test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges_empty ... ok test.unit.common.test_swob.TestRequest.test_not_401 test.unit.common.test_swob.TestRequest.test_not_401 ... ok test.unit.common.test_swob.TestRequest.test_params test.unit.common.test_swob.TestRequest.test_params ... ok test.unit.common.test_swob.TestRequest.test_path test.unit.common.test_swob.TestRequest.test_path ... ok test.unit.common.test_swob.TestRequest.test_path_info_pop test.unit.common.test_swob.TestRequest.test_path_info_pop ... ok test.unit.common.test_swob.TestRequest.test_path_info_pop_last test.unit.common.test_swob.TestRequest.test_path_info_pop_last ... ok test.unit.common.test_swob.TestRequest.test_path_info_pop_none test.unit.common.test_swob.TestRequest.test_path_info_pop_none ... ok test.unit.common.test_swob.TestRequest.test_path_qs test.unit.common.test_swob.TestRequest.test_path_qs ... ok test.unit.common.test_swob.TestRequest.test_path_question_mark test.unit.common.test_swob.TestRequest.test_path_question_mark ... ok test.unit.common.test_swob.TestRequest.test_properties test.unit.common.test_swob.TestRequest.test_properties ... ok test.unit.common.test_swob.TestRequest.test_split_path test.unit.common.test_swob.TestRequest.test_split_path ... ok test.unit.common.test_swob.TestRequest.test_swift_entity_path test.unit.common.test_swob.TestRequest.test_swift_entity_path ... ok test.unit.common.test_swob.TestRequest.test_timestamp test.unit.common.test_swob.TestRequest.test_timestamp ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges_w_no_etag_quarantine test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges_w_no_etag_quarantine ... ok test.unit.common.test_swob.TestRequest.test_timestamp_invalid test.unit.common.test_swob.TestRequest.test_timestamp_invalid ... ok test.unit.common.test_swob.TestRequest.test_timestamp_missing test.unit.common.test_swob.TestRequest.test_timestamp_missing ... ok test.unit.common.test_swob.TestRequest.test_unicode_params test.unit.common.test_swob.TestRequest.test_unicode_params ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '221'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_complete_multipart_upload_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_complete_multipart_upload_acl_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_complete_multipart_upload_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_complete_multipart_upload_acl_with_write_permission ... ok test.unit.common.test_swob.TestRequest.test_unicode_path test.unit.common.test_swob.TestRequest.test_unicode_path ... ok test.unit.common.test_swob.TestRequest.test_unicode_query test.unit.common.test_swob.TestRequest.test_unicode_query ... ok test.unit.common.test_swob.TestRequest.test_url test.unit.common.test_swob.TestRequest.test_url ... ok test.unit.common.test_swob.TestRequest.test_url2 test.unit.common.test_swob.TestRequest.test_url2 ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges_w_quarantine test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_app_iter_ranges_w_quarantine ... ok test.unit.common.test_swob.TestRequest.test_wsgify test.unit.common.test_swob.TestRequest.test_wsgify ... ok test.unit.common.test_swob.TestRequest.test_wsgify_method test.unit.common.test_swob.TestRequest.test_wsgify_method ... ok test.unit.common.test_swob.TestRequest.test_wsgify_raise test.unit.common.test_swob.TestRequest.test_wsgify_raise ... ok test.unit.common.test_utils.TestClosingIterator.test_close test.unit.common.test_utils.TestClosingIterator.test_close ... ok test.unit.common.test_utils.TestClosingIterator.test_close_gen test.unit.common.test_utils.TestClosingIterator.test_close_gen ... ok test.unit.common.test_utils.TestClosingIterator.test_close_on_exception test.unit.common.test_utils.TestClosingIterator.test_close_on_exception ... ok test.unit.common.test_utils.TestClosingIterator.test_close_on_stop_iteration test.unit.common.test_utils.TestClosingIterator.test_close_on_stop_iteration ... ok test.unit.common.test_utils.TestClosingIterator.test_close_others test.unit.common.test_utils.TestClosingIterator.test_close_others ... ok test.unit.common.test_utils.TestClosingIterator.test_close_wrapped_is_not_same_as_iter test.unit.common.test_utils.TestClosingIterator.test_close_wrapped_is_not_same_as_iter ... ok test.unit.common.test_utils.TestClosingIterator.test_init_with_iterable test.unit.common.test_utils.TestClosingIterator.test_init_with_iterable ... ok test.unit.common.test_utils.TestClosingIterator.test_nested_iters test.unit.common.test_utils.TestClosingIterator.test_nested_iters ... ok test.unit.common.test_utils.TestShardName.test test.unit.common.test_utils.TestShardName.test ... ok test.unit.common.test_utils.TestShardName.test_bad_create test.unit.common.test_utils.TestShardName.test_bad_create ... ok test.unit.common.test_utils.TestShardName.test_bad_parse test.unit.common.test_utils.TestShardName.test_bad_parse ... ok test.unit.common.test_utils.TestShardName.test_realistic_shard_range_names test.unit.common.test_utils.TestShardName.test_realistic_shard_range_names ... ok test.unit.common.test_utils.TestShardName.test_root_has_hyphens test.unit.common.test_utils.TestShardName.test_root_has_hyphens ... ok test.unit.common.test_utils.TestStringAlong.test_happy test.unit.common.test_utils.TestStringAlong.test_happy ... ok test.unit.common.test_utils.TestStringAlong.test_unhappy test.unit.common.test_utils.TestStringAlong.test_unhappy ... ok test.unit.common.utils.test_config.TestReadConf.test_readconf test.unit.common.utils.test_config.TestReadConf.test_readconf ... ok test.unit.common.utils.test_config.TestReadConf.test_readconf_dir test.unit.common.utils.test_config.TestReadConf.test_readconf_dir ... ok test.unit.common.utils.test_config.TestReadConf.test_readconf_dir_ignores_hidden_and_nondotconf_files test.unit.common.utils.test_config.TestReadConf.test_readconf_dir_ignores_hidden_and_nondotconf_files ... ok test.unit.common.utils.test_config.TestReadConf.test_readconf_raw test.unit.common.utils.test_config.TestReadConf.test_readconf_raw ... ok test.unit.common.utils.test_ipaddrs.TestIsValidIP.test_is_valid_ip test.unit.common.utils.test_ipaddrs.TestIsValidIP.test_is_valid_ip ... ok test.unit.common.utils.test_ipaddrs.TestIsValidIP.test_is_valid_ipv4 test.unit.common.utils.test_ipaddrs.TestIsValidIP.test_is_valid_ipv4 ... ok test.unit.common.utils.test_ipaddrs.TestIsValidIP.test_is_valid_ipv6 test.unit.common.utils.test_ipaddrs.TestIsValidIP.test_is_valid_ipv6 ... ok test.unit.container.test_auditor.TestAuditorMigrations.test_db_migration test.unit.container.test_auditor.TestAuditorMigrations.test_db_migration ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_batch_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_batch_reclaim ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/1/a/d0ca56be2b4d4d3d947d2a38609acb1d" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txc791d3de9a334fae8d342-0068c5707a" "container-server 1824514" 0.0010 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 201 - "PUT http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txc791d3de9a334fae8d342-0068c5707a" "proxy-server 1824514" 0.0255 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 201 - "PUT http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txc791d3de9a334fae8d342-0068c5707a" "proxy-server 1824514" 0.0167 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx32256bddbc4b4a1b9004a-0068c5707a" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "tx32256bddbc4b4a1b9004a-0068c5707a" "proxy-server 1824514" 0.0011 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0662a09f80204aa4bb615-0068c5707a" "proxy-server 1824514" 0.0060 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/2/a/292859879270477ea37b6fdbdf57e529" 204 - "HEAD http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529" "txa7e4271047154ff79818b-0068c5707a" "proxy-server 1824514" 0.0066 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdi1/2/a/292859879270477ea37b6fdbdf57e529/o" 200 92 "GET http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529/o" "txc67547c0a874428f8211f-0068c5707a" "proxy-server 1824514" 0.0089 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdh1/2/a/292859879270477ea37b6fdbdf57e529/o" 200 92 "GET http://foo:8080/v1/a/292859879270477ea37b6fdbdf57e529/o" "txc67547c0a874428f8211f-0068c5707a" "proxy-server 1824514" 0.0048 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3fb0f0df06d544d19a99c-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://foo:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txf334bef9a9244a5392573-0068c5707a" "proxy-server 1824514" 0.0094 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 201 - "PUT http://foo:8080/sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx8e1bf5b43eba4d13a0426-0068c5707a" "object-server 1824514" 0.0005 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 201 - "PUT http://foo:8080/sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx8e1bf5b43eba4d13a0426-0068c5707a" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 201 - "PUT http://foo:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx8e1bf5b43eba4d13a0426-0068c5707a" "proxy-server 1824514" 0.0166 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "PUT /sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 201 - "PUT http://foo:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx8e1bf5b43eba4d13a0426-0068c5707a" "proxy-server 1824514" 0.0163 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txe8c60f19afdc48fd93f3d-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txa42957f4c8ca47adbfda2-0068c5707a" "proxy-server 1824514" 0.0143 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 200 24 "GET http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx15114d1b05b8430da4b01-0068c5707a" "proxy-server 1824514" 0.0049 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txf37e5dc44de44e9a933b4-0068c5707a" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "tx4044c78b3cd8498c8dc89-0068c5707a" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 200 24 "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx527e7e5177164f99914cf-0068c5707a" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx6e094db056fa49b295468-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 200 380 "GET http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d?format=json&states=listing" "tx6e094db056fa49b295468-0068c5707a" "proxy-server 1824514" 0.0122 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb97d351eabb44c8cbf3fa-0068c5707a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txdaf42153f1a54559a6faa-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 200 24 "GET http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx2553c52322424afaacc1d-0068c5707a" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfc24eb45443f46e198343-0068c5707a" "proxy-server 1824514" 0.0093 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txb68704a299f54aef9c5d7-0068c5707a" "proxy-server 1824514" 0.0094 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 200 24 "GET http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx91a3dc6b575745c7881f5-0068c5707a" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx848d2f7736854e2baf27d-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txe3c60ef991c6445ebfbec-0068c5707a" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 412 - "GET http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx58cbe2319539464a9558d-0068c5707a" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 412 - "GET http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx58cbe2319539464a9558d-0068c5707a" "proxy-server 1824514" 0.0098 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx1f8bf30c3ab042dd99982-0068c5707a" "proxy-server 1824514" 0.0014 "-" 1824514 -test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_concurrent_delete test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_concurrent_delete ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_chexor test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_chexor ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_concurrent_marked_durable test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_concurrent_marked_durable ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=0-3', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=3-3', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=1-', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=-3', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': '', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'hoge', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=1', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=5-1', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=5-10', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_HEAD_Range_with_invalid_value test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_HEAD_Range_with_invalid_value ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_concurrent_writes test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_concurrent_writes ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_default_disallowed_metadata test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_default_disallowed_metadata ... ok test.unit.common.ring.test_ring.TestRing.test_reload test.unit.common.ring.test_ring.TestRing.test_reload ... ok test.unit.common.ring.test_ring.TestRing.test_reload_without_replication test.unit.common.ring.test_ring.TestRing.test_reload_without_replication ... ok test.unit.common.ring.test_ring.TestRing.test_replica_count test.unit.common.ring.test_ring.TestRing.test_replica_count ... ok test.unit.common.test_db.TestDictFactory.test_normal_case test.unit.common.test_db.TestDictFactory.test_normal_case ... ok test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_300_status test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_300_status ... ok test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_already_in_sync test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_already_in_sync ... ok test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_drive_not_mounted test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_drive_not_mounted ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_large_app_iter_ranges test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_large_app_iter_ranges ... ok test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_metadata_update test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_metadata_update ... ok test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_not_found test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_not_found ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_mkstemp_creates_dir test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_mkstemp_creates_dir ... ok test INFO: Starting relinker (cleanup=True) using 5 workers: 13:24:10 09/13/25 GMT test WARNING: Worker (pid=5, devs=sda4) exited in 0.0s after receiving signal: 9 test INFO: Finished relinker (cleanup=True): 13:24:10 09/13/25 GMT (0:00:00.000250 elapsed) ['Starting relinker (cleanup=True) using 5 workers: 13:24:10 09/13/25 GMT', 'Finished relinker (cleanup=True): 13:24:10 09/13/25 GMT (0:00:00.000250 elapsed)'] test INFO: Starting relinker (cleanup=True) using 5 workers: 13:24:10 09/13/25 GMT test WARNING: Worker (pid=5, devs=sda4) completed in 0.0s with errors test INFO: Finished relinker (cleanup=True): 13:24:10 09/13/25 GMT (0:00:00.004402 elapsed) ['Starting relinker (cleanup=True) using 5 workers: 13:24:10 09/13/25 GMT', 'Finished relinker (cleanup=True): 13:24:10 09/13/25 GMT (0:00:00.004402 elapsed)'] test INFO: Starting relinker (cleanup=True) using 5 workers: 13:24:10 09/13/25 GMT test WARNING: Worker (pid=5, devs=sda4) exited in 0.0s with unexpected status 42 test INFO: Finished relinker (cleanup=True): 13:24:10 09/13/25 GMT (0:00:00.006748 elapsed) ['Starting relinker (cleanup=True) using 5 workers: 13:24:10 09/13/25 GMT', 'Finished relinker (cleanup=True): 13:24:10 09/13/25 GMT (0:00:00.006748 elapsed)'] fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_GET_last_version_part_num test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_GET_last_version_part_num ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_GET_version test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_GET_version ... ok test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_not_response test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_not_response ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_GET_version_part_num test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_GET_version_part_num ... ok test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_rsync_success test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_rsync_success ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_preserves_slo test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_preserves_slo ... ok test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_small_container_always_usync test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_small_container_always_usync ... ok test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_usync_success test.unit.common.test_db_replicator.TestReplToNode.test_repl_to_node_usync_success ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_case_insensitive test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_case_insensitive ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_del_contains test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_del_contains ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_get test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_get ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_init_from_dict test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_init_from_dict ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_keys test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_keys ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_pop test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_pop ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_set test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_set ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_set_none test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_set_none ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_setdefault test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_setdefault ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_unicode test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_unicode ... ok test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_update test.unit.common.test_header_key_dict.TestHeaderKeyDict.test_update ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_bad_request_line test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_bad_request_line ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_swift_http_protocol_log_message test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_swift_http_protocol_log_message ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_swift_http_protocol_log_message_no_logger test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_swift_http_protocol_log_message_no_logger ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_preserves_sysmeta test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_preserves_sysmeta ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_swift_http_protocol_log_request test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_swift_http_protocol_log_request ... ok test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_swift_http_protocol_parse_request_no_proxy test.unit.common.test_http_protocol.TestSwiftHttpProtocol.test_swift_http_protocol_parse_request_no_proxy ... ok test.unit.common.test_internal_client.TestGetAuth.test_invalid_version test.unit.common.test_internal_client.TestGetAuth.test_invalid_version ... ok test.unit.common.test_internal_client.TestGetAuth.test_ok test.unit.common.test_internal_client.TestGetAuth.test_ok ... ok test.unit.common.test_memcached.TestMemcacheCommand.test_get_key_prefix test.unit.common.test_memcached.TestMemcacheCommand.test_get_key_prefix ... ok test.unit.common.test_memcached.TestMemcacheCommand.test_init test.unit.common.test_memcached.TestMemcacheCommand.test_init ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_append_log_info test.unit.common.test_request_helpers.TestRequestHelpers.test_append_log_info ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_constrain_req_limit test.unit.common.test_request_helpers.TestRequestHelpers.test_constrain_req_limit ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_copy_header_subset test.unit.common.test_request_helpers.TestRequestHelpers.test_copy_header_subset ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_get_ip_port test.unit.common.test_request_helpers.TestRequestHelpers.test_get_ip_port ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_get_log_info test.unit.common.test_request_helpers.TestRequestHelpers.test_get_log_info ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_get_name_and_placement_object_replication test.unit.common.test_request_helpers.TestRequestHelpers.test_get_name_and_placement_object_replication ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_get_name_and_placement_object_req test.unit.common.test_request_helpers.TestRequestHelpers.test_get_name_and_placement_object_req ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_get_reserved_name test.unit.common.test_request_helpers.TestRequestHelpers.test_get_reserved_name ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_get_reserved_name test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_get_reserved_name ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_names_in_system_accounts test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_names_in_system_accounts ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_reserved_name test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_reserved_name ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_reserved_names test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_reserved_names ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_reader_iter test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_reader_iter ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_reader_iter_w_io_error test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_reader_iter_w_io_error ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_split_reserved_name test.unit.common.test_request_helpers.TestRequestHelpers.test_invalid_split_reserved_name ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_is_backend_open_expired test.unit.common.test_request_helpers.TestRequestHelpers.test_is_backend_open_expired ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_is_object_transient_sysmeta test.unit.common.test_request_helpers.TestRequestHelpers.test_is_object_transient_sysmeta ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_is_open_expired test.unit.common.test_request_helpers.TestRequestHelpers.test_is_open_expired ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_is_sys_meta test.unit.common.test_request_helpers.TestRequestHelpers.test_is_sys_meta ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_is_sys_or_user_meta test.unit.common.test_request_helpers.TestRequestHelpers.test_is_sys_or_user_meta ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_is_use_replication_network test.unit.common.test_request_helpers.TestRequestHelpers.test_is_use_replication_network ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_is_user_meta test.unit.common.test_request_helpers.TestRequestHelpers.test_is_user_meta ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_remove_items test.unit.common.test_request_helpers.TestRequestHelpers.test_remove_items ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_split_reserved_name test.unit.common.test_request_helpers.TestRequestHelpers.test_split_reserved_name ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_strip_object_transient_sysmeta_prefix test.unit.common.test_request_helpers.TestRequestHelpers.test_strip_object_transient_sysmeta_prefix ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_strip_sys_meta_prefix test.unit.common.test_request_helpers.TestRequestHelpers.test_strip_sys_meta_prefix ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_strip_user_meta_prefix test.unit.common.test_request_helpers.TestRequestHelpers.test_strip_user_meta_prefix ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_container_params test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_container_params ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_internal_account test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_internal_account ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_internal_container test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_internal_container ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_internal_name test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_internal_name ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_internal_object test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_internal_object ... ok test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_params test.unit.common.test_request_helpers.TestRequestHelpers.test_validate_params ... ok test.unit.common.test_request_helpers.TestSegmentedIterable.test_simple_segments_app_iter test.unit.common.test_request_helpers.TestSegmentedIterable.test_simple_segments_app_iter ... ok test.unit.common.test_request_helpers.TestSegmentedIterable.test_simple_segments_app_iter_ranges test.unit.common.test_request_helpers.TestSegmentedIterable.test_simple_segments_app_iter_ranges ... ok test.unit.common.test_swob.TestConditionalIfMatch.test_match_star test.unit.common.test_swob.TestConditionalIfMatch.test_match_star ... ok test.unit.common.test_swob.TestConditionalIfMatch.test_match_star_on_404 test.unit.common.test_swob.TestConditionalIfMatch.test_match_star_on_404 ... ok test.unit.common.test_swob.TestConditionalIfMatch.test_no_match test.unit.common.test_swob.TestConditionalIfMatch.test_no_match ... ok test.unit.common.test_swob.TestConditionalIfMatch.test_quoted_simple_match test.unit.common.test_swob.TestConditionalIfMatch.test_quoted_simple_match ... ok test.unit.common.test_swob.TestConditionalIfMatch.test_simple_conditional_etag_match test.unit.common.test_swob.TestConditionalIfMatch.test_simple_conditional_etag_match ... ok test.unit.common.test_swob.TestConditionalIfMatch.test_simple_conditional_etag_no_match test.unit.common.test_swob.TestConditionalIfMatch.test_simple_conditional_etag_no_match ... ok test.unit.common.test_swob.TestConditionalIfMatch.test_simple_match test.unit.common.test_swob.TestConditionalIfMatch.test_simple_match ... ok test.unit.common.test_utils.TestCooperativeIterator.test_close test.unit.common.test_utils.TestCooperativeIterator.test_close ... ok test.unit.common.test_utils.TestCooperativeIterator.test_init test.unit.common.test_utils.TestCooperativeIterator.test_init ... ok test.unit.common.test_utils.TestCooperativeIterator.test_iter test.unit.common.test_utils.TestCooperativeIterator.test_iter ... ok test.unit.common.test_utils.TestCooperativeIterator.test_no_sleeps test.unit.common.test_utils.TestCooperativeIterator.test_no_sleeps ... ok test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0234 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0018 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/o" 201 - "-" "-" "-" 0.0157 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0093 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/%00c" 201 - "-" "-" "-" 0.0158 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/%00c%00test" 201 - "-" "-" "-" 0.0155 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c/" 201 - "-" "-" "-" 0.0144 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c/%00o" 400 61 "-" "-" "-" 0.0001 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0003 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/.a/c/o" 404 - "-" "-" "-" 0.0001 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/.a/c/o" 204 - "-" "-" "-" 0.0233 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/.c/o" 404 - "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/.c/.o" 404 - "-" "-" "-" 0.0001 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/.shards_a/c/o" 404 - "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0031 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/.shards_a/c/o" 204 - "-" "-" "-" 0.0032 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0156 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0025 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0195 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0126 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/%00null/%00null%00test02" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0120 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/a/%00null" 200 26 "-" "-" "-" 0.0019 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/a/%00null" 200 32 "-" "-" "-" 0.0019 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/container_default" 201 - "-" "-" "-" 0.0193 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/container_default" 204 - "-" "-" "-" 0.0133 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c_nada" 400 45 "-" "-" "-" 0.0002 "-" 1824541 nada test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c_999" 400 42 "-" "-" "-" 0.0001 "-" 1824541 999 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c_legacy" 201 - "-" "-" "-" 0.0153 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c_legacy" 204 - "-" "-" "-" 0.0011 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c_one" 201 - "-" "-" "-" 0.0121 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c_one" 204 - "-" "-" "-" 0.0133 "-" 1824541 1 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c_two" 201 - "-" "-" "-" 0.0194 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c_two" 204 - "-" "-" "-" 0.0012 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c_three" 201 - "-" "-" "-" 0.0155 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c_three" 204 - "-" "-" "-" 0.0011 "-" 1824541 3 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/c_four" 201 - "-" "-" "-" 0.0358 "-" 1824541 4 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/p/a/c_four" 204 - "-" "-" "-" 0.0133 "-" 1824541 4 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "method_doesnt_exist /sda1/p/a/c" 405 - "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "__init__ /sda1/p/a/c" 405 - "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0157 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0153 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:10 +0000] "GET /sda1/p/a/%00null" 200 183 "-" "-" "-" 0.0142 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: 1.2.3.4 - - [01/Jan/1970:02:46:42 +0000] "HEAD /sda1/p/a/c" 404 - "-" "-" "-" 2.0000 "-" 1234 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf'test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_markers_with_reserved test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_markers_with_reserved ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_not_allowed_method test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_not_allowed_method ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_object_update_with_multiple_timestamps test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_object_update_with_multiple_timestamps ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_object_update_with_offset test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_object_update_with_offset ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_params_format test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_params_format ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_reader_iter_w_quarantine test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_reader_iter_w_quarantine ... ok test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_writer test.unit.obj.test_diskfile.TestDiskFile.test_disk_file_writer ... ok test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_content_length test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_content_length ... ok test.unit.common.test_utils.TestCooperativeIterator.test_sleeps test.unit.common.test_utils.TestCooperativeIterator.test_sleeps ... ok test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_closed_part_iterator test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_closed_part_iterator ... ok test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_content_length_deleted test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_content_length_deleted ... ok test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_multiple_parts test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_multiple_parts ... ok test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_no_parts test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_no_parts ... ok test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_content_length_not_open test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_content_length_not_open ... ok test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_names test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_names ... ok test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_single_part test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_single_part ... ok test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_timestamp test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_timestamp ... ok test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_single_part_unexpected_ranges test.unit.common.test_utils.TestDocumentItersToHTTPResponseBody.test_single_part_unexpected_ranges ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_params_utf8 test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_params_utf8 ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_prefix_and_delim_with_reserved test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_prefix_and_delim_with_reserved ... ok test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_timestamp_deleted test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_timestamp_deleted ... ok test.unit.common.test_utils.TestReiterate.test_reiterate_closes test.unit.common.test_utils.TestReiterate.test_reiterate_closes ... ok test.unit.common.test_utils.TestReiterate.test_reiterate_consumes_first test.unit.common.test_utils.TestReiterate.test_reiterate_consumes_first ... ok test.unit.common.test_utils.TestReiterate.test_reiterate_list_or_tuple test.unit.common.test_utils.TestReiterate.test_reiterate_list_or_tuple ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_ceil test.unit.common.utils.test_timestamp.TestTimestamp.test_ceil ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_cmp_with_none test.unit.common.utils.test_timestamp.TestTimestamp.test_cmp_with_none ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_delta test.unit.common.utils.test_timestamp.TestTimestamp.test_delta ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_false test.unit.common.utils.test_timestamp.TestTimestamp.test_false ... ok test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_timestamp_not_open test.unit.obj.test_diskfile.TestDiskFile.test_diskfile_timestamp_not_open ... ok test.unit.obj.test_diskfile.TestDiskFile.test_durable_timestamp test.unit.obj.test_diskfile.TestDiskFile.test_durable_timestamp ... ok test.unit.obj.test_diskfile.TestDiskFile.test_durable_timestamp_no_data_file test.unit.obj.test_diskfile.TestDiskFile.test_durable_timestamp_no_data_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_create_broker test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_create_broker ... ok test.unit.obj.test_diskfile.TestDiskFile.test_durable_timestamp_not_open test.unit.obj.test_diskfile.TestDiskFile.test_durable_timestamp_not_open ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_float test.unit.common.utils.test_timestamp.TestTimestamp.test_float ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_force_internal test.unit.common.utils.test_timestamp.TestTimestamp.test_force_internal ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_from_isoformat test.unit.common.utils.test_timestamp.TestTimestamp.test_from_isoformat ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_greater_no_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_greater_no_offset ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:05 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_version_id_not_implemented test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_version_id_not_implemented ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_fullcontrol_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_fullcontrol_permission ... ok object-reconstructor ERROR: Invalid response 404 from 10.0.0.1:1001/sdb/0 policy#0 object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.814697265625e-06 seconds. object-reconstructor ERROR: 10.0.0.1:1001/sdb/0 policy#0 responded as unmounted object-reconstructor INFO: Nothing reconstructed for 3.814697265625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.982948303222656e-05 seconds. object-reconstructor WARNING: Unexpected entity in data dir: '/tmp/tmpsrrg2hbr/devices/sda/objects/junk' object-reconstructor INFO: Removing partition: /tmp/tmpsrrg2hbr/devices/sda/objects/junk object-reconstructor WARNING: Unexpected entity in data dir: '/tmp/tmpsrrg2hbr/devices/sda/objects/not' object-reconstructor INFO: Removing partition: /tmp/tmpsrrg2hbr/devices/sda/objects/not object-reconstructor DEBUG: Run listdir on /tmp/tmpsrrg2hbr/devices/sda/objects/1 object-reconstructor WARNING: Unable to read '/tmp/tmpsrrg2hbr/devices/sda/objects/1234/hashes.pkl' Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1336, in __get_hashes orig_hashes = self.consolidate_hashes(partition_path) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 436, in consolidate_hashes with lock_path(partition_dir): ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1294, in lock_path mkdirs(directory) ~~~~~~^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 802, in mkdirs os.makedirs(path) ~~~~~~~~~~~^^^^^^ File "", line 228, in makedirs FileExistsError: [Errno 17] File exists: '/tmp/tmpsrrg2hbr/devices/sda/objects/1234' object-reconstructor WARNING: Unexpected entity '/tmp/tmpsrrg2hbr/devices/sda/objects/1234' is not a directory object-reconstructor INFO: Removing partition: /tmp/tmpsrrg2hbr/devices/sda/objects/1234 object-reconstructor DEBUG: Run listdir on /tmp/tmpsrrg2hbr/devices/sda/objects/0 object-reconstructor DEBUG: Run listdir on /tmp/tmpsrrg2hbr/devices/sda/objects/2 object-reconstructor INFO: 6/6 (100.00%) partitions reconstructed in 0.02s (348.94/sec, 0s remaining) object-reconstructor INFO: Nothing reconstructed for 0.00013113021850585938 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #0 with frag indexes [1, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #1 at 10.0.0.15:1015/sdp/0/a/c/o policy#0 while rebuilding to 10.0.0.1:1001/sdb/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #2 at 10.0.0.16:1016/sdq/0/a/c/o policy#0 while rebuilding to 10.0.0.2:1002/sdc/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #2 with frag indexes [0, 1, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #3 at 10.0.0.17:1017/sdr/0/a/c/o policy#0 while rebuilding to 10.0.0.3:1003/sdd/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #3 with frag indexes [0, 1, 2, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #4 at 10.0.0.18:1018/sds/0/a/c/o policy#0 while rebuilding to 10.0.0.4:1004/sde/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #5 at 10.0.0.19:1019/sdt/0/a/c/o policy#0 while rebuilding to 10.0.0.5:1005/sdf/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #5 with frag indexes [0, 1, 2, 3, 4, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #6 at 10.0.0.20:1020/sdu/0/a/c/o policy#0 while rebuilding to 10.0.0.6:1006/sdg/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #6 with frag indexes [0, 1, 2, 3, 4, 5, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #7 at 10.0.0.21:1021/sdv/0/a/c/o policy#0 while rebuilding to 10.0.0.7:1007/sdh/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #7 with frag indexes [0, 1, 2, 3, 4, 5, 6, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #8 at 10.0.0.22:1022/sdw/0/a/c/o policy#0 while rebuilding to 10.0.0.8:1008/sdi/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #8 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #9 at 10.0.0.23:1023/sdx/0/a/c/o policy#0 while rebuilding to 10.0.0.9:1009/sdj/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #9 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #11 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #12 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #13 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #0 at 10.0.0.0:1000/sda/0/a/c/o policy#0 while rebuilding to 10.0.0.14:1014/sdo/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #0 with frag indexes [1, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #1 at 10.0.0.1:1001/sdb/0/a/c/o policy#0 while rebuilding to 10.0.0.15:1015/sdp/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #2 at 10.0.0.2:1002/sdc/0/a/c/o policy#0 while rebuilding to 10.0.0.16:1016/sdq/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #2 with frag indexes [0, 1, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #3 at 10.0.0.3:1003/sdd/0/a/c/o policy#0 while rebuilding to 10.0.0.17:1017/sdr/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #3 with frag indexes [0, 1, 2, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #4 at 10.0.0.4:1004/sde/0/a/c/o policy#0 while rebuilding to 10.0.0.18:1018/sds/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #5 at 10.0.0.5:1005/sdf/0/a/c/o policy#0 while rebuilding to 10.0.0.19:1019/sdt/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #5 with frag indexes [0, 1, 2, 3, 4, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones)test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_reconstruct_with_duplicate_frags_no_errors test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_reconstruct_with_duplicate_frags_no_errors ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_reconstruct_with_no_ec_policy_env test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_reconstruct_with_no_ec_policy_env ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_greater_with_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_greater_with_offset ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_hashable test.unit.common.utils.test_timestamp.TestTimestamp.test_hashable ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_int test.unit.common.utils.test_timestamp.TestTimestamp.test_int ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_ring_ip_and_bind_ip test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_ring_ip_and_bind_ip ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_internal_format_no_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_internal_format_no_offset ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_internal_format_with_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_internal_format_with_offset ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_sync_duplicates_to_remote_region test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_sync_duplicates_to_remote_region ... ok test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_two_ec_policies test.unit.obj.test_reconstructor.TestObjectReconstructorECDuplicationFactor.test_two_ec_policies ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_invalid_input test.unit.common.utils.test_timestamp.TestTimestamp.test_invalid_input ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '221'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '221'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_complete_multipart_upload_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_complete_multipart_upload_acl_without_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_initiate_multipart_upload_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_initiate_multipart_upload_acl_with_fullcontrol_permission ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_check_ring test.unit.obj.test_replicator.TestObjectReplicator.test_check_ring ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_failure_report_with_auditor_stats_json test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_failure_report_with_auditor_stats_json ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_invalid_string_conversion test.unit.common.utils.test_timestamp.TestTimestamp.test_invalid_string_conversion ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_inversion test.unit.common.utils.test_timestamp.TestTimestamp.test_inversion ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_inversion_reversibility test.unit.common.utils.test_timestamp.TestTimestamp.test_inversion_reversibility ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_isoformat test.unit.common.utils.test_timestamp.TestTimestamp.test_isoformat ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_no_force_internal_no_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_no_force_internal_no_offset ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_handoffs_first test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_handoffs_first ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_mkdirs_error test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_mkdirs_error ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_multi_disk test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_multi_disk ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_multi_disk_diff_ports_normal test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_multi_disk_diff_ports_normal ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_multi_disk_servers_per_port test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_multi_disk_servers_per_port ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_unmounted test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_unmounted ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_with_override_parts_and_unexpected_part_dir test.unit.obj.test_replicator.TestObjectReplicator.test_collect_jobs_with_override_parts_and_unexpected_part_dir ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_objs_ssync_only_when_in_sync test.unit.obj.test_replicator.TestObjectReplicator.test_delete_objs_ssync_only_when_in_sync ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition ... ok test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0035 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00null%00test02" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0152 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/%00null" 200 367 "-" "-" "-" 0.0021 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0141 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/%00null" 200 184 "-" "-" "-" 0.0141 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0158 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0094 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0185 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0107 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0112 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0096 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0075 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0078 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0071 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0073 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0052 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 117 "-" "-" "-" 0.0070 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 116 "-" "-" "-" 0.0030 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0081 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 120 "-" "-" "-" 0.0045 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0131 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 61 "-" "-" "-" 0.0101 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0018 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 400 37 "-" "-" "-" 0.0003 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 400 33 "-" "-" "-" 0.0001 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 400 34 "-" "-" "-" 0.0001 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 400 32 "-" "-" "-" 0.0001 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 400 34 "-" "-" "-" 0.0001 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 400 38 "-" "-" "-" 0.0001 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 400 34 "-" "-" "-" 0.0001 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0098 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0100 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0154 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0061 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0071 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0035 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0047 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00null%00test02" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00null%00foo" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00nullish" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0077 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/%00null" 200 207 "-" "-" "-" 0.0064 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0077 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00null%00test02" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00null%00foo" 201 - "-" "-" "-" 0.0046 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/%00null/%00nullish" 201 - "-" "-" "-" 0.0004 "-" 1824541 2test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_prefix_with_reserved test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_prefix_with_reserved ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_put_auto_create test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_put_auto_create ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_no_force_internal_with_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_no_force_internal_with_offset ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_normal_format_no_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_normal_format_no_offset ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_not_equal test.unit.common.utils.test_timestamp.TestTimestamp.test_not_equal ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_offset_limit test.unit.common.utils.test_timestamp.TestTimestamp.test_offset_limit ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_ordering test.unit.common.utils.test_timestamp.TestTimestamp.test_ordering ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_out_of_range_comparisons test.unit.common.utils.test_timestamp.TestTimestamp.test_out_of_range_comparisons ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_raw test.unit.common.utils.test_timestamp.TestTimestamp.test_raw ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_short_format_with_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_short_format_with_offset ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_smaller_no_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_smaller_no_offset ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_smaller_with_offset test.unit.common.utils.test_timestamp.TestTimestamp.test_smaller_with_offset ... ok test.unit.common.utils.test_timestamp.TestTimestamp.test_true test.unit.common.utils.test_timestamp.TestTimestamp.test_true ... ok test.unit.container.test_backend.TestContainerBroker.test_batch_reclaim test.unit.container.test_backend.TestContainerBroker.test_batch_reclaim ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_replication_server_call_all_methods test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_replication_server_call_all_methods ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_serv_reserv test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_serv_reserv ... ok test.unit.container.test_backend.TestContainerBroker.test_chexor test.unit.container.test_backend.TestContainerBroker.test_chexor ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_creation test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_creation ... ok test-TestDiskFile ERROR: ERROR DiskFile /tmp/tmpr3i1666s/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769850.83738.data close failure: Bad : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2414, in close self._handle_close_quarantine() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 5567, in mock_handle_close_quarantine raise Exception("Bad") Exception: Bad test-TestDiskFile ERROR: Problem cleaning up /tmp/tmpv9faf_me/tmp_test_obj_server_DiskFile/sda1/objects-1/0/221/2f5b65d1019c019d79e6f1411fb79221 (): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3338, in _finalize_durable self.manager.cleanup_ondisk_files(self._datadir) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test-TestDiskFile ERROR: Error removing tempfile: /tmp/tmpac1cme98/tmp_test_obj_server_DiskFile/sda1/tmp/tmpjr6b4qh1: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1887, in open fallocate(self._fd, self._size) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: [Errno 28] No space left on device During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3081, in create yield dfw.open() ~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1890, in open raise DiskFileNoSpace() swift.common.exceptions.DiskFileNoSpace During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1918, in close os.unlink(self._tmppath) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect FileNotFoundError: [Errno 2] No such file or directory test-TestDiskFile WARNING: Quarantined object /tmp/tmphyzvp1z1/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769851.05379.data: Bytes read: 30, does not match metadata: 31 test-TestDiskFile WARNING: Quarantined object /tmp/tmp76ttg40c/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769851.31289.data: [Errno 5] Input/output error test-TestDiskFile WARNING: Quarantined object /tmp/tmpni8nq7nu/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769851.32826.data: Bytes read: 10, does not match metadata: 11 Problem cleaning up /tmp/tmpwidp_ml4/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2005, in _finalize_put self.manager.cleanup_ondisk_files(self._datadir) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 5951, in mock_cleanup raise OSError() OSError test.unit.obj.test_diskfile.TestDiskFile.test_error_in_cleanup_ondisk_files test.unit.obj.test_diskfile.TestDiskFile.test_error_in_cleanup_ondisk_files ... ok test.unit.obj.test_diskfile.TestDiskFile.test_exception_in_handle_close_quarantine test.unit.obj.test_diskfile.TestDiskFile.test_exception_in_handle_close_quarantine ... ok test.unit.obj.test_diskfile.TestDiskFile.test_from_audit_location test.unit.obj.test_diskfile.TestDiskFile.test_from_audit_location ... ok test.unit.obj.test_diskfile.TestDiskFile.test_from_audit_location_with_mismatched_hash test.unit.obj.test_diskfile.TestDiskFile.test_from_audit_location_with_mismatched_hash ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_datafile_metadata test.unit.obj.test_diskfile.TestDiskFile.test_get_datafile_metadata ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_datafile_metadata_not_opened test.unit.obj.test_diskfile.TestDiskFile.test_get_datafile_metadata_not_opened ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_dev_path test.unit.obj.test_diskfile.TestDiskFile.test_get_dev_path ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_metadata test.unit.obj.test_diskfile.TestDiskFile.test_get_metadata ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_metadata_not_opened test.unit.obj.test_diskfile.TestDiskFile.test_get_metadata_not_opened ... ok test.unit.container.test_backend.TestContainerBroker.test_create_broker test.unit.container.test_backend.TestContainerBroker.test_create_broker ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_metafile_metadata test.unit.obj.test_diskfile.TestDiskFile.test_get_metafile_metadata ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_metafile_metadata_not_opened test.unit.obj.test_diskfile.TestDiskFile.test_get_metafile_metadata_not_opened ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_tempfile_fallback_to_mkstemp test.unit.obj.test_diskfile.TestDiskFile.test_get_tempfile_fallback_to_mkstemp ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_tempfile_use_linkat_os_open_called test.unit.obj.test_diskfile.TestDiskFile.test_get_tempfile_use_linkat_os_open_called ... ok test.unit.obj.test_diskfile.TestDiskFile.test_get_tmpfile_os_open_other_exceptions_are_raised test.unit.obj.test_diskfile.TestDiskFile.test_get_tmpfile_os_open_other_exceptions_are_raised ... ok test.unit.obj.test_diskfile.TestDiskFile.test_keep_cache test.unit.obj.test_diskfile.TestDiskFile.test_keep_cache ... ok test.unit.obj.test_diskfile.TestDiskFile.test_killed_before_cleanup test.unit.obj.test_diskfile.TestDiskFile.test_killed_before_cleanup ... ok test.unit.obj.test_diskfile.TestDiskFile.test_mount_checking test.unit.obj.test_diskfile.TestDiskFile.test_mount_checking ... ok test.unit.obj.test_diskfile.TestDiskFile.test_not_opened test.unit.obj.test_diskfile.TestDiskFile.test_not_opened ... ok test.unit.obj.test_diskfile.TestDiskFile.test_number_calls_to_cleanup_ondisk_files_during_create test.unit.obj.test_diskfile.TestDiskFile.test_number_calls_to_cleanup_ondisk_files_during_create ... ok test.unit.obj.test_diskfile.TestDiskFile.test_number_calls_to_cleanup_ondisk_files_during_delete test.unit.obj.test_diskfile.TestDiskFile.test_number_calls_to_cleanup_ondisk_files_during_delete ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_data_ts_meta test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_data_ts_meta ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_data_ts_meta_legacy_durable test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_data_ts_meta_legacy_durable ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_listdir_error test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_listdir_error ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_listdir_error_legacy_durable test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_listdir_error_legacy_durable ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_meta_data_ts test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_meta_data_ts ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_meta_data_ts_legacy_durable test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_meta_data_ts_legacy_durable ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_meta_ts_data test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_meta_ts_data ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_multiple_meta_data test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_multiple_meta_data ... ok test.unit.container.test_backend.TestContainerBroker.test_creation test.unit.container.test_backend.TestContainerBroker.test_creation ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_multiple_meta_data_legacy_durable test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_multiple_meta_data_legacy_durable ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_swift_bytes_in_content_type test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_swift_bytes_in_content_type ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_stale_meta_data test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_stale_meta_data ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_stale_meta_data_legacy_durable test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_stale_meta_data_legacy_durable ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call_invalid_path test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call_invalid_path ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call_invalid_path_utf8 test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_through_call_invalid_path_utf8 ... ok test.unit.container.test_backend.TestContainerBroker.test_db_file test.unit.container.test_backend.TestContainerBroker.test_db_file ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_ts_meta_data test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_ts_meta_data ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_wayward_files_ignored test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_wayward_files_ignored ... ok test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_wayward_files_ignored_legacy_durable test.unit.obj.test_diskfile.TestDiskFile.test_ondisk_search_loop_wayward_files_ignored_legacy_durable ... ok test.unit.container.test_backend.TestContainerBroker.test_delete_db_does_not_clear_particular_sharding_meta test.unit.container.test_backend.TestContainerBroker.test_delete_db_does_not_clear_particular_sharding_meta ... ok test.unit.obj.test_diskfile.TestDiskFile.test_open_data_file_concurrently_unlinked test.unit.obj.test_diskfile.TestDiskFile.test_open_data_file_concurrently_unlinked ... ok test.unit.obj.test_diskfile.TestDiskFile.test_open_deleted test.unit.obj.test_diskfile.TestDiskFile.test_open_deleted ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_update_sync_store_on_DELETE test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_update_sync_store_on_DELETE ... ok test.unit.obj.test_diskfile.TestDiskFile.test_open_deleted_with_corrupt_tombstone test.unit.obj.test_diskfile.TestDiskFile.test_open_deleted_with_corrupt_tombstone ... ok test.unit.container.test_backend.TestContainerBroker.test_delete_object test.unit.container.test_backend.TestContainerBroker.test_delete_object ... ok test.unit.obj.test_diskfile.TestDiskFile.test_open_expired test.unit.obj.test_diskfile.TestDiskFile.test_open_expired ... ok test.unit.container.test_backend.TestContainerBroker.test_double_check_trailing_delimiter test.unit.container.test_backend.TestContainerBroker.test_double_check_trailing_delimiter ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_update_sync_store_on_POST test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_update_sync_store_on_POST ... ok test.unit.container.test_backend.TestContainerBroker.test_double_check_trailing_delimiter_non_slash test.unit.container.test_backend.TestContainerBroker.test_double_check_trailing_delimiter_non_slash ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_update_sync_store_on_PUT test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_update_sync_store_on_PUT ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_HEAD_last_version test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_HEAD_last_version ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_HEAD_last_version_part_num test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_HEAD_last_version_part_num ... ok test.unit.obj.test_diskfile.TestDiskFile.test_open_meta_file_concurrently_unlinked test.unit.obj.test_diskfile.TestDiskFile.test_open_meta_file_concurrently_unlinked ... ok test.unit.obj.test_diskfile.TestDiskFile.test_open_not_exist test.unit.obj.test_diskfile.TestDiskFile.test_open_not_exist ... ok test.unit.obj.test_diskfile.TestDiskFile.test_open_not_expired test.unit.obj.test_diskfile.TestDiskFile.test_open_not_expired ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_bad_content_length test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_bad_content_length ... ok test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_updating_multiple_container_servers test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_updating_multiple_container_servers ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txb0679a9214d24c04bdd12-0068c5707a" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 304 - "GET http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx164310ad6efe454db6806-0068c5707a" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx15f7c917fcc6413d9b73b-0068c5707a" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "tx83ce0cc97b794fcf806c6-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 304 - "GET http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "txed41cc3557cf4141b26b1-0068c5707a" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfb6a4116922f4173b2a68-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txf906b5561110452fab737-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "GET /sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 200 24 "GET http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx23f30e89b25b435faac65-0068c5707a" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txfbeb072ce57345c8b0634-0068c5707a" "proxy-server 1824514" 0.0055 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "tx78c30406fb1b41faa1821-0068c5707a" "proxy-server 1824514" 0.0055 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 200 24 "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx7a62b7fcdf9540cca387b-0068c5707a" "proxy-server 1824514" 0.0049 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0aabce4d8ba2403187982-0068c5707a" "proxy-server 1824514" 0.0054 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txd073b5ad751e45d5b9900-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 200 24 "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx7e2d925761034e0d83d0c-0068c5707a" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0aaa9fd13deb4796a6b02-0068c5707a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "tx861dcea685ba45e6a3d48-0068c5707a" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 412 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "txf24d1bfdd2ae4cac9cf0c-0068c5707a" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 412 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "txf24d1bfdd2ae4cac9cf0c-0068c5707a" "proxy-server 1824514" 0.0048 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx99e512a92e094e8e943d5-0068c5707a" "proxy-server 1824514" 0.0053 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txe32cd071c811479ea8eaf-0068c5707a" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:10 +0000] "HEAD /sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 304 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "txbd7261a699d04b63aca8b-0068c5707a" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txf2df576d606447a4b1bc3-0068c5707a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "tx96a59412aa264ebbbac07-0068c5707b" "proxy-server 1824514" 0.0055 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdc1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 304 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx1fbe435fbbb847f489f88-0068c5707b" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txe70450017bd5438385b47-0068c5707b" "proxy-server 1824514" 0.0059 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/2/a/d0ca56be2b4d4d3d947d2a38609acb1d" 204 - "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d" "txadf0d274ebf147919fa6d-0068c5707b" "proxy-server 1824514" 0.0046 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdd1/0/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" 200 24 "HEAD http://localhost:8080/v1/a/d0ca56be2b4d4d3d947d2a38609acb1d/o" "tx6cb22e7b057448f2a6754-0068c5707b" "proxy-server 1824514" 0.0047 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe58b423c80084c2dba161-0068c5707b" "proxy-server 1824514" 0.0016 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdb1/1/a/10a9590d15d04004abbdbe48f20f0add" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/10a9590d15d04004abbdbe48f20f0add" "txe58b423c80084c2dba161-0068c5707b" "container-server 1824514" 0.0052 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/1/a/10a9590d15d04004abbdbe48f20f0add" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/10a9590d15d04004abbdbe48f20f0add" "txe58b423c80084c2dba161-0068c5707b" "container-server 1824514" 0.0011 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/3/a/10a9590d15d04004abbdbe48f20f0add" 201 - "PUT http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add" "txe58b423c80084c2dba161-0068c5707b" "proxy-server 1824514" 0.0172 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdb1/3/a/10a9590d15d04004abbdbe48f20f0add" 201 - "PUT http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add" "txe58b423c80084c2dba161-0068c5707b" "proxy-server 1824514" 0.0265 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb9a1a2de386f4a79997c4-0068c5707b" "proxy-server 1824514" 0.0061 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/3/a/10a9590d15d04004abbdbe48f20f0add" 204 - "HEAD http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add" "txb9a1a2de386f4a79997c4-0068c5707b" "proxy-server 1824514" 0.0054 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txad07d699abb842a3814ac-0068c5707b" "proxy-server 1824514" 0.0020 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/3/a/10a9590d15d04004abbdbe48f20f0add" 204 - "HEAD http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add" "tx7498c64a625d4db4b43d1-0068c5707b" "proxy-server 1824514" 0.0013 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/3/a/10a9590d15d04004abbdbe48f20f0add/o" 201 - "PUT http://foo:8080/sdd1/1/a/10a9590d15d04004abbdbe48f20f0add/o" "txbba54c5d3207417ba1b2a-0068c5707b" "object-server 1824514" 0.0005 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdb1/3/a/10a9590d15d04004abbdbe48f20f0add/o" 201 - "PUT http://foo:8080/sdc1/1/a/10a9590d15d04004abbdbe48f20f0add/o" "txbba54c5d3207417ba1b2a-0068c5707b" "object-server 1824514" 0.0004 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdc1/1/a/10a9590d15d04004abbdbe48f20f0add/o" 201 - "PUT http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add/o" "txbba54c5d3207417ba1b2a-0068c5707b" "proxy-server 1824514" 0.0166 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdd1/1/a/10a9590d15d04004abbdbe48f20f0add/o" 201 - "PUT http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add/o" "txbba54c5d3207417ba1b2a-0068c5707b" "proxy-server 1824514" 0.0163 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa5b7c34901c040a98c01f-0068c5707b" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/3/a/10a9590d15d04004abbdbe48f20f0add" 204 - "HEAD http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add" "txd302d6be16504c3fa0fb2-0068c5707b" "proxy-server 1824514" 0.0069 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdb1/3/a/10a9590d15d04004abbdbe48f20f0add/o" 201 - "POST http://foo:8080/sdd1/1/a/10a9590d15d04004abbdbe48f20f0add/o" "tx1845588633bc42949482a-0068c5707b" "object-server 1824514" 0.0004 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/3/a/10a9590d15d04004abbdbe48f20f0add/o" 201 - "POST http://foo:8080/sdc1/1/a/10a9590d15d04004abbdbe48f20f0add/o" "tx1845588633bc42949482a-0068c5707b" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "POST /sdd1/1/a/10a9590d15d04004abbdbe48f20f0add/o" 202 76 "POST http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add/o" "tx1845588633bc42949482a-0068c5707b" "proxy-server 1824514" 0.0107 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "POST /sdc1/1/a/10a9590d15d04004abbdbe48f20f0add/o" 202 76 "POST http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add/o" "tx1845588633bc42949482a-0068c5707b" "proxy-server 1824514" 0.0122 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx723c785ece124b33ab604-0068c5707b" "proxy-server 1824514" 0.0012 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/1/a/928a8ca48d5d4ff1b8c1558e2ac68200" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx723c785ece124b33ab604-0068c5707b" "container-server 1824514" 0.0085 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdb1/1/a/928a8ca48d5d4ff1b8c1558e2ac68200" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx723c785ece124b33ab604-0068c5707b" "container-server 1824514" 0.0012 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 201 - "PUT http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx723c785ece124b33ab604-0068c5707b" "proxy-server 1824514" 0.0303 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdb1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 201 - "PUT http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx723c785ece124b33ab604-0068c5707b" "proxy-server 1824514" 0.0364 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx997c3cdbb2bf41f9bed8c-0068c5707b" "proxy-server 1824514" 0.0061 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx997c3cdbb2bf41f9bed8c-0068c5707b" "proxy-server 1824514" 0.0013 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb0f69b3d3573486a8e2d6-0068c5707b" "proxy-server 1824514" 0.0020 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/3/a/10a9590d15d04004abbdbe48f20f0add" 204 - "HEAD http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add" "tx7af8677068e94856a0870-0068c5707b" "proxy-server 1824514" 0.0078 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdc1/1/a/10a9590d15d04004abbdbe48f20f0add/o" 200 24 "GET http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add/o" "tx605fee5c8a434251968e4-0068c5707b" "proxy-server 1824514" 0.0008 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdd1/1/a/10a9590d15d04004abbdbe48f20f0add/o" 200 24 "GET http://foo:8080/v1/a/10a9590d15d04004abbdbe48f20f0add/o" "tx605fee5c8a434251968e4-0068c5707b" "proxy-server 1824514" 0.0051 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txbe65d2df461c48ae9a8c0-0068c5707b" "proxy-server 1824514" 0.0090 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://foo:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "txc497e97b805a43f1b5b3b-0068c5707b" "proxy-server 1824514" 0.0177 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 201 - "PUT http://foo:8080/sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx11857b0fb99d482d96324-0068c5707b" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 201 - "PUT http://foo:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx11857b0fb99d482d96324-0068c5707b" "proxy-server 1824514" 0.0141 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdb1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 201 - "PUT http://foo:8080/sdc1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx11857b0fb99d482d96324-0068c5707b" "object-server 1824514" 0.0007 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "PUT /sdc1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 201 - "PUT http://foo:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx11857b0fb99d482d96324-0068c5707b" "proxy-server 1824514" 0.0339 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx465868e81aeb433db28a4-0068c5707b" "proxy-server 1824514" 0.0136 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx5fca548d083746a78eafc-0068c5707b" "proxy-server 1824514" 0.0141 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdc1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 200 24 "GET http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx7c8e6ce7751446b29530b-0068c5707b" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txc7d800e73545438783146-0068c5707b" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "txafcf09dd97664efd99478-0068c5707b" "proxy-server 1824514" 0.0027 "-" 1824514 1 object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #6 at 10.0.0.6:1006/sdg/0/a/c/o policy#0 while rebuilding to 10.0.0.20:1020/sdu/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #6 with frag indexes [0, 1, 2, 3, 4, 5, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #7 at 10.0.0.7:1007/sdh/0/a/c/o policy#0 while rebuilding to 10.0.0.21:1021/sdv/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #7 with frag indexes [0, 1, 2, 3, 4, 5, 6, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #8 at 10.0.0.8:1008/sdi/0/a/c/o policy#0 while rebuilding to 10.0.0.22:1022/sdw/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #8 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #9 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 10] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #11 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #12 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #13 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 9] object-reconstructor INFO: Nothing reconstructed for 1.2636184692382812e-05 seconds. object-reconstructor INFO: Nothing reconstructed for 0.0003123283386230469 seconds. object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor DEBUG: ssync completed ok: dev: sda, part: 0, policy: 0, num suffixes: 1, available: 0, sent: 0, deletable: 0 object-reconstructor INFO: Nothing reconstructed for 5.7220458984375e-06 seconds. object-reconstructor INFO: Running object reconstructor in script mode. object-reconstructor DEBUG: Run listdir on /tmp/tmp80uw_4nm/devices/sda/objects-1/0 object-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (738.17/sec, 0s remaining) object-reconstructor INFO: Object reconstruction complete (once). (0.00 minutes) object-reconstructor ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' object-reconstructor INFO: Nothing reconstructed for 6.9141387939453125e-06 seconds. test-replicator ERROR: ERROR creating /tmp/tmphaxzw9je/node/sda/objects: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/replicator.py", line 859, in build_replication_jobs mkdirs(obj_path) ~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_replicator.py", line 502, in blowup_mkdirs raise OSError('Ow!') OSError: Ow! test-replicator WARNING: /tmp/tmpcxz1quof/node/sda is not a directory test-replicator WARNING: /tmp/tmpcxz1quof/node/sda is not a directory test-replicator WARNING: /tmp/tmpcxz1quof/node/sda is not mounted test-replicator WARNING: /tmp/tmpcxz1quof/node/sda is not mounted test-replicator INFO: Removing partition: /tmp/tmpiuecqhsk/node/sda/objects-1/1 test-replicator INFO: Removing 0 objects test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.01s (650.96/sec, 0s remaining) test-replicator INFO: 18 successes, 0 failures test-replicator DEBUG: Successful rsync of /tmp/tmpt3c1u60d/node/sda/objects/1/... to 127.0.0.1::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpt3c1u60d/node/sda/objects/1/... to 127.0.0.2::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpt3c1u60d/node/sda/objects/1/... to 127.0.0.3::object/sda/objects/1 (0.000) test-replicator INFO: Removing partition: /tmp/tmpt3c1u60d/node/sda/objects/1 test-replicator INFO: Removing partition: /tmp/tmpt3c1u60d/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.01s (671.52/sec, 0s remaining) test-replicator INFO: 18 successes, 0 failures test-replicator DEBUG: Successful rsync of /tmp/tmpou0wauz8/node/sda/objects-1/1/... to 127.0.0.1::object/sda/objects-1/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpou0wauz8/node/sda/objects-1/1/... to 127.0.0.2::object/sda/objects-1/1 (0.000)test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_weird_content_types test.unit.container.test_server.TestNonLegacyDefaultStoragePolicy.test_weird_content_types ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_1 test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_1 ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_default_sync_method test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_default_sync_method ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ignores_os_no_data_error test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ignores_os_no_data_error ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_corrupt_xattrs test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_corrupt_xattrs ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_deleted_files test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_deleted_files ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ignores_os_no_entity_error test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ignores_os_no_entity_error ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_override_params test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_override_params ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_override_params_os_not_empty_error test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_override_params_os_not_empty_error ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ssync test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ssync ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ssync_single_region test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ssync_single_region ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ssync_with_cleanup_failure test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ssync_with_cleanup_failure ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ssync_with_sync_failure test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_ssync_with_sync_failure ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_failures test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_failures ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_handoff_delete test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_handoff_delete ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_fstat_oserror test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_fstat_oserror ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_db_file test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_db_file ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 143, in HEAD resp = self.GETorHEAD(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 109, in GETorHEAD resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2445, in get_response resp = self.acl_handler.handle_acl( app, method, container, obj, headers) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 94, in handle_acl return getattr(ah, method)(app) ~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 246, in HEAD return self._handle_acl(app, 'HEAD') ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 145, in _handle_acl resp = self.req.get_acl_response(app, 'HEAD', container, obj, headers, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPswift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_HEAD_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_HEAD_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_POST_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_POST_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'no', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'no', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_initiate_multipart_upload_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_initiate_multipart_upload_acl_with_write_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_initiate_multipart_upload_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_initiate_multipart_upload_acl_without_permission ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_HEAD_version test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_HEAD_version ... ok test-TestDiskFile ERROR: ERROR DiskFile /tmp/tmp0t9ca0md/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769851.41539.data close failure: a very special error : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 2414, in close self._handle_close_quarantine() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 5777, in blow_up raise Exception('a very special error') Exception: a very special error test-TestDiskFile WARNING: Quarantined object /tmp/tmplvgults7/tmp_test_obj_server_DiskFile/sda1/objects/0/85a/d32971898a6900ec6ee30a940141e85a/1757769851.43187.data: Hash of name in metadata does not match directory name test-TestDiskFile DEBUG: open(/tmp/tmpeauy0ex7/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c, O_TMPFILE | O_WRONLY) failed: Operation not supported Falling back to using mkstemp() test-TestDiskFile DEBUG: open(/tmp/tmpeauy0ex7/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c, O_TMPFILE | O_WRONLY) failed: Is a directory Falling back to using mkstemp() test-TestDiskFile DEBUG: open(/tmp/tmpeauy0ex7/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c, O_TMPFILE | O_WRONLY) failed: Invalid argument Falling back to using mkstemp() test-TestDiskFile DEBUG: Relinking /tmp/tmpsdn0pb43/tmp_test_obj_server_DiskFile/sda1/objects/537/616/86509ec1e49ada8eec36b3c064d47616/1757769851.50074.data to /tmp/tmpsdn0pb43/tmp_test_obj_server_DiskFile/sda1/objects/1074/616/86509ec1e49ada8eec36b3c064d47616/1757769851.50074.data due to next_part_power set test-TestDiskFile DEBUG: Relinking /tmp/tmpsdn0pb43/tmp_test_obj_server_DiskFile/sda1/objects-1/362/938/5aa44d00a4cfd743290a170eb699e938/1757769851.50162#2.data to /tmp/tmpsdn0pb43/tmp_test_obj_server_DiskFile/sda1/objects-1/725/938/5aa44d00a4cfd743290a170eb699e938/1757769851.50162#2.data due to next_part_power set test-TestDiskFile ERROR: Problem making data file durable /tmp/tmpsdn0pb43/tmp_test_obj_server_DiskFile/sda1/objects-1/362/938/5aa44d00a4cfd743290a170eb699e938/1757769851.50162#2#d.data (): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3338, in _finalize_durable self.manager.cleanup_ondisk_files(self._datadir) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception test-TestDiskFile WARNING: Quarantined object /tmp/tmppzdlsgz7/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769851.64971.ts: Metadata checksum mismatch for /tmp/tmppzdlsgz7/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769851.64971.ts: stored checksum='b'7bb2eae941ab75159fc991fcbcb6545b'', computed='b'eac6fb4133584bcfa4f037b0acfc6c4e'' test-TestDiskFile WARNING: Quarantined object /tmp/tmpeyh7mh0a/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769851.68458.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769851.69292.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769851.69292.data'>: stored checksum='b'e9c80105f59921b055a7e2bfb9ff580f'', computed='b'406786b13433cf2cf733a3ecf90f2169'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769851.69929.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769851.69929.data'>: stored checksum='b'488ea79820f4fe921d70805938e64e9d'', computed='b'3f0360123c93ae4a7ba70e5c1fc8535e'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769851.70153.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769851.70153.data'>: stored checksum='b'bbeb3030f34f9379b5c0868af86642ed'', computed='b'1f51b56d52edb5f1ede17311eed1be02'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769851.70978.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769851.70978.data'>: stored checksum='b'7172fb58d7cfcda294435c1024b6f950'', computed='b'228d301f21060c0086aba06b9f16585f'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769851.71190.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769851.71190.data'>: stored checksum='b'1dfea8a351403fb38c0c6ca2b9582a26'', computed='b'cca79bd0758880d922e1b758383fffc0'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769851.72153.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769851.72153.data'>: stored checksum='b'2ebdbb5106ee3eb22141351dd0dab99a'', computed='b'dc461b9835ecde1916ffc57f6569dcf1'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769851.72372.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769851.72372.data'>: stored checksum='b'c3e2ff6c9e8191d513deac3ab9225199'', computed='b'fd098c2ee628976ee376b715189bc082'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769851.72571.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769851.72571.data'>: stored checksum='b'f5f37adb356e0d806a0d564cff9ea174'', computed='b'1bb31277747cf2df1e945e848378cbda'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769851.72930.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp7mgthqgy/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769851.72930.data'>: stored checksum='b'34602dbcd37852b80780996d4ce825f5'', computed='b'1a97f0367d1416023295e41d30e5ce16'' test-TestDiskFile WARNING: Quarantined object /tmp/tmpai9n7o6z/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769851.74158.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp605v0gu_/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769851.75960.data: not stat-able: test-TestDiskFile WARNING: Quarantined object /tmp/tmpbf4by1sz/tmp_test_obj_server_DiskFile/sda1/objects/0/8bc/287c59f07389fb1fad230e73fdf8a8bc/made-up-filename: Expected directory, found file at /tmp/tmpbf4by1sz/tmp_test_obj_server_DiskFile/sda1/objects/0/8bc/287c59f07389fb1fad230e73fdf8a8bctest.unit.obj.test_diskfile.TestDiskFile.test_quarantine_hashdir_not_a_directory test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_hashdir_not_a_directory ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_hashdir_not_listable test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_hashdir_not_listable ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_bad_name test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_bad_name ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_HEAD_version_part_num test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEADAcl.test_mpu_HEAD_version_part_num ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_bad_x_delete_at test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_bad_x_delete_at ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_delete_db_does_not_clear_particular_sharding_meta test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_delete_db_does_not_clear_particular_sharding_meta ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:06 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:read:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:07 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_read_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_read_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_s3acl_and_keystone test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_s3acl_and_keystone ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_content_length test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_content_length ... ok test-replicator DEBUG: Successful rsync of /tmp/tmpou0wauz8/node/sda/objects-1/1/... to 127.0.0.3::object/sda/objects-1/1 (0.000) test-replicator INFO: Removing partition: /tmp/tmpou0wauz8/node/sda/objects-1/1 test-replicator INFO: Removing partition: /tmp/tmpou0wauz8/node/sda/objects/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.01s (979.66/sec, 0s remaining) test-replicator INFO: 18 successes, 0 failures test-replicator DEBUG: Successful rsync of /tmp/tmpdpjqlop7/node/sda/objects/1/... to 127.0.0.1::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpdpjqlop7/node/sda/objects/1/... to 127.0.0.2::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpdpjqlop7/node/sda/objects/1/... to 127.0.0.3::object/sda/objects/1 (0.000) test-replicator INFO: Removing partition: /tmp/tmpdpjqlop7/node/sda/objects/1 test-replicator INFO: Removing partition: /tmp/tmpdpjqlop7/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.01s (927.53/sec, 0s remaining) test-replicator INFO: 18 successes, 0 failures test-replicator INFO: Removing partition: /tmp/tmpcxjsch77/node/sda/objects/1 test-replicator INFO: 1/1 (100.00%) partitions replicated in 0.00s (451.63/sec, 0s remaining) test-replicator INFO: 3 successes, 0 failures test-replicator INFO: Removing partition: /tmp/tmpcc2jq950/node/sda/objects/1 test-replicator INFO: 1/1 (100.00%) partitions replicated in 0.00s (299.85/sec, 0s remaining) test-replicator INFO: 3 successes, 0 failures test-replicator ERROR: Can't find itself in policy with index 0 with ips 127.0.0.0 and with port 6200 in ring file, not replicating test-replicator ERROR: Can't find itself in policy with index 1 with ips 127.0.0.0 and with port 6200 in ring file, not replicating test-replicator INFO: Nothing replicated for 0.0008366107940673828 seconds. test-replicator INFO: Nothing replicated for 0.0003440380096435547 seconds. test-replicator INFO: Removing partition: /tmp/tmpu2h51jo_/node/sda/objects/1 test-replicator INFO: Removing partition: /tmp/tmpu2h51jo_/node/sda/objects-1/1 test-replicator INFO: 2/2 (100.00%) partitions replicated in 0.00s (976.90/sec, 0s remaining) test-replicator INFO: 6 successes, 0 failures test-replicator INFO: Removing partition: /tmp/tmp01mctg_d/node/sda/objects/1 test-replicator INFO: 1/1 (100.00%) partitions replicated in 0.01s (128.83/sec, 0s remaining) test-replicator INFO: 3 successes, 0 failures test-replicator INFO: Removing partition: /tmp/tmpwd9hqx9g/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.01s (1113.43/sec, 0s remaining) test-replicator INFO: 17 successes, 1 failures test-replicator INFO: Removing 1 objects test-replicator INFO: 15/7 (214.29%) partitions replicated in 0.02s (680.98/sec, 0s remaining) test-replicator INFO: 32 successes, 1 failures test-replicator INFO: Removing partition: /tmp/tmpwd9hqx9g/node/sda/objects/1 test-replicator INFO: 22/7 (314.29%) partitions replicated in 0.01s (1646.23/sec, 0s remaining) test-replicator INFO: 47 successes, 1 failures test INFO: Removing partition: /tmp/tmptorpxzbi/node/sda/objects/1 test INFO: Removing partition: /tmp/tmptorpxzbi/node/sda/objects-1/1 test INFO: 8/8 (100.00%) partitions replicated in 0.02s (469.88/sec, 0s remaining) test INFO: 18 successes, 0 failures test-replicator INFO: Removing partition: /tmp/tmpishrtn1_/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.02s (365.48/sec, 0s remaining) test-replicator INFO: 17 successes, 1 failures test-replicator INFO: Removing 1 objects test-replicator INFO: 15/7 (214.29%) partitions replicated in 0.01s (1124.82/sec, 0s remaining) test-replicator INFO: 32 successes, 1 failures test-replicator INFO: Removing 1 objects test-replicator INFO: 22/7 (314.29%) partitions replicated in 0.02s (1072.39/sec, 0s remaining) test-replicator INFO: 47 successes, 1 failures test-replicator INFO: Removing 1 objects test-replicator ERROR: Unexpected error trying to cleanup suffix dir '/tmp/tmpishrtn1_/node/sda/objects/1/a83': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/replicator.py", line 638, in delete_handoff_objs os.rmdir(suffix_dir) ~~~~~~~~^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_replicator.py", line 1755, in func raise instance OSError: [Errno 20] Not a directory test-replicator INFO: 29/7 (414.29%) partitions replicated in 0.03s (1031.44/sec, 0s remaining) test-replicator INFO: 59 successes, 4 failures test-replicator INFO: Removing 1 objects test-replicator INFO: 36/7 (514.29%) partitions replicated in 0.01s (3677.78/sec, 0s remaining) test-replicator INFO: 74 successes, 4 failures test-replicator INFO: Removing partition: /tmp/tmpishrtn1_/node/sda/objects/1 test-replicator INFO: 43/7 (614.29%) partitions replicated in 0.01s (4717.14/sec, 0s remaining) test-replicator INFO: 89 successes, 4 failures test-replicator INFO: Removing partition: /tmp/tmpxm1eu4ig/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.01s (616.14/sec, 0s remaining) test-replicator INFO: 16 successes, 2 failures test-replicator INFO: 15/7 (214.29%) partitions replicated in 0.01s (1151.31/sec, 0s remaining) test-replicator INFO: 28 successes, 5 failures test-replicator INFO: 22/7 (314.29%) partitions replicated in 0.00s (4768.72/sec, 0s remaining) test-replicator INFO: 40 successes, 8 failures test-replicator INFO: Removing partition: /tmp/tmp8r0xewhg/node/sda/objects-1/1 test-replicator ERROR: Bad rsync return code: 1 <- ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmp8r0xewhg/node/sda/objects/1/a83', '127.0.0.1::object/sda/objects/1'] test-replicator DEBUG: Successful rsync of /tmp/tmp8r0xewhg/node/sda/objects/1/... to 127.0.0.2::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmp8r0xewhg/node/sda/objects/1/... to 127.0.0.3::object/sda/objects/1 (0.000) test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.02s (465.60/sec, 0s remaining) test-replicator INFO: 17 successes, 1 failures test-replicator ERROR: Bad rsync return code: 1 <- ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmpics7n7gx/node/sda/objects/1/a83', '127.0.0.1::object/sda/objects/1'] test-replicator DEBUG: Successful rsync of /tmp/tmpics7n7gx/node/sda/objects/1/... to 127.0.0.2::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpics7n7gx/node/sda/objects/1/... to 127.0.0.3::object/sda/objects/1 (0.000) test-replicator INFO: Removing partition: /tmp/tmpics7n7gx/node/sda/objects/1 test-replicator INFO: Removing partition: /tmp/tmpics7n7gx/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.02s (352.58/sec, 0s remaining) test-replicator INFO: 17 successes, 1 failures test-replicator ERROR: Bad rsync return code: 1 <- ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmpnpm5i94m/node/sda/objects/1/a83', '127.0.0.1::object/sda/objects/1'] test-replicator ERROR: Bad rsync return code: 1 <- ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmpnpm5i94m/node/sda/objects/1/a83', '127.0.0.2::object/sda/objects/1'] test-replicator ERROR: Bad rsync return code: 1 <- ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmpnpm5i94m/node/sda/objects/1/a83', '127.0.0.3::object/sda/objects/1']test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_handoff_delete_fail_in_other_region test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_handoff_delete_fail_in_other_region ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_handoff_delete_failures test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_handoff_delete_failures ... ok test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0037 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/%00null" 200 367 "-" "-" "-" 0.0019 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0003 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/.a/c/o" 404 - "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/.a/c/o" 201 - "-" "-" "-" 0.0073 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/.c/o" 404 - "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/.o" 404 - "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0112 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/.shards_a/c/o" 404 - "-" "-" "-" 0.0002 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/.shards_a/c" 404 - "-" "-" "-" 0.0002 "-" 1824541 0 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0129 "-" 1824541 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0035 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o1" 201 - "-" "-" "-" 0.0005 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/o2" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 280 "-" "-" "-" 0.0121 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0003 "-" 1824541 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /bob" 400 18 "-" "-" "-" 0.0002 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c%D8%3E%2520/%25" 412 29 "-" "-" "-" 0.0001 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0166 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0110 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0023 "-" 1824541 - test INFO: - - - [13/Sep/2025:13:24:11 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0104 "-" 1824541 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0126 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0026 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test ERROR: ERROR account update failed with 1.2.3.4:5/sdb1 (will retry later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 268, in account_update account_response = conn.getresponse() ^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'getresponse' test ERROR: ERROR account update failed with 6.7.8.9:10/sdf1 (will retry later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 268, in account_update account_response = conn.getresponse() ^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'getresponse' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0128 "-" 1824541 2 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0075 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/0" 201 - "-" "-" "-" 0.0004 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "PUT /sda1/p/a/c/1" 201 - "-" "-" "-" 0.0003 "-" 1824541 2 test INFO: - - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/p/a/c" 200 248 "-" "-" "-" 0.0073 "-" 1824541 2 test DEBUG: Loading entry point 'test_watcher1' test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:11 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 58.45, bytes/sec: 59851.83, Total time: 0.02, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.17s. Total quarantined: 0, Total errors: 0, Total files/sec: 23.75, Total bytes/sec: 36958.72, Auditing time: 0.15, Rate: 0.88 test INFO: [audit-watcher test_watcher1] total unknown 0 ok 4 dark 0 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 2, "10240": 2, "OVER": 0}test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_too_high_handoff_delete test.unit.obj.test_replicator.TestObjectReplicator.test_delete_partition_with_too_high_handoff_delete ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_delete_policy_override_params test.unit.obj.test_replicator.TestObjectReplicator.test_delete_policy_override_params ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_do_listdir test.unit.obj.test_replicator.TestObjectReplicator.test_do_listdir ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_handoff_replication_setting_warnings test.unit.obj.test_replicator.TestObjectReplicator.test_handoff_replication_setting_warnings ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_handoffs_first_mode_will_abort_if_handoffs_remaining test.unit.obj.test_replicator.TestObjectReplicator.test_handoffs_first_mode_will_abort_if_handoffs_remaining ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_handoffs_first_mode_will_process_all_jobs_after_handoffs test.unit.obj.test_replicator.TestObjectReplicator.test_handoffs_first_mode_will_process_all_jobs_after_handoffs ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_limit_rsync_log test.unit.obj.test_replicator.TestObjectReplicator.test_limit_rsync_log ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_content_length_bad test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_content_length_bad ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_massive_handoff_delete_setting_warnings test.unit.obj.test_replicator.TestObjectReplicator.test_massive_handoff_delete_setting_warnings ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_delete_object test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_delete_object ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 200 24 "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx753bcfcceb414d2bb01e7-0068c5707b" "proxy-server 1824514" 0.0060 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txab9f2594dc114bdb9503f-0068c5707b" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 200 382 "GET http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200?format=json&states=listing" "txab9f2594dc114bdb9503f-0068c5707b" "proxy-server 1824514" 0.0020 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx60c3485666cb4130b2681-0068c5707b" "proxy-server 1824514" 0.0053 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx4a00a66d8f724ecdb0fc1-0068c5707b" "proxy-server 1824514" 0.0053 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 200 24 "GET http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx621e11df101c417d8f4c2-0068c5707b" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx84b76c098f444c68aa435-0068c5707b" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx4421fac1f70c4fab9fd1d-0068c5707b" "proxy-server 1824514" 0.0093 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 200 24 "GET http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx1550eb62783341678b1e0-0068c5707b" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx8356127976f244e99841a-0068c5707b" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "txbbc372298020450e8e12a-0068c5707b" "proxy-server 1824514" 0.0135 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 412 - "GET http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "txd93f823577384b62a2de3-0068c5707b" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdc1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 412 - "GET http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "txd93f823577384b62a2de3-0068c5707b" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx60718f5a955e4c20a5a1c-0068c5707b" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx472a327cfac74e9fba4ee-0068c5707b" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 304 - "GET http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx631bd91f708447f383b84-0068c5707b" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txbf5e57c7307a49d5b02e0-0068c5707b" "proxy-server 1824514" 0.0095 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx6f3836008c564baeb3724-0068c5707b" "proxy-server 1824514" 0.0093 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 304 - "GET http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "txa27c288c69374315b7ccd-0068c5707b" "proxy-server 1824514" 0.0119 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txb0ebeab1948544ab93aa2-0068c5707b" "proxy-server 1824514" 0.0133 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "txeb0ed752478f4f6088872-0068c5707b" "proxy-server 1824514" 0.0095 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "GET /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 200 24 "GET http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx2f55908e6b5f4a15afdc3-0068c5707b" "proxy-server 1824514" 0.0087 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx0cc742a441b04870ac5e9-0068c5707b" "proxy-server 1824514" 0.0094 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "txa1961f4866fb4b26a03c3-0068c5707b" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 200 24 "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx414d980c33b84570b0bbe-0068c5707b" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx7315d088d77f465792543-0068c5707b" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx3fbd70acc97c48f68a3b2-0068c5707b" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdc1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 200 24 "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "txa45a623025f64e268d694-0068c5707b" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txa561aa8d077148d0a5a39-0068c5707b" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx0de02b01a29e4fa781382-0068c5707b" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdc1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 412 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "txa6c85e1b2ec44284b85c0-0068c5707b" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 412 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "txa6c85e1b2ec44284b85c0-0068c5707b" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txba9f75ecbcee48449c4cd-0068c5707b" "proxy-server 1824514" 0.0134 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "txa115993ccabd456a8c359-0068c5707b" "proxy-server 1824514" 0.0094 "-" 1824514 1test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_copy_unencrypted_to_encrypted test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_copy_unencrypted_to_encrypted ... ok test.unit.obj.test_auditor.TestAuditWatchers.test_builtin_watchers test.unit.obj.test_auditor.TestAuditWatchers.test_builtin_watchers ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_double_check_trailing_delimiter test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_double_check_trailing_delimiter ... ok test.unit.container.test_backend.TestContainerBroker.test_empty test.unit.container.test_backend.TestContainerBroker.test_empty ... ok test-TestDiskFile WARNING: Quarantined object /tmp/tmpeytu9l0z/tmp_test_obj_server_DiskFile/sda1/objects/0/8bc/287c59f07389fb1fad230e73fdf8a8bc/made-up-filename: Failed to list directory at /tmp/tmpeytu9l0z/tmp_test_obj_server_DiskFile/sda1/objects/0/8bc/287c59f07389fb1fad230e73fdf8a8bc test-TestDiskFile WARNING: Quarantined object /tmp/tmpeytu9l0z/tmp_test_obj_server_DiskFile/sda1/objects/0/8bc/287c59f07389fb1fad230e73fdf8a8bc/made-up-filename: Failed to list directory at /tmp/tmpeytu9l0z/tmp_test_obj_server_DiskFile/sda1/objects/0/8bc/287c59f07389fb1fad230e73fdf8a8bc test-TestDiskFile ERROR: Client path /a/c/1 does not match path stored in object metadata /a/c/1garbage test-TestDiskFile ERROR: Client path /a/c/2 does not match path stored in object metadata /a/c/2garbage test-TestDiskFile ERROR: Client path /a/c/3 does not match path stored in object metadata /a/c/3garbage test-TestDiskFile ERROR: Client path /a/c/4 does not match path stored in object metadata /a/c/4garbage test-TestDiskFile ERROR: Client path /a/c/5 does not match path stored in object metadata /a/c/5garbage test-TestDiskFile ERROR: Client path /a/c/6 does not match path stored in object metadata /a/c/6garbage test-TestDiskFile ERROR: Client path /a/c/7 does not match path stored in object metadata /a/c/7garbage test-TestDiskFile ERROR: Client path /a/c/8 does not match path stored in object metadata /a/c/8garbage test-TestDiskFile ERROR: Client path /a/c/8 does not match path stored in object metadata /a/c/8garbage test-TestDiskFile WARNING: Quarantined object /tmp/tmps4w_x_sm/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769851.84055.data: bad metadata x-delete-at value bad integer test-TestDiskFile WARNING: Quarantined object /tmp/tmps4w_x_sm/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769851.84971.data: bad metadata x-delete-at value bad integer test-TestDiskFile WARNING: Quarantined object /tmp/tmps4w_x_sm/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769851.85188.data: bad metadata x-delete-at value bad integer test-TestDiskFile WARNING: Quarantined object /tmp/tmps4w_x_sm/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769851.86374.data: bad metadata x-delete-at value bad integer test-TestDiskFile WARNING: Quarantined object /tmp/tmps4w_x_sm/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769851.86586.data: bad metadata x-delete-at value bad integer test-TestDiskFile WARNING: Quarantined object /tmp/tmps4w_x_sm/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769851.86954.data: bad metadata x-delete-at value bad integer test-TestDiskFile WARNING: Quarantined object /tmp/tmps4w_x_sm/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769851.87173.data: bad metadata x-delete-at value bad integer test-TestDiskFile WARNING: Quarantined object /tmp/tmps4w_x_sm/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769851.87997.data: bad metadata x-delete-at value bad integer test-TestDiskFile WARNING: Quarantined object /tmp/tmps4w_x_sm/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769851.88215.data: bad metadata x-delete-at value bad integer test-TestDiskFile WARNING: Quarantined object /tmp/tmp33uvjk_v/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769851.90294.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp33uvjk_v/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769851.90535.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp33uvjk_v/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769851.91559.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp33uvjk_v/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769851.91772.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp33uvjk_v/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769851.92447.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp33uvjk_v/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769851.92658.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp33uvjk_v/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769851.93547.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp33uvjk_v/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769851.93763.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp33uvjk_v/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769851.95652.data: metadata content-length 1023 does not match actual object size 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmpcer_p1xx/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769851.96780.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmpcer_p1xx/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769851.96999.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmpcer_p1xx/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769851.98046.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmpcer_p1xx/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769851.98254.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmpcer_p1xx/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769851.99631.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmpcer_p1xx/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769851.99840.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmpcer_p1xx/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769852.00554.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmpcer_p1xx/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.01704.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmpcer_p1xx/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.02336.data: bad metadata content-length value zero test-TestDiskFile WARNING: Quarantined object /tmp/tmpsemf3f3g/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769852.03598.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 9d0ef2e3d00a0793bd4c5f31b8ad9e8a do not match test-TestDiskFile WARNING: Quarantined object /tmp/tmpsemf3f3g/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769852.03855.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 9d0ef2e3d00a0793bd4c5f31b8ad9e8a do not match test-TestDiskFile WARNING: Quarantined object /tmp/tmpsemf3f3g/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769852.05270.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 9d0ef2e3d00a0793bd4c5f31b8ad9e8a do not match test-TestDiskFile WARNING: Quarantined object /tmp/tmpsemf3f3g/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769852.05915.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 9d0ef2e3d00a0793bd4c5f31b8ad9e8a do not matchtest.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_etag test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_etag ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_missing_name test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_missing_name ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_zero_byte test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_invalid_zero_byte ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_ioerror_enodata test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_ioerror_enodata ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_ioerror_euclean test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_ioerror_euclean ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_double_check_trailing_delimiter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_double_check_trailing_delimiter_non_slash ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_missing_content_length test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_missing_content_length ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. swift: Using crc32c_kern implementation for CRC32C. fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Storage-Class': 'STANDARD', 'Content-Md5': 'XUFAKrxLKna5cZ2REBfFkg==', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '5d41402abc4b2a76b9719d911017c592', 'X-Timestamp': '1757769848.91972', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'}swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_bad_hash test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_bad_hash ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket mpu HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_GET_with_fullcontrol_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_GET_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_GET_with_owner_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_GET_with_owner_permission ... ok test.unit.container.test_backend.TestContainerBroker.test_empty_old_style_shard_container test.unit.container.test_backend.TestContainerBroker.test_empty_old_style_shard_container ... ok test-replicator INFO: Removing partition: /tmp/tmpnpm5i94m/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.01s (1158.81/sec, 0s remaining) test-replicator INFO: 15 successes, 3 failures test-replicator INFO: Removing partition: /tmp/tmp23x_hwns/node/sda/objects-1/1 test-replicator ERROR: Bad rsync return code: 1 <- ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmp23x_hwns/node/sda/objects/1/a83', '127.0.0.1::object/sda/objects/1'] test-replicator ERROR: Bad rsync return code: 1 <- ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmp23x_hwns/node/sda/objects/1/a83', '127.0.0.2::object/sda/objects/1'] test-replicator DEBUG: Successful rsync of /tmp/tmp23x_hwns/node/sda/objects/1/... to 127.0.0.3::object/sda/objects/1 (0.000) test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.01s (671.30/sec, 0s remaining) test-replicator INFO: 16 successes, 2 failures test-replicator INFO: Removing partition: /tmp/tmpxce2uyq9/node/sda/objects-1/1 test-replicator DEBUG: Successful rsync of /tmp/tmpxce2uyq9/node/sda/objects/1/... to 127.0.0.1::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpxce2uyq9/node/sda/objects/1/... to 127.0.0.2::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpxce2uyq9/node/sda/objects/1/... to 127.0.0.3::object/sda/objects/1 (0.000) test-replicator INFO: Removing partition: /tmp/tmpxce2uyq9/node/sda/objects/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.02s (471.40/sec, 0s remaining) test-replicator INFO: 18 successes, 0 failures test-replicator INFO: Running object replicator in script mode. test-replicator ERROR: Error syncing with node: 127.0.0.2:6200/sda: Connection refused test-replicator ERROR: Error syncing with node: 127.0.0.3:6200/sda: Connection refused test-replicator ERROR: Error syncing with node: 127.0.0.3:6200/sda: Connection refused test-replicator ERROR: Error syncing with node: 127.0.0.1:6200/sda: Connection refused test-replicator ERROR: Error syncing with node: 127.0.0.2:6200/sda: Connection refused test-replicator ERROR: Error syncing with node: 127.0.0.1:6200/sda: Connection refused test-replicator INFO: Removing partition: /tmp/tmptskrbwpb/node/sda/objects-1/1 test-replicator INFO: Removing partition: /tmp/tmptskrbwpb/node/sda/objects-1/99 test-replicator INFO: 5/5 (100.00%) partitions replicated in 0.02s (272.08/sec, 0s remaining) test-replicator INFO: 3 successes, 6 failures test-replicator INFO: Object replication complete (once). (0.00 minutes) test-replicator WARNING: Handoff only mode is not intended for normal operation, please disable handoffs_first and handoff_delete before the next normal rebalance test-replicator WARNING: Handoff only mode is not intended for normal operation, please disable handoffs_first and handoff_delete before the next normal rebalance test-replicator WARNING: Handoff only mode is not intended for normal operation, please disable handoffs_first and handoff_delete before the next normal rebalance test-replicator DEBUG: Successful rsync of /tmp/tmpd15tn7n0/node/sda/objects/1/... to 127.0.0.1::object/sda/objects/1 (0.000) test-replicator ERROR: Bad rsync return code: 1 <- ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmpd15tn7n0/node/sda/objects/1/a83', '127.0.0.2::object/sda/objects/1'] test-replicator DEBUG: Successful rsync of /tmp/tmpd15tn7n0/node/sda/objects/1/... to 127.0.0.3::object/sda/objects/1 (0.000) test-replicator WARNING: Handoffs first mode still has handoffs remaining. Aborting current replication pass. test-replicator DEBUG: Successful rsync of /tmp/tmpd15tn7n0/node/sda/objects-1/1/... to 127.0.0.1::object/sda/objects-1/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpd15tn7n0/node/sda/objects-1/1/... to 127.0.0.2::object/sda/objects-1/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpd15tn7n0/node/sda/objects-1/1/... to 127.0.0.3::object/sda/objects-1/1 (0.000) test-replicator INFO: Removing partition: /tmp/tmpd15tn7n0/node/sda/objects-1/1 test-replicator INFO: 2/8 (25.00%) partitions replicated in 0.02s (122.66/sec, 0s remaining) test-replicator INFO: 5 successes, 1 failures test-replicator DEBUG: Successful rsync of /tmp/tmpd15tn7n0/node/sda/objects/1/... to 127.0.0.1::object/sda/objects/1 (0.000) test-replicator ERROR: Bad rsync return code: 1 <- ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmpd15tn7n0/node/sda/objects/1/a83', '127.0.0.2::object/sda/objects/1'] test-replicator DEBUG: Successful rsync of /tmp/tmpd15tn7n0/node/sda/objects/1/... to 127.0.0.3::object/sda/objects/1 (0.000) test-replicator INFO: Removing partition: /tmp/tmpd15tn7n0/node/sda/objects/1 test-replicator INFO: 7/7 (100.00%) partitions replicated in 0.02s (455.24/sec, 0s remaining) test-replicator INFO: 14 successes, 1 failures test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects-1/1/... to 127.0.0.1::object/sda/objects-1/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects-1/1/... to 127.0.0.2::object/sda/objects-1/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects-1/1/... to 127.0.0.3::object/sda/objects-1/1 (0.000) test-replicator INFO: Removing partition: /tmp/tmpr1df2vl2/node/sda/objects-1/1 test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects/1/... to 127.0.0.1::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects/1/... to 127.0.0.2::object/sda/objects/1 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects/1/... to 127.0.0.3::object/sda/objects/1 (0.000) test-replicator INFO: Removing partition: /tmp/tmpr1df2vl2/node/sda/objects/1 test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects-1/0/... to 127.0.0.2::object/sda/objects-1/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects-1/0/... to 127.0.0.1::object/sda/objects-1/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects/0/... to 127.0.0.1::object/sda/objects/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpr1df2vl2/node/sda/objects/0/... to 127.0.0.2::object/sda/objects/0 (0.000) test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.03s (268.96/sec, 0s remaining) test-replicator INFO: 18 successes, 0 failures test-replicator INFO: 2 suffixes checked - 100.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0070s, min 0.0007s, med 0.0038s test-replicator WARNING: Handoff only mode is not intended for normal operation, please disable handoffs_first and handoff_delete before the next normal rebalance test-replicator WARNING: No storage policies found for which handoff_delete=1000 would have an effect. Disabling. test-replicator INFO: Running object replicator in script mode. test-replicator INFO: Removing partition: /tmp/tmp9l26eopt/node/sda/objects/1 test-replicator ERROR: Killing long-running rsync after 0s: ['r test-replicator ERROR: Killing long-running rsync after 0s: ['r test-replicator INFO: Removing partition: /tmp/tmp9l26eopt/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.04s (188.94/sec, 0s remaining) test-replicator INFO: 16 successes, 2 failures test-replicator INFO: 1 suffixes checked - 100.00% hashed, 200.00% syncedtest.unit.obj.test_replicator.TestObjectReplicator.test_replicate_rsync_timeout test.unit.obj.test_replicator.TestObjectReplicator.test_replicate_rsync_timeout ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_replicate_rsync_timeout_wedged test.unit.obj.test_replicator.TestObjectReplicator.test_replicate_rsync_timeout_wedged ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_replicate_skipped_partpower_increase test.unit.obj.test_replicator.TestObjectReplicator.test_replicate_skipped_partpower_increase ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_replicator_removes_zbf test.unit.obj.test_replicator.TestObjectReplicator.test_replicator_removes_zbf ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_replicator_skips_bogus_partition_dirs test.unit.obj.test_replicator.TestObjectReplicator.test_replicator_skips_bogus_partition_dirs ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_replicator_skips_rsync_temp_files test.unit.obj.test_replicator.TestObjectReplicator.test_replicator_skips_rsync_temp_files ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_revert_partition_lock_timeout test.unit.obj.test_replicator.TestObjectReplicator.test_revert_partition_lock_timeout ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_ring_ip_and_bind_ip test.unit.obj.test_replicator.TestObjectReplicator.test_ring_ip_and_bind_ip ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_compress_different_region test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_compress_different_region ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_failure_logging test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_failure_logging ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_failure_logging_no_transfer test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_failure_logging_no_transfer ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_success_logging test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_success_logging ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_success_logging_no_transfer test.unit.obj.test_replicator.TestObjectReplicator.test_rsync_success_logging_no_transfer ... ok test.unit.obj.test_replicator.TestObjectReplicator.test_run test.unit.obj.test_replicator.TestObjectReplicator.test_run ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_marker_beyond_end_marker_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_marker_beyond_end_marker_memcache ... ok test-TestDiskFile WARNING: Quarantined object /tmp/tmpsemf3f3g/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769852.06158.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 9d0ef2e3d00a0793bd4c5f31b8ad9e8a do not match test-TestDiskFile WARNING: Quarantined object /tmp/tmpsemf3f3g/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769852.06821.data: ETag 92ffae115f60c288e713127114be5091 and file's md5 9d0ef2e3d00a0793bd4c5f31b8ad9e8a do not match test-TestDiskFile WARNING: Quarantined object /tmp/tmp6mbvf6ji/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769852.09228.data: missing name metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmp6mbvf6ji/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769852.09462.data: missing name metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmp6mbvf6ji/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769852.10123.data: missing name metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmp6mbvf6ji/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769852.10765.data: missing name metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmp6mbvf6ji/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769852.11602.data: missing name metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmp6mbvf6ji/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769852.11823.data: missing name metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmp6mbvf6ji/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769852.12038.data: missing name metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmp6mbvf6ji/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.12845.data: missing name metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmp6mbvf6ji/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.13055.data: missing name metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmphjmbi3vj/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769852.14284.data: Bytes read: 0, does not match metadata: 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmphjmbi3vj/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769852.14524.data: Bytes read: 0, does not match metadata: 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmphjmbi3vj/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769852.15625.data: Bytes read: 0, does not match metadata: 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmphjmbi3vj/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769852.15840.data: Bytes read: 0, does not match metadata: 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmphjmbi3vj/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769852.16489.data: Bytes read: 0, does not match metadata: 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmphjmbi3vj/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769852.17532.data: Bytes read: 0, does not match metadata: 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmphjmbi3vj/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.18766.data: Bytes read: 0, does not match metadata: 1024 test-TestDiskFile WARNING: Quarantined object /tmp/tmp1vawa7u1/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769852.20186.data: Failed to open /tmp/tmp1vawa7u1/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769852.20186.data: [Errno 61] -ENODATA fool! test-TestDiskFile WARNING: Quarantined object /tmp/tmpo7ww8qog/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769852.21687.data: Failed to open /tmp/tmpo7ww8qog/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769852.21687.data: [Errno 117] -EUCLEAN fool! test-TestDiskFile WARNING: Quarantined object /tmp/tmpju65lc1k/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/1757769852.23902.data: missing content-length in metadata test-TestDiskFile WARNING: Quarantined object /tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769852.25248.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769852.25248.data'>: stored checksum='b'610d11550f1cd96c873455f6713fa48a'', computed='b'd320e0a33bcac23902c80f4c05e32742'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769852.26697.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769852.26697.data'>: stored checksum='b'05bd66756596857638de51c2ce6a9c19'', computed='b'f16ddd8e72ac647e478542da9f0b6980'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769852.26927.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769852.26927.data'>: stored checksum='b'c588af4a0b18842fedad1155817743b0'', computed='b'8956f58951d38732ad291e6c160a8494'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769852.27972.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769852.27972.data'>: stored checksum='b'485d0ee58fbf7b74cbf83e779682646b'', computed='b'15dab1dc02b36a90e63e274c55d13ca9'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769852.28190.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769852.28190.data'>: stored checksum='b'2edb3a3b00dd0af211b7cf3dcb38ca6e'', computed='b'96db26f7c54cfa98c6fdaf11addcbb2b'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769852.29244.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769852.29244.data'>: stored checksum='b'79414c5dc642b474fccc2db3e514a064'', computed='b'10865e6330b4e15580b715752b40b88f'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769852.29451.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769852.29451.data'>: stored checksum='b'2d33bd57c855c4f2328e1e7ffe7ef61c'', computed='b'70c7454bd45711991a2dc22e0a78ca83'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.30497.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.30497.data'>: stored checksum='b'5a06a2c39bfb627da9c9a00cc49fd2d6'', computed='b'82ec96462ebc4c1224c4dafb1b0f44c7'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.31927.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp45zbf86e/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.31927.data'>: stored checksum='b'0d7a0c49a36cb58fcb4e4bbb789e2e37'', computed='b'3d5755979f04157bc36e5ddf9cf30d4e''test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_subtly_corrupt_xattrs test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_subtly_corrupt_xattrs ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_truncated_xattrs test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_truncated_xattrs ... ok test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_valids test.unit.obj.test_diskfile.TestDiskFile.test_quarantine_valids ... ok test.unit.obj.test_diskfile.TestDiskFile.test_read_metadata test.unit.obj.test_diskfile.TestDiskFile.test_read_metadata ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 304 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "txd66153b82690432e961cf-0068c5707b" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "tx152ff881482b4fffbc82a-0068c5707b" "proxy-server 1824514" 0.0134 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx47416565f45548bca30fb-0068c5707b" "proxy-server 1824514" 0.0095 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdd1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 304 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx6e36b997b9144185b51c6-0068c5707b" "proxy-server 1824514" 0.0005 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost:8080/v1/a?format=json" "txd55a63546c984969b2a9c-0068c5707b" "proxy-server 1824514" 0.0055 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/0/a/928a8ca48d5d4ff1b8c1558e2ac68200" 204 - "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200" "tx09f3a12c766349c3bf19f-0068c5707b" "proxy-server 1824514" 0.0174 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdc1/3/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" 200 24 "HEAD http://localhost:8080/v1/a/928a8ca48d5d4ff1b8c1558e2ac68200/o" "tx0bdb97bfb8de416597c53-0068c5707c" "proxy-server 1824514" 0.0072 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txde7a011d23854c1cb3c40-0068c5707c" "proxy-server 1824514" 0.0114 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/1/a/%C4%8Brypto" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/%C4%8Brypto" "txde7a011d23854c1cb3c40-0068c5707c" "container-server 1824514" 0.0092 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdb1/1/a/%C4%8Brypto" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/%C4%8Brypto" "txde7a011d23854c1cb3c40-0068c5707c" "container-server 1824514" 0.0010 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdb1/3/a/%C4%8Brypto" 201 - "PUT http://foo:8080/v1/a/%C4%8Brypto" "txde7a011d23854c1cb3c40-0068c5707c" "proxy-server 1824514" 0.0295 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/3/a/%C4%8Brypto" 201 - "PUT http://foo:8080/v1/a/%C4%8Brypto" "txde7a011d23854c1cb3c40-0068c5707c" "proxy-server 1824514" 0.0286 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx91d6f915973b4b3589de1-0068c5707c" "proxy-server 1824514" 0.0101 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx91d6f915973b4b3589de1-0068c5707c" "proxy-server 1824514" 0.0054 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6f620f007cd54d34910ad-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx31097e266b44437595eba-0068c5707c" "proxy-server 1824514" 0.0053 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/3/a/%C4%8Brypto/%C4%8Brypto" 201 - "PUT http://foo:8080/sdc1/0/a/%C4%8Brypto/%C4%8Brypto" "tx9a8bae372793471782c79-0068c5707c" "object-server 1824514" 0.0004 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdb1/3/a/%C4%8Brypto/%C4%8Brypto" 201 - "PUT http://foo:8080/sdd1/0/a/%C4%8Brypto/%C4%8Brypto" "tx9a8bae372793471782c79-0068c5707c" "object-server 1824514" 0.0053 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 201 - "PUT http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx9a8bae372793471782c79-0068c5707c" "proxy-server 1824514" 0.0211 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdd1/0/a/%C4%8Brypto/%C4%8Brypto" 201 - "PUT http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx9a8bae372793471782c79-0068c5707c" "proxy-server 1824514" 0.0224 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx024f598fcd854e9ebd7f6-0068c5707c" "proxy-server 1824514" 0.0011 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx04769faba7f348cd8ae14-0068c5707c" "proxy-server 1824514" 0.0069 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/3/a/%C4%8Brypto/%C4%8Brypto" 201 - "POST http://foo:8080/sdd1/0/a/%C4%8Brypto/%C4%8Brypto" "tx7004f5a0051d44a79e322-0068c5707c" "object-server 1824514" 0.0014 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "POST /sdd1/0/a/%C4%8Brypto/%C4%8Brypto" 202 76 "POST http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx7004f5a0051d44a79e322-0068c5707c" "proxy-server 1824514" 0.0099 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdb1/3/a/%C4%8Brypto/%C4%8Brypto" 201 - "POST http://foo:8080/sdc1/0/a/%C4%8Brypto/%C4%8Brypto" "tx7004f5a0051d44a79e322-0068c5707c" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "POST /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 202 76 "POST http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx7004f5a0051d44a79e322-0068c5707c" "proxy-server 1824514" 0.0241 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7e29f89ee55549e0b04d1-0068c5707c" "proxy-server 1824514" 0.0074 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "txef418e4268694a95bd49a-0068c5707c" "proxy-server 1824514" 0.0076 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/0/a/%C4%8Brypto/%C4%8Brypto" 200 24 "GET http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx0715fc6ef430441bb0c8a-0068c5707c" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txfbf49187d9524af489e09-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "txad47f94e1e88425a96a43-0068c5707c" "proxy-server 1824514" 0.0102 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 200 24 "HEAD http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx908473fce3ed42b183400-0068c5707c" "proxy-server 1824514" 0.0057 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb768ceee930d443680a41-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx1b2e15bed38a4442af6e0-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 200 24 "GET http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx88531d8a41cd4c35af86e-0068c5707c" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx69a1f8b548fc430f8440e-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx8c05c7b4fb42471a9b2b1-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 1test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_crypto_UTF8_path test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_crypto_UTF8_path ... ok test-TestDiskFile WARNING: Quarantined object /tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769852.32787.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/4dd/ffc68e09e5432a9952a960e23e5cf4dd/1757769852.32787.data'>: stored checksum='b'041634af1c94ea522d1ff6eb943bee07'', computed='b'0eaf54bcbb4caf2bd91dfa5a4d39a6d4'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769852.33004.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/e75/8d96f2e9646e2739a7fff102ffe4fe75/1757769852.33004.data'>: stored checksum='b'322b1dd4719eae95c4e609ab97505d7b'', computed='b'4ffdf1f0c11ad1adfb7758ec0e471972'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769852.34038.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/e3e/cc698cbd8796491020de43797610be3e/1757769852.34038.data'>: stored checksum='b'945f068daf3a1a9c64f26988ed1fdb42'', computed='b'f8bf1d39000e375a188bfdad276ac48e'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769852.34246.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/7d2/a228e249d62f176469667413e946f7d2/1757769852.34246.data'>: stored checksum='b'940162fb292c7f1d303b2c1714da5448'', computed='b'cafd82d1835816c5714a0ddfad8c275f'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769852.35282.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/bc5/ee0ca5cd1f804cd5db33c75599b56bc5/1757769852.35282.data'>: stored checksum='b'1555e81d6087b28be571eb0e9e334b36'', computed='b'3a73149c8ac7e79762e4e5179a0a8030'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769852.36308.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/1ef/2dc424bf5975014ee4639710e7afb1ef/1757769852.36308.data'>: stored checksum='b'c6001f7b3e07ff88fbb0bc7a2d9e26d6'', computed='b'0b277acc0349f1442b3e7190957c8c5a'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769852.36526.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/492/f0a07fd628a32e949047f3605e3c1492/1757769852.36526.data'>: stored checksum='b'd6952836fbe57a1e41d40bf12e069b3a'', computed='b'd701c8401b064f6ad3a4e231ab4fe1ac'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.37558.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.37558.data'>: stored checksum='b'70de072e7c4ea53825fd818ace11b613'', computed='b'27aab869573bd1c2e87506783dd0fe1a'' test-TestDiskFile WARNING: Quarantined object /tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.37770.data: Metadata checksum mismatch for <_io.BufferedReader name='/tmp/tmp0nkowc0_/tmp_test_obj_server_DiskFile/sda1/objects/0/9a0/7150e1b1527b81423f3a98eb62a239a0/1757769852.37770.data'>: stored checksum='b'ebc24d0c7507eab24b4b90e81177cd03'', computed='b'b38364009eb1584e47486087d7730bd7'' Filesystem at n/a does not support xattr Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 205, in _read_file_metadata metadata += xattr.getxattr( ~~~~~~~~~~~~~~^ fd, METADATA_KEY + str(key or '').encode('ascii')) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 4123, in mock_getxattr raise IOError(error_num, "Operation not supported") OSError: [Errno 95] Operation not supported test.unit.obj.test_diskfile.TestDiskFile.test_read_metadata_no_xattr test.unit.obj.test_diskfile.TestDiskFile.test_read_metadata_no_xattr ... ok test.unit.obj.test_diskfile.TestDiskFile.test_splice_to_wsockfd_blocks test.unit.obj.test_diskfile.TestDiskFile.test_splice_to_wsockfd_blocks ... ok test.unit.obj.test_diskfile.TestDiskFile.test_tee_to_md5_pipe_length_mismatch test.unit.obj.test_diskfile.TestDiskFile.test_tee_to_md5_pipe_length_mismatch ... ok test.unit.obj.test_diskfile.TestDiskFile.test_write_cleanup test.unit.obj.test_diskfile.TestDiskFile.test_write_cleanup ... ok test.unit.obj.test_diskfile.TestDiskFile.test_write_cleanup_legacy_durable test.unit.obj.test_diskfile.TestDiskFile.test_write_cleanup_legacy_durable ... ok test.unit.obj.test_diskfile.TestDiskFile.test_write_cleanup_part_power_increase test.unit.obj.test_diskfile.TestDiskFile.test_write_cleanup_part_power_increase ... ok test.unit.obj.test_diskfile.TestDiskFile.test_write_metadata test.unit.obj.test_diskfile.TestDiskFile.test_write_metadata ... ok test-replicator INFO: Partition times: max 0.0234s, min 0.0005s, med 0.0033s test-replicator INFO: Object replication complete (once). (0.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator INFO: Removing partition: /tmp/tmpenoedg3i/node/sda/objects/1 test-replicator INFO: Removing partition: /tmp/tmpenoedg3i/node/sda/objects-1/1 test-replicator ERROR: Killing long-running rsync after 0s: ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmpenoedg3i/node/sda/objects/0/a83', '127.0.0.1::object/sda/objects/0'] test-replicator ERROR: Killing long-running rsync after 0s: ['rsync', '--recursive', '--whole-file', '--human-readable', '--xattrs', '--itemize-changes', '--ignore-existing', '--timeout=30', '--contimeout=30', '--bwlimit=0', '--exclude=.*.[0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z][0-9a-zA-Z]', '/tmp/tmpenoedg3i/node/sda/objects/0/a83', '127.0.0.2::object/sda/objects/0'] test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.04s (186.95/sec, 0s remaining) test-replicator INFO: 16 successes, 2 failures test-replicator INFO: 1 suffixes checked - 100.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0257s, min 0.0006s, med 0.0023s test-replicator INFO: Object replication complete (once). (0.00 minutes) test-replicator WARNING: next_part_power set in policy 'zero'. Skipping test-replicator WARNING: next_part_power set in policy 'one'. Skipping test-replicator INFO: Nothing replicated for 0.00041103363037109375 seconds. test-replicator INFO: Running object replicator in script mode. test-replicator WARNING: Removing partition directory which was a file: /tmp/tmp30dfif16/node/sda/objects-1/1 test-replicator WARNING: Removing partition directory which was a file: /tmp/tmp30dfif16/node/sda/objects/1 test-replicator INFO: 6/8 (75.00%) partitions replicated in 0.02s (318.88/sec, 0s remaining) test-replicator INFO: 12 successes, 0 failures test-replicator INFO: Object replication complete (once). (0.00 minutes) test-replicator DEBUG: Successful rsync of /tmp/tmprk_apvr_/node/sda/objects/0/... to 127.0.0.1::object/sda/objects/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmprk_apvr_/node/sda/objects/0/... to 127.0.0.2::object/sda/objects/0 (0.000) test-replicator INFO: 1/1 (100.00%) partitions replicated in 0.01s (114.69/sec, 0s remaining) test-replicator INFO: 2 successes, 0 failures test-replicator INFO: 1 suffixes checked - 100.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0078s, min 0.0078s, med 0.0078s test-replicator INFO: Unable to lock handoff partition 1 for replication on device sda policy 0 test-replicator ERROR: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:08 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_s3acl_and_unknown_user test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_s3acl_and_unknown_user ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_version_id_but_not_enabled test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_with_version_id_but_not_enabled ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Storage-Class': 'STANDARD', 'Content-Md5': '6qm+nUNIiw0hvrDDF0kHUQ==', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'eaa9be9d43488b0d21beb0c317490751', 'X-Timestamp': '1757769849.14547', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769849.00000', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769849.00000', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source?versionId=null', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769849.00000', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769849.00000', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_empty_src_path test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_empty_src_pathswift: Using crc32c_kern implementation for CRC32C. ... swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_collect_parts test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_collect_parts ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_collect_parts_mkdirs_error test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_collect_parts_mkdirs_error ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'no', 'Content-Type': 'application/directory'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_multipart_uploads_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_multipart_uploads_acl_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_multipart_uploads_acl_with_read_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_multipart_uploads_acl_with_read_permission ... ok test DEBUG: Loading entry point 'test_watcher1' test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: [audit-watcher test_watcher1] reporting dark data /a/DARK/o2 test INFO: Object audit (ALL). Since Sun Sep 14 03:24:11 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 76.88, bytes/sec: 78728.73, Total time: 0.01, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmp8cypraj3/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.17s. Total quarantined: 0, Total errors: 0, Total files/sec: 23.67, Total bytes/sec: 36833.05, Auditing time: 0.17, Rate: 0.99 test INFO: [audit-watcher test_watcher1] total unknown 0 ok 3 dark 1 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 2, "10240": 2, "OVER": 0} test DEBUG: Loading entry point 'test_watcher1' test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:12 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1418.43, bytes/sec: 2904949.13, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.11s. Total quarantined: 0, Total errors: 0, Total files/sec: 28.51, Total bytes/sec: 49415.41, Auditing time: 0.09, Rate: 0.90 test INFO: [audit-watcher test_watcher1] total unknown 0 ok 3 dark 0 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:12 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1353.00, bytes/sec: 2770946.64, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.11s. Total quarantined: 0, Total errors: 0, Total files/sec: 28.41, Total bytes/sec: 49248.82, Auditing time: 0.09, Rate: 0.86 test INFO: [audit-watcher test_watcher1] total unknown 0 ok 3 dark 0 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:12 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1279.53, bytes/sec: 2620480.35, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.11s. Total quarantined: 0, Total errors: 0, Total files/sec: 28.42, Total bytes/sec: 49255.60, Auditing time: 0.09, Rate: 0.82 test INFO: [audit-watcher test_watcher1] total unknown 0 ok 3 dark 0 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:12 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1314.83, bytes/sec: 2692769.46, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.11s. Total quarantined: 0, Total errors: 0, Total files/sec: 28.42, Total bytes/sec: 49269.62, Auditing time: 0.09, Rate: 0.86 test INFO: [audit-watcher test_watcher1] total unknown 3 ok 0 dark 0 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:12 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1331.53, bytes/sec: 2726963.36, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.10s. Total quarantined: 0, Total errors: 0, Total files/sec: 29.42, Total bytes/sec: 50995.05, Auditing time: 0.09, Rate: 0.90 test INFO: [audit-watcher test_watcher1] total unknown 3 ok 0 dark 0 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: [audit-watcher test_watcher1] reporting dark data /a/c/o1 test INFO: Object audit (ALL). Since Sun Sep 14 03:24:12 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1332.37, bytes/sec: 2728695.87, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon'test.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_agreement test.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_agreement ... ok test.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_watcher_init test.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_watcher_init ... ok test.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_with_sharding test.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_with_sharding ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_delete_partition test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_delete_partition ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_delete_reverted test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_delete_reverted ... ok test.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_with_sharding_fallback_to_root test.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_with_sharding_fallback_to_root ... ok test.unit.obj.test_server.TestZeroCopy.test_quarantine test.unit.obj.test_server.TestZeroCopy.test_quarantine ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:read_acp:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_GET_with_read_acp_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_GET_with_read_acp_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_GET_without_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_GET_without_permission ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_delete_reverted_max_objects_per_revert test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_delete_reverted_max_objects_per_revert ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_delete_reverted_nondurable test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_delete_reverted_nondurable ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_get_part_jobs test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_get_part_jobs ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_get_partners test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_get_partners ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_get_response test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_get_response ... ok test.unit.container.test_backend.TestContainerBroker.test_find_shard_ranges test.unit.container.test_backend.TestContainerBroker.test_find_shard_ranges ... ok test.unit.container.test_backend.TestContainerBroker.test_find_shard_ranges_errors test.unit.container.test_backend.TestContainerBroker.test_find_shard_ranges_errors ... ok test.unit.container.test_backend.TestContainerBroker.test_find_shard_ranges_with_misplaced_objects test.unit.container.test_backend.TestContainerBroker.test_find_shard_ranges_with_misplaced_objects ... ok test.unit.container.test_backend.TestContainerBroker.test_get_brokers test.unit.container.test_backend.TestContainerBroker.test_get_brokers ... ok test.unit.container.test_backend.TestContainerBroker.test_get_db_state test.unit.container.test_backend.TestContainerBroker.test_get_db_state ... ok test.unit.container.test_backend.TestContainerBroker.test_get_info test.unit.container.test_backend.TestContainerBroker.test_get_info ... ok test.unit.container.test_backend.TestContainerBroker.test_get_info_is_deleted test.unit.container.test_backend.TestContainerBroker.test_get_info_is_deleted ... ok test.unit.container.test_backend.TestContainerBroker.test_get_info_no_stale_reads test.unit.container.test_backend.TestContainerBroker.test_get_info_no_stale_reads ... ok test-replicator INFO: Partition times: max 0.0000s, min 0.0000s, med 0.0000s test-replicator INFO: Object replication complete (once). (1.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.2::object/sda/objects/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.1::object/sda/objects/0 (0.000) test-replicator INFO: 6/6 (100.00%) partitions replicated in 60.00s (0.10/sec, 0s remaining) test-replicator INFO: 12 successes, 0 failures test-replicator INFO: 1 suffixes checked - 0.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0000s, min 0.0000s, med 0.0000s test-replicator INFO: Object replication complete (once). (1.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.1::object/sda/objects/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.2::object/sda/objects/0 (0.000) test-replicator INFO: 6/6 (100.00%) partitions replicated in 60.00s (0.10/sec, 0s remaining) test-replicator INFO: 12 successes, 0 failures test-replicator INFO: 1 suffixes checked - 0.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0000s, min 0.0000s, med 0.0000s test-replicator INFO: Object replication complete (once). (1.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.2::object/sda/objects/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.1::object/sda/objects/0 (0.000) test-replicator INFO: 6/6 (100.00%) partitions replicated in 60.00s (0.10/sec, 0s remaining) test-replicator INFO: 12 successes, 0 failures test-replicator INFO: 1 suffixes checked - 0.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0000s, min 0.0000s, med 0.0000s test-replicator INFO: Object replication complete (once). (1.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.2::object/sda/objects/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.1::object/sda/objects/0 (0.000) test-replicator INFO: 6/6 (100.00%) partitions replicated in 60.00s (0.10/sec, 0s remaining) test-replicator INFO: 12 successes, 0 failures test-replicator INFO: 1 suffixes checked - 0.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0000s, min 0.0000s, med 0.0000s test-replicator INFO: Object replication complete (once). (1.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.2::object/sda/objects/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.1::object/sda/objects/0 (0.000) test-replicator INFO: 6/6 (100.00%) partitions replicated in 60.00s (0.10/sec, 0s remaining) test-replicator INFO: 12 successes, 0 failures test-replicator INFO: 1 suffixes checked - 0.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0000s, min 0.0000s, med 0.0000s test-replicator INFO: Object replication complete (once). (1.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.2::object/sda/objects/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmpjpo6z9kq/node/sda/objects/0/... to 127.0.0.1::object/sda/objects/0 (0.000) test-replicator INFO: 6/6 (100.00%) partitions replicated in 60.00s (0.10/sec, 0s remaining) test-replicator INFO: 12 successes, 0 failures test-replicator INFO: 1 suffixes checked - 0.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0000s, min 0.0000s, med 0.0000s test-replicator INFO: Object replication complete (once). (1.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator INFO: Removing partition: /tmp/tmprd13hi26/node/sda/objects/1 test-replicator DEBUG: Run listdir on /tmp/tmprd13hi26/node/sda/objects-1/3 test-replicator DEBUG: Run listdir on /tmp/tmprd13hi26/node/sda/objects/2 test-replicator DEBUG: Run listdir on /tmp/tmprd13hi26/node/sda/objects-1/0 test-replicator DEBUG: Successful rsync of /tmp/tmprd13hi26/node/sda/objects-1/0/... to 127.0.0.1::object/sda/objects-1/0 (0.000) test-replicator DEBUG: Successful rsync of /tmp/tmprd13hi26/node/sda/objects-1/0/... to 127.0.0.2::object/sda/objects-1/0 (0.000) test-replicator DEBUG: Run listdir on /tmp/tmprd13hi26/node/sda/objects/0 test-replicator DEBUG: Run listdir on /tmp/tmprd13hi26/node/sda/objects/3 test-replicator DEBUG: Run listdir on /tmp/tmprd13hi26/node/sda/objects-1/2 test-replicator INFO: Removing partition: /tmp/tmprd13hi26/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.02s (441.78/sec, 0s remaining) test-replicator INFO: 18 successes, 0 failures test-replicator INFO: 1 suffixes checked - 100.00% hashed, 200.00% synced test-replicator INFO: Partition times: max 0.0059s, min 0.0006s, med 0.0007s test-replicator INFO: Object replication complete (once). (0.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator ERROR: Can't find itself in policy with index 0 with ips 1.1.1.1 and with port 6200 in ring file, not replicating test-replicator ERROR: Can't find itself in policy with index 1 with ips 1.1.1.1 and with port 6200 in ring file, not replicating test-replicator INFO: Nothing replicated for 0.0006856918334960938 seconds. test-replicator INFO: Object replication complete (once). (0.00 minutes) test-replicator INFO: Running object replicator in script mode. test-replicator ERROR: Error syncing with node: 127.0.0.2:6200/sda: Timeout (Nones) test-replicator INFO: Removing partition: /tmp/tmplr8pyesz/node/sda/objects-1/1 test-replicator INFO: Removing partition: /tmp/tmplr8pyesz/node/sda/objects/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.03s (311.19/sec, 0s remaining) test-replicator INFO: 17 successes, 1 failures test-replicator INFO: 6 suffixes checked - 100.00% hashed, 150.00% synced test-replicator INFO: Partition times: max 0.0120s, min 0.0003s, med 0.0006s test-replicator INFO: Object replication complete (once). (0.00 minutes) test-replicator INFO: Removing partition: /tmp/tmp4h51j0i2/node/sda/objects/1 test-replicator INFO: Removing partition: /tmp/tmp4h51j0i2/node/sda/objects-1/1 test-replicator INFO: 8/8 (100.00%) partitions replicated in 0.03s (299.02/sec, 0s remaining) test-replicator INFO: 18 successes, 0 failures test DEBUG: Labeled statsd mode: disabled (test) test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/2100/a/c/o" 201 - "-" "-" "-" 0.0070 "-" 1824519 - test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sda1/2100/a/c/o" 200 12 "-" "-" "-" 0.0007 "-" 1824519 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/2100/a/c/o" 201 - "-" "-" "-" 0.0533 "-" 1824519 - test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sda1/2100/a/c/o" 200 4194304 "-" "-" "-" 0.0006 "-" 1824519 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/2100/a/c/o" 201 - "-" "-" "-" 0.0169 "-" 1824519 - test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sda1/2100/a/c/o" 200 12 "-" "-" "-" 0.0006 "-" 1824519 - test WARNING: Quarantined object /tmp/tmpeeth6ee8obj_server_zero_copy/sda1/objects/2100/a83/06fbf0b514e5199dfc4e00f42eb5ea83/1402601849.47475.data: ETag ddbb5de304f43838630b463cf0623404 and file's md5 e0aecd37989701571f2c96b6dd22233c do not match test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sda1/2100/a/c/o" 404 70 "-" "-" "-" 0.0003 "-" 1824519 - test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test INFO: [audit-watcher test_watcher1] reporting dark data /a/c/o0 test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpzcaqp5ne/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: [audit-watcher test_watcher1] reporting dark data /a/c_ec/o test INFO: Object audit (ALL) "once" mode completed: 0.11s. Total quarantined: 0, Total errors: 0, Total files/sec: 28.46, Total bytes/sec: 49322.21, Auditing time: 0.09, Rate: 0.90 test INFO: [audit-watcher test_watcher1] total unknown 0 ok 0 dark 3 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test WARNING: Dark data action 'invalid' unknown, defaults to action = 'log' test DEBUG: Loading entry point 'test_watcher1' test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpshwpmibd/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpshwpmibd/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpshwpmibd/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:12 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1247.93, bytes/sec: 2555767.51, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmpshwpmibd/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpshwpmibd/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpshwpmibd/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpshwpmibd/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpshwpmibd/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpshwpmibd/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.10s. Total quarantined: 0, Total errors: 0, Total files/sec: 29.48, Total bytes/sec: 51090.26, Auditing time: 0.10, Rate: 0.98 test INFO: [audit-watcher test_watcher1] total unknown 0 ok 3 dark 0 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test DEBUG: Loading entry point 'test_watcher1' test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpdov4k9r0/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpdov4k9r0/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpdov4k9r0/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:12 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1340.46, bytes/sec: 2745265.13, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmpdov4k9r0/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpdov4k9r0/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpdov4k9r0/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpdov4k9r0/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpdov4k9r0/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpdov4k9r0/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: Object audit (ALL) "once" mode completed: 0.10s. Total quarantined: 0, Total errors: 0, Total files/sec: 29.47, Total bytes/sec: 51086.31, Auditing time: 0.09, Rate: 0.88 test INFO: [audit-watcher test_watcher1] total unknown 0 ok 3 dark 0 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test DEBUG: Loading entry point 'test_watcher1' test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ALL) test DEBUG: Skipping the update of recently changed /tmp/tmpvdjvz0l6/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpvdjvz0l6/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpvdjvz0l6/tmp_test_object_auditor/node/sda/objects/auditor_status_ALL.json test INFO: Object audit (ALL). Since Sun Sep 14 03:24:13 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1356.94, bytes/sec: 2779014.75, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmpvdjvz0l6/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpvdjvz0l6/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.jsontest.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_with_sharding_fallback_to_root_no_objects test.unit.obj.test_auditor.TestAuditWatchers.test_dark_data_with_sharding_fallback_to_root_no_objects ... ok test.unit.obj.test_auditor.TestAuditWatchers.test_watchers test.unit.obj.test_auditor.TestAuditWatchers.test_watchers ... ok test.unit.obj.test_diskfile.TestHashesHelpers.test_ignore_corrupted_hashes test.unit.obj.test_diskfile.TestHashesHelpers.test_ignore_corrupted_hashes ... ok test.unit.obj.test_diskfile.TestHashesHelpers.test_read_legacy_hashes test.unit.obj.test_diskfile.TestHashesHelpers.test_read_legacy_hashes ... ok test.unit.obj.test_diskfile.TestHashesHelpers.test_read_write_invalid_hashes_mutation_and_transative_equality test.unit.obj.test_diskfile.TestHashesHelpers.test_read_write_invalid_hashes_mutation_and_transative_equality ... ok test.unit.obj.test_diskfile.TestHashesHelpers.test_read_write_valid_hashes_mutation_and_transative_equality test.unit.obj.test_diskfile.TestHashesHelpers.test_read_write_valid_hashes_mutation_and_transative_equality ... ok test.unit.obj.test_diskfile.TestHashesHelpers.test_write_hashes_invalid_updated test.unit.obj.test_diskfile.TestHashesHelpers.test_write_hashes_invalid_updated ... ok test.unit.obj.test_diskfile.TestHashesHelpers.test_write_hashes_safe_default test.unit.obj.test_diskfile.TestHashesHelpers.test_write_hashes_safe_default ... ok test.unit.obj.test_diskfile.TestHashesHelpers.test_write_hashes_valid_updated test.unit.obj.test_diskfile.TestHashesHelpers.test_write_hashes_valid_updated ... ok test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_audit_location_class test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_audit_location_class ... ok test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_auditor_status test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_auditor_status ... ok test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_finding_of_hashdirs test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_finding_of_hashdirs ... ok test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_only_catch_expected_errors test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_only_catch_expected_errors ... ok test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_skipping_files test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_skipping_files ... ok test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_skipping_unmounted_devices test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_skipping_unmounted_devices ... ok test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_update_auditor_status_throttle test.unit.obj.test_diskfile.TestObjectAuditLocationGenerator.test_update_auditor_status_throttle ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_base_have_quorum test.unit.proxy.controllers.test_base.TestFuncs.test_base_have_quorum ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_best_response_overrides test.unit.proxy.controllers.test_base.TestFuncs.test_best_response_overrides ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_bytes_to_skip test.unit.proxy.controllers.test_base.TestFuncs.test_bytes_to_skip ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_container_info_needs_req test.unit.proxy.controllers.test_base.TestFuncs.test_container_info_needs_req ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_container_info_preserves_storage_policy test.unit.proxy.controllers.test_base.TestFuncs.test_container_info_preserves_storage_policy ... ok test.unit.container.test_backend.TestContainerBroker.test_get_info_sharding_states test.unit.container.test_backend.TestContainerBroker.test_get_info_sharding_states ... ok test.unit.container.test_backend.TestContainerBroker.test_get_info_stale_read_ok test.unit.container.test_backend.TestContainerBroker.test_get_info_stale_read_ok ... ok test.unit.container.test_backend.TestContainerBroker.test_get_items_since test.unit.container.test_backend.TestContainerBroker.test_get_items_since ... ok test-TestDiskFile WARNING: MD5 sockets not supported. splice() will not be used. test-TestDiskFile WARNING: MD5 sockets not supported. splice() will not be used. test-TestDiskFile WARNING: MD5 sockets not supported. splice() will not be used. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp26d7a2mp/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmp26d7a2mp/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmp26d7a2mp/node/sda1/objects-1/0 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor ERROR: Unable to create /tmp/tmpclh_byvf/node/sda1/objects-1: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 1350, in collect_parts mkdirs(obj_path) ~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_reconstructor.py", line 1047, in blowup_mkdirs raise OSError('Ow!') OSError: Ow! test-reconstructor WARNING: sda5 is not mounted test-reconstructor ERROR: Unable to create /tmp/tmpclh_byvf/node/sda1/objects-2: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 1350, in collect_parts mkdirs(obj_path) ~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_reconstructor.py", line 1047, in blowup_mkdirs raise OSError('Ow!') OSError: Ow! test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpp5gh2u9j/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (297.81/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpp5gh2u9j/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmpp5gh2u9j/node/sda1/objects-1/2 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpp5gh2u9j/node/sda1/objects-1/2 test-reconstructor INFO: Removing partition: /tmp/tmpp5gh2u9j/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (552.90/sec, 0s remaining) test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpa0iwxz0n/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmpa0iwxz0n/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmpa0iwxz0n/node/sda1/objects-1/0 test-reconstructor INFO: 3/3 (100.00%) partitions reconstructed in 0.03s (98.48/sec, 0s remaining) test-reconstructor INFO: 12 suffixes checked - 0.00% hashed, 100.00% synced test-reconstructor INFO: Partition times: max 0.0127s, min 0.0002s, med 0.0004s test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpa0iwxz0n/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmpa0iwxz0n/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmpa0iwxz0n/node/sda1/objects-1/0 test-reconstructor INFO: 3/3 (100.00%) partitions reconstructed in 0.03s (112.41/sec, 0s remaining) test-reconstructor INFO: 12 suffixes checked - 0.00% hashed, 100.00% synced test-reconstructor INFO: Partition times: max 0.0045s, min 0.0005s, med 0.0007s test-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpoykib9wa/node/sda1/objects-1/2 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.01s (132.31/sec, 0s remaining) test-reconstructor INFO: Handoffs only mode still has handoffs remaining. Next pass will continue to revert handoffs. test-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpoykib9wa/node/sda1/objects-1/2 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (213.82/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmprg72v3tv/node/sda1/objects-1/2 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (261.54/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmprg72v3tv/node/sda1/objects-1/2 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.01s (136.13/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor DEBUG: Run listdir on /tmp/tmpb11oltv8/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmpb11oltv8/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmpb11oltv8/node/sda1/objects-1/0 test-reconstructor ERROR: Trying to GET 10.0.0.0:7200/sda0/0/nada policy#1: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception test-reconstructor ERROR: Trying to GET 10.0.0.0:7200/sda0/0/nada policy#1: Timeout (Nones) test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp4w3rnmez/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp4w3rnmez/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp4w3rnmez/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (482.83/sec, 0s remaining) test-reconstructor INFO: Handoffs only mode still has handoffs remaining. Next pass will continue to revert handoffs. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp4w3rnmez/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp4w3rnmez/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp4w3rnmez/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.01s (188.77/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining.test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_handoffs_only test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_handoffs_only ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_ignores_status_file test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_ignores_status_file ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_iter_nodes_for_frag test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_iter_nodes_for_frag ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_max_objects_per_revert_only_for_revert_jobs test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_max_objects_per_revert_only_for_revert_jobs ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_no_delete_failed_revert test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_no_delete_failed_revert ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_process_job_all_client_error test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_process_job_all_client_error ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:read:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:read:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_multipart_uploads_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_multipart_uploads_acl_without_permission ... ok test.unit.container.test_backend.TestContainerBroker.test_get_namespaces test.unit.container.test_backend.TestContainerBroker.test_get_namespaces ... ok test.unit.obj.test_server.TestZeroCopy.test_quarantine_on_well_formed_zero_byte_file test.unit.obj.test_server.TestZeroCopy.test_quarantine_on_well_formed_zero_byte_file ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_parts_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_parts_acl_with_fullcontrol_permission ... ok test.unit.container.test_backend.TestContainerBroker.test_get_namespaces_root_container_fill_gap test.unit.container.test_backend.TestContainerBroker.test_get_namespaces_root_container_fill_gap ... ok test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_SSYNC_device_not_available test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_SSYNC_device_not_available ... ok test.unit.container.test_backend.TestContainerBroker.test_get_namespaces_state_filtering test.unit.container.test_backend.TestContainerBroker.test_get_namespaces_state_filtering ... ok test.unit.container.test_backend.TestContainerBroker.test_get_objects test.unit.container.test_backend.TestContainerBroker.test_get_objects ... ok test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_SSYNC_disconnect test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_SSYNC_disconnect ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_process_job_all_insufficient_storage test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_process_job_all_insufficient_storage ... ok test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_SSYNC_invalid_policy test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_SSYNC_invalid_policy ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_without_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_GET_without_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_HEAD test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_HEAD ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ_ACP fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '462'} fake-swift DEBUG: Grant test:full_control FULL_CONTROL permission on the bucket /bucket fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_with_fullcontrol_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_with_other_owner test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_with_other_owner ... ok test.unit.container.test_backend.TestContainerBroker.test_get_objects_since_row test.unit.container.test_backend.TestContainerBroker.test_get_objects_since_row ... ok test.unit.container.test_backend.TestContainerBroker.test_get_own_shard_range test.unit.container.test_backend.TestContainerBroker.test_get_own_shard_range ... ok test.unit.container.test_backend.TestContainerBroker.test_get_policy_info test.unit.container.test_backend.TestContainerBroker.test_get_policy_info ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_process_job_all_success test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_process_job_all_success ... ok test.unit.container.test_backend.TestContainerBroker.test_get_replication_info test.unit.container.test_backend.TestContainerBroker.test_get_replication_info ... ok test.unit.container.test_backend.TestContainerBroker.test_get_report_info test.unit.container.test_backend.TestContainerBroker.test_get_report_info ... ok test.unit.container.test_backend.TestContainerBroker.test_get_shard_range_rows_with_limit test.unit.container.test_backend.TestContainerBroker.test_get_shard_range_rows_with_limit ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_process_job_all_timeout test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_process_job_all_timeout ... ok test.unit.container.test_backend.TestContainerBroker.test_get_shard_ranges test.unit.container.test_backend.TestContainerBroker.test_get_shard_ranges ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. swift: Using crc32c_kern implementation for CRC32C. fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-Modified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_headers_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_headers_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_headers_with_match_and_s3acl test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_headers_with_match_and_s3acl ... ok swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.container.test_backend.TestContainerBroker.test_get_shard_ranges_includes test.unit.container.test_backend.TestContainerBroker.test_get_shard_ranges_includes ... ok test.unit.container.test_backend.TestContainerBroker.test_get_shard_ranges_with_sharding_overlaps test.unit.container.test_backend.TestContainerBroker.test_get_shard_ranges_with_sharding_overlaps ... ok test.unit.container.test_backend.TestContainerBroker.test_get_shard_ranges_with_shrinking_overlaps test.unit.container.test_backend.TestContainerBroker.test_get_shard_ranges_with_shrinking_overlaps ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_reconstruct_check_ring test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_reconstruct_check_ring ... ok test.unit.container.test_backend.TestContainerBroker.test_get_shard_usage test.unit.container.test_backend.TestContainerBroker.test_get_shard_usage ... ok test.unit.container.test_backend.TestContainerBroker.test_has_multiple_policies test.unit.container.test_backend.TestContainerBroker.test_has_multiple_policies ... ok test.unit.container.test_backend.TestContainerBroker.test_has_other_shard_ranges test.unit.container.test_backend.TestContainerBroker.test_has_other_shard_ranges ... ok test.unit.container.test_backend.TestContainerBroker.test_initialize_container_broker_in_default test.unit.container.test_backend.TestContainerBroker.test_initialize_container_broker_in_default ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:read:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_parts_acl_with_read_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_parts_acl_with_read_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_parts_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_list_parts_acl_without_permission ... ok test DEBUG: Skipping the update of recently changed /tmp/tmpvdjvz0l6/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpvdjvz0l6/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpvdjvz0l6/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpvdjvz0l6/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ALL.json test INFO: [audit-watcher test_watcher1] reporting dark data /a/c_ec/o test INFO: Object audit (ALL) "once" mode completed: 0.10s. Total quarantined: 0, Total errors: 0, Total files/sec: 29.38, Total bytes/sec: 50924.69, Auditing time: 0.10, Rate: 0.98 test INFO: [audit-watcher test_watcher1] total unknown 0 ok 2 dark 1 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test DEBUG: Loading entry point 'test_watcher1' test DEBUG: [audit-watcher test_watcher1] getting started test DEBUG: 1 audit watcher(s) loaded test INFO: Begin object audit "once" mode (ZBF) test DEBUG: Skipping the update of recently changed /tmp/tmpqmijynh4/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpqmijynh4/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpqmijynh4/tmp_test_object_auditor/node/sda/objects/auditor_status_ZBF.json test INFO: Object audit (ZBF). Since Sun Sep 14 03:24:13 2025: Locally: 1 passed, 0 quarantined, 0 errors, files/sec: 1587.55, bytes/sec: 0.00, Total time: 0.00, Auditing time: 0.00, Rate: 0.00 test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test DEBUG: Skipping the update of recently changed /tmp/tmpqmijynh4/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpqmijynh4/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpqmijynh4/tmp_test_object_auditor/node/sda/objects-1/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpqmijynh4/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpqmijynh4/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test DEBUG: Skipping the update of recently changed /tmp/tmpqmijynh4/tmp_test_object_auditor/node/sda/objects-2/auditor_status_ZBF.json test INFO: Object audit (ZBF) "once" mode completed: 0.01s. Total quarantined: 0, Total errors: 0, Total files/sec: 271.56, Total bytes/sec: 0.00, Auditing time: 0.00, Rate: 0.07 test INFO: Object audit stats: {"10": 0, "100": 0, "1024": 1, "10240": 2, "OVER": 0} test DEBUG: the auditor has no logger prefix test DEBUG: Skipping the update of recently changed /tmp/tmpq_qbx414/sdq/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpq_qbx414/sdp/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpq_qbx414/sdp/objects/auditor_status_ALL.json test DEBUG: Skipping the update of recently changed /tmp/tmpq_qbx414/sdq/objects/auditor_status_ALL.json test DEBUG: Skipping: /tmp/tmp5au6bdpe/garbage is not a directory test DEBUG: Skipping: /tmp/tmp5au6bdpe/garbage is not mounted test DEBUG: Skipping: /tmp/tmp38f5qzs2/sdq is not mounted test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: Base DELETE returning 503 for (204, 204, 404) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx5cf34646403d4fe08746d-0068c5707d) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx5cf34646403d4fe08746d-0068c5707d) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx5cf34646403d4fe08746d-0068c5707d) test ERROR: Container HEAD returning 503 for [] (txn: tx5cf34646403d4fe08746d-0068c5707d) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.controllers.test_base.TestFuncs.test_generate_request_headers test.unit.proxy.controllers.test_base.TestFuncs.test_generate_request_headers ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_generate_request_headers_change_backend_user_agent test.unit.proxy.controllers.test_base.TestFuncs.test_generate_request_headers_change_backend_user_agent ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_reconstructor_skipped_partpower_increase test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_reconstructor_skipped_partpower_increase ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_generate_request_headers_with_no_orig_req test.unit.proxy.controllers.test_base.TestFuncs.test_generate_request_headers_with_no_orig_req ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_generate_request_headers_with_sysmeta test.unit.proxy.controllers.test_base.TestFuncs.test_generate_request_headers_with_sysmeta ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_bad_path test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_bad_path ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_cache test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_cache ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_env test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_env ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_infocache test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_infocache ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_no_cache test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_no_cache ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_swift_owner test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_swift_owner ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_swift_source test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_swift_source ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_uses_logging_app test.unit.proxy.controllers.test_base.TestFuncs.test_get_account_info_uses_logging_app ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_cache_key test.unit.proxy.controllers.test_base.TestFuncs.test_get_cache_key ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_bad_path test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_bad_path ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_cache test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_cache ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_env test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_env ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_in_pipeline test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_in_pipeline ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_no_account test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_no_account ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_no_auto_account test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_no_auto_account ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_no_cache test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_no_cache ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_no_container_gets_cached test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_no_container_gets_cached ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_only_lookup_cache test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_only_lookup_cache ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_reconstructor_skips_bogus_partition_dirs test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_reconstructor_skips_bogus_partition_dirs ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_swift_source test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_swift_source ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_uses_logging_app test.unit.proxy.controllers.test_base.TestFuncs.test_get_container_info_uses_logging_app ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_info test.unit.proxy.controllers.test_base.TestFuncs.test_get_info ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_info_zero_recheck test.unit.proxy.controllers.test_base.TestFuncs.test_get_info_zero_recheck ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_disabled test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_disabled ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_error test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_error ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_hit test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_hit ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_infocache_hit test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_infocache_hit ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_miss test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_miss ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_skips test.unit.proxy.controllers.test_base.TestFuncs.test_get_namespaces_from_cache_skips ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_object_info_env test.unit.proxy.controllers.test_base.TestFuncs.test_get_object_info_env ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_object_info_no_env test.unit.proxy.controllers.test_base.TestFuncs.test_get_object_info_no_env ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_get_object_info_swift_source test.unit.proxy.controllers.test_base.TestFuncs.test_get_object_info_swift_source ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_from_container_info test.unit.proxy.controllers.test_base.TestFuncs.test_headers_from_container_info ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_meta test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_meta ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_missing test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_missing ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_storage_policies test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_storage_policies ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_sys_meta test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_sys_meta ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_values test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_account_info_values ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_container_info_meta test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_container_info_meta ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_container_info_missing test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_container_info_missing ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_container_info_sys_meta test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_container_info_sys_meta ... ok test.unit.container.test_backend.TestContainerBroker.test_is_deleted test.unit.container.test_backend.TestContainerBroker.test_is_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_empty test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_empty ... ok test.unit.container.test_backend.TestContainerBroker.test_is_old_enough_to_reclaim test.unit.container.test_backend.TestContainerBroker.test_is_old_enough_to_reclaim ... ok test.unit.container.test_backend.TestContainerBroker.test_is_reclaimable test.unit.container.test_backend.TestContainerBroker.test_is_reclaimable ... ok test.unit.container.test_backend.TestContainerBroker.test_last_modified_time test.unit.container.test_backend.TestContainerBroker.test_last_modified_time ... ok test.unit.container.test_backend.TestContainerBroker.test_legacy_pending_files test.unit.container.test_backend.TestContainerBroker.test_legacy_pending_files ... ok test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp2599wr_z/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmp2599wr_z/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmp2599wr_z/node/sda1/objects-1/0 test-reconstructor INFO: 3/3 (100.00%) partitions reconstructed in 0.02s (154.60/sec, 0s remaining) test-reconstructor INFO: 12 suffixes checked - 0.00% hashed, 100.00% synced test-reconstructor INFO: Partition times: max 0.0049s, min 0.0006s, med 0.0006s test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp5fvdfhye/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp5fvdfhye/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor DEBUG: Run listdir on /tmp/tmp5fvdfhye/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (365.68/sec, 0s remaining) test-reconstructor INFO: Handoffs only mode still has handoffs remaining. Next pass will continue to revert handoffs. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp5fvdfhye/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp5fvdfhye/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor DEBUG: Run listdir on /tmp/tmp5fvdfhye/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (342.08/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp5fvdfhye/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmp5fvdfhye/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor DEBUG: Run listdir on /tmp/tmp5fvdfhye/node/sda1/objects-1/2 test-reconstructor INFO: Removing partition: /tmp/tmp5fvdfhye/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (452.26/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpgeaqkzmq/node/sda1/objects-1/0 test-reconstructor ERROR: Invalid response 400 from 10.0.0.0:6200/sda0/0 policy#1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.2:6200/sda2/0 policy#1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.3:6200/sda3/0 policy#1 test-reconstructor DEBUG: Run listdir on /tmp/tmpgeaqkzmq/node/sda1/objects-1/1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.0:6200/sda0/1 policy#1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.1:6200/sda5/1 policy#1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.2:6200/sda6/1 policy#1 test-reconstructor DEBUG: Run listdir on /tmp/tmpgeaqkzmq/node/sda1/objects-1/2 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpebwi20e9/node/sda1/objects-1/0 test-reconstructor ERROR: 10.0.0.0:6200/sda0/0 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.1:6200/sda5/0 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.2:6200/sda2/0 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.3:6200/sda7/0 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.3:6200/sda3/0 policy#1 responded as unmounted test-reconstructor DEBUG: Run listdir on /tmp/tmpebwi20e9/node/sda1/objects-1/1 test-reconstructor ERROR: 10.0.0.0:6200/sda0/1 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.1:6200/sda5/1 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.0:6200/sda4/1 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.2:6200/sda6/1 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.2:6200/sda2/1 policy#1 responded as unmounted test-reconstructor DEBUG: Run listdir on /tmp/tmpebwi20e9/node/sda1/objects-1/2 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpo52q1rht/node/sda1/objects-1/0 test-reconstructor DEBUG: Run listdir on /tmp/tmpo52q1rht/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmpo52q1rht/node/sda1/objects-1/1 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpo637t4oj/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmpo637t4oj/node/sda1/objects-1/1 test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.0:6200/sda0/1 policy#1': Timeout (Nones) test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.1:6200/sda5/1 policy#1': Timeout (Nones) test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.2:6200/sda6/1 policy#1': Timeout (Nones) test-reconstructor DEBUG: Run listdir on /tmp/tmpo637t4oj/node/sda1/objects-1/0 test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.0:6200/sda0/0 policy#1': Timeout (Nones) test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.2:6200/sda2/0 policy#1': Timeout (Nones) test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.3:6200/sda3/0 policy#1': Timeout (Nones) test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpze72ehnv/node/sda1/objects-2/0 test-reconstructor DEBUG: Run listdir on /tmp/tmpze72ehnv/node/sda1/objects-2/1 test-reconstructor DEBUG: Run listdir on /tmp/tmpze72ehnv/node/sda1/objects-2/2 test-reconstructor INFO: Removing partition: /tmp/tmpze72ehnv/node/sda1/objects-2/2 test-reconstructor INFO: Ring change detected for policy 1 (one). Aborting current reconstruction pass for this policy. test-reconstructor INFO: 3/6 (50.00%) partitions reconstructed in 0.02s (184.54/sec, 0s remaining) test-reconstructor WARNING: next_part_power set in policy 'one'. Skipping test-reconstructor WARNING: sda5 is not mounted test-reconstructor INFO: Nothing reconstructed for 0.0005671977996826172 seconds. test-reconstructor WARNING: Unexpected entity in data dir: '/tmp/tmpr2oa00dd/node/sda1/objects-1/burrito' test-reconstructor INFO: Removing partition: /tmp/tmpr2oa00dd/node/sda1/objects-1/burrito test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp1wmai6by/node/sda1/objects-1/2 test-reconstructor WARNING: Unable to read '/tmp/tmp1wmai6by/node/sda1/objects-1/1/hashes.pkl' Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1336, in __get_hashes orig_hashes = self.consolidate_hashes(partition_path) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 436, in consolidate_hashes with lock_path(partition_dir): ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1294, in lock_path mkdirs(directory) ~~~~~~^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 802, in mkdirs os.makedirs(path) ~~~~~~~~~~~^^^^^^ File "", line 228, in makedirs FileExistsError: [Errno 17] File exists: '/tmp/tmp1wmai6by/node/sda1/objects-1/1' test-reconstructor WARNING: Unexpected entity '/tmp/tmp1wmai6by/node/sda1/objects-1/1' is not a directory test-reconstructor INFO: Removing partition: /tmp/tmp1wmai6by/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmp1wmai6by/node/sda1/objects-1/0 test-reconstructor INFO: 3/3 (100.00%) partitions reconstructed in 0.01s (418.06/sec, 0s remaining)test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_removes_zbf test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_removes_zbf ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_run_once test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_run_once ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_run_once_override_devices test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_run_once_override_devices ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_sync_old_nondurable_before_committed_non_zero_commit_window test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_sync_old_nondurable_before_committed_non_zero_commit_window ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_sync_old_nondurable_before_committed_past_commit_window test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_sync_old_nondurable_before_committed_past_commit_window ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '446'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '450'} fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the bucket /bucket fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_with_owner_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_with_owner_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_with_write_acp_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_with_write_acp_permission ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=0-3', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=3-3', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=1-', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=-3', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_HEAD_Range test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_HEAD_Range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_HEAD_Range_with_invalid_value test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_HEAD_Range_with_invalid_value ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_sync_old_nondurable_before_committed_zero_commit_window test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructorLegacyDurable.test_sync_old_nondurable_before_committed_zero_commit_window ... ok test.unit.obj.test_server.TestObjectServer.test_expect_on_multiphase_put_diconnect test.unit.obj.test_server.TestObjectServer.test_expect_on_multiphase_put_diconnect ... ok test.unit.obj.test_server.TestObjectServer.test_expect_on_put test.unit.obj.test_server.TestObjectServer.test_expect_on_put ... ok test.unit.obj.test_server.TestObjectServer.test_expect_on_put_conflict test.unit.obj.test_server.TestObjectServer.test_expect_on_put_conflict ... ok test.unit.obj.test_server.TestObjectServer.test_expect_on_put_footer test.unit.obj.test_server.TestObjectServer.test_expect_on_put_footer ... ok test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter ... ok test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter_non_slash test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter_non_slash ... ok test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter_order_and_reverse test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter_order_and_reverse ... ok test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter_prefix_delim test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter_prefix_delim ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_container_info_values test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_container_info_values ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_meta test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_meta ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_missing test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_missing ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_sys_meta test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_sys_meta ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_transient_sysmeta test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_transient_sysmeta ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_values test.unit.proxy.controllers.test_base.TestFuncs.test_headers_to_object_info_values ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_info_clearing test.unit.proxy.controllers.test_base.TestFuncs.test_info_clearing ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_options test.unit.proxy.controllers.test_base.TestFuncs.test_options ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_options_unauthorized test.unit.proxy.controllers.test_base.TestFuncs.test_options_unauthorized ... ok test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter_with_reserved_name test.unit.container.test_backend.TestContainerBroker.test_list_objects_iter_with_reserved_name ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_options_with_null_allow_origin test.unit.proxy.controllers.test_base.TestFuncs.test_options_with_null_allow_origin ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_record_cache_op_metrics test.unit.proxy.controllers.test_base.TestFuncs.test_record_cache_op_metrics ... ok test.unit.container.test_backend.TestContainerBroker.test_load_old_record_from_pending_file test.unit.container.test_backend.TestContainerBroker.test_load_old_record_from_pending_file ... ok test.unit.container.test_backend.TestContainerBroker.test_make_tuple_for_pickle test.unit.container.test_backend.TestContainerBroker.test_make_tuple_for_pickle ... ok test-reconstructor INFO: Running object reconstructor in script mode. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor INFO: 0/8 (0.00%) partitions reconstructed in 0.00s (0.00/sec, 56s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmp1lzpfjlv/node/sda1/objects-1/1 test-reconstructor INFO: 1/8 (12.50%) partitions reconstructed in 0.00s (249.81/sec, 0s remaining) test-reconstructor INFO: 1/8 (12.50%) partitions reconstructed in 0.00s (234.92/sec, 0s remaining) test-reconstructor INFO: 2/8 (25.00%) partitions reconstructed in 0.01s (221.26/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmp1lzpfjlv/node/sdc1/objects-1/0 test-reconstructor INFO: 3/8 (37.50%) partitions reconstructed in 0.01s (288.75/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmp1lzpfjlv/node/sdb1/objects-1/3 test-reconstructor INFO: 4/8 (50.00%) partitions reconstructed in 0.01s (347.90/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmp1lzpfjlv/node/sda1/objects-1/2 test-reconstructor INFO: 4/8 (50.00%) partitions reconstructed in 0.01s (309.98/sec, 0s remaining) test-reconstructor INFO: 5/8 (62.50%) partitions reconstructed in 0.01s (380.85/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmp1lzpfjlv/node/sda1/objects-1/0 test-reconstructor INFO: 5/8 (62.50%) partitions reconstructed in 0.02s (269.34/sec, 0s remaining) test-reconstructor INFO: 6/8 (75.00%) partitions reconstructed in 0.02s (318.67/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmp1lzpfjlv/node/sdb1/objects-1/2 test-reconstructor INFO: 7/8 (87.50%) partitions reconstructed in 0.02s (352.44/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmp1lzpfjlv/node/sdb1/objects-1/0 test-reconstructor DEBUG: Run listdir on /tmp/tmp1lzpfjlv/node/sdb1/objects-1/1 test-reconstructor INFO: 8/8 (100.00%) partitions reconstructed in 0.02s (370.69/sec, 0s remaining) test-reconstructor INFO: 8/8 (100.00%) partitions reconstructed in 0.02s (365.62/sec, 0s remaining) test-reconstructor INFO: 8/8 (100.00%) partitions reconstructed in 0.02s (361.58/sec, 0s remaining) test-reconstructor INFO: Object reconstruction complete (once). (0.00 minutes) test-reconstructor ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test-reconstructor INFO: Running object reconstructor in script mode. test-reconstructor INFO: 0/1 (0.00%) partitions reconstructed in 0.00s (0.00/sec, 28s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpi9gd_zme/node/sdc1/objects-1/0 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (212.45/sec, 0s remaining) test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (200.45/sec, 0s remaining) test-reconstructor INFO: Object reconstruction complete (once). (0.00 minutes) test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpfri0aj1o/node/sda1/objects-1/1 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (468.79/sec, 0s remaining) test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpsylq0x_h/node/sda1/objects-1/1 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (469.63/sec, 0s remaining) test-reconstructor ERROR: Problem making data file durable /tmp/tmpsylq0x_h/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165053.08671#4#d.data ([Errno 2] No such file or directory: '/tmp/tmpsylq0x_h/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c'): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3298, in _finalize_durable os.rename(data_file_path, durable_data_file_path) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpsylq0x_h/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165053.08671#4.data' -> '/tmp/tmpsylq0x_h/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165053.08671#4#d.data' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3313, in _finalize_durable files = os.listdir(self._datadir) FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpsylq0x_h/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c' test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmppjlb6o61/node/sda1/objects-1/1 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.01s (135.15/sec, 0s remaining) test-reconstructor ERROR: Problem making data file durable /tmp/tmppjlb6o61/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165053.12243#4#d.data ([Errno 2] No such file or directory: '/tmp/tmppjlb6o61/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c'): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3298, in _finalize_durable os.rename(data_file_path, durable_data_file_path) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmppjlb6o61/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165053.12243#4.data' -> '/tmp/tmppjlb6o61/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165053.12243#4#d.data' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3313, in _finalize_durable files = os.listdir(self._datadir) FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmppjlb6o61/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c' test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 499 89 "-" "-" "-" 0.0011 "-" 1824529 - test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "-" "-" 0.0065 "-" 1824529 - test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "-" "-" 0.0023 "-" 1824529 - test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 409 95 "-" "-" "-" 0.0005 "-" 1824529 - test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server ERROR: ERROR __call__ error with PUT /sda1/0/a/c/o : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 1417, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/swift/common/base_storage_server.py", line 71, in _timing_stats resp = func(ctrl, *args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/base_storage_server.py", line 44, in _timing_stats resp = func( ctrl, req, *args, timing_stats_labels=labels, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 1077, in PUT self._do_multi_stage_mime_continue_headers(request, obj_input) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 907, in _do_multi_stage_mime_continue_headers _junk_hdrs, obj_input = next(mime_documents_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 77, in iter_mime_headers_and_bodies for file_like in mime_documents_iter: ^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 3110, in iter_multipart_mime_documents raise swift.common.exceptions.MimeInvalid( 'invalid starting boundary: wanted %r, got %r' % (boundary, got)) swift.common.exceptions.MimeInvalid: invalid starting boundary: wanted b'--boundary123', got b''test.unit.obj.test_server.TestObjectServer.test_multiphase_put_bad_commit_message test.unit.obj.test_server.TestObjectServer.test_multiphase_put_bad_commit_message ... ok test.unit.obj.test_server.TestObjectServer.test_multiphase_put_client_disconnect_in_the_middle_of_commit test.unit.obj.test_server.TestObjectServer.test_multiphase_put_client_disconnect_in_the_middle_of_commit ... ok test.unit.obj.test_server.TestObjectServer.test_multiphase_put_client_disconnect_right_before_commit test.unit.obj.test_server.TestObjectServer.test_multiphase_put_client_disconnect_right_before_commit ... ok test.unit.obj.test_server.TestObjectServer.test_multiphase_put_drains_extra_commit_junk test.unit.obj.test_server.TestObjectServer.test_multiphase_put_drains_extra_commit_junk ... ok test.unit.obj.test_server.TestObjectServer.test_multiphase_put_drains_extra_commit_junk_disconnect test.unit.obj.test_server.TestObjectServer.test_multiphase_put_drains_extra_commit_junk_disconnect ... ok test.unit.obj.test_server.TestObjectServer.test_multiphase_put_ec_fragment_in_headers_no_footers test.unit.obj.test_server.TestObjectServer.test_multiphase_put_ec_fragment_in_headers_no_footers ... ok test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_SSYNC_read_error test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_SSYNC_read_error ... ok test.unit.container.test_backend.TestContainerBroker.test_merge_items test.unit.container.test_backend.TestContainerBroker.test_merge_items ... ok test.unit.container.test_backend.TestContainerBroker.test_merge_items_is_green test.unit.container.test_backend.TestContainerBroker.test_merge_items_is_green ... ok test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_bad_request_invalid_frag_index test.unit.obj.test_ssync_receiver.TestSsyncRxServer.test_bad_request_invalid_frag_index ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'If-Modified-Since': 'Fri, 01 Apr 2014 11:00:00 GMT'} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'X-Amz-Copy-Source-If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'X-Amz-Copy-Source-If-Modified-Since': 'Fri, 01 Apr 2014 11:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769849.83698', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'X-Amz-Copy-Source-If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'X-Amz-Copy-Source-If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769849.89024', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:09 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_headers_with_not_match_and_s3acl test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_headers_with_not_match_and_s3acl ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_metadata_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_metadata_copy ... ok test.unit.container.test_backend.TestContainerBroker.test_merge_items_overwrite test.unit.container.test_backend.TestContainerBroker.test_merge_items_overwrite ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write_acp:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '456'} fake-swift DEBUG: Grant test:write_acp FULL_CONTROL permission on the bucket /bucket fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '448'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE_ACP fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_without_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_bucket_acl_PUT_without_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_authenticated_read test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_authenticated_read ... ok test.unit.obj.test_server.TestObjectServer.test_multiphase_put_metadata_footer test.unit.obj.test_server.TestObjectServer.test_multiphase_put_metadata_footer ... ok test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon ... ok test.unit.container.test_backend.TestContainerBroker.test_merge_items_overwrite_unicode test.unit.container.test_backend.TestContainerBroker.test_merge_items_overwrite_unicode ... ok test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon_all_empty_devices test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon_all_empty_devices ... ok test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon_partial_device_updates test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon_partial_device_updates ... ok test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon_with_missing_keys test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon_with_missing_keys ... ok test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon_wrong_type_per_device test.unit.obj.test_updater.TestObjectUpdater.test_aggregate_and_dump_recon_wrong_type_per_device ... ok test.unit.obj.test_updater.TestObjectUpdater.test_conf_params test.unit.obj.test_updater.TestObjectUpdater.test_conf_params ... ok test.unit.obj.test_server.TestObjectServer.test_multiphase_put_metadata_footer_disconnect test.unit.obj.test_server.TestObjectServer.test_multiphase_put_metadata_footer_disconnect ... ok test.unit.obj.test_updater.TestObjectUpdater.test_creation test.unit.obj.test_updater.TestObjectUpdater.test_creation ... ok test.unit.container.test_backend.TestContainerBroker.test_merge_items_post_overwrite_out_of_order test.unit.container.test_backend.TestContainerBroker.test_merge_items_post_overwrite_out_of_order ... ok test.unit.obj.test_server.TestObjectServer.test_multiphase_put_no_metadata_replicated test.unit.obj.test_server.TestObjectServer.test_multiphase_put_no_metadata_replicated ... ok test.unit.obj.test_updater.TestObjectUpdater.test_dump_device_recon test.unit.obj.test_updater.TestObjectUpdater.test_dump_device_recon ... ok test.unit.obj.test_updater.TestObjectUpdater.test_gather_recon_stats test.unit.obj.test_updater.TestObjectUpdater.test_gather_recon_stats ... ok test.unit.obj.test_server.TestObjectServer.test_multiphase_put_no_mime_boundary test.unit.obj.test_server.TestObjectServer.test_multiphase_put_no_mime_boundary ... ok test.unit.container.test_backend.TestContainerBroker.test_merge_shard_range_single_record test.unit.container.test_backend.TestContainerBroker.test_merge_shard_range_single_record ... ok test.unit.obj.test_updater.TestObjectUpdater.test_listdir_with_exception test.unit.obj.test_updater.TestObjectUpdater.test_listdir_with_exception ... ok test.unit.obj.test_updater.TestObjectUpdater.test_listdir_without_exception test.unit.obj.test_updater.TestObjectUpdater.test_listdir_without_exception ... ok test.unit.obj.test_server.TestObjectServer.test_not_found test.unit.obj.test_server.TestObjectServer.test_not_found ... ok test.unit.container.test_backend.TestContainerBroker.test_merge_shard_ranges test.unit.container.test_backend.TestContainerBroker.test_merge_shard_ranges ... ok test.unit.container.test_backend.TestContainerBroker.test_merge_shard_ranges_deleted test.unit.container.test_backend.TestContainerBroker.test_merge_shard_ranges_deleted ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_empty_list test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_empty_list ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx2fdfde422e8842238a5b7-0068c5707d) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx2fdfde422e8842238a5b7-0068c5707d) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx2fdfde422e8842238a5b7-0068c5707d) test ERROR: Container HEAD returning 503 for [] (txn: tx2fdfde422e8842238a5b7-0068c5707d) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx91e2a1fa49f541ea94603-0068c5707d) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx91e2a1fa49f541ea94603-0068c5707d) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx91e2a1fa49f541ea94603-0068c5707d) test ERROR: Container HEAD returning 503 for [] (txn: tx91e2a1fa49f541ea94603-0068c5707d) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.controllers.test_base.TestFuncs.test_set_namespaces_in_cache_disabled test.unit.proxy.controllers.test_base.TestFuncs.test_set_namespaces_in_cache_disabled ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_set_namespaces_in_cache_error test.unit.proxy.controllers.test_base.TestFuncs.test_set_namespaces_in_cache_error ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_set_namespaces_in_cache_infocache_exists test.unit.proxy.controllers.test_base.TestFuncs.test_set_namespaces_in_cache_infocache_exists ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_set_namespaces_in_cache_ok test.unit.proxy.controllers.test_base.TestFuncs.test_set_namespaces_in_cache_ok ... ok test.unit.proxy.controllers.test_base.TestFuncs.test_transfer_headers_with_sysmeta test.unit.proxy.controllers.test_base.TestFuncs.test_transfer_headers_with_sysmeta ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_record_type_object test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_record_type_object ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_record_type_shard test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_record_type_shard ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_extra_line_parts test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_extra_line_parts ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_record_type_shard_with_listing_state test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_record_type_shard_with_listing_state ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_newer_meta test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_newer_meta ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_none test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_none ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_older_meta test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_older_meta ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/0/a/%C4%8Brypto/%C4%8Brypto" 200 24 "GET http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx7618ae5e7dfb4150ac636-0068c5707c" "proxy-server 1824514" 0.0022 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6c56978edd5b4d3fa0b63-0068c5707c" "proxy-server 1824514" 0.0018 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx5d8e9718ef0c4bb19f647-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/0/a/%C4%8Brypto/%C4%8Brypto" 412 - "GET http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx514c41a0fd7d4e15b58a7-0068c5707c" "proxy-server 1824514" 0.0008 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 412 - "GET http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx514c41a0fd7d4e15b58a7-0068c5707c" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txfb7cbdc9b03c46629538d-0068c5707c" "proxy-server 1824514" 0.0018 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx366d3b2a5779413992ebc-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/0/a/%C4%8Brypto/%C4%8Brypto" 304 - "GET http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx3edb2c3c0df149889b02d-0068c5707c" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa88ae43a1ae64211a2d02-0068c5707c" "proxy-server 1824514" 0.0032 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx41d78d228d1941a1b7ffe-0068c5707c" "proxy-server 1824514" 0.0085 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/0/a/%C4%8Brypto/%C4%8Brypto" 304 - "GET http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "txe976ea38dfaf42efa034b-0068c5707c" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx69fc356293d5442995716-0068c5707c" "proxy-server 1824514" 0.0038 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "txc04c6593e60c4bc0b131c-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 200 24 "GET http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx79462e8d28a642c2a4ebf-0068c5707c" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx138986cb81c4421c86bd9-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "txfe9eff622976493284586-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 200 24 "HEAD http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "txf35056dd35b845129a42b-0068c5707c" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx217291201df34e13ad4f4-0068c5707c" "proxy-server 1824514" 0.0016 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx8a8eb462d3504af9baa56-0068c5707c" "proxy-server 1824514" 0.0017 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 200 24 "HEAD http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx033a35af515248c7bfcea-0068c5707c" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txcad12abb949444b5bfd09-0068c5707c" "proxy-server 1824514" 0.0066 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "txcb722bacd80a41158e374-0068c5707c" "proxy-server 1824514" 0.0146 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 412 - "HEAD http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx857556513ac04a65ba5b3-0068c5707c" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdd1/0/a/%C4%8Brypto/%C4%8Brypto" 412 - "HEAD http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx857556513ac04a65ba5b3-0068c5707c" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2a7d37d0ef97481480624-0068c5707c" "proxy-server 1824514" 0.0054 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx335d086fc4814720962cd-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 304 - "HEAD http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "txdd7bb3595e244c8ea1405-0068c5707c" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2570376e52b949e68867b-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx73aafc982c6e48e8ae3b6-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdd1/0/a/%C4%8Brypto/%C4%8Brypto" 304 - "HEAD http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "tx66ca7f47e26d480c8b416-0068c5707c" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb66d1e85302a4941ac9a2-0068c5707c" "proxy-server 1824514" 0.0080 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/3/a/%C4%8Brypto" 204 - "HEAD http://foo:8080/v1/a/%C4%8Brypto" "tx78a438bedecc4bae8be0d-0068c5707c" "proxy-server 1824514" 0.0011 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdc1/0/a/%C4%8Brypto/%C4%8Brypto" 200 24 "HEAD http://foo:8080/v1/a/%C4%8Brypto/%C4%8Brypto" "txefc7835fad034579b388a-0068c5707c" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txcbe3e5e71ce640cba9382-0068c5707c" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdb1/3/a/%C4%8Brypto" 200 399 "GET http://foo:8080/v1/a/%C4%8Brypto?format=json&states=listing" "txcbe3e5e71ce640cba9382-0068c5707c" "proxy-server 1824514" 0.0349 "-" 1824514 1 proxy INFO: Path stored in meta ('/a/Ä\x8brypto/Ä\x8brypto') does not match path from request ('/a/ċrypto')! Using path from meta. (txn: txcbe3e5e71ce640cba9382-0068c5707c) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7d5ae349a1074108a0633-0068c5707c" "proxy-server 1824514" 0.0014 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdb1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx7d5ae349a1074108a0633-0068c5707c" "container-server 1824514" 0.0010 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx7d5ae349a1074108a0633-0068c5707c" "container-server 1824514" 0.0010 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 201 - "PUT http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx7d5ae349a1074108a0633-0068c5707c" "proxy-server 1824514" 0.0152 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 201 - "PUT http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx7d5ae349a1074108a0633-0068c5707c" "proxy-server 1824514" 0.0226 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txae6fecb2b28244db8e33e-0068c5707c" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "txae6fecb2b28244db8e33e-0068c5707c" "proxy-server 1824514" 0.0075 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6dfec5ae4abe40569f9b5-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx11a14c8964f4463e84716-0068c5707c" "proxy-server 1824514" 0.0014 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 201 - "PUT http://foo:8080/sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx957a2abfd4a24a12a86ab-0068c5707c" "object-server 1824514" 0.0006 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 201 - "PUT http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx957a2abfd4a24a12a86ab-0068c5707c" "proxy-server 1824514" 0.0087 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 201 - "PUT http://foo:8080/sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx957a2abfd4a24a12a86ab-0068c5707c" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 201 - "PUT http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx957a2abfd4a24a12a86ab-0068c5707c" "proxy-server 1824514" 0.0124 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5119b0a3e8ec4dea825ab-0068c5707c" "proxy-server 1824514" 0.0018 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx0b329330271b475f8a0ec-0068c5707c" "proxy-server 1824514" 0.0066 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 201 - "POST http://foo:8080/sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "txe52e8ebf0dd747a29dff9-0068c5707c" "object-server 1824514" 0.0033 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "PUT /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 201 - "POST http://foo:8080/sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "txe52e8ebf0dd747a29dff9-0068c5707c" "object-server 1824514" 0.0006 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "POST /sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 202 76 "POST http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "txe52e8ebf0dd747a29dff9-0068c5707c" "proxy-server 1824514" 0.0187 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "POST /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 202 76 "POST http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "txe52e8ebf0dd747a29dff9-0068c5707c" "proxy-server 1824514" 0.0259 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx76ce976ed8b14079aaffe-0068c5707c" "proxy-server 1824514" 0.0096 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx6d72c81dd21d43d8b536d-0068c5707c" "proxy-server 1824514" 0.0045 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 200 24 "GET http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx2439f39da95e48d5afe1f-0068c5707c" "proxy-server 1824514" 0.0009 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9f3a6d4c4f854fb7980bb-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx2951ca088d6947929bd8c-0068c5707c" "proxy-server 1824514" 0.0053 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 200 24 "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx6a62701d91f2414eac63e-0068c5707c" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx91d05852deda47a4a257f-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx2f6357770a9d4f8396330-0068c5707c" "proxy-server 1824514" 0.0054 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 200 24 "GET http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx983ef29d88dd47b1b408e-0068c5707c" "proxy-server 1824514" 0.0009 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx88c281878cdf460bb9be1-0068c5707c" "proxy-server 1824514" 0.0055 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx3f5dec28a2a44c2b963a3-0068c5707c" "proxy-server 1824514" 0.0086 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 200 24 "GET http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "txdbf2fc3b5e8647e983432-0068c5707c" "proxy-server 1824514" 0.0009 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx35e6dacdea9c41238a27c-0068c5707c" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx862a2b2d4a6148e1a24f0-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 412 - "GET http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx4c328ba06b0b4025a10b4-0068c5707c" "proxy-server 1824514" 0.0009 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 412 - "GET http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx4c328ba06b0b4025a10b4-0068c5707c" "proxy-server 1824514" 0.0009 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx19cded818dbf491c87e9e-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "txebc3e96d1048477490375-0068c5707c" "proxy-server 1824514" 0.0078 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "GET /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 304 - "GET http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "txaf3d3a1570ae46e8b3c85-0068c5707c" "proxy-server 1824514" 0.0031 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5fb90129480a400d820b6-0068c5707c" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "txc888a461c9784ba991a20-0068c5707c" "proxy-server 1824514" 0.0091 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 304 - "GET http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx8529df96bbc748739b8a2-0068c5707d" "proxy-server 1824514" 0.0009 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4fd0accb601b4f16824cd-0068c5707d" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "txe47ebad5a10b4ed19a970-0068c5707d" "proxy-server 1824514" 0.0055 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 200 24 "GET http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx1a8b725e2f4742b4bdf2a-0068c5707d" "proxy-server 1824514" 0.0064 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6d7ed13173954144b9bb1-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "txfd4b9010894049c9b1fa4-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 200 24 "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx1fbd46e84f8a48e1890ab-0068c5707d" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txdcc5291500a5467d80b28-0068c5707d" "proxy-server 1824514" 0.0070 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "txccb3e1e24af64b378dcae-0068c5707d" "proxy-server 1824514" 0.0087 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 200 24 "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx42a82e013f8d484088859-0068c5707d" "proxy-server 1824514" 0.0066 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txfd3c00db2f2d4c8eb979a-0068c5707d" "proxy-server 1824514" 0.0073 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "txa83c3287f05c408cb614b-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 412 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx43bf17004dca4f1c908aa-0068c5707d" "proxy-server 1824514" 0.0009 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 412 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx43bf17004dca4f1c908aa-0068c5707d" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx72023c34686c4c16be66e-0068c5707d" "proxy-server 1824514" 0.0043 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "txefc9ab6656ea4eb5aea8a-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 304 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "txc4ac73d2a8ff4e628ecc9-0068c5707d" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx27c7b15813404e6db9a5c-0068c5707d" "proxy-server 1824514" 0.0058 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx3f2cf342449a42a091824-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdd1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 304 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx9288a3b2383f4eee9f392-0068c5707d" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx578862b56b0141e4982ad-0068c5707d" "proxy-server 1824514" 0.0043 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 204 - "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" "tx293bfb1f24a7480d96e2b-0068c5707d" "proxy-server 1824514" 0.0016 "-" 1824514 1test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_crypto_max_length_path test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_crypto_max_length_path ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_one_exact test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_one_exact ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_one_newer test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_have_one_newer ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_local_durable test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_local_durable ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': '', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'hoge', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=1', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=5-1', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Range': 'bytes=5-10', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 143, in HEAD resp = self.GETorHEAD(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 109, in GETorHEAD resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2445, in get_response resp = self.acl_handler.handle_acl( app, method, container, obj, headers) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 94, in handle_acl return getattr(ah, method)(app) ~~~~~~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 246, in HEAD return self._handle_acl(app, 'HEAD') ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/acl_handlers.py", line 145, in _handle_acl resp = self.req.get_acl_response(app, 'HEAD', container, obj, headers, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500)test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_HEAD_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_HEAD_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_POST_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_POST_error ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_local_durable_older_than_remote_non_durable test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_local_durable_older_than_remote_non_durable ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_list_parts test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_list_parts ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_list_parts_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_list_parts_error ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant AuthenticatedUsers READ permission on the object /bucket/object fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_bucket_owner_full_control test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_bucket_owner_full_control ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_bucket_owner_read test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_bucket_owner_read ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_local_non_durable test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_local_non_durable ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_missing_durable test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_missing_durable ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_missing_durable_but_commit_fails test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_missing_durable_but_commit_fails ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_missing_meta_expired_data test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_missing_meta_expired_data ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_other_exception test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_other_exception ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_partial_line test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_partial_line ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_storage_policy test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_storage_policy ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_timeout test.unit.obj.test_ssync_receiver.TestReceiver.test_MISSING_CHECK_timeout ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_bad_storage_policy_index_header test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_bad_storage_policy_index_headerswift: Using crc32c_kern implementation for CRC32C. ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:10 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'X-Amz-Metadata-Directive': 'COPY', 'X-Amz-Meta-Something': 'oh hai', 'X-Amz-Meta-Unreadable-Prefix': '\x04w', 'X-Amz-Meta-Unreadable-Suffix': 'h\x04', 'X-Amz-Meta-Lots-Of-Unprintable': '\x04\x04\x04\x04\x04', 'Cache-Control': 'hello', 'Content-Disposition': 'how are you', 'Content-Encoding': 'good and you', 'Content-Language': 'great', 'Expires': 'yeah', 'X-Robots-Tag': 'bye', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769851.18358', 'Content-Type': 'so'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'X-Amz-Metadata-Directive': 'REPLACE', 'X-Amz-Meta-Something': 'oh hai', 'X-Amz-Meta-Unreadable-Prefix': '\x04w', 'X-Amz-Meta-Unreadable-Suffix': 'h\x04', 'X-Amz-Meta-Lots-Of-Unprintable': '\x04\x04\x04\x04\x04', 'Cache-Control': 'hello', 'Content-Disposition': 'how are you', 'Content-Encoding': 'good and you', 'Content-Language': 'great', 'Expires': 'yeah', 'X-Robots-Tag': 'bye', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769851.20154', 'Content-Type': 'so'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_metadata_replace test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_metadata_replace ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_self test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_self ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_self_metadata_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_self_metadata_copy ... ok swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_default_storage_policy test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_default_storage_policy ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_invalid_indexes test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_invalid_indexes ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_matched_indexes test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_matched_indexes ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_mismatched_indexes test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_mismatched_indexes ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_only_frag_index_header test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_only_frag_index_header ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_only_node_index_header test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_only_node_index_header ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_storage_policy_index_header test.unit.obj.test_ssync_receiver.TestReceiver.test_Receiver_with_storage_policy_index_header ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_Exception test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_Exception ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_Exception_Exception test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_Exception_Exception ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_calls_replication_lock test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_calls_replication_lock ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Storage-Class': 'STANDARD', 'Content-Md5': 'XUFAKrxLKna5cZ2REBfFkg==', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '5d41402abc4b2a76b9719d911017c592', 'X-Timestamp': '1757769851.44618', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_bad_hash test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_bad_hash ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_initial_path test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_initial_path ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'Content-Md5': 'CY9rzUYh03PK3k6DJie09g==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '098f6bcd4621d373cade4e832627b4f6'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e', 'Content-Length': '0'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'Content-Md5': 'CY9rzUYh03PK3k6DJie09g==', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '098f6bcd4621d373cade4e832627b4f6', 'Content-Length': '0'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Transfer-Encoding': 'chunked', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'Content-Md5': 'CY9rzUYh03PK3k6DJie09g==', 'Transfer-Encoding': 'chunked', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '098f6bcd4621d373cade4e832627b4f6'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multi_upload_empty_body test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multi_upload_empty_body ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_abort test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_abort ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_mount_check test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_mount_check ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdc1/1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" 200 24 "HEAD http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc/oooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooooo" "tx990dcf40a6c64f7faee0d-0068c5707d" "proxy-server 1824514" 0.0038 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb3e651948537498d901cf-0068c5707d" "proxy-server 1824514" 0.0075 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sda1/0/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc" 200 2652 "GET http://foo:8080/v1/a/cccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccccc?format=json&states=listing" "txb3e651948537498d901cf-0068c5707d" "proxy-server 1824514" 0.0022 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0190722e27ab4cf1b42e3-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sdb1/1/a/4a7fac35e47c445c981a0249cdf149be" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/4a7fac35e47c445c981a0249cdf149be" "tx0190722e27ab4cf1b42e3-0068c5707d" "container-server 1824514" 0.0010 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sda1/1/a/4a7fac35e47c445c981a0249cdf149be" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" "tx0190722e27ab4cf1b42e3-0068c5707d" "container-server 1824514" 0.0010 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 201 - "PUT http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx0190722e27ab4cf1b42e3-0068c5707d" "proxy-server 1824514" 0.0167 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 201 - "PUT http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx0190722e27ab4cf1b42e3-0068c5707d" "proxy-server 1824514" 0.0297 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe9d6c4f30e88476f89755-0068c5707d" "proxy-server 1824514" 0.0069 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txe9d6c4f30e88476f89755-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7ca48c89df3a4f83bda78-0068c5707d" "proxy-server 1824514" 0.0019 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx166584daa7ed45338be75-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be/o" 201 - "PUT http://foo:8080/sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx42d3517d21d4466094ff3-0068c5707d" "object-server 1824514" 0.0005 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sda1/0/a/4a7fac35e47c445c981a0249cdf149be/o" 201 - "PUT http://foo:8080/sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx42d3517d21d4466094ff3-0068c5707d" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 201 - "PUT http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx42d3517d21d4466094ff3-0068c5707d" "proxy-server 1824514" 0.0179 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 201 - "PUT http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx42d3517d21d4466094ff3-0068c5707d" "proxy-server 1824514" 0.0250 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb5f83379991743be8d562-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx163630541f10445e90b54-0068c5707d" "proxy-server 1824514" 0.0108 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be/o" 201 - "POST http://foo:8080/sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx7588ca8836974d8b9627c-0068c5707d" "object-server 1824514" 0.0086 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sda1/0/a/4a7fac35e47c445c981a0249cdf149be/o" 201 - "POST http://foo:8080/sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx7588ca8836974d8b9627c-0068c5707d" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "POST /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 202 76 "POST http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx7588ca8836974d8b9627c-0068c5707d" "proxy-server 1824514" 0.0219 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "POST /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 202 76 "POST http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx7588ca8836974d8b9627c-0068c5707d" "proxy-server 1824514" 0.0214 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5659427eab6e4d86a5e4f-0068c5707d" "proxy-server 1824514" 0.0019 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx09d0a5ecbd1e4d039961e-0068c5707d" "proxy-server 1824514" 0.0073 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txb112f4521b5d423083b75-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe9b7896d45b6402f859b7-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txc1871b77f3dc49b98dad5-0068c5707d" "proxy-server 1824514" 0.0117 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx07bf4808f34a41e295bd6-0068c5707d" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx778abfaa560e414e95654-0068c5707d" "proxy-server 1824514" 0.0058 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txead9fcca88d34d469aefe-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx9ac39b258885474eba0e9-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0c77d33f0526497ca6122-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx5fb3383bf54541ef81b33-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx0fe11178cd92445abeda9-0068c5707d" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx00aad06e73084b7495b06-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx8e3a68895ff041a4bdbea-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txae6f9f4669eb4c1fb4d67-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx488fdecf317b496594034-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txd7d60a30a4d64d89b4f12-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx1bfe8b91663649a6b1680-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx75cf03605cff4329ae640-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx71226cdc2ee54eea939f4-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 412 - "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx4f30057e941e44a6806ff-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 412 - "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx4f30057e941e44a6806ff-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe09170a8c8984005a067c-0068c5707d" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txbb23f42a98df48b193574-0068c5707d" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 304 - "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txb605732e392a425cbda60-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2fecc682b4a844f99df76-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx2175586108ab494e9736c-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 304 - "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx508904a6d47d414997135-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx58dfa6c92b894fb19add9-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx60659c94cd3c4850aef99-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx5fb4862b51af48a7b25a2-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txfe8dc016ee8a44c78f63b-0068c5707d" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txbb7be0bb96a74b89bfb1b-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx8c817d05629a463c80eb8-0068c5707d" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txbdffa8b173d14e89abf48-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txbfb7924d2faa498bb14be-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx57ac4c94a2ee4bdba3f5f-0068c5707d" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2389c8b892b544a9bc6ba-0068c5707d" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx2eff9ccc80414a008ed4d-0068c5707d" "proxy-server 1824514" 0.0091 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 412 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx8da563c6facd4555bceee-0068c5707d" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 412 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx8da563c6facd4555bceee-0068c5707d" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5209ee51d61240b5a584d-0068c5707d" "proxy-server 1824514" 0.0095 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx24ff7603ccda4fb0836b2-0068c5707d" "proxy-server 1824514" 0.0094 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 304 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx88c7875c01fa47f194d4e-0068c5707d" "proxy-server 1824514" 0.0088 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txd45be94a7144468396a92-0068c5707d" "proxy-server 1824514" 0.0094 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx419a954eee804882adf46-0068c5707d" "proxy-server 1824514" 0.0054 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 304 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txe266fe56bee844b1bd156-0068c5707d" "proxy-server 1824514" 0.0048 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa6f47b16aada4832bb626-0068c5707d" "proxy-server 1824514" 0.0055 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx8c0b1b90e3b247c197eaf-0068c5707d" "proxy-server 1824514" 0.0022 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx341593f579bc45df9a5af-0068c5707d" "proxy-server 1824514" 0.0087 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb47dd5c7724e45528f8e9-0068c5707e" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx95c4abe7e00b4cafbfe34-0068c5707e" "proxy-server 1824514" 0.0082 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx7b74f6babdfb40eba1a7c-0068c5707e" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx64d9150671454ce08ec18-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx1096d212267d496d90a00-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txd820a70fa2ef4ae18fb01-0068c5707e" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txcfb2c469c54c44d69905b-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txeb940e9a70ce4a13a03e3-0068c5707e" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 412 - "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx31b74441e6404d8797647-0068c5707e" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 412 - "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx31b74441e6404d8797647-0068c5707e" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3a6de4c408ab4dbd9616a-0068c5707e" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx421d591857fe428c991b0-0068c5707e" "proxy-server 1824514" 0.0055 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 304 - "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txa31d3247f85e432eb49bd-0068c5707e" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9a13f5d0a8bf4fd395b82-0068c5707e" "proxy-server 1824514" 0.0081 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx008ea35a67d54e76a9c20-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 304 - "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx4f05ecd1302941188d679-0068c5707e" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txfc23209289f845fb8e598-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx324409b483774a5398ac0-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "GET http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx0e6a42b34b0d4863bc7c6-0068c5707e" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx186c0837ee3e44adb7dd6-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 -test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_disable_encryption_config_option test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_disable_encryption_config_option ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_mount_check_isdir test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_mount_check_isdir ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_replication_lock_fail test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_replication_lock_fail ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_replication_lock_per_partition test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_replication_lock_per_partition ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_semaphore_locked test.unit.obj.test_ssync_receiver.TestReceiver.test_SSYNC_semaphore_locked ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_BONK test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_BONK ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_DELETE test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_DELETE ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:tester READ permission on the object /bucket/object fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_private test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_private ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_empty test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_empty ... ok fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_abort_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_abort_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_complete_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_complete_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_POST test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_POST ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:testertest:testerFULL_CONTROL fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:testertest:testerFULL_CONTROL fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/bucket/object', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'X-Amz-Metadata-Directive': 'REPLACE', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769851.00000', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_self_metadata_replace test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_self_metadata_replace ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_with_fullcontrol_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_with_fullcontrol_permission ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_PUT test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_PUT ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_public_read test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_public_read ... ok swift: Using crc32c_kern implementation for CRC32C. test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_mix_ok_and_unavailable_shards test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_mix_ok_and_unavailable_shards ... swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txb21cfeb4af6841b7b23b4-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txf2fbe81ef80e452988a48-0068c5707e" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7d4a077078204364a1824-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "txeabec074656c4181b0831-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx4798545c00564a2ca73cb-0068c5707e" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb5f45d7495f04fe3b3152-0068c5707e" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx1578bd62f4484ea7b192f-0068c5707e" "proxy-server 1824514" 0.0043 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 412 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txcb523230187346d1b2092-0068c5707e" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 412 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txcb523230187346d1b2092-0068c5707e" "proxy-server 1824514" 0.0047 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6a67d489aaa84800b3672-0068c5707e" "proxy-server 1824514" 0.0136 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx4aea34384ae947feb95ca-0068c5707e" "proxy-server 1824514" 0.0096 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 304 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "txa8be180a7968444985b5e-0068c5707e" "proxy-server 1824514" 0.0048 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx520cc478dfa445bd8dca3-0068c5707e" "proxy-server 1824514" 0.0095 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx43f7a842400b4accb6630-0068c5707e" "proxy-server 1824514" 0.0095 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdd1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 304 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx666a6ac2d6254f01a333e-0068c5707e" "proxy-server 1824514" 0.0088 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txbe7ac0e56c054ed78655d-0068c5707e" "proxy-server 1824514" 0.0121 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/0/a/4a7fac35e47c445c981a0249cdf149be" 204 - "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be" "tx75992037e846467092f52-0068c5707e" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdc1/1/a/4a7fac35e47c445c981a0249cdf149be/o" 200 24 "HEAD http://foo:8080/v1/a/4a7fac35e47c445c981a0249cdf149be/o" "tx637c3d4815e34ce0bddd7-0068c5707e" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc96977076e3e41b7b1cf7-0068c5707e" "proxy-server 1824514" 0.0013 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/1/a/290cb1736e1641de9fbafc7c223d15d8" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/290cb1736e1641de9fbafc7c223d15d8" "txc96977076e3e41b7b1cf7-0068c5707e" "container-server 1824514" 0.0012 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sdb1/1/a/290cb1736e1641de9fbafc7c223d15d8" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/290cb1736e1641de9fbafc7c223d15d8" "txc96977076e3e41b7b1cf7-0068c5707e" "container-server 1824514" 0.0173 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sdb1/0/a/290cb1736e1641de9fbafc7c223d15d8" 201 - "PUT http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8" "txc96977076e3e41b7b1cf7-0068c5707e" "proxy-server 1824514" 0.0546 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/290cb1736e1641de9fbafc7c223d15d8" 201 - "PUT http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8" "txc96977076e3e41b7b1cf7-0068c5707e" "proxy-server 1824514" 0.0383 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx14bbc7aff32e4f65aec76-0068c5707e" "proxy-server 1824514" 0.0199 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/0/a/290cb1736e1641de9fbafc7c223d15d8" 204 - "HEAD http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8" "tx14bbc7aff32e4f65aec76-0068c5707e" "proxy-server 1824514" 0.0145 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txeb5b8b0b1a3b4804ba2f0-0068c5707e" "proxy-server 1824514" 0.0186 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/0/a/290cb1736e1641de9fbafc7c223d15d8" 204 - "HEAD http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8" "txd6093859a85145acba00f-0068c5707e" "proxy-server 1824514" 0.0132 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/290cb1736e1641de9fbafc7c223d15d8/o" 201 - "PUT http://foo:8080/sdd1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx151865d4ba3e4ec1aba5a-0068c5707e" "object-server 1824514" 0.0009 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sdb1/0/a/290cb1736e1641de9fbafc7c223d15d8/o" 201 - "PUT http://foo:8080/sdc1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx151865d4ba3e4ec1aba5a-0068c5707e" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sdd1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" 201 - "PUT http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx151865d4ba3e4ec1aba5a-0068c5707e" "proxy-server 1824514" 0.0747 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sdc1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" 201 - "PUT http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx151865d4ba3e4ec1aba5a-0068c5707e" "proxy-server 1824514" 0.0905 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx08d2abb556f040d6b8266-0068c5707e" "proxy-server 1824514" 0.0108 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdb1/0/a/290cb1736e1641de9fbafc7c223d15d8" 204 - "HEAD http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8" "tx9675966dc3e44bf5820ca-0068c5707e" "proxy-server 1824514" 0.0187 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sdb1/0/a/290cb1736e1641de9fbafc7c223d15d8/o" 201 - "POST http://foo:8080/sdd1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx3f623bc6e5844c1eba78a-0068c5707e" "object-server 1824514" 0.0009 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/290cb1736e1641de9fbafc7c223d15d8/o" 201 - "POST http://foo:8080/sdc1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx3f623bc6e5844c1eba78a-0068c5707e" "object-server 1824514" 0.0008 "-" 1824514 1test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_mixed_policies_error test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_mixed_policies_error ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_ondisk_data_after_write_with_crypto test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_ondisk_data_after_write_with_crypto ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_PUT_replication_headers test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_PUT_replication_headers ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_PUT_with_storage_policy_and_node_index test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_PUT_with_storage_policy_and_node_index ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_bad_content_length test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_bad_content_length ... ok fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Storage-Class': 'STANDARD', 'Content-Md5': '6qm+nUNIiw0hvrDDF0kHUQ==', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'eaa9be9d43488b0d21beb0c317490751', 'X-Timestamp': '1757769851.97000', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:11 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769851.00000', 'Content-Type': 'binary/octet-stream'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_bad_headers test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_bad_headers ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant AllUsers READ permission on the object /bucket/object fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant AllUsers READ permission on the object /bucket/object fake-swift DEBUG: Grant AllUsers WRITE permission on the object /bucket/object fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_public_read_write test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_canned_acl_public_read_write ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_bad_subrequest_line_1 test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_bad_subrequest_line_1 ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '13'} fake-swift DEBUG: Start tag expected, '<' not found, line 1, column 1 (, line 1) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '221'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_complete_s3acl test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_complete_s3acl ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_initiate_no_content_type test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_upload_initiate_no_content_type ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_all_users test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_all_users ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_all_users_with_uppercase_type test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_all_users_with_uppercase_type ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_bad_subrequest_line_2 test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_bad_subrequest_line_2 ... ok swift: Using crc32c_kern implementation for CRC32C. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:testertest:testerFULL_CONTROL fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'X-Amz-Copy-Source': '/src_bucket/src_obj', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769852.26113', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'X-Amz-Copy-Source': '/src_bucket/src_obj', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769852.28373', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPswift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_with_grantee_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_with_grantee_permission ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_with_owner_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_with_owner_permission ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_content_length_with_DELETE test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_content_length_with_DELETE ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769852.00000', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source?versionId=null', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769852.00000', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769852.00000', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant AllUsers READ permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant AllUsers READ permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant AuthenticatedUsers READ permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_empty_src_path test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_empty_src_path ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_headers_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_headers_error ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_early_termination test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_early_termination ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'X-Amz-Acl': 'public-read', 'X-Amz-Meta-Foo': 'bar', 'User-Agent': 'Mozzarella Foxfire', 'X-Object-Sysmeta-S3Api-Has-Content-Type': 'no', 'Content-Type': 'application/directory'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_uploads_list test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_multipart_uploads_list ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_upload_part test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_upload_part ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_authenticated_users test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_authenticated_users ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_email test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_email ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-Modified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'If-Modified-Since': 'Fri, 01 Apr 2014 11:00:00 GMT'} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'X-Amz-Copy-Source-If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'X-Amz-Copy-Source-If-Modified-Since': 'Fri, 01 Apr 2014 11:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769853.55603', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_headers_with_match_and_s3acl test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_headers_with_match_and_s3acl ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_headers_with_not_match_and_s3acl test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_headers_with_not_match_and_s3acl ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_failures test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_failures ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_multiple test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_multiple ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Content-Length': '11'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_upload_part_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_object_upload_part_error ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_acl_with_fullcontrol_permission ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_no_content_length_with_PUT test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_no_content_length_with_PUT ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_no_headers test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_no_headers ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_no_start test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_no_start ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_other_exception test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_other_exception ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_subreq_does_not_read_all test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_subreq_does_not_read_all ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_acl_with_write_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_acl_without_permission ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "POST /sdd1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" 202 76 "POST http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx3f623bc6e5844c1eba78a-0068c5707e" "proxy-server 1824514" 0.0233 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "POST /sdc1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" 202 76 "POST http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx3f623bc6e5844c1eba78a-0068c5707e" "proxy-server 1824514" 0.0253 "-" 1824514 1 cont1 INFO: - - - [13/Sep/2025:13:24:14 +0000] "GET /sda1/0/a/290cb1736e1641de9fbafc7c223d15d8" 200 382 "-" "-" "-" 0.0172 "-" 1824514 1 cont1 INFO: - - - [13/Sep/2025:13:24:14 +0000] "GET /sdb1/0/a/290cb1736e1641de9fbafc7c223d15d8" 200 382 "-" "-" "-" 0.0097 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx36166e26ce5640e58b2ec-0068c5707e" "proxy-server 1824514" 0.0088 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/0/a/290cb1736e1641de9fbafc7c223d15d8" 204 - "HEAD http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8" "tx092b2c58a99f4bd5a75d6-0068c5707e" "proxy-server 1824514" 0.0193 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sdc1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" 200 24 "GET http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx6ee8f878736e4008aec9c-0068c5707e" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx788dd55d883c47c081f16-0068c5707e" "proxy-server 1824514" 0.0015 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sda1/0/a/290cb1736e1641de9fbafc7c223d15d8" 204 - "HEAD http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8" "tx6891a8f44d1a49a1a823d-0068c5707e" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "HEAD /sdd1/2/a/290cb1736e1641de9fbafc7c223d15d8/o" 200 24 "HEAD http://foo:8080/v1/a/290cb1736e1641de9fbafc7c223d15d8/o" "tx2c259e147dce4231a3cc3-0068c5707e" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0154ef9b9a3147ef9b715-0068c5707f" "proxy-server 1824514" 0.0037 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sda1/1/a/4b055683de5b480c8060182cbf75f19d" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/4b055683de5b480c8060182cbf75f19d" "tx0154ef9b9a3147ef9b715-0068c5707f" "container-server 1824514" 0.0010 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdb1/1/a/4b055683de5b480c8060182cbf75f19d" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/4b055683de5b480c8060182cbf75f19d" "tx0154ef9b9a3147ef9b715-0068c5707f" "container-server 1824514" 0.0181 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdb1/2/a/4b055683de5b480c8060182cbf75f19d" 201 - "PUT http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d" "tx0154ef9b9a3147ef9b715-0068c5707f" "proxy-server 1824514" 0.0422 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sda1/2/a/4b055683de5b480c8060182cbf75f19d" 201 - "PUT http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d" "tx0154ef9b9a3147ef9b715-0068c5707f" "proxy-server 1824514" 0.0596 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx86335e35bd6645ce97b8c-0068c5707f" "proxy-server 1824514" 0.0108 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/2/a/4b055683de5b480c8060182cbf75f19d" 204 - "HEAD http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d" "tx86335e35bd6645ce97b8c-0068c5707f" "proxy-server 1824514" 0.0170 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6b69761c857e48a49d23a-0068c5707f" "proxy-server 1824514" 0.0134 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/2/a/4b055683de5b480c8060182cbf75f19d" 204 - "HEAD http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d" "tx77e75e39d3ce431585b15-0068c5707f" "proxy-server 1824514" 0.0044 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sda1/2/a/4b055683de5b480c8060182cbf75f19d/o" 201 - "PUT http://foo:8080/sdh1/0/a/4b055683de5b480c8060182cbf75f19d/o" "tx0045ccac384e4047954f6-0068c5707f" "object-server 1824514" 0.0005 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdh1/0/a/4b055683de5b480c8060182cbf75f19d/o" 201 - "PUT http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d/o" "tx0045ccac384e4047954f6-0068c5707f" "proxy-server 1824514" 0.0441 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdi1/0/a/4b055683de5b480c8060182cbf75f19d/o" 201 - "PUT http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d/o" "tx0045ccac384e4047954f6-0068c5707f" "proxy-server 1824514" 0.0450 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdb1/2/a/4b055683de5b480c8060182cbf75f19d/o" 201 - "PUT http://foo:8080/sdg1/0/a/4b055683de5b480c8060182cbf75f19d/o" "tx0045ccac384e4047954f6-0068c5707f" "object-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdg1/0/a/4b055683de5b480c8060182cbf75f19d/o" 201 - "PUT http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d/o" "tx0045ccac384e4047954f6-0068c5707f" "proxy-server 1824514" 0.0557 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa6f63f98573a4e04945b7-0068c5707f" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/2/a/4b055683de5b480c8060182cbf75f19d" 204 - "HEAD http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d" "txc90a68c5c23d4c8ba4f19-0068c5707f" "proxy-server 1824514" 0.0023 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "POST /sdg1/0/a/4b055683de5b480c8060182cbf75f19d/o" 202 76 "POST http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d/o" "tx5b42ac3a789b4f68bf1ec-0068c5707f" "proxy-server 1824514" 0.0228 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sda1/2/a/4b055683de5b480c8060182cbf75f19d/o" 201 - "POST http://foo:8080/sdh1/0/a/4b055683de5b480c8060182cbf75f19d/o" "tx5b42ac3a789b4f68bf1ec-0068c5707f" "object-server 1824514" 0.0004 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdb1/2/a/4b055683de5b480c8060182cbf75f19d/o" 201 - "POST http://foo:8080/sdi1/0/a/4b055683de5b480c8060182cbf75f19d/o" "tx5b42ac3a789b4f68bf1ec-0068c5707f" "object-server 1824514" 0.0005 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "POST /sdi1/0/a/4b055683de5b480c8060182cbf75f19d/o" 202 76 "POST http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d/o" "tx5b42ac3a789b4f68bf1ec-0068c5707f" "proxy-server 1824514" 0.0313 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "POST /sdh1/0/a/4b055683de5b480c8060182cbf75f19d/o" 202 76 "POST http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d/o" "tx5b42ac3a789b4f68bf1ec-0068c5707f" "proxy-server 1824514" 0.0366 "-" 1824514 3 cont1 INFO: - - - [13/Sep/2025:13:24:15 +0000] "GET /sda1/2/a/4b055683de5b480c8060182cbf75f19d" 200 384 "-" "-" "-" 0.0077 "-" 1824514 3 cont1 INFO: - - - [13/Sep/2025:13:24:15 +0000] "GET /sdb1/2/a/4b055683de5b480c8060182cbf75f19d" 200 384 "-" "-" "-" 0.0093 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6cf957bb32354ba38dce9-0068c5707f" "proxy-server 1824514" 0.0032 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/2/a/4b055683de5b480c8060182cbf75f19d" 204 - "HEAD http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d" "tx5d4b2413877349c285613-0068c5707f" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "GET /sdh1/0/a/4b055683de5b480c8060182cbf75f19d/o" 200 92 "GET http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d/o" "txe2f32738afd64867b67ec-0068c5707f" "proxy-server 1824514" 0.0009 "-" 1824514 3test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_ondisk_data_after_write_with_crypto_ec test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_ondisk_data_after_write_with_crypto_ec ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {'If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'X-Amz-Copy-Source-If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'X-Amz-Copy-Source-If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.12869', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'X-Amz-Metadata-Directive': 'COPY', 'X-Amz-Meta-Something': 'oh hai', 'X-Amz-Meta-Unreadable-Prefix': '\x04w', 'X-Amz-Meta-Unreadable-Suffix': 'h\x04', 'X-Amz-Meta-Lots-Of-Unprintable': '\x04\x04\x04\x04\x04', 'Cache-Control': 'hello', 'Content-Disposition': 'how are you', 'Content-Encoding': 'good and you', 'Content-Language': 'great', 'Expires': 'yeah', 'X-Robots-Tag': 'bye', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.14622', 'Content-Type': 'so'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_metadata_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_metadata_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_metadata_replace test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_metadata_replace ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_self test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_self ... ok test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_with_storage_policy test.unit.obj.test_ssync_receiver.TestReceiver.test_UPDATES_with_storage_policy ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_invalid_source test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_invalid_source ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_with_fullcontrol_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_with_fullcontrol_permission ... ok test.unit.obj.test_ssync_sender.TestSender.test_call test.unit.obj.test_ssync_sender.TestSender.test_call ... ok test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check ... ok test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check_metadata_legacy_response test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check_metadata_legacy_response ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift ERROR: 501 Not Implemented fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_email_xml test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_email_xml ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_full_control test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_full_control ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: some source HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/some/source', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'X-Amz-Metadata-Directive': 'REPLACE', 'X-Amz-Meta-Something': 'oh hai', 'X-Amz-Meta-Unreadable-Prefix': '\x04w', 'X-Amz-Meta-Unreadable-Suffix': 'h\x04', 'X-Amz-Meta-Lots-Of-Unprintable': '\x04\x04\x04\x04\x04', 'Cache-Control': 'hello', 'Content-Disposition': 'how are you', 'Content-Encoding': 'good and you', 'Content-Language': 'great', 'Expires': 'yeah', 'X-Robots-Tag': 'bye', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.62910', 'Content-Type': 'so'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:testertest:testerFULL_CONTROL fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_self_metadata_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_self_metadata_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_self_metadata_replace test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_self_metadata_replace ... ok test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check_timeout_send_line test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check_timeout_send_line ... ok test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check_with_obj_list test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check_with_obj_list ... ok test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check_with_obj_list_but_required test.unit.obj.test_ssync_sender.TestSender.test_call_and_missing_check_with_obj_list_but_required ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/src_bucket/src_obj', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769852.85680', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'X-Amz-Copy-Source': '/src_bucket/src_obj', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769852.87418', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:12 -0000', 'User-Agent': 'Mozzarella Foxfire'}swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_without_dst_container_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_without_dst_container_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_without_src_obj_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_copy_without_src_obj_permission ... ok test.unit.obj.test_ssync_sender.TestSender.test_call_calls_others test.unit.obj.test_ssync_sender.TestSender.test_call_calls_others ... ok test.unit.obj.test_ssync_sender.TestSender.test_call_catches_MessageTimeout test.unit.obj.test_ssync_sender.TestSender.test_call_catches_MessageTimeout ... ok test.unit.obj.test_ssync_sender.TestSender.test_call_catches_ReplicationException test.unit.obj.test_ssync_sender.TestSender.test_call_catches_ReplicationException ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:testertest:testerFULL_CONTROL fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/bucket/object', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'X-Amz-Metadata-Directive': 'REPLACE', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.00000', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:testertest:testerFULL_CONTROL fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'X-Amz-Copy-Source': '/src_bucket/src_obj', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.95210', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_with_fullcontrol_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_with_grantee_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_with_grantee_permission ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_with_owner_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_with_owner_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_with_write_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_with_write_permission ... ok test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 500 1487 "-" "-" "-" 0.0060 "-" 1824529 - test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 500 125 "-" "-" "-" 0.0033 "-" 1824529 1 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 499 89 "-" "-" "-" 0.0157 "-" 1824529 1 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 499 89 "-" "-" "-" 0.0083 "-" 1824529 1 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "-" "-" 0.0218 "-" 1824529 1 test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sda1/0/a/c/o" 200 82 "-" "-" "-" 0.0007 "-" 1824529 1 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 499 89 "-" "-" "-" 0.0163 "-" 1824529 1 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "-" "-" 0.0142 "-" 1824529 1 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "-" "-" 0.0280 "-" 1824529 1 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 499 89 "-" "-" "-" 0.0094 "-" 1824529 1 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "-" "-" 0.0085 "-" 1824529 - test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "PUT /sda1/0/a/c/o" 400 16 "-" "-" "-" 0.0005 "-" 1824529 - test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server INFO: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "GET /sda1/0/a/c/o" 404 70 "-" "-" "-" 0.0004 "-" 1824529 - test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test ERROR: None/sda1/1 read failed in ssync.Receiver: missing_check line: missing newline test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test ERROR: ssync client disconnected test DEBUG: Labeled statsd mode: disabled (test) test ERROR: ssync client disconnected test DEBUG: Labeled statsd mode: disabled (test) test ERROR: ssync client disconnected test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: None/sda1/1 SSYNC LOCK TIMEOUT: 0.01 seconds: /tmp/tmpb334ztyc/tmp_test_ssync_receiver/sda1/objects/1/.lock-replication test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test ERROR: None/device/partition EXCEPTION in ssync.Receiver: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/ssync_receiver.py", line 272, in __call__ for data in self.updates(): ~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/ssync_receiver.py", line 545, in updates method, path = context.split(' ', 1) ^^^^^^^^^^^^ ValueError: not enough values to unpack (expected 2, got 1) test DEBUG: Labeled statsd mode: disabled (test) test ERROR: None/device/partition read failed in ssync.Receiver: updates line: missing newline test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 3, sent: 0, deletable: 3 test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 3, sent: 1, deletable: 3 test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 3, sent: 1, deletable: 2 test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-sender ERROR: 1.2.3.4:5678/sda1/99 0.01 seconds: missing_check send line: 0 lines (0 bytes) sent test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 0, deletable: 1 test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 0 test-ssync-sender DEBUG: ssync completed ok: dev: test-dev, part: 99, policy: 0, num suffixes: 1, available: 0, sent: 0, deletable: 0 test-ssync-sender ERROR: 1.2.3.4:5678/sda1/9 1 second: test connect test-ssync-sender ERROR: 1.2.3.4:5678/sda1/9 test connect test-ssync-sender ERROR: EXCEPTION in ssync.Sender: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/ssync_sender.py", line 185, in __call__ connection, response = self.connect() ~~~~~~~~~~~~^^ TypeError: 'str' object is not callable During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/ssync_sender.py", line 223, in __call__ node_str = utils.node_to_string(self.node, replication=True) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1176, in node_to_string node_ip, node_port = select_ip_port(node_dict, use_replication=replication) ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1159, in select_ip_port node_ip = node_dict['replication_ip'] ~~~~~~~~~^^^^^^^^^^^^^^^^^^ TypeError: 'NoneType' object is not subscriptabletest.unit.obj.test_ssync_sender.TestSender.test_call_catches_exception_handling_exception test.unit.obj.test_ssync_sender.TestSender.test_call_catches_exception_handling_exception ... ok test.unit.obj.test_ssync_sender.TestSender.test_call_catches_other_exceptions test.unit.obj.test_ssync_sender.TestSender.test_call_catches_other_exceptions ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect test.unit.obj.test_ssync_sender.TestSender.test_connect ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_bad_status test.unit.obj.test_ssync_sender.TestSender.test_connect_bad_status ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff_no_frag test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff_no_frag ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff_none_frag test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff_none_frag ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff_none_frag_to_primary test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff_none_frag_to_primary ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff_replicated test.unit.obj.test_ssync_sender.TestSender.test_connect_handoff_replicated ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_legacy_receiver test.unit.obj.test_ssync_sender.TestSender.test_connect_legacy_receiver ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_legacy_receiver_include_non_durable test.unit.obj.test_ssync_sender.TestSender.test_connect_legacy_receiver_include_non_durable ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'X-Amz-Copy-Source': '/src_bucket/src_obj', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.18843', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Copy-Source': '/src_bucket/src_obj', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.22268', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_with_owner_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_with_owner_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_without_dst_container_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_without_dst_container_permission ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_receive_timeout test.unit.obj.test_ssync_sender.TestSender.test_connect_receive_timeout ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_send_timeout test.unit.obj.test_ssync_sender.TestSender.test_connect_send_timeout ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_upgraded_receiver test.unit.obj.test_ssync_sender.TestSender.test_connect_upgraded_receiver ... ok test.unit.obj.test_ssync_sender.TestSender.test_connect_upgraded_receiver_include_non_durable test.unit.obj.test_ssync_sender.TestSender.test_connect_upgraded_receiver_include_non_durable ... ok test.unit.obj.test_ssync_sender.TestSender.test_disconnect test.unit.obj.test_ssync_sender.TestSender.test_disconnect ... ok 1 RLock(s) were not greened, to fix this error make sure you run eventlet.monkey_patch() before importing any other modules. test.unit.obj.test_ssync_sender.TestSender.test_disconnect_timeout test.unit.obj.test_ssync_sender.TestSender.test_disconnect_timeout ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_extra_line_parts test.unit.obj.test_ssync_sender.TestSender.test_missing_check_extra_line_parts ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_far_end_disconnect test.unit.obj.test_ssync_sender.TestSender.test_missing_check_far_end_disconnect ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_far_end_disconnect2 test.unit.obj.test_ssync_sender.TestSender.test_missing_check_far_end_disconnect2 ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_without_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_without_permission ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_far_end_unexpected test.unit.obj.test_ssync_sender.TestSender.test_missing_check_far_end_unexpected ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_has_empty_suffixes test.unit.obj.test_ssync_sender.TestSender.test_missing_check_has_empty_suffixes ... ok test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_root_update_bad_location_header test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_root_update_bad_location_header ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_has_suffixes test.unit.obj.test_ssync_sender.TestSender.test_missing_check_has_suffixes ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'X-Amz-Copy-Source': '/src_bucket/src_obj', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.30587', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: test:testertest:testertest:testertest:testerFULL_CONTROL fake-swift DEBUG: permission denined: 403 Forbidden test:write READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_without_src_obj_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_copy_without_src_obj_permission ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_max_objects_exactly_actual_objects test.unit.obj.test_ssync_sender.TestSender.test_missing_check_max_objects_exactly_actual_objects ... ok test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_root_update_missing_location_header test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_root_update_missing_location_header ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_max_objects_less_than_actual_objects test.unit.obj.test_ssync_sender.TestSender.test_missing_check_max_objects_less_than_actual_objects ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_send_map test.unit.obj.test_ssync_sender.TestSender.test_missing_check_send_map ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: test:testertest:testertest:testertest:testerFULL_CONTROL fake-swift DEBUG: permission denined: 403 Forbidden test:write READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769853.69328', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769853.69567', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:13 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769853.69753', 'Content-Type': 'binary/octet-stream'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_root_update_redirected test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_root_update_redirected ... ok test.unit.obj.test_ssync_sender.TestSender.test_missing_check_timeout_start test.unit.obj.test_ssync_sender.TestSender.test_missing_check_timeout_start ... ok test.unit.obj.test_ssync_sender.TestSender.test_readline_all test.unit.obj.test_ssync_sender.TestSender.test_readline_all ... ok test.unit.obj.test_ssync_sender.TestSender.test_readline_all_trailing_not_newline_termed test.unit.obj.test_ssync_sender.TestSender.test_readline_all_trailing_not_newline_termed ... ok test.unit.obj.test_ssync_sender.TestSender.test_readline_at_start_of_chunk test.unit.obj.test_ssync_sender.TestSender.test_readline_at_start_of_chunk ... ok test.unit.obj.test_ssync_sender.TestSender.test_readline_broken_chunk test.unit.obj.test_ssync_sender.TestSender.test_readline_broken_chunk ... ok test.unit.obj.test_ssync_sender.TestSender.test_readline_buffer_exceeds_network_chunk_size_somehow test.unit.obj.test_ssync_sender.TestSender.test_readline_buffer_exceeds_network_chunk_size_somehow ... ok test.unit.obj.test_ssync_sender.TestSender.test_readline_chunk_with_extension test.unit.obj.test_ssync_sender.TestSender.test_readline_chunk_with_extension ... ok test.unit.obj.test_ssync_sender.TestSender.test_readline_newline_in_buffer test.unit.obj.test_ssync_sender.TestSender.test_readline_newline_in_buffer ... ok test.unit.obj.test_ssync_sender.TestSender.test_readline_terminated_chunk test.unit.obj.test_ssync_sender.TestSender.test_readline_terminated_chunk ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_delete test.unit.obj.test_ssync_sender.TestSender.test_send_delete ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_delete_timeout test.unit.obj.test_ssync_sender.TestSender.test_send_delete_timeout ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_post test.unit.obj.test_ssync_sender.TestSender.test_send_post ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_post_unicode test.unit.obj.test_ssync_sender.TestSender.test_send_post_unicode ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_put test.unit.obj.test_ssync_sender.TestSender.test_send_put ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_put_chunk_timeout test.unit.obj.test_ssync_sender.TestSender.test_send_put_chunk_timeout ... ok test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "PUT /sda1/2100/a/c/o" 201 - "-" "-" "-" 0.0098 "-" 1824519 - test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sda1/2100/a/c/o" 200 - "-" "-" "-" 0.0006 "-" 1824519 - test INFO: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "GET /sda1/2100/a/c/o" 200 - "-" "-" "-" 0.0006 "-" 1824519 - test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "SSYNC /sdc1/0" 507 109 "-" "-" "-" 0.0003 "-" 1824519 0 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "SSYNC /sdb1/0" 500 125 "-" "-" "-" 0.0002 "-" 1824519 0 test-reconstructor ERROR: 127.0.0.1:35121/sdb1/0 Expected status 200; got 500 (b'

Internal Error

The server has either erred or is incapable of performing the requested operation.

') test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "SSYNC /sda1/0" 503 22 "-" "-" "-" 0.0003 "-" 1824519 2 test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" 0.0003 "-" 1824519 0 test-object-server ERROR: 127.0.0.1/sda1/0 read failed in ssync.Receiver: missing_check start: invalid literal for int() with base 16: b'' test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" 0.0002 "-" 1824519 0 test-object-server ERROR: 127.0.0.1/sda1/0 read failed in ssync.Receiver: missing_check start: unexpected end of file while parsing chunked data test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" 0.0002 "-" 1824519 0 test-object-server ERROR: 127.0.0.1/sda1/0 read failed in ssync.Receiver: missing_check line: invalid literal for int() with base 16: b'x\r\n' test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" 0.0002 "-" 1824519 0 test-object-server ERROR: 127.0.0.1/sda1/0 read failed in ssync.Receiver: missing_check line: unexpected end of file while parsing chunked data test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:13 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" 0.0002 "-" 1824519 0 test-object-server ERROR: 127.0.0.1/sda1/0 read failed in ssync.Receiver: updates start: invalid literal for int() with base 16: b'' test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" 0.0002 "-" 1824519 0 test-object-server ERROR: 127.0.0.1/sda1/0 read failed in ssync.Receiver: updates start: unexpected end of file while parsing chunked data test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" 0.0002 "-" 1824519 0 test-object-server ERROR: 127.0.0.1/sda1/0 read failed in ssync.Receiver: updates line: invalid literal for int() with base 16: b'x\r\n' test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" 0.0002 "-" 1824519 0 test-object-server ERROR: 127.0.0.1/sda1/0 read failed in ssync.Receiver: updates line: unexpected end of file while parsing chunked data test-object-server DEBUG: Labeled statsd mode: disabled (test-object-server) test-object-server DEBUG: 127.0.0.1 - - [13/Sep/2025:13:24:14 +0000] "SSYNC /sda1/0" 400 41 "-" "-" "-" 0.0003 "-" 1824519 - test WARNING: The slowdown option is deprecated in favor of objects_per_second. This option may be ignored in a future release. test WARNING: The slowdown option is deprecated in favor of objects_per_second. This option may be ignored in a future release. test ERROR: ERROR: Unable to access foo/bar: permission_denied test INFO: Object update sweep starting on /tmp/tmpwkq5ebt1/devices/sda1 (pid: 1824519) test ERROR: Container update failed for '/a/c/o'; problem with redirect location: Invalid path: bad%20bad%20bad test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test ERROR: Container update failed for '/a/c/o'; problem with redirect location: Invalid path: bad%20bad%20bad test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test ERROR: Container update failed for '/a/c/o'; problem with redirect location: Invalid path: bad%20bad%20bad test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update failed for /a/c/o /tmp/tmpwkq5ebt1/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769855.00000 test INFO: Object update sweep completed on /tmp/tmpwkq5ebt1/devices/sda1 in 0.00s seconds:, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpsg0wy10c/devices/sda1 (pid: 1824519) test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update failed for /a/c/o /tmp/tmpsg0wy10c/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769856.00000 test INFO: Object update sweep completed on /tmp/tmpsg0wy10c/devices/sda1 in 0.01s seconds:, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmp1pj5ereq/devices/sda1 (pid: 1824519) test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /a/c/o /tmp/tmp1pj5ereq/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769855.00000 to .shards_a/c_shard_new test DEBUG: Update sent for /.shards_a/c_shard_new/o /tmp/tmp1pj5ereq/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769855.00000 test INFO: Object update sweep completed on /tmp/tmp1pj5ereq/devices/sda1 in 0.01s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 1 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.02s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 1 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpkn56q8zb/devices/sda1 (pid: 1824519) test DEBUG: Error code 507 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 507 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update failed for /a/c/o /tmp/tmpkn56q8zb/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769855.00000 test INFO: Object update sweep completed on /tmp/tmpkn56q8zb/devices/sda1 in 0.01s seconds:, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.02s, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpkn56q8zb/devices/sda1 (pid: 1824519) test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /a/c/o /tmp/tmpkn56q8zb/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769855.00000 to .shards_a/c_shard_1 test DEBUG: Update sent for /.shards_a/c_shard_1/o /tmp/tmpkn56q8zb/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769855.00000test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_root_update_redirected_previous_success test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_root_update_redirected_previous_success ... ok test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_shard_update_redirected_twice test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_shard_update_redirected_twice ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_group_xml test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_group_xml ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_permission ... ok test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_update_redirection_loop test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_update_redirection_loop ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_put_initial_timeout test.unit.obj.test_ssync_sender.TestSender.test_send_put_initial_timeout ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_put_non_durable test.unit.obj.test_ssync_sender.TestSender.test_send_put_non_durable ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.37847', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.38430', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.38629', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.40051', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.40248', 'Content-Type': 'binary/octet-stream'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 177, in PUT resp = req.get_response(self.app) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2452, in get_response return self.get_acl_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e', 'X-Timestamp': '1757769855.41862', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.44294', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.44491', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.45876', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.50453', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.50642', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_quota_exceeded test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_quota_exceeded ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_put_unicode test.unit.obj.test_ssync_sender.TestSender.test_send_put_unicode ... ok test.unit.obj.test_ssync_sender.TestSender.test_send_put_unicode_header_name test.unit.obj.test_ssync_sender.TestSender.test_send_put_unicode_header_name ... ok test.unit.obj.test_ssync_sender.TestSender.test_update_send_delete test.unit.obj.test_ssync_sender.TestSender.test_update_send_delete ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "GET /sdi1/0/a/4b055683de5b480c8060182cbf75f19d/o" 200 92 "GET http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d/o" "txe2f32738afd64867b67ec-0068c5707f" "proxy-server 1824514" 0.0055 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx848f4b57d12a4e849ff47-0068c5707f" "proxy-server 1824514" 0.0015 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/2/a/4b055683de5b480c8060182cbf75f19d" 204 - "HEAD http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d" "txe18660a94be545b7a2d99-0068c5707f" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdi1/0/a/4b055683de5b480c8060182cbf75f19d/o" 200 92 "HEAD http://foo:8080/v1/a/4b055683de5b480c8060182cbf75f19d/o" "txf7b3bb79a468485bb0717-0068c5707f" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5fa5d7b047024dc09fb17-0068c5707f" "proxy-server 1824514" 0.0013 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sda1/1/a/a0007cd4a4864c5696948cd9ddfb54c1" 201 - "PUT http://127.0.0.1:60751/sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx5fa5d7b047024dc09fb17-0068c5707f" "container-server 1824514" 0.0011 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdb1/1/a/a0007cd4a4864c5696948cd9ddfb54c1" 201 - "PUT http://127.0.0.1:40941/sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx5fa5d7b047024dc09fb17-0068c5707f" "container-server 1824514" 0.0011 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 201 - "PUT http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx5fa5d7b047024dc09fb17-0068c5707f" "proxy-server 1824514" 0.0190 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 201 - "PUT http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx5fa5d7b047024dc09fb17-0068c5707f" "proxy-server 1824514" 0.0266 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf4d6c11b0f974508b6bfb-0068c5707f" "proxy-server 1824514" 0.0111 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txf4d6c11b0f974508b6bfb-0068c5707f" "proxy-server 1824514" 0.0013 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx704a2d3294464e09af045-0068c5707f" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx00c0c9ac1be84785a0c21-0068c5707f" "proxy-server 1824514" 0.0012 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 201 - "PUT http://foo:8080/sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx484c1a2cabd440e98f92e-0068c5707f" "object-server 1824514" 0.0005 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 201 - "PUT http://foo:8080/sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx484c1a2cabd440e98f92e-0068c5707f" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 201 - "PUT http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx484c1a2cabd440e98f92e-0068c5707f" "proxy-server 1824514" 0.0272 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 201 - "PUT http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx484c1a2cabd440e98f92e-0068c5707f" "proxy-server 1824514" 0.0285 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx71f5468c288e477dbbec4-0068c5707f" "proxy-server 1824514" 0.0171 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txbd922d1df1c041dd9b1c7-0068c5707f" "proxy-server 1824514" 0.0064 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 201 - "POST http://foo:8080/sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx05ba085ae2eb45a6bdde6-0068c5707f" "object-server 1824514" 0.0004 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "PUT /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 201 - "POST http://foo:8080/sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx05ba085ae2eb45a6bdde6-0068c5707f" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "POST /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 202 76 "POST http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx05ba085ae2eb45a6bdde6-0068c5707f" "proxy-server 1824514" 0.0158 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "POST /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 202 76 "POST http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx05ba085ae2eb45a6bdde6-0068c5707f" "proxy-server 1824514" 0.0060 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx542807402ce246e39ca15-0068c5707f" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx5cf94b1318524555b4ce4-0068c5707f" "proxy-server 1824514" 0.0071 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "GET /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 200 24 "GET http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx8086f16d9c5043f6921e0-0068c5707f" "proxy-server 1824514" 0.0108 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf1f5dd82d6924bfba010c-0068c5707f" "proxy-server 1824514" 0.0018 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txd1e6c5cad6474226999e3-0068c5707f" "proxy-server 1824514" 0.0090 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 200 24 "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "txdb0cfe3feb9243359a919-0068c5707f" "proxy-server 1824514" 0.0209 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx249053d9b1384be789f18-0068c5707f" "proxy-server 1824514" 0.0294 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txbedcbda0d7a5439da7b88-0068c5707f" "proxy-server 1824514" 0.0015 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "GET /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 200 24 "GET http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx41b4db4e44af47e5ae2be-0068c5707f" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txfc974032228f4695ba61d-0068c5707f" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx1221a03c695f457ab6b46-0068c5707f" "proxy-server 1824514" 0.0144 "-" 1824514 1test.unit.obj.test_ssync_sender.TestSender.test_updates_empty_send_map test.unit.obj.test_ssync_sender.TestSender.test_updates_empty_send_map ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_is_deleted test.unit.obj.test_ssync_sender.TestSender.test_updates_is_deleted ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_post test.unit.obj.test_ssync_sender.TestSender.test_updates_post ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_put test.unit.obj.test_ssync_sender.TestSender.test_updates_put ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_put_and_post test.unit.obj.test_ssync_sender.TestSender.test_updates_put_and_post ... ok test INFO: Object update sweep completed on /tmp/tmpkn56q8zb/devices/sda1 in 0.01s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 1 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 1 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpdmvftdz9/devices/sda1 (pid: 1824519) test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /.shards_a/c_shard_older/o /tmp/tmpdmvftdz9/devices/sda1/async_pending-1/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769855.00000 to .shards_a/c_shard_new test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /.shards_a/c_shard_new/o /tmp/tmpdmvftdz9/devices/sda1/async_pending-1/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769855.00000 to .shards_a/c_shard_newer test INFO: Object update sweep completed on /tmp/tmpdmvftdz9/devices/sda1 in 0.01s seconds:, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 2 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 2 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpdmvftdz9/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /.shards_a/c_shard_newer/o /tmp/tmpdmvftdz9/devices/sda1/async_pending-1/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769855.00000 test INFO: Object update sweep completed on /tmp/tmpdmvftdz9/devices/sda1 in 0.00s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.00s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpw528zq4j/devices/sda1 (pid: 1824519) test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /a/c/o /tmp/tmpw528zq4j/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769856.00000 to .shards_a/c_shard_1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /.shards_a/c_shard_1/o /tmp/tmpw528zq4j/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769856.00000 to .shards_a/c_shard_2 test INFO: Object update sweep completed on /tmp/tmpw528zq4j/devices/sda1 in 0.01s seconds:, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 2 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 2 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpw528zq4j/devices/sda1 (pid: 1824519) test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /.shards_a/c_shard_2/o /tmp/tmpw528zq4j/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769856.00000 to None test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /a/c/o /tmp/tmpw528zq4j/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769856.00000 to .shards_a/c_shard_3 test INFO: Object update sweep completed on /tmp/tmpw528zq4j/devices/sda1 in 0.02s seconds:, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 2 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.02s, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 2 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpw528zq4j/devices/sda1 (pid: 1824519) test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /.shards_a/c_shard_3/o /tmp/tmpw528zq4j/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769856.00000 to .shards_a/c_shard_1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Error code 301 is returned from remote server 127.0.0.1:60789/sda1 test DEBUG: Update redirected for /.shards_a/c_shard_1/o /tmp/tmpw528zq4j/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769856.00000 to None test INFO: Object update sweep completed on /tmp/tmpw528zq4j/devices/sda1 in 0.01s seconds:, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 2 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 2 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpw528zq4j/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c/o /tmp/tmpw528zq4j/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769856.00000 test INFO: Object update sweep completed on /tmp/tmpw528zq4j/devices/sda1 in 0.00s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.00s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpb65r3e_3/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /.shards_a/shard_c/o /tmp/tmpb65r3e_3/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769857.00000 test INFO: Object update sweep completed on /tmp/tmpb65r3e_3/devices/sda1 in 0.02s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.02s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon'test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_updates test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_async_updates ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_disconnect_end test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_disconnect_end ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_disconnect_start test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_disconnect_start ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_timeout_end test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_timeout_end ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Storage-Class': 'STANDARD', 'Content-Md5': 'XUFAKrxLKna5cZ2REBfFkg==', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '5d41402abc4b2a76b9719d911017c592', 'X-Timestamp': '1757769855.54054', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS4-HMAC-SHA256 Credential=test:tester/20250913/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-date, Signature=hmac', 'X-Amz-Date': '20250913T132415Z', 'X-Amz-Storage-Class': 'STANDARD', 'X-Amz-Content-Sha256': '2cf24dba5fb0a30e26e83b2ac5b9e29e1b161e5c1fa7425e73043362938b9824', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.56922', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_v4 test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_v4 ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_v4_bad_hash test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_v4_bad_hash ... ok test.unit.container.test_backend.TestContainerBroker.test_merge_shard_ranges_state test.unit.container.test_backend.TestContainerBroker.test_merge_shard_ranges_state ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_timeout_start test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_timeout_start ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_unexp_end test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_unexp_end ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_unexp_start test.unit.obj.test_ssync_sender.TestSender.test_updates_read_response_unexp_start ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_target test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_target ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_uri test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_uri ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_uri_xml test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_invalid_uri_xml ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_storage_policy_index test.unit.obj.test_ssync_sender.TestSender.test_updates_storage_policy_index ... ok test.unit.container.test_backend.TestContainerBroker.test_newid test.unit.container.test_backend.TestContainerBroker.test_newid ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_timeout test.unit.obj.test_ssync_sender.TestSender.test_updates_timeout ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.28041', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.28221', 'Content-Type': 'binary/octet-stream'} fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 177, in PUT resp = req.get_response(self.app) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2452, in get_response return self.get_acl_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2428, in get_acl_response resp = self._get_response( app, method, container, obj, headers, body, query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Content-Md5': '1B2M2Y8AsgTpgAmY7PhCfg==', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Etag': 'd41d8cd98f00b204e9800998ecf8427e', 'X-Timestamp': '1757769854.28512', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.29517', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.29707', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.30705', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.33289', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.33463', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'X-Amz-Storage-Class': 'STANDARD', 'Content-Md5': 'XUFAKrxLKna5cZ2REBfFkg==', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'Etag': '5d41402abc4b2a76b9719d911017c592', 'X-Timestamp': '1757769854.43016', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_quota_exceeded test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_quota_exceeded ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_v4 test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_v4 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_empty_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_empty_old_style_shard_container ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_unexpected_response_lines1 test.unit.obj.test_ssync_sender.TestSender.test_updates_unexpected_response_lines1 ... ok test.unit.obj.test_ssync_sender.TestSender.test_updates_unexpected_response_lines2 test.unit.obj.test_ssync_sender.TestSender.test_updates_unexpected_response_lines2 ... ok test.unit.proxy.controllers.test_base.TestNodeIter.test_annotate_node_with_use_replication test.unit.proxy.controllers.test_base.TestNodeIter.test_annotate_node_with_use_replication ... ok test.unit.proxy.controllers.test_base.TestNodeIter.test_iter_default_fake_ring test.unit.proxy.controllers.test_base.TestNodeIter.test_iter_default_fake_ring ... ok test.unit.container.test_backend.TestContainerBroker.test_object_stats_old_style_root_container test.unit.container.test_backend.TestContainerBroker.test_object_stats_old_style_root_container ... ok test.unit.proxy.controllers.test_base.TestNodeIter.test_iter_does_not_mutate_supplied_nodes test.unit.proxy.controllers.test_base.TestNodeIter.test_iter_does_not_mutate_supplied_nodes ... ok test.unit.proxy.controllers.test_base.TestNodeIter.test_iter_with_handoffs test.unit.proxy.controllers.test_base.TestNodeIter.test_iter_with_handoffs ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS4-HMAC-SHA256 Credential=test:tester/20250913/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-date, Signature=hmac', 'X-Amz-Date': '20250913T132415Z', 'X-Amz-Storage-Class': 'STANDARD', 'X-Amz-Content-Sha256': '0000000000000000000000000000000000000000000000000000000000000000', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.60204', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS4-HMAC-SHA256 Credential=test:tester/20250913/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-date, Signature=hmac', 'X-Amz-Date': '20250913T132415Z', 'X-Amz-Storage-Class': 'STANDARD', 'X-Amz-Content-Sha256': 'UNSIGNED-PAYLOAD', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.64522', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_v4_unsigned_payload test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_v4_unsigned_payload ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_with_fullcontrol_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_with_fullcontrol_permission ... ok test.unit.proxy.controllers.test_base.TestNodeIter.test_multi_iteration test.unit.proxy.controllers.test_base.TestNodeIter.test_multi_iteration ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:write:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {} fake-swift DEBUG: test:testertest:testertest:writetest:writeWRITE fake-swift DEBUG: permission denined: 403 Forbidden test:write READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_without_src_permission test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_acl_without_src_permission ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_headers_error test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_headers_error ... ok test.unit.container.test_backend.TestContainerBroker.test_object_stats_old_style_shard_container test.unit.container.test_backend.TestContainerBroker.test_object_stats_old_style_shard_container ... ok test.unit.container.test_backend.TestContainerBroker.test_object_stats_root_container test.unit.container.test_backend.TestContainerBroker.test_object_stats_root_container ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.67818', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.72319', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_with_owner_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_with_owner_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_with_write_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_with_write_permission ... ok test.unit.container.test_backend.TestContainerBroker.test_object_stats_shard_container test.unit.container.test_backend.TestContainerBroker.test_object_stats_shard_container ... ok test.unit.container.test_backend.TestContainerBroker.test_old_style_root_account_container_path test.unit.container.test_backend.TestContainerBroker.test_old_style_root_account_container_path ... ok test.unit.container.test_backend.TestContainerBroker.test_overlap_shard_range_order test.unit.container.test_backend.TestContainerBroker.test_overlap_shard_range_order ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift ERROR: 400 Bad Request fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:tester READ permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_read test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_read ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_read_acp test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_read_acp ... ok test.unit.container.test_backend.TestContainerBroker.test_path test.unit.container.test_backend.TestContainerBroker.test_path ... ok test.unit.container.test_backend.TestContainerBroker.test_pending_file_name test.unit.container.test_backend.TestContainerBroker.test_pending_file_name ... ok test INFO: Object update sweep starting on /tmp/tmpb65r3e_3/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c/o /tmp/tmpb65r3e_3/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769858.00000 test INFO: Object update sweep completed on /tmp/tmpb65r3e_3/devices/sda1 in 0.01s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Object update sweep starting on /tmp/tmpb65r3e_3/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c/o /tmp/tmpb65r3e_3/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769859.00000 test INFO: Object update sweep completed on /tmp/tmpb65r3e_3/devices/sda1 in 0.01s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Object update sweep starting on /tmp/tmpb65r3e_3/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c/o /tmp/tmpb65r3e_3/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769860.00000 test INFO: Object update sweep completed on /tmp/tmpb65r3e_3/devices/sda1 in 0.01s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Object update sweep starting on /tmp/tmpb65r3e_3/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c/o /tmp/tmpb65r3e_3/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769861.00000 test INFO: Object update sweep completed on /tmp/tmpb65r3e_3/devices/sda1 in 0.01s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Object update sweep starting on /tmp/tmpb65r3e_3/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c/o /tmp/tmpb65r3e_3/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769862.00000 test INFO: Object update sweep completed on /tmp/tmpb65r3e_3/devices/sda1 in 0.00s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Object update sweep starting on /tmp/tmp4_zxzvii/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c/o /tmp/tmp4_zxzvii/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769857.00000 test INFO: Object update sweep completed on /tmp/tmp4_zxzvii/devices/sda1 in 0.00s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.00s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Object update sweep starting on /tmp/tmp4_zxzvii/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c/o /tmp/tmp4_zxzvii/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769859.00000test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_legacy_updates test.unit.obj.test_updater.TestObjectUpdater.test_obj_put_legacy_updates ... ok test.unit.obj.test_updater.TestObjectUpdater.test_obj_update_gone_missing test.unit.obj.test_updater.TestObjectUpdater.test_obj_update_gone_missing ... ok test.unit.obj.test_updater.TestObjectUpdater.test_obj_update_quarantine test.unit.obj.test_updater.TestObjectUpdater.test_obj_update_quarantine ... ok test.unit.obj.test_updater.TestObjectUpdater.test_object_sweep test.unit.obj.test_updater.TestObjectUpdater.test_object_sweep ... ok test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'X-Amz-Copy-Source-If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'X-Amz-Copy-Source-If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'X-Amz-Copy-Source-If-Modified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-Modified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'X-Amz-Copy-Source-If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'X-Amz-Copy-Source-If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'X-Amz-Copy-Source-If-Modified-Since': 'Fri, 01 Apr 2014 11:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'If-Modified-Since': 'Fri, 01 Apr 2014 11:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_headers_with_match_and_s3acl test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_headers_with_match_and_s3acl ... ok test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_headers_with_not_match_and_s3acl test.unit.common.middleware.s3api.test_multi_upload.TestS3ApiMultiUploadAclNonUTC.test_upload_part_copy_headers_with_not_match_and_s3acl ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_cors_headers test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_cors_headers ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_cors_preflight test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_cors_preflight ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_GET_part_num test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_GET_part_num ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_GET_part_num_and_range test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_GET_part_num_and_range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_GET_part_num_invalid test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_GET_part_num_invalid ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_GET_part_num_not_satisfiable test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_GET_part_num_not_satisfiable ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_HEAD_part_num test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_HEAD_part_num ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_HEAD_part_num_and_range test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_HEAD_part_num_and_range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_HEAD_part_num_invalid test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_HEAD_part_num_invalid ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_HEAD_part_num_not_satisfiable test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_non_slo_object_HEAD_part_num_not_satisfiable ... ok test.unit.container.test_backend.TestContainerBroker.test_policy_stat_tracking test.unit.container.test_backend.TestContainerBroker.test_policy_stat_tracking ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id_GET_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id_GET_error ... ok test.unit.container.test_backend.TestContainerBroker.test_put_misplaced_object_does_not_effect_container_stats test.unit.container.test_backend.TestContainerBroker.test_put_misplaced_object_does_not_effect_container_stats ... ok test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_defer_2_skip_1 test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_defer_2_skip_1 ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespace_caching test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespace_caching ... ok test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_defer_3_skip_1 test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_defer_3_skip_1 ... ok test.unit.container.test_backend.TestContainerBroker.test_put_object test.unit.container.test_backend.TestContainerBroker.test_put_object ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "GET /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 200 24 "GET http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx98954007b34f48a2915a4-0068c5707f" "proxy-server 1824514" 0.0082 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx26413089e1314e8bb2a4f-0068c5707f" "proxy-server 1824514" 0.0132 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txc1d2ae2cde474bb1919cb-0068c5707f" "proxy-server 1824514" 0.0172 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "GET /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 412 - "GET http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx8db05d707a5f49a0bb86e-0068c5707f" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "GET /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 412 - "GET http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx8db05d707a5f49a0bb86e-0068c5707f" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx186a27f841164fa980477-0068c5707f" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx2ba77555eb8748c696acb-0068c5707f" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "GET /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 304 - "GET http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "txa9f0e9ef407c4e0f8ffc6-0068c57080" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9ccb0a355f0b4f2a8b091-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txebdd616520524deabe4e5-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "GET /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 304 - "GET http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "txdaca17d61d1a49feaaa05-0068c57080" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5d5195ba261849d6a4be4-0068c57080" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx1409fe1bc103444bba9f1-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "GET /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 200 24 "GET http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx0693e5ebaae1488b9ead8-0068c57080" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx181313ef9d5d468bb2b08-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txc7cc4f8dd8cf476b8d0dd-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 200 24 "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx56412768e35e4905a359e-0068c57080" "proxy-server 1824514" 0.0108 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5110b495b45c48d59001f-0068c57080" "proxy-server 1824514" 0.0095 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx075fa34e5c9d434aa752f-0068c57080" "proxy-server 1824514" 0.0095 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 200 24 "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx3f28bf3349bd4a0d9f495-0068c57080" "proxy-server 1824514" 0.0126 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf59b2669d3e44b158592b-0068c57080" "proxy-server 1824514" 0.0094 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "tx5922074f9d294139bf152-0068c57080" "proxy-server 1824514" 0.0093 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdc1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 412 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "txa4815f3f325b485dbaa76-0068c57080" "proxy-server 1824514" 0.0088 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 412 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "txa4815f3f325b485dbaa76-0068c57080" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx1f3077676c684f73bbf48-0068c57080" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txa53445b4f6df4c6da7b7e-0068c57080" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 304 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx6b24f765ee5d4c3794cd1-0068c57080" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb725c302b89f4321bd5b7-0068c57080" "proxy-server 1824514" 0.0042 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txd4a8d99b22df4e2682b1a-0068c57080" "proxy-server 1824514" 0.0099 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 304 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx98da7ec4bbc34bd59c1d2-0068c57080" "proxy-server 1824514" 0.0067 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4b496697613b41edb2bae-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 204 - "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1" "txe198f80bccd246558be22-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdd1/2/a/a0007cd4a4864c5696948cd9ddfb54c1/o" 200 24 "HEAD http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1/o" "tx0162c1affb414529b3dd5-0068c57080" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx91fa2d81da88419ca943f-0068c57080" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "GET /sda1/0/a/a0007cd4a4864c5696948cd9ddfb54c1" 200 155 "GET http://foo:8080/v1/a/a0007cd4a4864c5696948cd9ddfb54c1?format=json&states=listing" "tx91fa2d81da88419ca943f-0068c57080" "proxy-server 1824514" 0.0023 "-" 1824514 1test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_put_without_crypto_post_with_crypto_read_with_crypto test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_put_without_crypto_post_with_crypto_read_with_crypto ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.80922', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.83786', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_without_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_object_PUT_without_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_slo_object_DELETE test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_slo_object_DELETE ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_404_response test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_404_response ... ok test.unit.container.test_backend.TestContainerBroker.test_put_object_multiple_encoded_timestamps_using_file test.unit.container.test_backend.TestContainerBroker.test_put_object_multiple_encoded_timestamps_using_file ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:tester READ_ACP permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS4-HMAC-SHA256 Credential=test:tester/20250913/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-date, Signature=hmac', 'X-Amz-Date': '20250913T132414Z', 'X-Amz-Storage-Class': 'STANDARD', 'X-Amz-Content-Sha256': '2cf24dba5fb0a30e26e83b2ac5b9e29e1b161e5c1fa7425e73043362938b9824', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.80831', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS4-HMAC-SHA256 Credential=test:tester/20250913/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-date, Signature=hmac', 'X-Amz-Date': '20250913T132414Z', 'X-Amz-Storage-Class': 'STANDARD', 'X-Amz-Content-Sha256': '0000000000000000000000000000000000000000000000000000000000000000', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769854.84352', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_v4_bad_hash test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_v4_bad_hash ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_v4_unsigned_payload test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_v4_unsigned_payload ... ok test.unit.container.test_backend.TestContainerBroker.test_put_object_multiple_encoded_timestamps_using_memory test.unit.container.test_backend.TestContainerBroker.test_put_object_multiple_encoded_timestamps_using_memory ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_with_both_header_and_canned_acl test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_with_both_header_and_canned_acl ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_with_both_header_and_xml test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_with_both_header_and_xml ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. test.unit.container.test_backend.TestContainerBroker.test_put_object_multiple_explicit_timestamps_using_file test.unit.container.test_backend.TestContainerBroker.test_put_object_multiple_explicit_timestamps_using_file ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_and_override_headers test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_and_override_headers ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_bad_response_body test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_bad_response_body ... ok test.unit.container.test_backend.TestContainerBroker.test_put_object_multiple_explicit_timestamps_using_memory test.unit.container.test_backend.TestContainerBroker.test_put_object_multiple_explicit_timestamps_using_memory ... ok test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_some_limited test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_some_limited ... ok test.unit.container.test_backend.TestContainerBroker.test_reclaim test.unit.container.test_backend.TestContainerBroker.test_reclaim ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_cache_unused_recheck_listing_shard_ranges test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_cache_unused_recheck_listing_shard_ranges ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_slo_object_async_DELETE test.unit.common.middleware.s3api.test_obj.TestS3ApiObjNonUTCAcl.test_slo_object_async_DELETE ... ok test.unit.common.middleware.s3api.test_s3response.TestErrorResponse.test_error_response test.unit.common.middleware.s3api.test_s3response.TestErrorResponse.test_error_response ... ok test.unit.common.middleware.s3api.test_s3response.TestErrorResponse.test_error_response_trans_id test.unit.common.middleware.s3api.test_s3response.TestErrorResponse.test_error_response_trans_id ... ok test.unit.common.middleware.s3api.test_utils.TestConfig.test_defaults test.unit.common.middleware.s3api.test_utils.TestConfig.test_defaults ... ok test.unit.common.middleware.s3api.test_utils.TestConfig.test_set_get_delete test.unit.common.middleware.s3api.test_utils.TestConfig.test_set_get_delete ... ok test.unit.common.middleware.s3api.test_utils.TestConfig.test_update test.unit.common.middleware.s3api.test_utils.TestConfig.test_update ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_count_quota_copy_from_bad_src test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_count_quota_copy_from_bad_src ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_exceed_bytes_count_quota_copy_from test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_exceed_bytes_count_quota_copy_from ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_exceed_bytes_count_quota_copy_verb test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_exceed_bytes_count_quota_copy_verb ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_exceed_bytes_quota_copy_from test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_exceed_bytes_quota_copy_from ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_exceed_bytes_quota_copy_verb test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_exceed_bytes_quota_copy_verb ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_not_exceed_bytes_count_quota_copy_from test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_not_exceed_bytes_count_quota_copy_from ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_not_exceed_bytes_count_quota_copy_verb test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_not_exceed_bytes_count_quota_copy_verb ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_not_exceed_bytes_quota_copy_from test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_not_exceed_bytes_quota_copy_from ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_not_exceed_bytes_quota_copy_verb test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_not_exceed_bytes_quota_copy_verb ... ok test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_quota_copy_from_bad_src test.unit.common.middleware.test_account_quotas.AccountQuotaCopyingTestCases.test_quota_copy_from_bad_src ... ok test.unit.common.middleware.test_dlo.TestDloConfiguration.test_finding_defaults_from_dir test.unit.common.middleware.test_dlo.TestDloConfiguration.test_finding_defaults_from_dir ... ok test.unit.common.middleware.test_dlo.TestDloConfiguration.test_finding_defaults_from_file test.unit.common.middleware.test_dlo.TestDloConfiguration.test_finding_defaults_from_file ... ok test.unit.common.middleware.test_dlo.TestDloConfiguration.test_skip_defaults_if_configured test.unit.common.middleware.test_dlo.TestDloConfiguration.test_skip_defaults_if_configured ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_next_response_first test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_next_response_first ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_next_response_is_last_response_wins test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_next_response_is_last_response_wins ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_next_response_keeps_current_registered_response test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_next_response_keeps_current_registered_response ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_resets test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_resets ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_response_is_forever test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_response_is_forever ... ok test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_response_is_last_response_wins test.unit.common.middleware.test_helpers.TestFakeSwiftMultipleResponses.test_register_response_is_last_response_wins ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestAccountOperations.test_list_containers test.unit.common.middleware.test_object_versioning.ObjectVersioningTestAccountOperations.test_list_containers ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestAccountOperations.test_list_containers_prefix test.unit.common.middleware.test_object_versioning.ObjectVersioningTestAccountOperations.test_list_containers_prefix ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestAccountOperations.test_list_orphan_hidden_containers test.unit.common.middleware.test_object_versioning.ObjectVersioningTestAccountOperations.test_list_orphan_hidden_containers ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_COPY_overwrite_object test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_COPY_overwrite_object ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_COPY_overwrite_tombstone test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_COPY_overwrite_tombstone ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_COPY_overwrite_version_symlink test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_COPY_overwrite_version_symlink ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_copy_new_version_different_account test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_copy_new_version_different_account ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_copy_object_versioning_disabled test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCopy.test_copy_object_versioning_disabled ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_access_log_headers_only test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_access_log_headers_only ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_access_user_id_field test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_access_user_id_field ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_access_user_id_field_with_anonymization test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_access_user_id_field_with_anonymization ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_app_exception test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_app_exception ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_basic_error test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_basic_error ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_basic_req test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_basic_req ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_basic_req_second_time test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_basic_req_second_time ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_body_iter_updates_environ_proxy_logging_status test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_body_iter_updates_environ_proxy_logging_status ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_chunked_response test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_chunked_response ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_client_logging test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_client_logging ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_conf_statsd_emit_legacy test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_conf_statsd_emit_legacy ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_conf_statsd_label_mode test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_conf_statsd_label_mode ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_disconnect_on_read test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_disconnect_on_read ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_disconnect_on_readline test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_disconnect_on_readline ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_dual_logging_middlewares test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_dual_logging_middlewares ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_dual_logging_middlewares_w_inner test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_dual_logging_middlewares_w_inner ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_ensure_fields test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_ensure_fields ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_environ_has_proxy_logging_status test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_environ_has_proxy_logging_status ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_environ_has_proxy_logging_status_and_app_explodes test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_environ_has_proxy_logging_status_and_app_explodes ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_environ_has_proxy_logging_status_and_body_explodes test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_environ_has_proxy_logging_status_and_body_explodes ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_environ_has_proxy_logging_status_unread_body test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_environ_has_proxy_logging_status_unread_body ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_exploding_body test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_exploding_body ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_facility test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_facility ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_filter test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_filter ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_init_labeled_statsd_options_access_log_prefix test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_init_labeled_statsd_options_access_log_prefix ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_init_labeled_statsd_options_log_prefix test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_init_labeled_statsd_options_log_prefix ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_init_statsd_options_user_labels test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_init_statsd_options_user_labels ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_invalid_log_config test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_invalid_log_config ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_ipv6 test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_ipv6 ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_iterator_closing test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_iterator_closing ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_auth_token test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_auth_token ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_headers test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_headers ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_info_multiple test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_info_multiple ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_info_none test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_info_none ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_cache_write_for_incomplete_listing test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_cache_write_for_incomplete_listing ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_empty_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_empty_old_style_shard_container ... ok test-ssync-sender ERROR: 1.2.3.4:5678/sda1/9 EXCEPTION in ssync.Sender: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/ssync_sender.py", line 185, in __call__ connection, response = self.connect() ~~~~~~~~~~~~^^ TypeError: 'str' object is not callable test-ssync-sender ERROR: 1.2.3.4:5678/sda1/9 Expected status 200; got 503 (an error message) test-ssync-sender WARNING: ssync receiver 1.2.3.4:5678 does not accept non-durable fragments test-ssync-sender ERROR: 1.2.3.4:5678/sda1/9 0.02 seconds: connect receive test-ssync-sender ERROR: 1.2.3.4:5678/sda1/9 0.01 seconds: connect send test-ssync-sender INFO: ssync missing_check truncated after 2 objects: device: dev, part: 9, policy: 0, last object hash: 9d41d8cd98f00b204e9800998ecf0def test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test WARNING: Handoff requested (9) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx82f9edf92d0f4e9e857e4-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txcf60c9260a9a445fb57b5-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx5c07a3cb3cba47dd9f92f-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx6464e5d7f85e470b83c16-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx22660338b008459bbb5c3-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txb860198fa042418bbbbd9-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx6bf92d62ed99408abbb7d-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx354f0e4816ff4da385f14-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx384a69f8ace74c5aa8e2d-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx8e5abfed404249f08b685-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txc76d6a01e4c44a7ababac-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txcc09b47f67b741238ecd4-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txb44f9da991ba4092a869b-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx43b9def3f437470ab0c14-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx8dac2b0e37b34615bc32c-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx30b9b73d66e646d9b95e0-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx50f5c07471364f4ebaf52-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx25ff899c59af4b44851b6-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx64797143cbd14f3a80e4f-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx0915eca150144e548e1d3-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txaf3e2ca1692f4884abd82-0068c57080) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txc4438e1d019b431483869-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txb3d1334fdf0841bfa8ad9-0068c57080) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txd7a8098a392f4b84a01dc-0068c57080) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: Problem with container shard listing response from /v1/a/c?states=listing&format=json: ValueError('not a list') (txn: txe6ad9e0fc7a744d7ac0a7-0068c57080) test ERROR: Failed to get namespaces from /v1/a/c?states=listing&format=json: invalid data: KeyError('name') (txn: txfff5ddd7d86e478dae054-0068c57080) test ERROR: Problem with container shard listing response from /v1/a/c?states=listing&format=json: ValueError('not a list') (txn: txdc7402817fe14525a7997-0068c57080) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_cache_write_for_non_sharded_states test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_cache_write_for_non_sharded_states ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'X-Amz-Copy-Source-If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'X-Amz-Copy-Source-If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: checking permission: src_bucket src_obj HEAD {'If-None-Match': '7dfa07a8e59ddbcd1dc84d4c4f82aea1', 'If-Unmodified-Since': 'Fri, 01 Apr 2014 12:00:00 GMT'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 261, in DELETE new_resp = self._restore_on_delete(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 195, in _restore_on_delete resp = req.get_response(self.app, 'GET', req.container_name, '', query={'prefix': req.object_name, 'versions': True}) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 261, in DELETE new_resp = self._restore_on_delete(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 207, in _restore_on_delete resp = req.get_response(self.app, 'PUT', query={ 'version-id': item['version_id']}) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500)test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id_PUT_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id_PUT_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id_is_delete_marker test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id_is_delete_marker ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id_is_missing test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_current_version_id_is_missing ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_in_versioned_container_with_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_in_versioned_container_with_version_id ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_in_versioned_container_without_version test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_in_versioned_container_without_version ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_missing test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_missing ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_multipart test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_multipart ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_no_multipart test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_no_multipart ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_old_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_old_version_id ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_version_id_not_implemented test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_version_id_not_implemented ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_with_version_id_but_not_enabled test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_DELETE_with_version_id_but_not_enabled ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_Range test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_Range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_Range_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_Range_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_Response test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_Response ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_version_id test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_version_id ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_version_id_not_implemented test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_version_id_not_implemented ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_with_version_id_but_not_enabled test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_GET_with_version_id_but_not_enabled ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_HEAD test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_HEAD ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_HEAD_Range test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_HEAD_Range ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_HEAD_Range_with_invalid_value test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_HEAD_Range_with_invalid_value ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_HEAD_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_HEAD_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_POST_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_POST_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_bad_hash test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_bad_hash ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_headers_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_headers_error ... ok swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. swift: Using crc32c_kern implementation for CRC32C. swift: No implementation found for CRC64NVME; install ISA-L or anycrc for support. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:14 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS4-HMAC-SHA256 Credential=test:tester/20250913/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-date, Signature=hmac', 'X-Amz-Date': '20250913T132415Z', 'X-Amz-Storage-Class': 'STANDARD', 'X-Amz-Content-Sha256': 'UNSIGNED-PAYLOAD', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.09748', 'Content-Length': '5', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.12446', 'Content-Type': 'binary/octet-stream'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_with_fullcontrol_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_with_owner_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_with_owner_permission ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_cache_write_for_object_listing test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_cache_write_for_object_listing ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_headers_with_match test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_headers_with_match ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_headers_with_not_match test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_headers_with_not_match ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_metadata_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_metadata_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_metadata_replace test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_metadata_replace ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_self test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_self ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_self_metadata_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_self_metadata_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_self_metadata_replace test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_copy_self_metadata_replace ... ok test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_unlimited test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_unlimited ... ok fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:tester WRITE permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_write test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_write ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.26865', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.29104', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_with_write_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_with_write_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_write_acp test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_grant_write_acp ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_cache_write_with_cached_container_info test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_cache_write_with_cached_container_info ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - First:%201%0ASecond:%202 0.0001 - - 1757769856.387472630 1757769856.387571812 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.389487505 1757769856.389583826 - test:tester test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.390303135 1757769856.390373468 - - test INFO: GET / {SMD5}14fe1612c332096e282486e4baa37e63 test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 500 - - - - - - - - 0.0000 - - 1757769856.402391434 1757769856.402400732 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/17 GET /path HTTP/1.0 503 - - - - 118 - - - 0.7000 - - 1757769856.403391838 1757769857.103391886 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.405164003 1757769856.405246258 - - test INFO: GET /v1/a/c 205 205 test INFO: GET /v1/a/c 209 205 test INFO: GET /v1/a/c 210 205 test INFO: 1.2.3.4 1.2.3.4 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.453093529 1757769856.453176022 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 499 - - - - - - - - 0.0000 - - 1757769856.469619513 1757769856.469645739 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 499 - - - - - - - - 0.0000 - - 1757769856.482894182 1757769856.482911825 - - test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.484091759 1757769856.484173536 - - test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.485154152 1757769856.485225201 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 15 - - - 0.0004 - - 1757769856.485141277 1757769856.485503912 - - test INFO: - - 26/Apr/1970/17/46/41 GET / HTTP/1.0 200 - - - - 8 - - - 1.0000 - - 10000000.000000000 10000001.000000000 - - test INFO: GET /v1/a/c 503 503 test INFO: GET /v1/a/c 429 503 test INFO: GET /v1/a/c 429 503 test INFO: GET /v1/a/c - 503 test INFO: GET /v1/a/c - 503 test INFO: GET /v1/a/c True 503 test INFO: GET /v1/a/c - 503 test INFO: GET /v1/a/c parsing%20ok 503 test INFO: GET /v1/a/c 500 500 test INFO: GET /v1/a/c 500 568 test INFO: GET /v1/a/c 499 503 test INFO: GET /v1/a/c 499 503 test INFO: GET / 500 200 test INFO: 2001:db8:85a3:8d3:1319:8a2e:370:7348 2001:db8:85a3:8d3:1319:8a2e:370:7348 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.598447561 1757769856.598541498 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.617220640 1757769856.617303371 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - b05bf940-0464-4c... - 8 - - - 0.0001 - - 1757769856.618006229 1757769856.618076563 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.630969763 1757769856.631075621 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - b05bf940... - 8 - - - 0.0001 - - 1757769856.631935120 1757769856.632012367 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - b05bf940-0464-4c0e-8c70-87717d2d73e8 - 8 - - - 0.0001 - - 1757769856.632702827 1757769856.632793188 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - b05bf940-0464-4c0e-8c70-87717d2d73e8 - 8 - - - 0.0001 - - 1757769856.634107113 1757769856.634191036 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.647183180 1757769856.647285700 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - ... - 8 - - - 0.0001 - - 1757769856.648112535 1757769856.648191214 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - Host:%20localhost:80 0.0001 - - 1757769856.649046421 1757769856.649117708 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - Host:%20localhost:80 0.0000 - - 1757769856.649528027 1757769856.649576426 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0122 - one%2Cand%20two 1757769856.650615692 1757769856.662809610 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.664126873 1757769856.664211750 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.664976358 1757769856.665051460 - - test INFO: - - 13/Sep/2025/13/24/16 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - one 1757769856.666098595 1757769856.666169167 - -test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_memcache_available test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_no_memcache_available ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_info_single test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_info_single ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_msg_template test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_msg_template ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_msg_template_s3api test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_msg_template_s3api ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_query_string test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_query_string ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_method_filtering_custom test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_method_filtering_custom ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_method_filtering_default test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_method_filtering_default ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_bad_GET test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_bad_GET ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: skipping failed PUT?version-id=1574341899.21751 fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 249, in DELETE resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 156, in GET return self.GETorHEAD(req) ~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 109, in GETorHEAD resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 143, in HEAD resp = self.GETorHEAD(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 109, in GETorHEAD resp = req.get_response(self.app, query=query) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500) fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/obj.py", line 177, in PUT resp = req.get_response(self.app) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500)test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_error test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_error ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_headers test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_headers ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_quota_exceeded test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_quota_exceeded ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_v4 test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_v4 ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_v4_bad_hash test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_v4_bad_hash ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_v4_unsigned_payload test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_v4_unsigned_payload ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_with_version test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_PUT_with_version ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_policy_index_logging test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_object_policy_index_logging ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_simple_object_copy test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_simple_object_copy ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_slo_object_DELETE test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_slo_object_DELETE ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_slo_object_async_DELETE test.unit.common.middleware.s3api.test_obj.TestS3ApiObj.test_slo_object_async_DELETE ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_all_users test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_all_users ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_authenticated_read test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_authenticated_read ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_authenticated_users test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_authenticated_users ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_bucket_owner_full_control test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_bucket_owner_full_control ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_bucket_owner_read test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_bucket_owner_read ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_canonical_user test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_canonical_user ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_elem test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_elem ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_from_elem test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_from_elem ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_from_elem_by_id_only test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_from_elem_by_id_only ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_private test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_private ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_public_read test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_public_read ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_public_read_write test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_acl_public_read_write ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_base_grantee test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_base_grantee ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_canned_acl_grantees test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_canned_acl_grantees ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_container test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_container ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_empty_list test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_empty_list ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_object test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_object ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_undefined test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_undefined ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_with_invalid_json test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_decode_acl_with_invalid_json ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_encode_acl_container test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_encode_acl_container ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_encode_acl_many_grant test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_encode_acl_many_grant ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_encode_acl_object test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_encode_acl_object ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_from_headers_x_amz_acl test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_from_headers_x_amz_acl ... ok test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_from_headers_x_amz_acl_invalid test.unit.common.middleware.s3api.test_subresource.TestS3ApiSubresource.test_from_headers_x_amz_acl_invalid ... ok test.unit.common.middleware.test_cname_lookup.TestSwiftInfo.test_registered_defaults test.unit.common.middleware.test_cname_lookup.TestSwiftInfo.test_registered_defaults ... ok test.unit.common.middleware.test_cname_lookup.TestSwiftInfo.test_registered_nondefaults test.unit.common.middleware.test_cname_lookup.TestSwiftInfo.test_registered_nondefaults ... ok test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_blank_plus_other_reseller test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_blank_plus_other_reseller ... ok test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_blank_reseller test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_blank_reseller ... ok test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_default test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_default ... ok test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_multiple_resellers test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_multiple_resellers ... ok test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_same_as_default test.unit.common.middleware.test_keystoneauth.PrefixAccount.test_same_as_default ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_bytes_count test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_bytes_count ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_container_listing_translation test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_container_listing_translation ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_404_versions_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_404_versions_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_delete_markers test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_delete_markers ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_delimiter test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_delimiter ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_empty_primary test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_empty_primary ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_empty_versions_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_empty_versions_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_error_versions_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_error_versions_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_invalid_delimiter test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_invalid_delimiter ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_marker test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_marker ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_marker_missing_marker test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_marker_missing_marker ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_never_enabled test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_never_enabled ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_unversioned test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_list_versions_unversioned ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_listing_translation_utf8 test.unit.common.middleware.test_object_versioning.ObjectVersioningTestContainerOperations.test_listing_translation_utf8 ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_get_with_if_modified_since test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_get_with_if_modified_since ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches_alternate_etag_non_slo test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches_alternate_etag_non_slo ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches_alternate_etag_non_slo_after_refetch test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches_alternate_etag_non_slo_after_refetch ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches_and_range test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_matches_and_range ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches_alternate_etag_non_slo test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches_alternate_etag_non_slo ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches_alternate_etag_non_slo_after_refetch test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches_alternate_etag_non_slo_after_refetch ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches_manifest_json_md5 test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_match_mismatches_manifest_json_md5 ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_modified_since_ancient_date test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_modified_since_ancient_date ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_modified_since_last_modified test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_modified_since_last_modified ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_modified_since_now test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_modified_since_now ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_matches test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_matches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_matches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_matches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_matches_no_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_matches_no_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_mismatches test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_mismatches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_mismatches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_mismatches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_mismatches_json_md5 test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_none_match_mismatches_json_md5 ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_unmodified_since_ancient_date test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_unmodified_since_ancient_date ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_unmodified_since_last_modified test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_unmodified_since_last_modified ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_unmodified_since_now test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_if_unmodified_since_now ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_matches test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_matches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_matches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_matches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_mismatches test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_mismatches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_mismatches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_mismatches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_mismatches_alternate_etag_miss test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_mismatches_alternate_etag_miss ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_mismatches_without_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_match_mismatches_without_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_none_match_matches test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_none_match_matches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_none_match_matches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_none_match_matches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_none_match_mismatches test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_none_match_mismatches ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_none_match_mismatches_alternate_etag test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_manifest_get_if_none_match_mismatches_alternate_etag ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_old_swift_if_match_matches_and_range test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_old_swift_if_match_matches_and_range ... ok test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_range_resume_download test.unit.common.middleware.test_slo.TestSloConditionalGetOldManifest.test_range_resume_download ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_read_from_cache test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_read_from_cache ... ok test.unit.common.middleware.test_staticweb.TestStaticWebUrlBase.test_container3subdirz_both test.unit.common.middleware.test_staticweb.TestStaticWebUrlBase.test_container3subdirz_both ... ok test.unit.common.middleware.test_staticweb.TestStaticWebUrlBase.test_container3subdirz_host test.unit.common.middleware.test_staticweb.TestStaticWebUrlBase.test_container3subdirz_host ... ok test.unit.common.middleware.test_staticweb.TestStaticWebUrlBase.test_container3subdirz_scheme test.unit.common.middleware.test_staticweb.TestStaticWebUrlBase.test_container3subdirz_scheme ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_read_from_cache_empty_list test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_read_from_cache_empty_list ... ok test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_authed_for_path_single test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_authed_for_path_single ... ok test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_authed_for_primary_path_multiple test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_authed_for_primary_path_multiple ... ok test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_authed_for_second_path_with_operator_role_and_service test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_authed_for_second_path_with_operator_role_and_service ... ok test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_delete_denied_for_second_path test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_delete_denied_for_second_path ... ok test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_delete_of_second_path_by_reseller_admin test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_delete_of_second_path_by_reseller_admin ... ok test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_denied_for_path_single test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_denied_for_path_single ... ok test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_denied_for_second_path_for_service_user test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_denied_for_second_path_for_service_user ... ok test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_denied_for_second_path_with_only_operator_role test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_denied_for_second_path_with_only_operator_role ... ok test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_denied_for_second_path_with_only_service test.unit.common.middleware.test_tempauth.ServiceTokenFunctionality.test_denied_for_second_path_with_only_service ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_account_delete_permissions test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_account_delete_permissions ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_account_put_permissions test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_account_put_permissions ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_admin_is_owner test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_admin_is_owner ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_anon test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_anon ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_anon_badpath test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_anon_badpath ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_deny_non_reseller_prefix test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_deny_non_reseller_prefix ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_deny_non_reseller_prefix_no_override test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_deny_non_reseller_prefix_no_override ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_fail test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_fail ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_no_reseller_prefix_deny test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_no_reseller_prefix_deny ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_no_reseller_prefix_no_token test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_no_reseller_prefix_no_token ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_prefix_init test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_prefix_init ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_reseller_prefix_with_s3_deny test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_reseller_prefix_with_s3_deny ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_scheme test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_scheme ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_old_s3api_details test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_old_s3api_details ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_old_swift3_details test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_old_swift3_details ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_s3api_authorization_good test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_s3api_authorization_good ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_s3api_authorization_invalid test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_s3api_authorization_invalid ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_s3api_unicode_authorization_good test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_s3api_unicode_authorization_good ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_swift3_authorization_good test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_swift3_authorization_good ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_swift3_authorization_invalid test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_auth_with_swift3_authorization_invalid ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_account_access test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_account_access ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_acl_group_access test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_acl_group_access ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_acl_referer_after_user_groups test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_acl_referer_after_user_groups ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_acl_referrer_access test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_acl_referrer_access ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_bad_path test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_authorize_bad_path ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift DEBUG: Calling S3Api Middleware fake-swift INFO: - - 13/Sep/2025/13/24/16 GET /bucket/object HTTP/1.0 200 - Mozzarella%20Foxfire - - 5 - - - 0.0009 - - 1757769856.617046595 1757769856.617940187 1 test:tester fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift DEBUG: Calling S3Api Middleware fake-swift INFO: - - 13/Sep/2025/13/24/16 GET /bucket/object HTTP/1.0 200 - Mozzarella%20Foxfire - - 5 - - - 0.0171 - - 1757769856.618538857 1757769856.635616779 0 test:tester fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware ERROR: swift.cache could not be found in env! test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_compressed_fernet_token_no_memcache test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_compressed_fernet_token_no_memcache ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_deny_cross_reseller test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_deny_cross_reseller ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_detect_reseller_request test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_detect_reseller_request ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_read_from_cache_error test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_read_from_cache_error ... ok ERROR: swift.cache could not be found in env! ERROR: swift.cache could not be found in env! test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_fernet_token_no_memcache test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_fernet_token_no_memcache ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail_bad_path test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail_bad_path ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail_invalid_x_auth_user_format test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail_invalid_x_auth_user_format ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail_missing_key test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail_missing_key ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail_non_matching_account_in_request test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_fail_non_matching_account_in_request ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_memcache_error test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_memcache_error ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_sets_access_logging_user_id test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_sets_access_logging_user_id ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_success test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_success ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_success_other_auth_prefix test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_token_success_other_auth_prefix ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_user_group test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_get_user_group ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_object_name_containing_slash test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_object_name_containing_slash ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_old_token_overdate test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_old_token_overdate ... ok test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='rhubarb', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9959&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1065 (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Setting object count to 1065 (txn: tx4bea1cac1c844dd7a20f4-0068c5707a) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx19210555508c41cd89b93-0068c5707c) test DEBUG: GET listing from 0 shards for: /v1/a/c?marker=bb&end_marker=aa&format=json&states=listing (txn: tx19210555508c41cd89b93-0068c5707c) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'auto'} (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=10000&marker=&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test DEBUG: Found 1 objects in shard (state=unsharded), total = 1 (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_c', lower='b', upper='c') .shards_a/c_c with {'X-Backend-Record-Type': 'auto'} (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test DEBUG: Get listing from /v1/.shards_a/c_c?format=json&limit=9999&marker=b&end_marker=c%00 {'X-Backend-Record-Type': 'auto'} (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test DEBUG: Found 1 objects in shard (state=unsharded), total = 2 (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='c', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9998&marker=c&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.2:1002/sdc (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.1:1001/sdb (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.0:1000/sda (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.3:1003/sda (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.4:1004/sda (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.5:1005/sda (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test ERROR: Container GET returning 503 for [503, 503, 503, 503, 503, 503] (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_?format=json&limit=9998&marker=c&end_marker=&states=listing: 503 (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test ERROR: Aborting listing from shards due to bad response: [200, 200, 503] (txn: tx8f247f12f9ad47ca9e903-0068c5707f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 1 shards for: /v1/a/c?format=json&states=listing (txn: tx340c22f6b4984208b50c9-0068c5707f) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_pie', lower='', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx340c22f6b4984208b50c9-0068c5707f) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx340c22f6b4984208b50c9-0068c5707f) test ERROR: Aborting listing from shards due to bad shard policy index: 0 (expected 1) (txn: tx340c22f6b4984208b50c9-0068c5707f) test DEBUG: GET listing from 1 shards for: /v1/a/c?format=json&states=listing (txn: tx1e3099b991c74b608f23f-0068c5707f) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_pie', lower='', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx1e3099b991c74b608f23f-0068c5707f) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx1e3099b991c74b608f23f-0068c5707f) test ERROR: Aborting listing from shards due to bad shard policy index: None (expected 1) (txn: tx1e3099b991c74b608f23f-0068c5707f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx07c64b42562540468d426-0068c57080" "proxy-server 1824514" 0.0097 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdb1/1/a/f9fbdc9d97a74f22933686890923b3a0" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/f9fbdc9d97a74f22933686890923b3a0" "tx07c64b42562540468d426-0068c57080" "container-server 1824514" 0.0010 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sda1/1/a/f9fbdc9d97a74f22933686890923b3a0" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/f9fbdc9d97a74f22933686890923b3a0" "tx07c64b42562540468d426-0068c57080" "container-server 1824514" 0.0010 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdb1/3/a/f9fbdc9d97a74f22933686890923b3a0" 201 - "PUT http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0" "tx07c64b42562540468d426-0068c57080" "proxy-server 1824514" 0.0265 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sda1/3/a/f9fbdc9d97a74f22933686890923b3a0" 201 - "PUT http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0" "tx07c64b42562540468d426-0068c57080" "proxy-server 1824514" 0.0152 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7a58e97b8f1249adbcc48-0068c57080" "proxy-server 1824514" 0.0060 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/3/a/f9fbdc9d97a74f22933686890923b3a0" 204 - "HEAD http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0" "tx7a58e97b8f1249adbcc48-0068c57080" "proxy-server 1824514" 0.0095 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txcd8b815a229f4447a3fe9-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/3/a/f9fbdc9d97a74f22933686890923b3a0" 204 - "HEAD http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0" "tx4cdb79c00aa94458ae82d-0068c57080" "proxy-server 1824514" 0.0011 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdb1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 201 - "PUT http://foo:8080/sdd1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" "tx16d1cf8964f74905822f7-0068c57080" "object-server 1824514" 0.0005 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sda1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 201 - "PUT http://foo:8080/sdc1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" "tx16d1cf8964f74905822f7-0068c57080" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdc1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 201 - "PUT http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0/o" "tx16d1cf8964f74905822f7-0068c57080" "proxy-server 1824514" 0.0457 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdd1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 201 - "PUT http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0/o" "tx16d1cf8964f74905822f7-0068c57080" "proxy-server 1824514" 0.0370 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx094d5575f24e4d8091f26-0068c57080" "proxy-server 1824514" 0.0022 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/3/a/f9fbdc9d97a74f22933686890923b3a0" 204 - "HEAD http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0" "tx5a93291d2d42463da5d8f-0068c57080" "proxy-server 1824514" 0.0097 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "GET /sdc1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 200 24 "GET http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0/o" "tx233771338ae945cbb3fa2-0068c57080" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txce860553b7ca4d919722d-0068c57080" "proxy-server 1824514" 0.0128 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "GET /sdb1/3/a/f9fbdc9d97a74f22933686890923b3a0" 200 350 "GET http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0?format=json&states=listing" "txce860553b7ca4d919722d-0068c57080" "proxy-server 1824514" 0.0078 "-" 1824514 1 proxy INFO: Client disconnected on read of '/a/f9fbdc9d97a74f22933686890923b3a0/o' (txn: txce860553b7ca4d919722d-0068c57080) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc2f3a1eef50a4020966e1-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/3/a/f9fbdc9d97a74f22933686890923b3a0" 204 - "HEAD http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0" "txa7493b11668c4337aa94b-0068c57080" "proxy-server 1824514" 0.0014 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sda1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 201 - "PUT http://foo:8080/sdc1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" "txafb61807b42842898b2f5-0068c57080" "object-server 1824514" 0.0004 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdb1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 201 - "PUT http://foo:8080/sdd1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" "txafb61807b42842898b2f5-0068c57080" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdd1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 201 - "PUT http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0/o" "txafb61807b42842898b2f5-0068c57080" "proxy-server 1824514" 0.0308 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdc1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 201 - "PUT http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0/o" "txafb61807b42842898b2f5-0068c57080" "proxy-server 1824514" 0.0448 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txfc2863ac630b4563a2cf3-0068c57080" "proxy-server 1824514" 0.0073 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/3/a/f9fbdc9d97a74f22933686890923b3a0" 204 - "HEAD http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0" "txe816865d4d2b4961ae972-0068c57080" "proxy-server 1824514" 0.0150 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "GET /sdd1/3/a/f9fbdc9d97a74f22933686890923b3a0/o" 200 24 "GET http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0/o" "tx84fa1a8e65ef4cbfa4b31-0068c57080" "proxy-server 1824514" 0.0085 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx23adb737c12046e1ae470-0068c57080" "proxy-server 1824514" 0.0094 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "GET /sda1/3/a/f9fbdc9d97a74f22933686890923b3a0" 200 350 "GET http://foo:8080/v1/a/f9fbdc9d97a74f22933686890923b3a0?format=json&states=listing" "tx23adb737c12046e1ae470-0068c57080" "proxy-server 1824514" 0.0137 "-" 1824514 1 proxy INFO: Client disconnected on read of '/a/f9fbdc9d97a74f22933686890923b3a0/o' (txn: tx23adb737c12046e1ae470-0068c57080) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx65916b5129ef47849b8e3-0068c57080" "proxy-server 1824514" 0.0038 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sda1/1/a/beb593b9a7844bd397988fa0225e5471" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/beb593b9a7844bd397988fa0225e5471" "tx65916b5129ef47849b8e3-0068c57080" "container-server 1824514" 0.0013 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdb1/1/a/beb593b9a7844bd397988fa0225e5471" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/beb593b9a7844bd397988fa0225e5471" "tx65916b5129ef47849b8e3-0068c57080" "container-server 1824514" 0.0012 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 201 - "PUT http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "tx65916b5129ef47849b8e3-0068c57080" "proxy-server 1824514" 0.0482 "-" 1824514 1test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_old_token_with_old_data test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_old_token_with_old_data ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769855.60693', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_without_permission test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_object_PUT_without_permission ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_slo_object_DELETE test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_slo_object_DELETE ... ok test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_slo_object_async_DELETE test.unit.common.middleware.s3api.test_obj.TestS3ApiObjAcl.test_slo_object_async_DELETE ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_options_call test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_options_call ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_override_asked_for_and_allowed test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_override_asked_for_and_allowed ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_override_asked_for_but_not_allowed test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_override_asked_for_but_not_allowed ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_override_default_allowed test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_override_default_allowed ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_regular_is_not_owner test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_regular_is_not_owner ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_request_method_not_allowed test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_request_method_not_allowed ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:tester WRITE_ACP permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_invalid_canned_acl test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_invalid_canned_acl ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_GET_with_fullcontrol_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_GET_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_GET_with_owner_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_GET_with_owner_permission ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_write_to_cache test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_write_to_cache ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_reseller_admin_is_owner test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_reseller_admin_is_owner ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_reseller_prefix_init test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_reseller_prefix_init ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_statsd_prefix test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_statsd_prefix ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_storage_url_based_on_host test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_storage_url_based_on_host ... ok test INFO: template which can be edited in config: HTTP/1.0 / GET {SMD5}c65475e457fea0951fbb9ec9596b2177 - 1.0000 26/Apr/1970/17/46/40 10000001.000000000 0.5 example.com test DEBUG: Labeled statsd mode: disabled (test) test INFO: HTTP/1.0 /bucket/path/to/key GET AUTH_test bucket path/to/key test INFO: - - 13/Sep/2025/13/24/16 GET /%3Fx%3D3 HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769856.682202101 1757769856.682279348 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 foo /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 - /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 PUTT /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 SPECIAL /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 GET /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 PUT /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 COPY /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 foo /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 - /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 PUTT /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 SPECIAL /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 GET /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 PUT /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 COPY /v1/a/c HTTP/1.0 911 - - - 4 43 - - - 1.0100 - - 10000.000000000 10001.010000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 foo /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 - /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 PUTT /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 SPECIAL /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 GET /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 PUT /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 COPY /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 HEAD /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 POST /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 DELETE /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/02/46/41 OPTIONS /v1/a/ HTTP/1.0 299 - - - 11 3 - - - 1.1700 - - 10000.000000000 10001.170000000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET - HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET / HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /bad HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /baddy/mc_badderson HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /v1 HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /v1/ HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0 HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/ HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0// HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0//c HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a// HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a//o HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o/p HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o/p/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o/p/p2 HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 -test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_storage_url_default test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_storage_url_default ... ok test INFO: Object update sweep completed on /tmp/tmp4_zxzvii/devices/sda1 in 0.01s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Object update sweep starting on /tmp/tmp9l_x9vsp/devices/sda1 (pid: 1824519) test ERROR: ERROR Pickle problem, quarantining /tmp/tmp9l_x9vsp/devices/sda1/async_pending-1/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769856.00000: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/updater.py", line 649, in _load_update return pickle.load(open(update_path, 'rb')) # nosec: B301 ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^ _pickle.UnpicklingError: invalid load key, '\xff'. test INFO: Object update sweep completed on /tmp/tmp9l_x9vsp/devices/sda1 in 0.00s seconds:, 0 successes, 0 failures, 1 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.00s, 0 successes, 0 failures, 1 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmptsgyi5w8/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /.shards_a/c2_shard/o09 /tmp/tmptsgyi5w8/devices/sda1/async_pending/ca9/43aefe16fd826546f72b52db0520cca9-1757769856.33769 test DEBUG: Update sent for /a/c1/o05 /tmp/tmptsgyi5w8/devices/sda1/async_pending/dc4/017ff741f591e7220e0836a0c4fcedc4-1757769856.33725 test INFO: Object update sweep completed on /tmp/tmptsgyi5w8/devices/sda1 in 0.22s seconds:, 2 successes, 0 failures, 0 quarantines, 2 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 9 skips, 9 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.22s, 2 successes, 0 failures, 0 quarantines, 2 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 9 skips, 9 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpallsaaw6/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c1/o01 /tmp/tmpallsaaw6/devices/sda1/async_pending/22b/9f78f96341102120ea7474897595a22b-1757769856.55792 test DEBUG: Update sent for /a/c1/o00 /tmp/tmpallsaaw6/devices/sda1/async_pending/a20/8110018052c71b62f4f93b1cd45fda20-1757769856.55782 test DEBUG: Update sent for /a/c1/o02 /tmp/tmpallsaaw6/devices/sda1/async_pending/5d9/74b39c6818abfa3cdadce7038f4a15d9-1757769856.55798 test INFO: Object update sweep completed on /tmp/tmpallsaaw6/devices/sda1 in 0.11s seconds:, 3 successes, 0 failures, 0 quarantines, 3 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 1 skips, 2 deferrals, 1 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.11s, 3 successes, 0 failures, 0 quarantines, 3 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 1 skips, 2 deferrals, 1 drains test INFO: Object update sweep starting on /tmp/tmp4nlw9inh/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c1/o02 /tmp/tmp4nlw9inh/devices/sda1/async_pending/5d9/74b39c6818abfa3cdadce7038f4a15d9-1757769856.66721 test DEBUG: Update sent for /a/c1/o01 /tmp/tmp4nlw9inh/devices/sda1/async_pending/22b/9f78f96341102120ea7474897595a22b-1757769856.66715 test DEBUG: Update sent for /a/c1/o03 /tmp/tmp4nlw9inh/devices/sda1/async_pending/ff2/d12c716df8024e3a557661979780dff2-1757769856.66726 test DEBUG: Update sent for /a/c1/o00 /tmp/tmp4nlw9inh/devices/sda1/async_pending/a20/8110018052c71b62f4f93b1cd45fda20-1757769856.66703 test INFO: Object update sweep completed on /tmp/tmp4nlw9inh/devices/sda1 in 0.02s seconds:, 4 successes, 0 failures, 0 quarantines, 4 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 1 skips, 3 deferrals, 2 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.02s, 4 successes, 0 failures, 0 quarantines, 4 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 1 skips, 3 deferrals, 2 drains test INFO: Object update sweep starting on /tmp/tmpy4t161mn/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c1/o00 /tmp/tmpy4t161mn/devices/sda1/async_pending/a20/8110018052c71b62f4f93b1cd45fda20-1757769856.68608 test DEBUG: Update sent for /a/c1/o03 /tmp/tmpy4t161mn/devices/sda1/async_pending/ff2/d12c716df8024e3a557661979780dff2-1757769856.68629 test INFO: Object update sweep completed on /tmp/tmpy4t161mn/devices/sda1 in 0.11s seconds:, 2 successes, 0 failures, 0 quarantines, 2 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 2 skips, 2 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.11s, 2 successes, 0 failures, 0 quarantines, 2 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 2 skips, 2 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpe2cizm9q/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /.shards_a/c2_shard/o09 /tmp/tmpe2cizm9q/devices/sda1/async_pending/ca9/43aefe16fd826546f72b52db0520cca9-1757769856.81343 test DEBUG: Update sent for /a/c1/o00 /tmp/tmpe2cizm9q/devices/sda1/async_pending/a20/8110018052c71b62f4f93b1cd45fda20-1757769856.81268 test DEBUG: Update sent for /a/c1/o01 /tmp/tmpe2cizm9q/devices/sda1/async_pending/22b/9f78f96341102120ea7474897595a22b-1757769856.81282 test DEBUG: Update sent for /a/c1/o05 /tmp/tmpe2cizm9q/devices/sda1/async_pending/dc4/017ff741f591e7220e0836a0c4fcedc4-1757769856.81301 test DEBUG: Update sent for /a/c1/o07 /tmp/tmpe2cizm9q/devices/sda1/async_pending/fc8/26ac197975ac1169d403eeb7ae8bbfc8-1757769856.81310 test DEBUG: Update sent for /a/c1/o02 /tmp/tmpe2cizm9q/devices/sda1/async_pending/5d9/74b39c6818abfa3cdadce7038f4a15d9-1757769856.81288 test DEBUG: Update sent for /a/c1/o06 /tmp/tmpe2cizm9q/devices/sda1/async_pending/5b6/29e303e1cb80d29563757ae87f5c55b6-1757769856.81306 test DEBUG: Update sent for /a/c1/o09 /tmp/tmpe2cizm9q/devices/sda1/async_pending/bee/db77f283b4b1bb5e5b6ce501ca337bee-1757769856.81317 test DEBUG: Update sent for /a/c1/o04 /tmp/tmpe2cizm9q/devices/sda1/async_pending/016/7bf5c8c93f8043f6705026176f67c016-1757769856.81297 test DEBUG: Update sent for /a/c1/o08 /tmp/tmpe2cizm9q/devices/sda1/async_pending/5b8/4e594cf882aac2f7f8f2f4cdade285b8-1757769856.81314 test DEBUG: Update sent for /a/c1/o03 /tmp/tmpe2cizm9q/devices/sda1/async_pending/ff2/d12c716df8024e3a557661979780dff2-1757769856.81293 test INFO: Object update sweep completed on /tmp/tmpe2cizm9q/devices/sda1 in 0.23s seconds:, 11 successes, 0 failures, 0 quarantines, 11 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.23s, 11 successes, 0 failures, 0 quarantines, 11 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmpr_9h3eea/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c1/o05 /tmp/tmpr_9h3eea/devices/sda1/async_pending/dc4/017ff741f591e7220e0836a0c4fcedc4-1757769857.04635 test DEBUG: Update sent for /a/c1/o01 /tmp/tmpr_9h3eea/devices/sda1/async_pending/22b/9f78f96341102120ea7474897595a22b-1757769857.04613 test DEBUG: Update sent for /a/c1/o02 /tmp/tmpr_9h3eea/devices/sda1/async_pending/5d9/74b39c6818abfa3cdadce7038f4a15d9-1757769857.04619 test DEBUG: Update sent for /a/c1/o06 /tmp/tmpr_9h3eea/devices/sda1/async_pending/5b6/29e303e1cb80d29563757ae87f5c55b6-1757769857.04639test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_storage_url_overridden_scheme test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_storage_url_overridden_scheme ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_GET test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_GET ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_GET_log_made test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_GET_log_made ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_write_to_cache_with_x_newest test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_GET_namespaces_write_to_cache_with_x_newest ... ok test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_unsent_deferrals test.unit.obj.test_updater.TestObjectUpdater.test_per_container_rate_limit_unsent_deferrals ... ok test.unit.obj.test_updater.TestObjectUpdater.test_process_devices_in_child test.unit.obj.test_updater.TestObjectUpdater.test_process_devices_in_child ... ok test.unit.obj.test_updater.TestObjectUpdater.test_run_once_child test.unit.obj.test_updater.TestObjectUpdater.test_run_once_child ... ok test.unit.obj.test_updater.TestObjectUpdater.test_run_once_child_with_more_workers test.unit.obj.test_updater.TestObjectUpdater.test_run_once_child_with_more_workers ... ok test.unit.obj.test_updater.TestObjectUpdater.test_run_once_parent_default test.unit.obj.test_updater.TestObjectUpdater.test_run_once_parent_default ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_GET_no_policy test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_GET_no_policy ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_successful_token_unicode_user test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_successful_token_unicode_user ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_sync_request_fail_key test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_sync_request_fail_key ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_sync_request_fail_no_timestamp test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_sync_request_fail_no_timestamp ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_GET_s3_object test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_GET_s3_object ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_PUT test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_PUT ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_sync_request_success test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_sync_request_success ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_sync_request_success_lb_sync_host test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_sync_request_success_lb_sync_host ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_cache_clearing test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_cache_clearing ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_top_level_deny test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_top_level_deny ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object DELETE {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:15 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}}test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorization_nova_toconnect test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorization_nova_toconnect ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorize_with_access_key test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorize_with_access_key ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_use_old_token_from_memcached test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_use_old_token_from_memcached ... ok test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_use_token_success test.unit.common.middleware.test_tempauth.TestAuthWithMultiplePrefixes.test_use_token_success ... ok test.unit.common.test_constraints.TestConstraints.test_check_account_format test.unit.common.test_constraints.TestConstraints.test_check_account_format ... ok test.unit.common.test_constraints.TestConstraints.test_check_container_format test.unit.common.test_constraints.TestConstraints.test_check_container_format ... ok test.unit.common.test_constraints.TestConstraints.test_check_delete_headers test.unit.common.test_constraints.TestConstraints.test_check_delete_headers ... ok test.unit.common.test_constraints.TestConstraints.test_check_delete_headers_removes_delete_after test.unit.common.test_constraints.TestConstraints.test_check_delete_headers_removes_delete_after ... ok test.unit.common.test_constraints.TestConstraints.test_check_delete_headers_sets_delete_at test.unit.common.test_constraints.TestConstraints.test_check_delete_headers_sets_delete_at ... ok test.unit.common.test_constraints.TestConstraints.test_check_drive_invalid_path test.unit.common.test_constraints.TestConstraints.test_check_drive_invalid_path ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorize_with_access_key_and_unquote_chars test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorize_with_access_key_and_unquote_chars ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorize_with_access_key_in_container test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorize_with_access_key_in_container ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized ... ok test.unit.common.test_constraints.TestConstraints.test_check_drive_isdir test.unit.common.test_constraints.TestConstraints.test_check_drive_isdir ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized_bytes test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized_bytes ... ok test.unit.common.test_constraints.TestConstraints.test_check_drive_ismount test.unit.common.test_constraints.TestConstraints.test_check_drive_ismount ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized_http test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized_http ... ok test.unit.common.test_constraints.TestConstraints.test_check_float test.unit.common.test_constraints.TestConstraints.test_check_float ... ok test.unit.common.test_constraints.TestConstraints.test_check_metadata_count test.unit.common.test_constraints.TestConstraints.test_check_metadata_count ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized_trailing_slash test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized_trailing_slash ... ok test.unit.common.test_constraints.TestConstraints.test_check_metadata_empty test.unit.common.test_constraints.TestConstraints.test_check_metadata_empty ... ok test.unit.common.test_constraints.TestConstraints.test_check_metadata_empty_name test.unit.common.test_constraints.TestConstraints.test_check_metadata_empty_name ... ok test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized_v3 test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_authorized_v3 ... ok test.unit.common.test_constraints.TestConstraints.test_check_metadata_good test.unit.common.test_constraints.TestConstraints.test_check_metadata_good ... ok test.unit.common.test_constraints.TestConstraints.test_check_metadata_name_length test.unit.common.test_constraints.TestConstraints.test_check_metadata_name_length ... ok test.unit.common.test_constraints.TestConstraints.test_check_metadata_non_utf8 test.unit.common.test_constraints.TestConstraints.test_check_metadata_non_utf8 ... ok test.unit.common.test_constraints.TestConstraints.test_check_metadata_size test.unit.common.test_constraints.TestConstraints.test_check_metadata_size ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_get_from_shards_add_root_spi test.unit.proxy.controllers.test_container.TestGetPathNamespaceCaching.test_get_from_shards_add_root_spi ... ok test.unit.common.test_constraints.TestConstraints.test_check_metadata_value_length test.unit.common.test_constraints.TestConstraints.test_check_metadata_value_length ... ok test.unit.common.test_constraints.TestConstraints.test_check_object_creation_bad_content_type test.unit.common.test_constraints.TestConstraints.test_check_object_creation_bad_content_type ... ok test.unit.common.test_constraints.TestConstraints.test_check_object_creation_bad_delete_headers test.unit.common.test_constraints.TestConstraints.test_check_object_creation_bad_delete_headers ... ok test DEBUG: Update sent for /a/c1/o00 /tmp/tmpr_9h3eea/devices/sda1/async_pending/a20/8110018052c71b62f4f93b1cd45fda20-1757769857.04602 test INFO: Object update sweep completed on /tmp/tmpr_9h3eea/devices/sda1 in 0.01s seconds:, 5 successes, 0 failures, 0 quarantines, 5 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 2 skips, 4 deferrals, 2 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 5 successes, 0 failures, 0 quarantines, 5 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 2 skips, 4 deferrals, 2 drains test INFO: Object update sweep starting on /tmp/tmp73rgfccp/devices/sda1 (pid: 1824519) test INFO: Object update sweep completed on /tmp/tmp73rgfccp/devices/sda1 in 0.01s seconds:, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmp73rgfccp/devices/sda1 (pid: 1824519) test INFO: Object update sweep completed on /tmp/tmp73rgfccp/devices/sda1 in 0.00s seconds:, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.00s, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmp73rgfccp/devices/sda1 (pid: 1824519) test INFO: Object update sweep completed on /tmp/tmp73rgfccp/devices/sda1 in 0.01s seconds:, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.01s, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmp73rgfccp/devices/sda1 (pid: 1824519) test ERROR: ERROR with remote server 127.0.0.1:60789/sda1: Connection refused test ERROR: ERROR with remote server 127.0.0.1:60789/sda1: Connection refused test ERROR: ERROR with remote server 127.0.0.1:60789/sda1: Connection refused test DEBUG: Update failed for /a/c/o /tmp/tmp73rgfccp/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769857.08443 test INFO: Object update sweep completed on /tmp/tmp73rgfccp/devices/sda1 in 0.02s seconds:, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 1 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.02s, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 1 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmp73rgfccp/devices/sda1 (pid: 1824519) test DEBUG: Error code 500 is returned from remote server 127.0.0.1:36637/sda1 test DEBUG: Error code 500 is returned from remote server 127.0.0.1:36637/sda1 test DEBUG: Update failed for /a/c/o /tmp/tmp73rgfccp/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769857.08443 test INFO: Object update sweep completed on /tmp/tmp73rgfccp/devices/sda1 in 0.02s seconds:, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.02s, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmp73rgfccp/devices/sda1 (pid: 1824519) test DEBUG: Error code 404 is returned from remote server 127.0.0.1:36637/sda1 test DEBUG: Update failed for /a/c/o /tmp/tmp73rgfccp/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769857.08443 test INFO: Object update sweep completed on /tmp/tmp73rgfccp/devices/sda1 in 0.02s seconds:, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.03s, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmp73rgfccp/devices/sda1 (pid: 1824519) test INFO: Timeout waiting on remote server 127.0.0.1:36637/sda1: 99 seconds test DEBUG: Update failed for /a/c/o /tmp/tmp73rgfccp/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769857.08443 test INFO: Object update sweep completed on /tmp/tmp73rgfccp/devices/sda1 in 0.00s seconds:, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.00s, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmp73rgfccp/devices/sda1 (pid: 1824519) test INFO: Timeout connecting to remote server 127.0.0.1:36637/sda1: 9 seconds test DEBUG: Update failed for /a/c/o /tmp/tmp73rgfccp/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769857.08443 test INFO: Object update sweep completed on /tmp/tmp73rgfccp/devices/sda1 in 0.00s seconds:, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.00s, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmp73rgfccp/devices/sda1 (pid: 1824519) test DEBUG: Update sent for /a/c/o /tmp/tmp73rgfccp/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769857.08443 test INFO: Object update sweep completed on /tmp/tmp73rgfccp/devices/sda1 in 0.02s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.02s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Begin object update sweep of all devices test INFO: Begin object update sweep of all devices test INFO: Begin object update sweep of all devices test INFO: Object update sweep of all devices completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Begin object update sweep of all devices test INFO: Object update sweep of all devices completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon'test.unit.obj.test_updater.TestObjectUpdater.test_run_once_parent_more_updater_workers test.unit.obj.test_updater.TestObjectUpdater.test_run_once_parent_more_updater_workers ... ok test.unit.obj.test_updater.TestObjectUpdater.test_run_once_recon_dump test.unit.obj.test_updater.TestObjectUpdater.test_run_once_recon_dump ... ok test.unit.obj.test_updater.TestObjectUpdater.test_run_once_subsequent_children test.unit.obj.test_updater.TestObjectUpdater.test_run_once_subsequent_children ... ok test.unit.obj.test_updater.TestObjectUpdater.test_run_once_with_disk_unmounted test.unit.obj.test_updater.TestObjectUpdater.test_run_once_with_disk_unmounted ... ok test.unit.obj.test_updater.TestObjectUpdater.test_sweep_logs test.unit.obj.test_updater.TestObjectUpdater.test_sweep_logs ... ok test.unit.common.test_constraints.TestConstraints.test_check_object_creation_content_length test.unit.common.test_constraints.TestConstraints.test_check_object_creation_content_length ... ok test.unit.common.test_constraints.TestConstraints.test_check_object_creation_content_type test.unit.common.test_constraints.TestConstraints.test_check_object_creation_content_type ... ok test.unit.common.test_constraints.TestConstraints.test_check_object_creation_name_length test.unit.common.test_constraints.TestConstraints.test_check_object_creation_name_length ... ok test.unit.common.test_constraints.TestConstraints.test_check_utf8 test.unit.common.test_constraints.TestConstraints.test_check_utf8 ... ok test.unit.common.test_constraints.TestConstraints.test_check_utf8_internal test.unit.common.test_constraints.TestConstraints.test_check_utf8_internal ... ok test.unit.common.test_constraints.TestConstraints.test_check_utf8_lone_surrogates test.unit.common.test_constraints.TestConstraints.test_check_utf8_lone_surrogates ... ok test.unit.common.test_constraints.TestConstraints.test_check_utf8_non_canonical test.unit.common.test_constraints.TestConstraints.test_check_utf8_non_canonical ... ok test.unit.common.test_constraints.TestConstraints.test_valid_api_version test.unit.common.test_constraints.TestConstraints.test_valid_api_version ... ok test.unit.common.test_constraints.TestConstraints.test_valid_timestamp test.unit.common.test_constraints.TestConstraints.test_valid_timestamp ... ok test.unit.common.test_constraints.TestConstraints.test_validate_bad_meta test.unit.common.test_constraints.TestConstraints.test_validate_bad_meta ... ok test.unit.common.test_constraints.TestConstraints.test_validate_constraints test.unit.common.test_constraints.TestConstraints.test_validate_constraints ... ok test.unit.common.test_constraints.TestConstraintsConfig.test_default_constraints test.unit.common.test_constraints.TestConstraintsConfig.test_default_constraints ... ok test.unit.common.test_constraints.TestConstraintsConfig.test_effective_constraints test.unit.common.test_constraints.TestConstraintsConfig.test_effective_constraints ... ok test.unit.common.test_constraints.TestConstraintsConfig.test_override_constraints test.unit.common.test_constraints.TestConstraintsConfig.test_override_constraints ... ok test.unit.common.test_constraints.TestConstraintsConfig.test_reload_reset test.unit.common.test_constraints.TestConstraintsConfig.test_reload_reset ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_cleanup_post_replicate test.unit.common.test_db_replicator.TestDBReplicator.test_cleanup_post_replicate ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync_db_exists test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync_db_exists ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_all_found test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_all_found ... ok test.unit.obj.test_updater.TestObjectUpdater.test_sweep_logs_multiple_policies test.unit.obj.test_updater.TestObjectUpdater.test_sweep_logs_multiple_policies ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync_old_file_does_not_exist test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync_old_file_does_not_exist ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_half_not_found_headers_and_body test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_half_not_found_headers_and_body ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync_rename test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync_rename ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync_with_bad_input test.unit.common.test_db_replicator.TestDBReplicator.test_complete_rsync_with_bad_input ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_half_not_found_statuses test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_half_not_found_statuses ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_creation test.unit.common.test_db_replicator.TestDBReplicator.test_creation ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_delete_db test.unit.common.test_db_replicator.TestDBReplicator.test_delete_db ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_drive_not_mounted test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_drive_not_mounted ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_no_arg_pop test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_no_arg_pop ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_operation_complete_rsync test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_operation_complete_rsync ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdb1/3/a/beb593b9a7844bd397988fa0225e5471" 201 - "PUT http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "tx65916b5129ef47849b8e3-0068c57080" "proxy-server 1824514" 0.0450 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7df68619962745939a524-0068c57080" "proxy-server 1824514" 0.0105 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "tx7df68619962745939a524-0068c57080" "proxy-server 1824514" 0.0055 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb1640b0677dc4191918e2-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "tx409f5c88fe2b4eabae8d4-0068c57080" "proxy-server 1824514" 0.0013 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sda1/3/a/beb593b9a7844bd397988fa0225e5471/o" 201 - "PUT http://foo:8080/sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" "txb18ed36370f0447c829bd-0068c57080" "object-server 1824514" 0.0005 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdb1/3/a/beb593b9a7844bd397988fa0225e5471/o" 201 - "PUT http://foo:8080/sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" "txb18ed36370f0447c829bd-0068c57080" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 201 - "PUT http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txb18ed36370f0447c829bd-0068c57080" "proxy-server 1824514" 0.0321 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "PUT /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 201 - "PUT http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txb18ed36370f0447c829bd-0068c57080" "proxy-server 1824514" 0.0320 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc61b0b4dafdc4f82aa45b-0068c57080" "proxy-server 1824514" 0.0020 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txd4c6b132ee2a408a8ed00-0068c57080" "proxy-server 1824514" 0.0106 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "PUT /sdb1/3/a/beb593b9a7844bd397988fa0225e5471/o" 201 - "POST http://foo:8080/sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" "tx7bb4871c6393430b8afc2-0068c57081" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "POST /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 202 76 "POST http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "tx7bb4871c6393430b8afc2-0068c57081" "proxy-server 1824514" 0.0132 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "PUT /sda1/3/a/beb593b9a7844bd397988fa0225e5471/o" 201 - "POST http://foo:8080/sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" "tx7bb4871c6393430b8afc2-0068c57081" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "POST /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 202 76 "POST http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "tx7bb4871c6393430b8afc2-0068c57081" "proxy-server 1824514" 0.0188 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb65ee242ec364a97923ad-0068c57081" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txbe51a86fc0484de2a88e8-0068c57081" "proxy-server 1824514" 0.0250 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "GET /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 200 24 "GET http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "tx2999106865e5465994769-0068c57081" "proxy-server 1824514" 0.0048 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7187ec7eedd14646be347-0068c57081" "proxy-server 1824514" 0.0091 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "tx7fa89dfced1c4706921b3-0068c57081" "proxy-server 1824514" 0.0149 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 200 24 "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txc260bfaf66d643238e0ac-0068c57081" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0d66cb13519a4b5f89322-0068c57081" "proxy-server 1824514" 0.0208 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txec1aea60ebd04a888878a-0068c57081" "proxy-server 1824514" 0.0083 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "GET /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 200 24 "GET http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txada572e6486b4459a695a-0068c57081" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txce6987f6f29f4877ae80d-0068c57081" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txd6de72b5ea6649a094335-0068c57081" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "GET /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 200 24 "GET http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txd34cad72e46446539af82-0068c57081" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0b8ace73aa024ec0bcc9d-0068c57081" "proxy-server 1824514" 0.0017 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txfda1e19acd87472d841cf-0068c57081" "proxy-server 1824514" 0.0015 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "GET /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 412 - "GET http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "tx77d6c455c20f4eb7b840a-0068c57081" "proxy-server 1824514" 0.0009 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "GET /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 412 - "GET http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "tx77d6c455c20f4eb7b840a-0068c57081" "proxy-server 1824514" 0.0042 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9529da9717464d0f96250-0068c57081" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txacdb2fd6a7664f889783f-0068c57081" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "GET /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 304 - "GET http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txb181f9e2d5ca4e53a736e-0068c57081" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx71aefb40e13947aab5cbd-0068c57081" "proxy-server 1824514" 0.0091 "-" 1824514 - fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:full_control:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:read_acp:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'}test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_GET_with_read_acp_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_GET_with_read_acp_permission ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_operation_rsync_then_merge test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_operation_rsync_then_merge ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_operation_unexpected test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_operation_unexpected ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_unexpected_operation_db_does_not_exist test.unit.common.test_db_replicator.TestDBReplicator.test_dispatch_unexpected_operation_db_does_not_exist ... ok test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o/p HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o/p/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o/p/p2 HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o/p HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o/p/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1/a/c/o/p/p2 HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o/p HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o/p/ HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /v1.0/a/c/o/p/p2 HTTP/1.0 321 - - - 4 7 - - - 2.7183 - - 18.000000000 20.718281828 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /bucket/obj HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /bucket/obj/blah HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/20 GET /bucket/obj HTTP/1.0 200 - - - - 7 - - - 2.7183 - - 18.000000000 20.718281828 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o/p HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o/p/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o/p/p2 HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o/p HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o/p/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o/p/p2 HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o/p HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o/p/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1/a/c/o/p/p2 HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 -test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_PUT_no_policy test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_PUT_no_policy ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_PUT_s3_container test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_log_request_stat_type_good_PUT_s3_container ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_logger_statsd_prefix test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_logger_statsd_prefix ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_middleware_error test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_middleware_error ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_middleware_exception test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_middleware_exception ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_multi_segment_resp test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_multi_segment_resp ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_no_content_length_no_transfer_encoding_with_empty_strings test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_no_content_length_no_transfer_encoding_with_empty_strings ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_no_content_length_no_transfer_encoding_with_generator test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_no_content_length_no_transfer_encoding_with_generator ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_no_content_length_no_transfer_encoding_with_list_body test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_no_content_length_no_transfer_encoding_with_list_body ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_object_error test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_object_error ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_obscure_req test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_obscure_req ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_policy_index test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_policy_index ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_proxy_client_logging test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_proxy_client_logging ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_req_path_info_popping test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_req_path_info_popping ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_sensitive_headers_registered test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_sensitive_headers_registered ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_unread_body test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_unread_body ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_upload_line test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_upload_line ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_upload_size test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_upload_size ... ok test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_upload_size_no_policy test.unit.common.middleware.test_proxy_logging.TestProxyLogging.test_upload_size_no_policy ... ok test.unit.common.middleware.test_slo.TestSloBulkDeleter.test_passes_through_concurrency test.unit.common.middleware.test_slo.TestSloBulkDeleter.test_passes_through_concurrency ... ok test.unit.common.middleware.test_slo.TestSloBulkDeleter.test_reused_logger test.unit.common.middleware.test_slo.TestSloBulkDeleter.test_reused_logger ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_empty_suffix_and_hash_dirs_get_cleanedup test.unit.common.test_db_replicator.TestDBReplicator.test_empty_suffix_and_hash_dirs_get_cleanedup ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_extract_device test.unit.common.test_db_replicator.TestDBReplicator.test_extract_device ... ok test.unit.common.middleware.test_slo.TestSloBulkDeleter.test_uses_big_max_deletes test.unit.common.middleware.test_slo.TestSloBulkDeleter.test_uses_big_max_deletes ... ok test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest ... ok test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest_passthrough test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest_passthrough ... ok test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest_ratelimiting test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest_ratelimiting ... ok test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest_repeated_segments_uses_multi_range_requests test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest_repeated_segments_uses_multi_range_requests ... ok test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest_with_submanifest test.unit.common.middleware.test_slo.TestSloGetManifests.test_get_manifest_with_submanifest ... ok test.unit.common.middleware.test_slo.TestSloGetManifests.test_multiple_ranges_get_manifest test.unit.common.middleware.test_slo.TestSloGetManifests.test_multiple_ranges_get_manifest ... ok test.unit.common.middleware.test_slo.TestSloGetManifests.test_multiple_ranges_including_suffix_get_manifest test.unit.common.middleware.test_slo.TestSloGetManifests.test_multiple_ranges_including_suffix_get_manifest ... ok test.unit.common.middleware.test_slo.TestSloGetManifests.test_range_get_manifest test.unit.common.middleware.test_slo.TestSloGetManifests.test_range_get_manifest ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_account test.unit.common.middleware.test_staticweb.TestStaticWeb.test_account ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_app_set test.unit.common.middleware.test_staticweb.TestStaticWeb.test_app_set ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_conf_set test.unit.common.middleware.test_staticweb.TestStaticWeb.test_conf_set ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container1 test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container1 ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container10unicodesubdirlisting test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container10unicodesubdirlisting ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container11subdirmarkeraltdirtype test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container11subdirmarkeraltdirtype ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container11subdirmarkerinvaliddirtype test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container11subdirmarkerinvaliddirtype ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Found 8 objects in shard (state=unsharded), total = 8 (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9992&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1032 (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: Setting object count to 1032 (txn: tx86e831de50f641afaefef-0068c57081) test DEBUG: GET listing from 3 shards for: /v1/a/c?reverse=true&format=json&states=listing (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_?reverse=true&format=json&limit=10000&marker=&end_marker=pie {'X-Backend-Record-Type': 'auto'} (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?reverse=true&format=json&limit=10000&marker=&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Found 8 objects in shard (state=unsharded), total = 8 (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?reverse=true&format=json&limit=9992&marker=i&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 48 (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: Setting object count to 48 (txn: tx665c3bd2ec954680b44f5-0068c57081) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Found 0 objects in shard (state=unsharded), total = 40 (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9960&marker=h&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1064 (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: Setting object count to 1064 (txn: tx4ba4ff14a01144208ac96-0068c57081) test DEBUG: GET listing from 2 shards for: /v1/a/c?marker=koolaid&format=json&states=listing (txn: txe90cb432fd3d454c85d13-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txe90cb432fd3d454c85d13-0068c57081)test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_empty_shard_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_empty_shard_no_memcache ... ok test DEBUG: Keystone Reply: Status: 200, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Connecting with tenant: FORCED_TENANT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 200, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Connecting with tenant: PROJECT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 200, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Connecting with tenant: PROJECT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 200, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Connecting with tenant: PROJECT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 200, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Connecting with tenant: PROJECT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 200, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Connecting with tenant: PROJECT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Connecting with tenant: PROJECT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 200, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Connecting with tenant: PROJECT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Connecting with tenant: PROJECT_ID test DEBUG: Starting the S3 Token Authentication component test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware.test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_bad_reply_missing_parts test.unit.common.middleware.s3api.test_s3token.S3TokenMiddlewareTestV3.test_bad_reply_missing_parts ... ok test.unit.common.middleware.s3api.test_service.TestS3ApiServiceNoAcl.test_service_GET test.unit.common.middleware.s3api.test_service.TestS3ApiServiceNoAcl.test_service_GET ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_handoff_delete test.unit.common.test_db_replicator.TestDBReplicator.test_handoff_delete ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_http_connect test.unit.common.test_db_replicator.TestDBReplicator.test_http_connect ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_in_sync test.unit.common.test_db_replicator.TestDBReplicator.test_in_sync ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container11subdirmarkermatchdirtype test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container11subdirmarkermatchdirtype ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container11subdirmarkerobjectindex test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container11subdirmarkerobjectindex ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container12unredirectedrequest test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container12unredirectedrequest ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container13empty test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container13empty ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container1_web_mode_explicitly_off test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container1_web_mode_explicitly_off ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container1_web_mode_explicitly_on test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container1_web_mode_explicitly_on ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2 test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2 ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2_web_mode_explicitly_off test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2_web_mode_explicitly_off ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2_web_mode_explicitly_on test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2_web_mode_explicitly_on ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2json test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2json ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2json_web_mode_explicitly_off test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2json_web_mode_explicitly_off ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2json_web_mode_explicitly_on test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2json_web_mode_explicitly_on ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2onetxt test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container2onetxt ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3 test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3 ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3bindexhtml test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3bindexhtml ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3indexhtml test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3indexhtml ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subdir test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subdir ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subdirx test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subdirx ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subdiry test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subdiry ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subdirz test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subdirz ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subsubdir test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subsubdir ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subsubdircontents test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3subsubdircontents ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3unknown test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container3unknown ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4indexhtml test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4indexhtml ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4indexhtmlauthed test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4indexhtmlauthed ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4onetxt test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4onetxt ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4subdir test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4subdir ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4tempurl test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4tempurl ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4twotxt test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4twotxt ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4unknown test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container4unknown ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container5indexhtml test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container5indexhtml ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container5unknown test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container5unknown ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container6blisting test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container6blisting ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container6listing test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container6listing ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container6subdir test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container6subdir ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container7listing test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container7listing ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container8listingcss test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container8listingcss ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container8subdirlistingcss test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container8subdirlistingcss ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container9listingcss test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container9listingcss ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container9subdirlistingcss test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container9subdirlistingcss ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container_404_has_css test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container_404_has_css ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container_404_has_no_css test.unit.common.middleware.test_staticweb.TestStaticWeb.test_container_404_has_no_css ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_no_auth_middleware test.unit.common.middleware.test_staticweb.TestStaticWeb.test_no_auth_middleware ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_root test.unit.common.middleware.test_staticweb.TestStaticWeb.test_root ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_subrequest_not_override_auth test.unit.common.middleware.test_staticweb.TestStaticWeb.test_subrequest_not_override_auth ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_subrequest_once_if_possible test.unit.common.middleware.test_staticweb.TestStaticWeb.test_subrequest_once_if_possible ... ok test.unit.common.middleware.test_staticweb.TestStaticWeb.test_version test.unit.common.middleware.test_staticweb.TestStaticWeb.test_version ... ok test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_account_acl_failures test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_account_acl_failures ... ok test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_account_acl_success test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_account_acl_success ... ok test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_acl_syntax_verification test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_acl_syntax_verification ... ok test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_acls_propagate_to_sysmeta test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_acls_propagate_to_sysmeta ... ok test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_admin_privileges test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_admin_privileges ... ok test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_bad_acls_get_denied test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_bad_acls_get_denied ... ok test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_readonly_privileges test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_readonly_privileges ... ok test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_readwrite_privileges test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_readwrite_privileges ... ok test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_user_gets_best_acl test.unit.common.middleware.test_tempauth.TestAuthMultiplePrefixes.test_user_gets_best_acl ... ok test.unit.common.middleware.test_tempauth.TestGetUserGroups.test_custom_url_config test.unit.common.middleware.test_tempauth.TestGetUserGroups.test_custom_url_config ... ok test.unit.common.middleware.test_tempauth.TestGetUserGroups.test_multiple_reseller test.unit.common.middleware.test_tempauth.TestGetUserGroups.test_multiple_reseller ... ok test.unit.common.middleware.test_tempauth.TestGetUserGroups.test_no_prefix_reseller test.unit.common.middleware.test_tempauth.TestGetUserGroups.test_no_prefix_reseller ... ok test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: Setting object count to 3120 (txn: txba4f3385e4424b6b9db21-0068c57081) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: Setting object count to 3120 (txn: tx5066c54359044a11b4d21-0068c57081) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: Setting object count to 3120 (txn: txf58833d6e3104c79a9418-0068c57081) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='a/c', lower='pie', upper='') a/c with {'X-Backend-Record-Type': 'object'} (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Get listing from /v1/a/c?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'object'} (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Found 3072 objects in shard (state=sharded), total = 3120 (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: Setting object count to 3120 (txn: tx510444d5bc8440f9b4263-0068c57081) test DEBUG: GET listing from 5 shards for: /v1/a/c?reverse=true&limit=&format=json&states=listing (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_?reverse=true&limit=10000&format=json&marker=&end_marker=%F0%9F%8C%B4 {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1024 (txn: txe33d6324ac3f4e4ba4ae0-0068c57081)test.unit.common.middleware.test_tempauth.TestGetUserGroups.test_single_reseller test.unit.common.middleware.test_tempauth.TestGetUserGroups.test_single_reseller ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_DELETE_on_expired_versioned_object test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_DELETE_on_expired_versioned_object ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_blank_add_versions_precedence test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_blank_add_versions_precedence ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_container_allow_versioned_writes_false test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_container_allow_versioned_writes_false ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_first_object_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_first_object_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_latest_version_doubled_up_markers_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_latest_version_doubled_up_markers_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_latest_version_is_marker_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_latest_version_is_marker_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_latest_version_no_marker_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_latest_version_no_marker_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_latest_version_restores_marker_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_latest_version_restores_marker_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_no_versions_container_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_no_versions_container_success ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_merge_items test.unit.common.test_db_replicator.TestDBReplicator.test_merge_items ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_merge_syncs test.unit.common.test_db_replicator.TestDBReplicator.test_merge_syncs ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_object_no_versioning_with_container_config_true test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_object_no_versioning_with_container_config_true ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_single_version_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_delete_single_version_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_denied_DELETE_of_versioned_object test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_denied_DELETE_of_versioned_object ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_denied_PUT_of_versioned_object test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_denied_PUT_of_versioned_object ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_empty_versions_location test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_empty_versions_location ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_get_container test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_get_container ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_get_head test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_get_head ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_head_container test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_head_container ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_history_delete_marker_no_object_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_history_delete_marker_no_object_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_history_delete_marker_over_object_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_history_delete_marker_over_object_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_new_version_get_errors test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_new_version_get_errors ... ok test-replicator DEBUG: Not deleting db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py (0/3 success) test-replicator DEBUG: Not deleting db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py (2/3 success) test-replicator DEBUG: Not deleting db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py (2 new rows) test-replicator ERROR: Not deleting db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py (negative max_row_delta: -1) test-replicator DEBUG: Successfully deleted db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py test-replicator DEBUG: Failed to delete db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py ERROR reading HTTP response from {'replication_ip': '127.0.0.1', 'replication_port': 80, 'device': 'sdb1'} Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_replicator.py", line 170, in replicate self.request('REPLICATE', self.path, body, ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ {'Content-Type': 'application/json'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py", line 354, in other_req raise Exception('blah') Exception: blah test.unit.common.test_db_replicator.TestDBReplicator.test_repl_connection test.unit.common.test_db_replicator.TestDBReplicator.test_repl_connection ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_account_out_of_place test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_account_out_of_place ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_container_out_of_place test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_container_out_of_place ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_container_out_of_place_no_node test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_container_out_of_place_no_node ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_delete_because_deleted test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_delete_because_deleted ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_delete_because_not_shouldbehere test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_delete_because_not_shouldbehere ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_delete_delegated_to_cleanup_post_replicate test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_delete_delegated_to_cleanup_post_replicate ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_different_region test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_different_region ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_quarantine test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_quarantine ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_new_version_put_errors test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_new_version_put_errors ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_new_version_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_new_version_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_new_version_sysmeta_precedence test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_new_version_sysmeta_precedence ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ_ACP fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACPtest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_GET_without_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_GET_without_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_with_fullcontrol_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_with_fullcontrol_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_with_owner_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_with_owner_permission ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_with_exception test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_with_exception ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_container test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_container ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_container_both_headers test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_container_both_headers ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_container_history_header test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_container_history_header ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_first_object_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_first_object_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_object_no_versioning test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_object_no_versioning ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_object_no_versioning_with_container_config_true test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_object_no_versioning_with_container_config_true ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_request_is_dlo_manifest_with_container_config_true test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_request_is_dlo_manifest_with_container_config_true ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_version_is_dlo_manifest_with_container_config_true test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_version_is_dlo_manifest_with_container_config_true ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_versioned_object_including_url_encoded_name_success test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_put_versioned_object_including_url_encoded_name_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_remove_add_versions_precedence test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_remove_add_versions_precedence ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_with_exception_run_out_of_nodes test.unit.common.test_db_replicator.TestDBReplicator.test_replicate_object_with_exception_run_out_of_nodes ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicator_sync test.unit.common.test_db_replicator.TestDBReplicator.test_replicator_sync ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx4916896b99c0402194896-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx6d8f64fca68c472bb1874-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&reverse=true&format=json (txn: txea81eeb8b8514e4da4193-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&marker=jam&format=json (txn: txb0854fb7c3904039a65e3-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&marker=jam&end_marker=kale&format=json (txn: txb27313d3b2754728a6e2d-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&includes=egg&format=json (txn: tx930ce58d67d74d0db56b7-0068c57081) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx5dd9647795084e0cb91bf-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx4ef5551b945c4845ab5c4-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txad91efc0cd6e4ad1acaa3-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx34ee33b1e766465d8df0b-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txa0790caa0e8649559c06d-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx4996ccbcb0784c07b4aa2-0068c57081) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Skipping shard cache lookup (x-newest) for /v1/a/c?states=listing&format=json (txn: txc990ddb868634942a4771-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txc990ddb868634942a4771-0068c57081) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} test ERROR: Aborting listing from shards due to bad response: [204] test DEBUG: GET listing from 3 shards for: /v1/a/c test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} test ERROR: Aborting listing from shards due to bad response: [204] test DEBUG: GET listing from 3 shards for: /v1/a/c test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} test ERROR: Aborting listing from shards due to bad response: [204] test DEBUG: GET listing from 3 shards for: /v1/a/c test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} test ERROR: Aborting listing from shards due to bad response: [204] proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_handoff test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_handoff ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_insufficient_found_plus_404_507 test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_insufficient_found_plus_404_507 ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_replicator_sync_with_broker_replication_missing_table test.unit.common.test_db_replicator.TestDBReplicator.test_replicator_sync_with_broker_replication_missing_table ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_roundrobin_datadirs test.unit.common.test_db_replicator.TestDBReplicator.test_roundrobin_datadirs ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_db test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_db ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_remove_headers test.unit.common.middleware.test_versioned_writes.VersionedWritesTestCase.test_remove_headers ... ok test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"name": "PROJECT_NAME", "id": "PROJECT_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "roles": [{"name": "swift-user"}, {"name": "_member_"}]}}' - rejecting request test DEBUG: Calling S3Token middleware. test DEBUG: Connecting to Keystone sending this JSON: {"credentials": {"access": "access", "token": "dG9rZW4=", "signature": "signature"}} test DEBUG: Keystone Reply: Status: 201, Output: b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}}}' test DEBUG: Error on keystone reply: 201 b'{"token": {"user": {"domain": {"name": "Default", "id": "default"}, "name": "S3_USER", "id": "USER_ID"}, "project": {"domain": {"name": "PROJECT_DOMAIN_NAME", "id": "PROJECT_DOMAIN_ID"}, "name": "PROJECT_NAME", "id": "PROJECT_ID"}}}' - rejecting request fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: InternalError: 500 Internal Server Error (unexpected status code 500): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 351, in __call__ resp = self.handle_request(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3api.py", line 392, in handle_request res = handler(req) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/controllers/service.py", line 35, in GET resp = req.get_response(self.app, query={'format': 'json'}) File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2272, in get_response return self._get_response(app, method, container, obj, ~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers, body, query) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/middleware/s3api/s3request.py", line 2257, in _get_response raise InternalError('unexpected status code %d' % status) swift.common.middleware.s3api.s3response.InternalError: InternalError: 500 Internal Server Error (unexpected status code 500)test.unit.common.middleware.s3api.test_service.TestS3ApiServiceNoAcl.test_service_GET_error test.unit.common.middleware.s3api.test_service.TestS3ApiServiceNoAcl.test_service_GET_error ... ok test.unit.common.middleware.s3api.test_service.TestS3ApiServiceNoAcl.test_service_GET_subresource test.unit.common.middleware.s3api.test_service.TestS3ApiServiceNoAcl.test_service_GET_subresource ... ok test.unit.common.middleware.s3api.test_service.TestS3ApiServiceNoAcl.test_service_GET_with_blind_resource test.unit.common.middleware.s3api.test_service.TestS3ApiServiceNoAcl.test_service_GET_with_blind_resource ... ok test.unit.common.middleware.test_acl.TestACL.test_acls_from_account_info test.unit.common.middleware.test_acl.TestACL.test_acls_from_account_info ... ok test.unit.common.middleware.test_acl.TestACL.test_clean_acl test.unit.common.middleware.test_acl.TestACL.test_clean_acl ... ok test.unit.common.middleware.test_acl.TestACL.test_format_v1_acl test.unit.common.middleware.test_acl.TestACL.test_format_v1_acl ... ok test.unit.common.middleware.test_acl.TestACL.test_format_v2_acl test.unit.common.middleware.test_acl.TestACL.test_format_v2_acl ... ok test.unit.common.middleware.test_acl.TestACL.test_parse_acl test.unit.common.middleware.test_acl.TestACL.test_parse_acl ... ok test.unit.common.middleware.test_acl.TestACL.test_parse_v2_acl test.unit.common.middleware.test_acl.TestACL.test_parse_v2_acl ... ok test.unit.common.middleware.test_acl.TestACL.test_referrer_allowed test.unit.common.middleware.test_acl.TestACL.test_referrer_allowed ... ok test.unit.common.middleware.test_bulk.TestSwiftInfo.test_registered_defaults test.unit.common.middleware.test_bulk.TestSwiftInfo.test_registered_defaults ... ok test.unit.common.middleware.test_crossdomain.TestCrossDomain.test_crossdomain_custom test.unit.common.middleware.test_crossdomain.TestCrossDomain.test_crossdomain_custom ... ok test.unit.common.middleware.test_crossdomain.TestCrossDomain.test_crossdomain_default test.unit.common.middleware.test_crossdomain.TestCrossDomain.test_crossdomain_default ... ok test.unit.common.middleware.test_crossdomain.TestCrossDomain.test_crossdomain_get_only test.unit.common.middleware.test_crossdomain.TestCrossDomain.test_crossdomain_get_only ... ok test.unit.common.middleware.test_crossdomain.TestCrossDomain.test_crossdomain_pass test.unit.common.middleware.test_crossdomain.TestCrossDomain.test_crossdomain_pass ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_POST test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_POST ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_POST_mismatched_location test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_POST_mismatched_location ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_POST_regular_symlink test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_POST_regular_symlink ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_DLO_with_object test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_DLO_with_object ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_SLO_with_object test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_SLO_with_object ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_object test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_object ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_object_with_DLO test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_object_with_DLO ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_tombstone test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_PUT_overwrite_tombstone ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_delete_container_fail_delete_versions_cont test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_delete_container_fail_delete_versions_cont ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_delete_container_fail_object_count test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_delete_container_fail_object_count ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_delete_container_success test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_delete_container_success ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_denied_PUT_of_versioned_object test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_denied_PUT_of_versioned_object ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_enable_versioning_existing_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_enable_versioning_existing_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_enable_versioning_failed_primary_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_enable_versioning_failed_primary_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_enable_versioning_failed_versions_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_enable_versioning_failed_versions_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_existing_container_has_deprecated_policy test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_existing_container_has_deprecated_policy ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_existing_container_has_deprecated_policy_unauthed test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_existing_container_has_deprecated_policy_unauthed ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_get test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_get ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_get_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_get_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_get_reserved_container_passthrough test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_get_reserved_container_passthrough ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_get_symlink test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_get_symlink ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_head_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_head_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_new_version_get_errors test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_new_version_get_errors ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_new_version_put_errors test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_new_version_put_errors ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_put_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_put_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_put_container_with_legacy_versioning test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_put_container_with_legacy_versioning ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_put_container_with_super_legacy_versioning test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_put_container_with_super_legacy_versioning ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_put_object_no_versioning test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_put_object_no_versioning ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_same_policy_as_existing_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_same_policy_as_existing_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_same_policy_as_primary_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestCase.test_same_policy_as_primary_container ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_current_obj_is_unversioned test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_current_obj_is_unversioned ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_current_version test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_current_version ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_current_version_is_delete_marker test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_current_version_is_delete_marker ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_not_current_version test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_not_current_version ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_null_version test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_DELETE_null_version ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_404 test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_404 ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_and_HEAD test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_and_HEAD ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_null_id test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_null_id ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_null_id_404 test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_null_id_404 ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_null_id_versioned_obj test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_GET_null_id_versioned_obj ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_HEAD test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_HEAD ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_HEAD_delete_marker test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_HEAD_delete_marker ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_HEAD_null_id test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_HEAD_null_id ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_POST_error test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_POST_error ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version ... ok test.unit.common.middleware.test_xprofile.Test_html_viewer.test_download test.unit.common.middleware.test_xprofile.Test_html_viewer.test_download ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_container_not_found test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_container_not_found ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_invalid test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_invalid ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_not_found test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_not_found ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_with_no_length_or_encoding test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_with_no_length_or_encoding ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_with_non_empty_body test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_PUT_version_with_non_empty_body ... ok test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_fail_non_versioned_container test.unit.common.middleware.test_object_versioning.ObjectVersioningTestVersionAPI.test_fail_non_versioned_container ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_get_manifest_with_x_open_expired_part_num test.unit.common.middleware.test_slo.TestPartNumber.test_get_manifest_with_x_open_expired_part_num ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_get_non_integer_part_number_invalid test.unit.common.middleware.test_slo.TestPartNumber.test_get_non_integer_part_number_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_get_out_of_range_part_number test.unit.common.middleware.test_slo.TestPartNumber.test_get_out_of_range_part_number ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_num_with_repeated_segments test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_num_with_repeated_segments ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_number test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_number ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_number_data_manifest test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_number_data_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_number_large_manifest test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_number_large_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_number_sub_slo test.unit.common.middleware.test_slo.TestPartNumber.test_get_part_number_sub_slo ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_head_negative_part_number_invalid_on_subrange test.unit.common.middleware.test_slo.TestPartNumber.test_head_negative_part_number_invalid_on_subrange ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_head_non_integer_part_number_invalid test.unit.common.middleware.test_slo.TestPartNumber.test_head_non_integer_part_number_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_head_out_of_range_part_number test.unit.common.middleware.test_slo.TestPartNumber.test_head_out_of_range_part_number ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_head_out_of_range_part_number_on_subrange test.unit.common.middleware.test_slo.TestPartNumber.test_head_out_of_range_part_number_on_subrange ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number_data_manifest test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number_data_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number_refetch_path test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number_refetch_path ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number_subrange test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number_subrange ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number_zero_invalid test.unit.common.middleware.test_slo.TestPartNumber.test_head_part_number_zero_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_negative_part_number_invalid test.unit.common.middleware.test_slo.TestPartNumber.test_negative_part_number_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_exceeds_max_manifest_segments_is_ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_exceeds_max_manifest_segments_is_ok ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_ignored_for_manifest_get test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_ignored_for_manifest_get ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_ignored_for_non_slo_object test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_ignored_for_non_slo_object ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_ignored_for_non_slo_object_with_range test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_ignored_for_non_slo_object_with_range ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_sub_ranges_manifest test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_sub_ranges_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_with_range_segments test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_with_range_segments ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_zero_byte_manifest test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_zero_byte_manifest ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_zero_invalid test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_zero_invalid ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_zero_invalid_on_subrange test.unit.common.middleware.test_slo.TestPartNumber.test_part_number_zero_invalid_on_subrange ... ok test.unit.common.middleware.test_slo.TestPartNumber.test_range_with_part_number_is_error test.unit.common.middleware.test_slo.TestPartNumber.test_range_with_part_number_is_error ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_download_takes_too_long test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_download_takes_too_long ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_error_fetching_first_segment_submanifest test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_error_fetching_first_segment_submanifest ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_error_fetching_segment test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_error_fetching_segment ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_error_fetching_submanifest test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_error_fetching_submanifest ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_first_segment_mismatched_etag test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_first_segment_mismatched_etag ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_first_segment_mismatched_size test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_first_segment_mismatched_size ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_first_segment_not_available test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_first_segment_not_available ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_first_segment_not_exists test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_first_segment_not_exists ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_generator_closure test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_generator_closure ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_generator_closure_iter_app_resp test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_generator_closure_iter_app_resp ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_get_bogus_manifest test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_get_bogus_manifest ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_db_change_after_sync test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_db_change_after_sync ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_db_rsync_file_call test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_db_rsync_file_call ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_db_rsync_file_failure test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_db_rsync_file_failure ... ok test.unit.common.middleware.test_xprofile.Test_html_viewer.test_format_source_code test.unit.common.middleware.test_xprofile.Test_html_viewer.test_format_source_code ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_file test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_file ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_file_popen_args test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_file_popen_args ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_file_popen_args_different_region_and_rsync_compress test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_file_popen_args_different_region_and_rsync_compress ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_file_popen_args_whole_file_false test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_file_popen_args_whole_file_false ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_then_merge test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_then_merge ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_then_merge_db_does_not_exist test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_then_merge_db_does_not_exist ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_with_crypto test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_with_crypto ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_get_invalid_sysmeta_passthrough test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_get_invalid_sysmeta_passthrough ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_head_does_not_validate_first_segment_mismatched_etag test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_head_does_not_validate_first_segment_mismatched_etag ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_head_does_not_validate_first_segment_mismatched_size test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_head_does_not_validate_first_segment_mismatched_size ... ok test.unit.common.middleware.test_xprofile.Test_html_viewer.test_get_param test.unit.common.middleware.test_xprofile.Test_html_viewer.test_get_param ... ok test.unit.common.middleware.test_xprofile.Test_html_viewer.test_index test.unit.common.middleware.test_xprofile.Test_html_viewer.test_index ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_invalid_json_submanifest test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_invalid_json_submanifest ... ok test.unit.common.middleware.test_xprofile.Test_html_viewer.test_index_all test.unit.common.middleware.test_xprofile.Test_html_viewer.test_index_all ... ok test.unit.common.middleware.test_xprofile.Test_html_viewer.test_plot test.unit.common.middleware.test_xprofile.Test_html_viewer.test_plot ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_then_merge_old_does_not_exist test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_then_merge_old_does_not_exist ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_then_merge_with_objects test.unit.common.test_db_replicator.TestDBReplicator.test_rsync_then_merge_with_objects ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_no_ips test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_no_ips ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_no_local_device_in_ring test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_no_local_device_in_ring ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_node_is_mounted test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_node_is_mounted ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_mismatched_checksum test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_mismatched_checksum ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_mismatched_etag test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_mismatched_etag ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_mismatched_length test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_mismatched_length ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_mismatched_size test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_mismatched_size ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_recursion_limit test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_recursion_limit ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_slo_sysmeta_on_error test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_slo_sysmeta_on_error ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_sub_slo_recursion test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_sub_slo_recursion ... ok test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_sub_slo_recursion_limit test.unit.common.middleware.test_slo.TestSloErrorsOldManifests.test_sub_slo_recursion_limit ... ok test.unit.common.middleware.test_slo.TestSwiftInfo.test_registered_defaults test.unit.common.middleware.test_slo.TestSwiftInfo.test_registered_defaults ... ok test.unit.common.middleware.test_slo.TestSwiftInfo.test_registered_non_defaults test.unit.common.middleware.test_slo.TestSwiftInfo.test_registered_non_defaults ... ok test.unit.common.middleware.test_tempauth.TestUtilityMethods.test_account_acls_bad_path_raises_exception test.unit.common.middleware.test_tempauth.TestUtilityMethods.test_account_acls_bad_path_raises_exception ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_adding_second_zone test.unit.common.ring.test_builder.TestGetRequiredOverload.test_adding_second_zone ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_balanced_zones_unbalanced_servers test.unit.common.ring.test_builder.TestGetRequiredOverload.test_balanced_zones_unbalanced_servers ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_big_zone test.unit.common.ring.test_builder.TestGetRequiredOverload.test_big_zone ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_enormous_zone test.unit.common.ring.test_builder.TestGetRequiredOverload.test_enormous_zone ... ok test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?reverse=true&limit=8976&format=json&marker=%F0%9F%8C%B5&end_marker=%E2%98%83 {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2048 (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?reverse=true&limit=7952&format=json&marker=%E2%98%84&end_marker=pie {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3072 (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?reverse=true&limit=6928&format=json&marker=q&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Found 8 objects in shard (state=unsharded), total = 3080 (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?reverse=true&limit=6920&format=json&marker=i&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 3120 (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: Setting object count to 3120 (txn: txe33d6324ac3f4e4ba4ae0-0068c57081) test DEBUG: GET listing from 5 shards for: /v1/a/c?limit=49&format=json&states=listing (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?limit=49&format=json&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?limit=9&format=json&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?limit=1&format=json&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: Found 1 objects in shard (state=unsharded), total = 49 (txn: txf72e2484da2244fb9d32f-0068c57081) test DEBUG: GET listing from 2 shards for: /v1/a/c?marker=%E2%98%86&format=json&states=listing (txn: tx601cc36a695e4c1daa3ad-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx601cc36a695e4c1daa3ad-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%86&format=json&limit=10000&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx601cc36a695e4c1daa3ad-0068c57081) test DEBUG: Found 1022 objects in shard (state=unsharded), total = 1022 (txn: tx601cc36a695e4c1daa3ad-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx601cc36a695e4c1daa3ad-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_?marker=%E2%A8%83&format=json&limit=8978&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx601cc36a695e4c1daa3ad-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2046 (txn: tx601cc36a695e4c1daa3ad-0068c57081) test DEBUG: GET listing from 4 shards for: /v1/a/c?end_marker=%E2%98%8A&format=json&states=listing (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?end_marker=ham%00&format=json&limit=10000&marker= {'X-Backend-Record-Type': 'auto'} (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?end_marker=pie%00&format=json&limit=9960&marker=h {'X-Backend-Record-Type': 'auto'} (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?end_marker=%E2%98%83%00&format=json&limit=9952&marker=p {'X-Backend-Record-Type': 'auto'} (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?end_marker=%E2%98%8A&format=json&limit=8928&marker=%D1%B0 {'X-Backend-Record-Type': 'auto'} (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: Found 6 objects in shard (state=unsharded), total = 1078 (txn: tx59081c6a3c9b416bbca4d-0068c57081) test DEBUG: GET listing from 5 shards for: /v1/a/c?prefix=hat&format=json&states=listing (txn: txf0218a770cd44e17804ce-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txf0218a770cd44e17804ce-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?prefix=hat&format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txf0218a770cd44e17804ce-0068c57081) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: txf0218a770cd44e17804ce-0068c57081) test DEBUG: GET listing from 1 shards for: /v1/a/c?marker=%E2%98%86&end_marker=%E2%98%8A&limit=2&format=json&states=listing (txn: tx511a06616f4c4f11a86cb-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx511a06616f4c4f11a86cb-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%86&end_marker=%E2%98%8A&limit=2&format=json {'X-Backend-Record-Type': 'auto'} (txn: tx511a06616f4c4f11a86cb-0068c57081) test DEBUG: Found 4 objects in shard (state=unsharded), total = 4 (txn: tx511a06616f4c4f11a86cb-0068c57081)test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_no_memcache ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:full_control FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:tester FULL_CONTROL permission on the object /bucket/object fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Grant test:write_acp FULL_CONTROL permission on the object /bucket/objecttest.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_with_write_acp_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_with_write_acp_permission ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_equal_replica_and_devices_count_ignore_weights test.unit.common.ring.test_builder.TestGetRequiredOverload.test_equal_replica_and_devices_count_ignore_weights ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_gradual_replica_count test.unit.common.ring.test_builder.TestGetRequiredOverload.test_gradual_replica_count ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_multi_zone_with_failed_device test.unit.common.ring.test_builder.TestGetRequiredOverload.test_multi_zone_with_failed_device ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_multiple_replicas_each test.unit.common.ring.test_builder.TestGetRequiredOverload.test_multiple_replicas_each ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_multiple_replicas_in_zone_with_single_device test.unit.common.ring.test_builder.TestGetRequiredOverload.test_multiple_replicas_in_zone_with_single_device ... ok proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.8:1008/sdi, error: ERROR Insufficient Storage (txn: tx9e9fed3778ab42cf84009-0068c57081) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.24:1024/sdy, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.25:1025/sdz, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.18:1018/sds, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.26:1026/sda, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.13:1013/sdn, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.9:1009/sdj, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.6:1006/sdg, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.12:1012/sdm, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.10:1010/sdk, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.8:1008/sdi, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.21:1021/sdv, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.7:1007/sdh, error: ERROR Insufficient Storage (txn: txbdb1449adf52404baf466-0068c57081) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.4:1004/sde, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.25:1025/sdz, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.8:1008/sdi, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.14:1014/sdo, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.10:1010/sdk, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.12:1012/sdm, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.3:1003/sdd, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.21:1021/sdv, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.19:1019/sdt, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.20:1020/sdu, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.5:1005/sdf, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.6:1006/sdg, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.27:1027/sdb, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.9:1009/sdj, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.28:1028/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.29:1029/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.30:1030/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.31:1031/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.32:1032/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.33:1033/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.34:1034/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.35:1035/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.36:1036/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.37:1037/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.38:1038/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.39:1039/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.40:1040/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.41:1041/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.42:1042/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.43:1043/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.44:1044/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.45:1045/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.46:1046/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_insufficient_found_plus_404_507_and_handoffs_fail test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_insufficient_found_plus_404_507_and_handoffs_fail ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_multiple_small_zones test.unit.common.ring.test_builder.TestGetRequiredOverload.test_multiple_small_zones ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_none_needed test.unit.common.ring.test_builder.TestGetRequiredOverload.test_none_needed ... ok test INFO: Object update sweep starting on /tmp/tmps5895432/devices/sda1 (pid: 1824519) test INFO: Object update sweep completed on /tmp/tmps5895432/devices/sda1 in 0.00s seconds:, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.00s, 0 successes, 0 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Object update sweep starting on /tmp/tmps5895432/devices/sda1 (pid: 1824519) test DEBUG: Update failed for /a/c/o /tmp/tmps5895432/devices/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769857.00000 test INFO: Object update sweep completed on /tmp/tmps5895432/devices/sda1 in 0.00s seconds:, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep of sda1 completed: 0.00s, 0 successes, 1 failures, 0 quarantines, 0 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test INFO: Begin object update sweep of all devices test INFO: Begin object update sweep of all devices test INFO: Begin object update sweep of all devices test INFO: Begin object update sweep of all devices test INFO: Begin object update sweep of all devices test WARNING: Skipping: sda1 is unmounted test INFO: Object update sweep of all devices completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Begin object update sweep of all devices test WARNING: Skipping: sda1 is unmounted test INFO: Object update sweep of all devices completed: 0.00s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Begin object update sweep of all devices test WARNING: Skipping: sda2 is unmounted test INFO: Object update sweep of all devices completed: 0.01s test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test INFO: Object update sweep starting on /tmp/tmp34wkbzdn/devices/sda1 (pid: 1824519) test INFO: Object update sweep progress on /tmp/tmp34wkbzdn/devices/sda1: 16.00s, 2 successes, 0 failures, 0 quarantines, 2 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep progress on /tmp/tmp34wkbzdn/devices/sda1: 32.00s, 4 successes, 0 failures, 0 quarantines, 4 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep completed on /tmp/tmp34wkbzdn/devices/sda1 in 44.00s seconds:, 5 successes, 0 failures, 0 quarantines, 5 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test INFO: Object update sweep starting on /tmp/tmp2rzj6whk/devices/sda1 (pid: 1824519) test INFO: Object update sweep completed on /tmp/tmp2rzj6whk/devices/sda1 in 0.13s seconds:, 6 successes, 0 failures, 0 quarantines, 6 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824519) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txab14f28645aa4fcdb875d-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx046edd15ee154cc8a69ef-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txfd91760c665e42bb8e2ea-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txb08d306578674222bbe0a-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txfe0483b4cd23412b9b88c-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txdac73234680e467481e58-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txea4b7e8492bd4c2c8fe14-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txcbda8da0a524489ebf9e7-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx141390ee6c394c6f92232-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx5787cc843cc0470c96078-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txc39ca68960d44b4697dda-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx14fa931abfae42a49875b-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx86f30e32c2554d2fa3213-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txef3b2d7e3c5848a397b85-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txd1e67de9662a485889789-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx7f642ccd7e6646428db6b-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx4f0120c7d9814a83bf0b8-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txe0391216af4a4dd5b2462-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txee03d52d20584dbd8e469-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txf469a4ddb30e4cf198dcb-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx6af81188ce5e4e00a3660-0068c57081) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx7a73f844a3b64885a7355-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: txad931945730049da9c59c-0068c57081) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx05ea8744910e4ea98aceb-0068c57081)test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespace_caching test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespace_caching ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_404_response test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_404_response ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_bad_response_body test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_bad_response_body ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_cache_unused_recheck_listing_shard_ranges test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_cache_unused_recheck_listing_shard_ranges ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_cache_write_for_incomplete_listing test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_cache_write_for_incomplete_listing ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_cache_write_for_non_sharded_states test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_cache_write_for_non_sharded_states ... ok test-replicator DEBUG: Replicating db /path/to/file test-replicator ERROR: Found /path/to/file for /a%20c%20t when it should be on partition 0; will replicate out and remove. test-replicator DEBUG: Successfully deleted db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py test-replicator DEBUG: Replicating db /path/to/file test-replicator ERROR: Found /path/to/file for /a%20c%20t/c%20o%20n when it should be on partition 0; will replicate out and remove. test-replicator DEBUG: Successfully deleted db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py test-replicator DEBUG: Replicating db /path/to/file test-replicator ERROR: Found /path/to/file for /a%20c%20t/c%20o%20n when it should be on partition 0; will replicate out and remove. test-replicator DEBUG: Successfully deleted db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py test-replicator DEBUG: Replicating db /path/to/file test-replicator ERROR: Found /path/to/file for /a%20c%20t/c%20o%20n when it should be on partition 0; will replicate out and remove. test-replicator DEBUG: Not deleting db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py (0/0 success) test-replicator DEBUG: Replicating db /path/to/file test-replicator DEBUG: Not deleting db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py (0/3 success) test-replicator DEBUG: Replicating db /path/to/file test-replicator ERROR: ERROR syncing /path/to/file with node {'id': 1, 'weight': 10.0, 'zone': 1, 'ip': '1.1.1.1', 'port': 6200, 'device': 'sdb', 'meta': '', 'replication_ip': '1.1.1.1', 'replication_port': 6200, 'region': 1}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/db_replicator.py", line 681, in _replicate_object success = self._repl_to_node(node, broker, partition, info, different_region) File "/build/reproducible-path/swift-2.36.0/swift/common/db_replicator.py", line 487, in _repl_to_node return self._handle_sync_response(node, response, info, broker, http, ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ different_region=different_region) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/db_replicator.py", line 492, in _handle_sync_response if response.status == HTTP_NOT_FOUND: # completely missing, rsync ^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py", line 714, in status raise self._status Exception: ugh test-replicator ERROR: ERROR syncing /path/to/file with node {'id': 2, 'weight': 10.0, 'zone': 2, 'ip': '1.1.1.2', 'port': 6200, 'device': 'sdb', 'meta': '', 'replication_ip': '1.1.1.2', 'replication_port': 6200, 'region': 2}: Timeout (Nones) test-replicator DEBUG: /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py in sync with 1.1.1.3:6200/sdb, nothing to do test-replicator DEBUG: Not deleting db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py (1/3 success) test-replicator DEBUG: Replicating db /path/to/file test-replicator DEBUG: /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py in sync with 1.1.1.1:6200/sdb, nothing to do test-replicator DEBUG: /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py in sync with 1.1.1.2:6200/sdb, nothing to do test-replicator DEBUG: Not deleting db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py (2/3 success) test-replicator DEBUG: Replicating db /path/to/file test-replicator DEBUG: /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py in sync with 1.1.1.1:6200/sdb, nothing to do test-replicator DEBUG: /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py in sync with 1.1.1.2:6200/sdb, nothing to do test-replicator ERROR: ERROR Remote drive not mounted {'id': 3, 'weight': 10.0, 'zone': 3, 'ip': '1.1.1.3', 'port': 6200, 'device': 'sdb', 'meta': '', 'replication_ip': '1.1.1.3', 'replication_port': 6200, 'region': 1} test-replicator ERROR: ERROR Remote drive not mounted {'id': 4, 'weight': 10.0, 'zone': 4, 'ip': '1.1.1.4', 'port': 6200, 'device': 'sdb', 'meta': '', 'replication_ip': '1.1.1.4', 'replication_port': 6200, 'region': 2} test-replicator DEBUG: /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py in sync with 1.1.1.5:6200/sdb, nothing to do test-replicator DEBUG: Not deleting db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py (3/5 success) test-replicator DEBUG: Replicating db /path/to/file test-replicator DEBUG: /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py in sync with 1.1.1.1:6200/sdb, nothing to do test-replicator DEBUG: /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py in sync with 1.1.1.2:6200/sdb, nothing to do test-replicator DEBUG: /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py in sync with 1.1.1.3:6200/sdb, nothing to do test-replicator DEBUG: Successfully deleted db /build/reproducible-path/swift-2.36.0/test/unit/common/test_db_replicator.py test-replicator ERROR: Unable to decode remote metadata 'metadata' test-replicator ERROR: Quarantining DB test-replicator ERROR: ERROR Failed to get my own IPs? test-replicator ERROR: Can't find itself 127.0.0.1 with port 1000 in ring file, not replicating test-replicator INFO: Beginning replication run test-replicator INFO: Replication run OVER test-replicator INFO: Attempted to replicate 0 dbs in 0.00019 seconds (0.00000/s) test-replicator INFO: Removed 0 dbs test-replicator INFO: 0 successes, 0 failures test-replicator INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test-replicator INFO: Beginning replication run test-replicator INFO: Replication run OVER test-replicator INFO: Attempted to replicate 0 dbs in 0.00036 seconds (0.00000/s) test-replicator INFO: Removed 0 dbs test-replicator INFO: 0 successes, 0 failures test-replicator ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test-replicator INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test-replicator WARNING: Skipping: Boom! test-replicator INFO: Beginning replication run test-replicator INFO: Replication run OVER test-replicator INFO: Attempted to replicate 0 dbs in 0.00038 seconds (0.00000/s) test-replicator INFO: Removed 0 dbs test-replicator INFO: 0 successes, 1 failures test-replicator ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test-replicator INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_node_is_not_mounted test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_node_is_not_mounted ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_one_big_guy_does_not_spoil_his_buddy test.unit.common.ring.test_builder.TestGetRequiredOverload.test_one_big_guy_does_not_spoil_his_buddy ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_with_local_device_in_ring test.unit.common.test_db_replicator.TestDBReplicator.test_run_once_with_local_device_in_ring ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_stats test.unit.common.test_db_replicator.TestDBReplicator.test_stats ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_usync test.unit.common.test_db_replicator.TestDBReplicator.test_usync ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_usync_http_error_above_300 test.unit.common.test_db_replicator.TestDBReplicator.test_usync_http_error_above_300 ... ok test.unit.common.test_db_replicator.TestDBReplicator.test_usync_http_error_below_200 test.unit.common.test_db_replicator.TestDBReplicator.test_usync_http_error_below_200 ... ok test.unit.common.test_manager.TestServer.test_conf_dir test.unit.common.test_manager.TestServer.test_conf_dir ... ok test.unit.common.test_manager.TestServer.test_conf_files test.unit.common.test_manager.TestServer.test_conf_files ... ok test.unit.common.test_manager.TestServer.test_create_server test.unit.common.test_manager.TestServer.test_create_server ... ok test.unit.common.test_manager.TestServer.test_expirer_conf_files test.unit.common.test_manager.TestServer.test_expirer_conf_files ... ok test.unit.common.test_manager.TestServer.test_get_conf_file_name test.unit.common.test_manager.TestServer.test_get_conf_file_name ... ok test.unit.common.test_manager.TestServer.test_get_custom_pid_file_name test.unit.common.test_manager.TestServer.test_get_custom_pid_file_name ... ok test.unit.common.test_manager.TestServer.test_get_pid_file_name test.unit.common.test_manager.TestServer.test_get_pid_file_name ... ok test.unit.common.test_manager.TestServer.test_get_running_pids test.unit.common.test_manager.TestServer.test_get_running_pids ... ok test.unit.common.test_manager.TestServer.test_interact test.unit.common.test_manager.TestServer.test_interact ... ok test.unit.common.test_manager.TestServer.test_iter_pid_files test.unit.common.test_manager.TestServer.test_iter_pid_files ... ok test.unit.common.test_manager.TestServer.test_kill_running_pids test.unit.common.test_manager.TestServer.test_kill_running_pids ... ok test.unit.common.test_manager.TestServer.test_launch test.unit.common.test_manager.TestServer.test_launch ... ok test.unit.common.test_manager.TestServer.test_named_conf_dir test.unit.common.test_manager.TestServer.test_named_conf_dir ... ok test.unit.common.test_manager.TestServer.test_named_conf_dir_pid_files test.unit.common.test_manager.TestServer.test_named_conf_dir_pid_files ... ok test.unit.common.test_manager.TestServer.test_proxy_conf_dir test.unit.common.test_manager.TestServer.test_proxy_conf_dir ... ok test.unit.common.test_manager.TestServer.test_server_equality test.unit.common.test_manager.TestServer.test_server_equality ... ok test.unit.common.test_manager.TestServer.test_server_repr test.unit.common.test_manager.TestServer.test_server_repr ... ok test.unit.common.test_manager.TestServer.test_server_to_string test.unit.common.test_manager.TestServer.test_server_to_string ... ok test.unit.common.test_manager.TestServer.test_signal_pids test.unit.common.test_manager.TestServer.test_signal_pids ... ok test.unit.common.test_manager.TestServer.test_spawn test.unit.common.test_manager.TestServer.test_spawn ... ok test.unit.common.test_manager.TestServer.test_status test.unit.common.test_manager.TestServer.test_status ... ok test.unit.common.test_manager.TestServer.test_stop test.unit.common.test_manager.TestServer.test_stop ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_cache_write_for_object_listing test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_cache_write_for_object_listing ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other WRITE_ACP fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:16 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o/p HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o/p/ HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/01/05 PUT /v1.0/a/c/o/p/p2 HTTP/1.0 314 - - - 6 8 - - - 7.3321 - - 58.200000000 65.532100000 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/18 PUT /bucket HTTP/1.0 200 - - - - 7 - - - 0.5000 - - 18.000000000 18.500000000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 01/Jan/1970/00/00/18 PUT /bucket HTTP/1.0 200 - - - - 7 - - - 0.5000 - - 18.000000000 18.500000000 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/17 GET /path HTTP/1.0 503 - - - - 118 - - - 0.7000 FA - 1757769857.069194794 1757769857.769194841 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/17 GET /path HTTP/1.0 500 - - - - - - - - 0.2000 - - 1757769857.070590019 1757769857.270590067 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/17 GET / HTTP/1.0 200 - - - - 17 - - - 0.0001 SOS - 1757769857.088830948 1757769857.088930368 - - test INFO: - - 13/Sep/2025/13/24/17 GET / HTTP/1.0 200 - - - - - - - - 0.0001 - - 1757769857.090058327 1757769857.090136051 - - test INFO: - - 13/Sep/2025/13/24/17 GET / HTTP/1.0 200 - - - - 3 - - - 0.0001 - - 1757769857.103490591 1757769857.103600979 - - test INFO: - - 13/Sep/2025/13/24/17 GET / HTTP/1.0 200 - - - - 12 - - - 0.0001 - - 1757769857.104769468 1757769857.104852438 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/17 GET /v1/a/c/o HTTP/1.0 503 - - - - 118 - - - 0.7000 - - 1757769857.105837584 1757769857.805837631 0 - test INFO: - - 13/Sep/2025/13/24/17 PUT /v1/a/c/o HTTP/1.0 200 - - - - 8 - - - 0.0000 - - 1757769857.138195038 1757769857.138226509 1 - test INFO: - - 13/Sep/2025/13/24/17 GET /v1/a/c HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769857.151258707 1757769857.151355982 1 - test INFO: 4.5.6.7 1.2.3.4 13/Sep/2025/13/24/17 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769857.152517080 1757769857.152601957 - - test INFO: 4.5.6.7 1.2.3.4 13/Sep/2025/13/24/17 GET / HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769857.153360128 1757769857.153430700 - - test INFO: - - 13/Sep/2025/13/24/17 GET /v1/something HTTP/1.0 200 - - - - 8 - - - 0.0001 - - 1757769857.154459238 1757769857.154537916 - - test INFO: - - 13/Sep/2025/13/24/17 GET / HTTP/1.0 499 - - - - 4 - - - 0.0001 - - 1757769857.168670416 1757769857.168793201 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/17 POST /v1/a/c HTTP/1.0 200 - - - 11 8 - - Host:%20localhost:80 0.0000 - - 1757769857.169559002 1757769857.169580460 - - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/17 PUT /v1/a/c/o/foo HTTP/1.0 200 - - - 10 8 - - Host:%20localhost:80 0.0000 - - 1757769857.170315981 1757769857.170339346 0 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/17 PUT /v1/a/c/o/foo HTTP/1.0 200 - - - 10 8 - - Host:%20localhost:80 0.0000 - - 1757769857.187089443 1757769857.187120438 -1 - test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - 13/Sep/2025/13/24/17 PUT /v1/a/c/o/foo HTTP/1.0 200 - - - 10 8 - - Host:%20localhost:80 0.0000 - - 1757769857.188089848 1757769857.188116312 - - Sun Sep 14 03:24:17 2025 /tmp/tmpv_z31hdl/unittest.profile123 Sun Sep 14 03:24:17 2025 /tmp/tmpv_z31hdl/unittest.profile1824512 Sun Sep 14 03:24:17 2025 /tmp/tmpv_z31hdl/unittest.profile456 30 function calls in 0.001 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 6 0.001 0.000 0.001 0.000 profile:0(import os;os.getcwd();) 6 0.000 0.000 0.000 0.000 :0(exec) 6 0.000 0.000 0.000 0.000 :0(getcwd) 6 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 6 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpv_z31hdl/unittest.profile123 Sun Sep 14 03:24:17 2025 /tmp/tmpv_z31hdl/unittest.profile1824512 Sun Sep 14 03:24:17 2025 /tmp/tmpv_z31hdl/unittest.profile456 30 function calls in 0.001 seconds Ordered by: call count ncalls tottime percall cumtime percall filename:lineno(function) 6 0.001 0.000 0.001 0.000 profile:0(import os;os.getcwd();) 6 0.000 0.000 0.000 0.000 :0(exec) 6 0.000 0.000 0.000 0.000 :1() 6 0.000 0.000 0.000 0.000 :0(getcwd) 6 0.000 0.000 0.000 0.000 :0(setprofile) 0 0.000 0.000 profile:0(profiler) Sun Sep 14 03:24:17 2025 /tmp/tmpv_z31hdl/unittest.profile123 Sun Sep 14 03:24:17 2025 /tmp/tmpv_z31hdl/unittest.profile1824512 Sun Sep 14 03:24:17 2025 /tmp/tmpv_z31hdl/unittest.profile456 30 function calls in 0.001 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 6 0.001 0.000 0.001 0.000 profile:0(import os;os.getcwd();) 6 0.000 0.000 0.000 0.000 :0(exec) 6 0.000 0.000 0.000 0.000 :0(getcwd) 6 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 6 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile123 5 function calls in 0.000 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 1 0.000 0.000 0.000 0.000 :0(exec) 1 0.000 0.000 0.000 0.000 profile:0(import os;os.getcwd();) 1 0.000 0.000 0.000 0.000 :0(getcwd) 1 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 1 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile123 5 function calls in 0.000 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 1 0.000 0.000 0.000 0.000 :0(exec) 1 0.000 0.000 0.000 0.000 profile:0(import os;os.getcwd();) 1 0.000 0.000 0.000 0.000 :0(getcwd) 1 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 1 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile123 5 function calls in 0.000 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 1 0.000 0.000 0.000 0.000 :0(exec) 1 0.000 0.000 0.000 0.000 profile:0(import os;os.getcwd();) 1 0.000 0.000 0.000 0.000 :0(getcwd) 1 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 1 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile123 5 function calls in 0.000 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 1 0.000 0.000 0.000 0.000 :0(exec) 1 0.000 0.000 0.000 0.000 profile:0(import os;os.getcwd();) 1 0.000 0.000 0.000 0.000test.unit.common.middleware.test_xprofile.Test_html_viewer.test_render test.unit.common.middleware.test_xprofile.Test_html_viewer.test_render ... ok test.unit.common.ring.test_builder.TestPartPowerIncrease.test_cancel_increase_partition_power test.unit.common.ring.test_builder.TestPartPowerIncrease.test_cancel_increase_partition_power ... ok test.unit.common.ring.test_builder.TestPartPowerIncrease.test_finalize_increase_partition_power test.unit.common.ring.test_builder.TestPartPowerIncrease.test_finalize_increase_partition_power ... ok test.unit.common.ring.test_builder.TestPartPowerIncrease.test_increase_partition_power test.unit.common.ring.test_builder.TestPartPowerIncrease.test_increase_partition_power ... ok test.unit.common.ring.test_builder.TestPartPowerIncrease.test_increase_partition_power_failed test.unit.common.ring.test_builder.TestPartPowerIncrease.test_increase_partition_power_failed ... ok test.unit.common.ring.test_builder.TestPartPowerIncrease.test_prepare_increase_partition_power test.unit.common.ring.test_builder.TestPartPowerIncrease.test_prepare_increase_partition_power ... ok test.unit.common.ring.test_builder.TestPartPowerIncrease.test_prepare_increase_partition_power_failed test.unit.common.ring.test_builder.TestPartPowerIncrease.test_prepare_increase_partition_power_failed ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_add_dev test.unit.common.ring.test_builder.TestRingBuilder.test_add_dev ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_without_permission test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_without_permission ... ok test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_xml_error test.unit.common.middleware.s3api.test_s3_acl.TestS3ApiS3Acl.test_object_acl_PUT_xml_error ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_authenticate_delete_Authorization_from_s3req test.unit.common.middleware.s3api.test_s3request.TestRequest.test_authenticate_delete_Authorization_from_s3req ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_canonical_uri_sigv2 test.unit.common.middleware.s3api.test_s3request.TestRequest.test_canonical_uri_sigv2 ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_canonical_uri_sigv4 test.unit.common.middleware.s3api.test_s3request.TestRequest.test_canonical_uri_sigv4 ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_sig_v4_streaming_aws_hmac_sha256_missing_trailer_sig test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_sig_v4_streaming_aws_hmac_sha256_missing_trailer_sig ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_sig_v4_streaming_aws_hmac_sha256_payload_trailer_bad test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_sig_v4_streaming_aws_hmac_sha256_payload_trailer_bad ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_sig_v4_streaming_aws_hmac_sha256_payload_trailer_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_sig_v4_streaming_aws_hmac_sha256_payload_trailer_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_multi_bytes_secret_failure test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_multi_bytes_secret_failure ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_sigv2 test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_sigv2 ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_sigv2_unicode_string test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_sigv2_unicode_string ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_sigv4_unsigned_payload test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_sigv4_unsigned_payload ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_sigv4_url_encode test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_sigv4_url_encode ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_chunk_invalid test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_chunk_invalid ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_chunk_no_last_chunk test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_chunk_no_last_chunk ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_chunk_valid test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_chunk_valid ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_chunk_wrong_size test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_chunk_wrong_size ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_no_secret test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_signature_v4_hmac_sha256_payload_no_secret ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_sigv4_req_zero_content_length_sha256 test.unit.common.middleware.s3api.test_s3request.TestRequest.test_check_sigv4_req_zero_content_length_sha256 ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_date_header_expired test.unit.common.middleware.s3api.test_s3request.TestRequest.test_date_header_expired ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_date_header_missing test.unit.common.middleware.s3api.test_s3request.TestRequest.test_date_header_missing ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_date_header_with_x_amz_date_expired test.unit.common.middleware.s3api.test_s3request.TestRequest.test_date_header_with_x_amz_date_expired ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_date_header_with_x_amz_date_valid test.unit.common.middleware.s3api.test_s3request.TestRequest.test_date_header_with_x_amz_date_valid ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_container_info test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_container_info ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_with_check_container_permission test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_with_check_container_permission ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_with_check_object_permission test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_with_check_object_permission ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_without_duplication_HEAD_request test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_without_duplication_HEAD_request ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_without_match_ACL_MAP test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_without_match_ACL_MAP ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_without_s3_acl test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_response_without_s3_acl ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_validate_param test.unit.common.middleware.s3api.test_s3request.TestRequest.test_get_validate_param ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_headers_to_sign_sigv4 test.unit.common.middleware.s3api.test_s3request.TestRequest.test_headers_to_sign_sigv4 ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_match test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_match ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_modified_since test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_modified_since ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_none_match test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_none_match ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_none_match_star test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_none_match_star ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_unmodified_since test.unit.common.middleware.s3api.test_s3request.TestRequest.test_put_object_if_unmodified_since ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_request_timestamp_sigv2 test.unit.common.middleware.s3api.test_s3request.TestRequest.test_request_timestamp_sigv2 ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_request_timestamp_sigv4 test.unit.common.middleware.s3api.test_s3request.TestRequest.test_request_timestamp_sigv4 ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_algo_mismatch test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_algo_mismatch ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_and_trailer test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_and_trailer ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc32_mismatch test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc32_mismatch ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc32_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc32_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc32c_mismatch test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc32c_mismatch ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc32c_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc32c_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc64nvme_invalid test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc64nvme_invalid ... skipped 'no crc64nvme implementation, install isal or anycrc' test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc64nvme_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_crc64nvme_ok ... skipped 'no crc64nvme implementation, install isal or anycrc' test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_sha1_mismatch test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_sha1_mismatch ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_sha1_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_sha1_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_sha256_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_hdr_sha256_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_sha256_mismatch test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_checksum_sha256_mismatch ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_duplicate test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_duplicate ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_extra test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_extra ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_invalid test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_invalid ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_mismatch test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_mismatch ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_missing test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_missing ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_multiple test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_multiple ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_none_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_none_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_short test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_short ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_undeclared test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_undeclared ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_unrecognised test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_unrecognised ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_with_commas_invalid test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_with_commas_invalid ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_with_commas_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_strm_unsgnd_pyld_trl_with_commas_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_crc32_invalid test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_crc32_invalid ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_crc32_mismatch test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_crc32_mismatch ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_crc32_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_crc32_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_declares_crc32_trailer test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_declares_crc32_trailer ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_no_crc_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sig_v4_unsgnd_pyld_no_crc_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_encoding_aws_chunked_is_ignored test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_encoding_aws_chunked_is_ignored ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_sha256_bad_value test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_sha256_bad_value ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_sha256_ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_sha256_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_sha256_streaming_is_bad_request test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_sha256_streaming_is_bad_request ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_sha256_streaming_no_decoded_content_length test.unit.common.middleware.s3api.test_s3request.TestRequest.test_sigv2_content_sha256_streaming_no_decoded_content_length ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_to_swift_req_Authorization_not_exist_in_swreq test.unit.common.middleware.s3api.test_s3request.TestRequest.test_to_swift_req_Authorization_not_exist_in_swreq ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_to_swift_req_subrequest_proxy_access_log test.unit.common.middleware.s3api.test_s3request.TestRequest.test_to_swift_req_subrequest_proxy_access_log ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_v4_req_amz_content_sha256_missing test.unit.common.middleware.s3api.test_s3request.TestRequest.test_v4_req_amz_content_sha256_missing ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_v4_req_x_mz_content_sha256_bad_format test.unit.common.middleware.s3api.test_s3request.TestRequest.test_v4_req_x_mz_content_sha256_bad_format ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_v4_req_xmz_content_sha256_mismatch test.unit.common.middleware.s3api.test_s3request.TestRequest.test_v4_req_xmz_content_sha256_mismatch ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_validate_part_number test.unit.common.middleware.s3api.test_s3request.TestRequest.test_validate_part_number ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_validate_part_number_invalid_argument test.unit.common.middleware.s3api.test_s3request.TestRequest.test_validate_part_number_invalid_argument ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_validate_part_number_invalid_part_number test.unit.common.middleware.s3api.test_s3request.TestRequest.test_validate_part_number_invalid_part_number ... ok test.unit.common.middleware.s3api.test_s3request.TestRequest.test_validate_part_number_with_range_header test.unit.common.middleware.s3api.test_s3request.TestRequest.test_validate_part_number_with_range_header ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_chunk_separator_missing test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_chunk_separator_missing ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_final_newline_missing test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_final_newline_missing ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_good_with_trailers test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_good_with_trailers ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_invalid_chunk_params test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_invalid_chunk_params ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_invalid_chunk_size test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_invalid_chunk_size ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_not_enough_content test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_not_enough_content ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_read test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_read ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_read_multiple_chunks test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_read_multiple_chunks ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_read_multiple_chunks_with_size test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_read_multiple_chunks_with_size ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_read_with_size test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_read_with_size ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_line_spans_chunks test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_line_spans_chunks ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_newline_in_middle_and_at_end test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_newline_in_middle_and_at_end ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_newline_in_middle_not_at_end test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_newline_in_middle_not_at_end ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_no_newline test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_no_newline ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_with_size_line_spans_chunks test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_readline_with_size_line_spans_chunks ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_small_final_chunk_size_ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_small_final_chunk_size_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_small_first_chunk_size test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_small_first_chunk_size ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_trailing_garbage_ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_trailing_garbage_ok ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_unexpected_trailers test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_unexpected_trailers ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_wrong_chunk_size test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_wrong_chunk_size ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_wrong_signature_first_chunk test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_wrong_signature_first_chunk ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_wrong_signature_last_chunk test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_wrong_signature_last_chunk ... ok proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.47:1047/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.48:1048/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.49:1049/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.50:1050/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.51:1051/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.52:1052/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.53:1053/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.54:1054/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.55:1055/sda, error: ERROR Insufficient Storage (txn: tx17cef256420a4e26993c0-0068c57081) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.3:1003/sdd, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.4:1004/sde, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.26:1026/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.5:1005/sdf, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.12:1012/sdm, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.15:1015/sdp, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.17:1017/sdr, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.8:1008/sdi, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.10:1010/sdk, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.23:1023/sdx, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.25:1025/sdz, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.11:1011/sdl, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.7:1007/sdh, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.27:1027/sdb, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.28:1028/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.29:1029/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.30:1030/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.31:1031/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.32:1032/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.33:1033/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.34:1034/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.35:1035/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.36:1036/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.37:1037/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.38:1038/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.39:1039/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.40:1040/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.41:1041/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.42:1042/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.43:1043/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.44:1044/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.45:1045/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.46:1046/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.47:1047/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.48:1048/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.49:1049/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.50:1050/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.51:1051/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.52:1052/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.53:1053/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.54:1054/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_insufficient_found_plus_507_and_handoffs_fail test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_insufficient_found_plus_507_and_handoffs_fail ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_insufficient_found_plus_timeouts test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_insufficient_found_plus_timeouts ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_limits_expirer_queue_updates test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_limits_expirer_queue_updates ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_missing_one test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_missing_one ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_mostly_found test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_mostly_found ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_mostly_not_found test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_mostly_not_found ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_none_found test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_none_found ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_one_found test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_one_found ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_simple test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_simple ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_write_affinity_after_replication test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_write_affinity_after_replication ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_write_affinity_before_replication test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_DELETE_write_affinity_before_replication ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txd4ff4b66af424feeae251-0068c57081" "proxy-server 1824514" 0.0215 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "GET /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 304 - "GET http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txb3bc1689a9e54652b5076-0068c57081" "proxy-server 1824514" 0.0125 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4cb5733522164f6eaac70-0068c57081" "proxy-server 1824514" 0.0135 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txc25a4ce258a646ebb0adb-0068c57081" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "GET /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 200 24 "GET http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txcfa8e87d561c4912b00ac-0068c57081" "proxy-server 1824514" 0.0074 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx898df2c3b1794fc5bc6f4-0068c57081" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txb48fbc9cd47c4f3d94d26-0068c57081" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 200 24 "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "tx660f5c9138dc4adbbce99-0068c57081" "proxy-server 1824514" 0.0108 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa5778f59397846d995154-0068c57081" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txaf232a6f430147da97897-0068c57081" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 200 24 "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txa07800006b28497988ec2-0068c57081" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txca8926d8da724566ad5d2-0068c57081" "proxy-server 1824514" 0.0174 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "tx7c1e2d2e472e4264b2b88-0068c57081" "proxy-server 1824514" 0.0174 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 412 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txea34434ffd494b9ab5007-0068c57081" "proxy-server 1824514" 0.0124 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 412 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txea34434ffd494b9ab5007-0068c57081" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txac51ea4a24194f1888752-0068c57081" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "tx642f2e0979d344058ea8e-0068c57081" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 304 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "tx22f3b23feef84f7b9976d-0068c57081" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc792f88f3fca4741b1afa-0068c57081" "proxy-server 1824514" 0.0435 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "tx02f0fb7d726e41fe9494f-0068c57081" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdc1/3/a/beb593b9a7844bd397988fa0225e5471/o" 304 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "tx1145f7a94dea4133ab354-0068c57081" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx360edaeafbe84b7bbe3e8-0068c57081" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sda1/3/a/beb593b9a7844bd397988fa0225e5471" 204 - "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471" "txe7cdc7e1e7984bbfa18fa-0068c57081" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdd1/3/a/beb593b9a7844bd397988fa0225e5471/o" 200 24 "HEAD http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471/o" "txeb98e92c45904a5880982-0068c57081" "proxy-server 1824514" 0.0072 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6cc5668ec5ab4e0e852b1-0068c57081" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "GET /sdb1/3/a/beb593b9a7844bd397988fa0225e5471" 200 380 "GET http://foo:8080/v1/a/beb593b9a7844bd397988fa0225e5471?format=json&states=listing" "tx6cc5668ec5ab4e0e852b1-0068c57081" "proxy-server 1824514" 0.0022 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx505d1d08e6a7486dba001-0068c57081" "proxy-server 1824514" 0.0013 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "PUT /sda1/1/a/b464c6f353c842c7a867e3a08081f005" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/b464c6f353c842c7a867e3a08081f005" "tx505d1d08e6a7486dba001-0068c57081" "container-server 1824514" 0.0011 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "PUT /sdb1/1/a/b464c6f353c842c7a867e3a08081f005" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/b464c6f353c842c7a867e3a08081f005" "tx505d1d08e6a7486dba001-0068c57081" "container-server 1824514" 0.0010 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "PUT /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 201 - "PUT http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx505d1d08e6a7486dba001-0068c57081" "proxy-server 1824514" 0.0407 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "PUT /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 201 - "PUT http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx505d1d08e6a7486dba001-0068c57081" "proxy-server 1824514" 0.0459 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx1a71627d068844348dab0-0068c57081" "proxy-server 1824514" 0.0018 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:17 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx1a71627d068844348dab0-0068c57081" "proxy-server 1824514" 0.0012 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5be6466794cf4f949cc43-0068c57081" "proxy-server 1824514" 0.0139 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txb60192afb34b42d08a3e8-0068c57082" "proxy-server 1824514" 0.0012 "-" 1824514 1test.unit.common.ring.test_builder.TestGetRequiredOverload.test_one_small_guy_does_not_spoil_his_buddy test.unit.common.ring.test_builder.TestGetRequiredOverload.test_one_small_guy_does_not_spoil_his_buddy ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_small_extra_server_in_zone_with_multiple_replicas test.unit.common.ring.test_builder.TestGetRequiredOverload.test_small_extra_server_in_zone_with_multiple_replicas ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_small_zone test.unit.common.ring.test_builder.TestGetRequiredOverload.test_small_zone ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_two_big_two_small test.unit.common.ring.test_builder.TestGetRequiredOverload.test_two_big_two_small ... ok test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_wrong_signature_middle_chunk test.unit.common.middleware.s3api.test_s3request.TestStreamingInput.test_wrong_signature_middle_chunk ... ok test.unit.common.ring.test_builder.TestGetRequiredOverload.test_two_servers_with_more_than_one_replica test.unit.common.ring.test_builder.TestGetRequiredOverload.test_two_servers_with_more_than_one_replica ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_GET_enabled test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_GET_enabled ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_add_rebalance_add_rebalance_delete_rebalance test.unit.common.ring.test_builder.TestRingBuilder.test_add_rebalance_add_rebalance_delete_rebalance ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_GET_not_configured test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_GET_not_configured ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_GET_suspended test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_GET_suspended ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_PUT_enabled test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_PUT_enabled ... ok proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.55:1055/sda, error: ERROR Insufficient Storage (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server ERROR: Object DELETE returning 503 for (204, 204, 204, 204, 204, 204, 204, 204, 204, 204, 204, 204, 204, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503) (txn: tx327afff9cdf3426d98bf6-0068c57081) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.21:1021/sdv re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.19:1019/sdt re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.17:1017/sdr re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.25:1025/sdz re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.24:1024/sdy re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.27:1027/sdb re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.23:1023/sdx re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txa877019f45614530bf2b5-0068c57081) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Node is error limited: 10.0.0.6:1006/sdg (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.12:1012/sdm (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.17:1017/sdr (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.9:1009/sdj (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.14:1014/sdo (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.15:1015/sdp (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.10:1010/sdk (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.21:1021/sdv (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.25:1025/sdz (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx26f0647b708545978e361-0068c57082)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_all_primaries_error_limited test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_all_primaries_error_limited ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_cache_write_with_cached_container_info test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_cache_write_with_cached_container_info ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_add_replicas_then_rebalance_respects_weight test.unit.common.ring.test_builder.TestRingBuilder.test_add_replicas_then_rebalance_respects_weight ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_memcache_available test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_no_memcache_available ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_PUT_error test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_PUT_error ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_PUT_suspended test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_bucket_versioning_PUT_suspended ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_GET_enabled test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_GET_enabled ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_adding_region_slowly_with_unbalanceable_ring test.unit.common.ring.test_builder.TestRingBuilder.test_adding_region_slowly_with_unbalanceable_ring ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_GET_not_configured test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_GET_not_configured ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_GET_suspended test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_GET_suspended ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_read_from_cache test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_read_from_cache ... ok test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_compose_rings test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_compose_rings ... ok proxy-server DEBUG: Node is error limited: 10.0.0.3:1003/sdd (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.19:1019/sdt (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.27:1027/sdb (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.26:1026/sda (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.13:1013/sdn (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.5:1005/sdf (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.11:1011/sdl (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.23:1023/sdx (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.18:1018/sds (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.8:1008/sdi (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.16:1016/sdq (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.20:1020/sdu (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.24:1024/sdy (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.4:1004/sde (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.7:1007/sdh (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.22:1022/sdw (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx26f0647b708545978e361-0068c57082) proxy-server ERROR: Object returning 503 for [] (txn: tx26f0647b708545978e361-0068c57082) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082)test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_PUT_enabled test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_PUT_enabled ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_duplicate_but_insufficient_frag_indexes test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_duplicate_but_insufficient_frag_indexes ... ok test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_compose_rings_float_replica_count_builder_error test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_compose_rings_float_replica_count_builder_error ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_PUT_error test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_PUT_error ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_read_from_cache_empty_list test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_read_from_cache_empty_list ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_PUT_not_implemented test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_PUT_not_implemented ... ok test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_compose_rings_rebalance_needed test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_compose_rings_rebalance_needed ... ok test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_PUT_suspended test.unit.common.middleware.s3api.test_versioning.TestS3ApiVersioning.test_object_versioning_PUT_suspended ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_duplicate_but_sufficient_frag_indexes test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_duplicate_but_sufficient_frag_indexes ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_read_from_cache_error test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_read_from_cache_error ... ok test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_composite_only_one_ring_in_the_args_error test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_composite_only_one_ring_in_the_args_error ... ok test.unit.common.middleware.test_bulk.TestUntar.test_bad_container test.unit.common.middleware.test_bulk.TestUntar.test_bad_container ... ok test.unit.common.middleware.test_bulk.TestUntar.test_bad_tar test.unit.common.middleware.test_bulk.TestUntar.test_bad_tar ... ok test.unit.common.middleware.test_bulk.TestUntar.test_content_length_required test.unit.common.middleware.test_bulk.TestUntar.test_content_length_required ... ok test.unit.common.middleware.test_bulk.TestUntar.test_create_container_for_path test.unit.common.middleware.test_bulk.TestUntar.test_create_container_for_path ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_duplication_factor test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_duplication_factor ... ok test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_composite_same_device_in_the_different_rings_error test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_composite_same_device_in_the_different_rings_error ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_avoid_tier_change_new_region test.unit.common.ring.test_builder.TestRingBuilder.test_avoid_tier_change_new_region ... ok test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_composite_same_region_in_the_different_rings_error test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_composite_same_region_in_the_different_rings_error ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_call test.unit.common.middleware.test_bulk.TestUntar.test_extract_call ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_compress_type test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_compress_type ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_cont_401 test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_cont_401 ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_create_cont test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_create_cont ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_create_cont_value_err test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_create_cont_value_err ... ok test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_different_part_power_error test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_different_part_power_error ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_create_add_dev_add_replica_rebalance test.unit.common.ring.test_builder.TestRingBuilder.test_create_add_dev_add_replica_rebalance ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_max_cont test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_max_cont ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_max_failed_extractions test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_max_failed_extractions ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_max_file_size test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_max_file_size ... ok test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_different_replica_count_works test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_different_replica_count_works ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_write_to_cache test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_write_to_cache ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_obj_401 test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_obj_401 ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_obj_name_len test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_obj_name_len ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_duplication_factor_almost_duplicate_dispersion test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_duplication_factor_almost_duplicate_dispersion ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_unicode test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_fail_unicode ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_deepcopy test.unit.common.ring.test_builder.TestRingBuilder.test_deepcopy ... ok test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_ring_swap test.unit.common.ring.test_composite_builder.TestCompositeBuilder.test_ring_swap ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_with_basefile test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_with_basefile ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "PUT /sda1/3/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "PUT http://foo:8080/sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" "txa6c44734e9b642c187523-0068c57082" "object-server 1824514" 0.0085 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "PUT /sdb1/3/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "PUT http://foo:8080/sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" "txa6c44734e9b642c187523-0068c57082" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "PUT /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "PUT http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txa6c44734e9b642c187523-0068c57082" "proxy-server 1824514" 0.0345 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "PUT /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "PUT http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txa6c44734e9b642c187523-0068c57082" "proxy-server 1824514" 0.0261 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx611ee310a82644c8ba267-0068c57082" "proxy-server 1824514" 0.0174 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx9fbefd97681f4efa9c0e9-0068c57082" "proxy-server 1824514" 0.0064 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "PUT /sdb1/3/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "POST http://foo:8080/sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" "tx852fed2353614a5da7659-0068c57082" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "POST /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 202 76 "POST http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx852fed2353614a5da7659-0068c57082" "proxy-server 1824514" 0.0453 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "PUT /sda1/3/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "POST http://foo:8080/sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" "tx852fed2353614a5da7659-0068c57082" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "POST /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 202 76 "POST http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx852fed2353614a5da7659-0068c57082" "proxy-server 1824514" 0.0345 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7d05cd09cabb4a8085b5e-0068c57082" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx5d196b7fc1fb4266a6069-0068c57082" "proxy-server 1824514" 0.0112 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txcde09c56896449bf95c06-0068c57082" "proxy-server 1824514" 0.0170 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5577e624e4d14cf69fa85-0068c57082" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx8e1ef00c59da466aa8af3-0068c57082" "proxy-server 1824514" 0.0025 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txa655279751294e108b847-0068c57082" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3d545c7ac7b742e0b7881-0068c57082" "proxy-server 1824514" 0.0015 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txb61db6496c25428db111e-0068c57082" "proxy-server 1824514" 0.0096 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txd607669c87154a54953ea-0068c57082" "proxy-server 1824514" 0.0089 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0811367498734412a1ddd-0068c57082" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txaf872d7f640541e79655f-0068c57082" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx671cffd66b57434cb6832-0068c57082" "proxy-server 1824514" 0.0090 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe3f46b1a3fde4363a1143-0068c57082" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txa02b5b03206c4050b0a13-0068c57082" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txf3f9fc7566b144238e347-0068c57082" "proxy-server 1824514" 0.0008 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txf3f9fc7566b144238e347-0068c57082" "proxy-server 1824514" 0.0090 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx18cab900431341339295b-0068c57082" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txe3e57ac17c5f48d99c667-0068c57082" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txb4080421ebf941d3bba6a-0068c57082" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx29710af17071477bad8fb-0068c57082" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx54c8521e12ad48bfafccb-0068c57082" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx608d906e99644eab8fbe7-0068c57082" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx13de6c21a8bf493286e20-0068c57082" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx6a08f25e34154770869fc-0068c57082" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txc5dc53147f06471b80d3e-0068c57082" "proxy-server 1824514" 0.0007 "-" 1824514 1test.unit.common.ring.test_builder.TestRingBuilder.test_dispersion_with_zero_weight_devices test.unit.common.ring.test_builder.TestRingBuilder.test_dispersion_with_zero_weight_devices ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_write_to_cache_with_x_newest test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_GET_namespaces_write_to_cache_with_x_newest ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_many_missed_overwrite_will_need_handoff test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_many_missed_overwrite_will_need_handoff ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_abs_paths_persisted test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_abs_paths_persisted ... ok test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_works test.unit.common.middleware.test_bulk.TestUntar.test_extract_tar_works ... ok test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_cache_clearing test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_cache_clearing ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_dispersion_with_zero_weight_devices_with_parts test.unit.common.ring.test_builder.TestRingBuilder.test_dispersion_with_zero_weight_devices_with_parts ... ok test.unit.common.middleware.test_bulk.TestUntar.test_get_response_body test.unit.common.middleware.test_bulk.TestUntar.test_get_response_body ... ok test.unit.common.middleware.test_dlo.TestDloHeadManifest.test_head_large_object test.unit.common.middleware.test_dlo.TestDloHeadManifest.test_head_large_object ... ok test.unit.common.middleware.test_dlo.TestDloHeadManifest.test_head_large_object_no_segments test.unit.common.middleware.test_dlo.TestDloHeadManifest.test_head_large_object_no_segments ... ok test.unit.common.middleware.test_dlo.TestDloHeadManifest.test_head_large_object_too_many_segments test.unit.common.middleware.test_dlo.TestDloHeadManifest.test_head_large_object_too_many_segments ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_path_obj_slash_v1 test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_path_obj_slash_v1 ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_path_root_and_path test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_path_root_and_path ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_path_root_obj test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_path_root_obj ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_path_trailing_slash test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_path_trailing_slash ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_root_path_obj_slash_v1 test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_container_with_root_path_obj_slash_v1 ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_compose_modified_component_builders test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_compose_modified_component_builders ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_with_path_root_container test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_account_with_path_root_container ... ok test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_with_path_root_and_path_no_slash test.unit.common.middleware.test_domain_remap.TestDomainRemapClientMangling.test_domain_remap_with_path_root_and_path_no_slash ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_empty_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_empty_shard_container ... ok test.unit.common.middleware.test_domain_remap.TestSwiftInfo.test_registered_defaults test.unit.common.middleware.test_domain_remap.TestSwiftInfo.test_registered_defaults ... ok test.unit.common.middleware.test_domain_remap.TestSwiftInfo.test_registered_nondefaults test.unit.common.middleware.test_domain_remap.TestSwiftInfo.test_registered_nondefaults ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_accept_content_type_on_missing_qs test.unit.common.middleware.test_listing_formats.TestListingFormats.test_accept_content_type_on_missing_qs ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_accept_ignored_on_invalid_qs test.unit.common.middleware.test_listing_formats.TestListingFormats.test_accept_ignored_on_invalid_qs ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_add_vary_when_content_type_not_json test.unit.common.middleware.test_listing_formats.TestListingFormats.test_add_vary_when_content_type_not_json ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_blank_account test.unit.common.middleware.test_listing_formats.TestListingFormats.test_blank_account ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_blank_container test.unit.common.middleware.test_listing_formats.TestListingFormats.test_blank_container ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_pass_through test.unit.common.middleware.test_listing_formats.TestListingFormats.test_pass_through ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_effective_overload test.unit.common.ring.test_builder.TestRingBuilder.test_effective_overload ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_bad_but_not_terrible_json test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_bad_but_not_terrible_json ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: Problem with container shard listing response from /v1/a/c?states=listing&format=json: ValueError('not a list') (txn: tx9e711e0f68f3433a96b92-0068c57081) test ERROR: Failed to get namespaces from /v1/a/c?states=listing&format=json: invalid data: KeyError('name') (txn: tx6bb36718d1154df4935ef-0068c57081) test ERROR: Problem with container shard listing response from /v1/a/c?states=listing&format=json: ValueError('not a list') (txn: tx51947ba4ed524cc3a1faf-0068c57081) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx03aee05f96794a688ac9a-0068c57082) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&format=json (txn: tx1daa33ffe4894ad2b53be-0068c57082) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&reverse=true&format=json (txn: tx6e14af80f31e496498212-0068c57082) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&marker=jam&format=json (txn: tx7d266243efd847008c800-0068c57082) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&marker=jam&end_marker=kale&format=json (txn: tx83c0a11ce92b4679ae45e-0068c57082) test DEBUG: Found 3 shards in cache for /v1/a/c?states=listing&includes=egg&format=json (txn: txa8eeb6e3bd7a496684aa1-0068c57082) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txc5d334492d8a4cd69440c-0068c57082) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx1f4e1c7fd024480d9beda-0068c57082) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txd773e4f2b64d4645a4329-0068c57082) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx80364c09882f4f4c80f13-0068c57082) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txd18d0293fb5e4a779b798-0068c57082) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx010d4fedcd5347779bd83-0068c57082) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Skipping shard cache lookup (x-newest) for /v1/a/c?states=listing&format=json (txn: tx28a3212dd77a47d2ba4ad-0068c57082) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx28a3212dd77a47d2ba4ad-0068c57082) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} test ERROR: Aborting listing from shards due to bad response: [204] test DEBUG: GET listing from 3 shards for: /v1/a/c test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'}test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_get_from_shards_add_root_spi test.unit.proxy.controllers.test_container.TestGetPathNamespaceCachingLegacy.test_get_from_shards_add_root_spi ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_admin_disallow_info test.unit.proxy.controllers.test_info.TestInfoController.test_admin_disallow_info ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_disabled_admin_info test.unit.proxy.controllers.test_info.TestInfoController.test_disabled_admin_info ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_disabled_info test.unit.proxy.controllers.test_info.TestInfoController.test_disabled_info ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_disallow_info test.unit.proxy.controllers.test_info.TestInfoController.test_disallow_info ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info_invalid_expires test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info_invalid_expires ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info_invalid_key test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info_invalid_key ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info_invalid_method test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info_invalid_method ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info_invalid_path test.unit.proxy.controllers.test_info.TestInfoController.test_get_admin_info_invalid_path ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_get_info test.unit.proxy.controllers.test_info.TestInfoController.test_get_info ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_get_info_cors test.unit.proxy.controllers.test_info.TestInfoController.test_get_info_cors ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_head_admin_info test.unit.proxy.controllers.test_info.TestInfoController.test_head_admin_info ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_head_info test.unit.proxy.controllers.test_info.TestInfoController.test_head_info ... ok test.unit.proxy.controllers.test_info.TestInfoController.test_options_info test.unit.proxy.controllers.test_info.TestInfoController.test_options_info ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_missing_and_mixed_frags_may_503 test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_missing_and_mixed_frags_may_503 ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_compose_ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_compose_ok ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_bad_json test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_bad_json ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_all_found test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_all_found ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_ever_rebalanced test.unit.common.ring.test_builder.TestRingBuilder.test_ever_rebalanced ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_not_json test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_not_json ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_not_really_json test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_not_really_json ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_fractional_replicas_rebalance test.unit.common.ring.test_builder.TestRingBuilder.test_fractional_replicas_rebalance ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_get_part_devices test.unit.common.ring.test_builder.TestRingBuilder.test_get_part_devices ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_get_part_devices_partial_replicas test.unit.common.ring.test_builder.TestRingBuilder.test_get_part_devices_partial_replicas ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_compose_override_component_builders test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_compose_override_component_builders ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_get_ring test.unit.common.ring.test_builder.TestRingBuilder.test_get_ring ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_id test.unit.common.ring.test_builder.TestRingBuilder.test_id ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_id_copy_from test.unit.common.ring.test_builder.TestRingBuilder.test_id_copy_from ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_id_legacy_builder_file test.unit.common.ring.test_builder.TestRingBuilder.test_id_legacy_builder_file ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_id_not_initialised_errors test.unit.common.ring.test_builder.TestRingBuilder.test_id_not_initialised_errors ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_init test.unit.common.ring.test_builder.TestRingBuilder.test_init ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_errors test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_errors ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_enable_sharding test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_enable_sharding ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_initial_balance test.unit.common.ring.test_builder.TestRingBuilder.test_initial_balance ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_half_not_found_headers_and_body test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_half_not_found_headers_and_body ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_insufficient_replicas test.unit.common.ring.test_builder.TestRingBuilder.test_insufficient_replicas ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_half_not_found_statuses test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_half_not_found_statuses ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_compose_with_builder_files test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_compose_with_builder_files ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_load_errors test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_load_errors ... ok proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server ERROR: Object returning 503 for [] (txn: tx03a7a34716604dbf87f39-0068c57082) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server ERROR: Object returning 503 for [] (txn: txafcd5c3ae1f947c3b3485-0068c57082) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_missing_and_mixed_frags_will_dig_deep_but_stop test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_missing_and_mixed_frags_will_dig_deep_but_stop ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_load test.unit.common.ring.test_builder.TestRingBuilder.test_load ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_handoff test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_handoff ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_insufficient_found_plus_404_507 test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_insufficient_found_plus_404_507 ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_min_part_hours_zero_will_move_one_replica test.unit.common.ring.test_builder.TestRingBuilder.test_min_part_hours_zero_will_move_one_replica ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_insufficient_found_plus_404_507_and_handoffs_fail test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_insufficient_found_plus_404_507_and_handoffs_fail ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_exception test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_exception ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_rebalance test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_rebalance ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_missing_and_mixed_frags_will_dig_deep_but_succeed test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_missing_and_mixed_frags_will_dig_deep_but_succeed ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_more_devices_than_replicas_validation_when_removed_dev test.unit.common.ring.test_builder.TestRingBuilder.test_more_devices_than_replicas_validation_when_removed_dev ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_multiple_duplicate_device_assignment test.unit.common.ring.test_builder.TestRingBuilder.test_multiple_duplicate_device_assignment ... ok test ERROR: Aborting listing from shards due to bad response: [204] test DEBUG: GET listing from 3 shards for: /v1/a/c test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} test ERROR: Aborting listing from shards due to bad response: [204] test DEBUG: GET listing from 3 shards for: /v1/a/c test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} test ERROR: Aborting listing from shards due to bad response: [204] proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 500 Trying to DELETE /AUTH_kilroy/ascii/ascii From Object Server 10.0.0.2:1002/sdc (txn: tx714e15018c814241a2d6c-0068c57082) proxy-server ERROR: ERROR 500 Trying to DELETE /AUTH_kilroy/툎/鐉 From Object Server 10.0.0.0:1000/sda (txn: tx44226608c88f4737b1a83-0068c57082) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: tx3ee89bb90de94b4d849e3-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx18f49ac132fc4972b735e-0068c57082) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx18f49ac132fc4972b735e-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: txe7d68158b4264dbbbeb61-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: txe7d68158b4264dbbbeb61-0068c57082) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sda re: Trying to DELETE /AUTH_kilroy/ascii/ascii: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception (txn: txe7d68158b4264dbbbeb61-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx8dc5f3d4408440f787ca7-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx8dc5f3d4408440f787ca7-0068c57082) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sda re: Trying to DELETE /AUTH_kilroy/툎/鐉: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception (txn: tx8dc5f3d4408440f787ca7-0068c57082) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: txce7f7a09482f4d208e4da-0068c57082) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: tx05cd8ae75d5144958a3d8-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx05cd8ae75d5144958a3d8-0068c57082) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: tx9411e7d0c5c34885ae1f0-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx9411e7d0c5c34885ae1f0-0068c57082) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.3:1003/sda, error: ERROR Insufficient Storage (txn: tx9411e7d0c5c34885ae1f0-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.3:1003/sda (txn: tx9411e7d0c5c34885ae1f0-0068c57082) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.4:1004/sda, error: ERROR Insufficient Storage (txn: tx9411e7d0c5c34885ae1f0-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.4:1004/sda (txn: tx9411e7d0c5c34885ae1f0-0068c57082) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.5:1005/sda, error: ERROR Insufficient Storage (txn: tx9411e7d0c5c34885ae1f0-0068c57082) proxy-server DEBUG: Node is error limited: 10.0.0.5:1005/sda (txn: tx9411e7d0c5c34885ae1f0-0068c57082) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_insufficient_found_plus_507_and_handoffs_fail test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_insufficient_found_plus_507_and_handoffs_fail ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_insufficient_found_plus_timeouts test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_insufficient_found_plus_timeouts ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_rebalance_errors test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_rebalance_errors ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_limits_expirer_queue_updates test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_limits_expirer_queue_updates ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_dont_move_too_many_replicas test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_dont_move_too_many_replicas ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_rebalance_with_unrebalanced_builders test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_rebalance_with_unrebalanced_builders ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_missing_one test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_missing_one ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_mixed_etags_at_same_timestamp test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_mixed_etags_at_same_timestamp ... ok test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_save_errors test.unit.common.ring.test_composite_builder.TestCompositeRingBuilder.test_save_errors ... ok test.unit.common.ring.test_utils.TestUtils.test_build_dev_from_opts test.unit.common.ring.test_utils.TestUtils.test_build_dev_from_opts ... ok test.unit.common.ring.test_utils.TestUtils.test_build_tier_tree test.unit.common.ring.test_utils.TestUtils.test_build_tier_tree ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_mostly_found test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_mostly_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_mostly_not_found test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_mostly_not_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_none_found test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_none_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_one_found test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_one_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_simple test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_simple ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf1e1e040ebd04a898dc57-0068c57082" "proxy-server 1824514" 0.0116 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx183f30c3f72345d6a602e-0068c57082" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txf009f682c7cd4f079d501-0068c57082" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2820db7d04364e649fe29-0068c57082" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx9a015e6a8ff44aa2b6188-0068c57082" "proxy-server 1824514" 0.0093 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx655869d120f64a588595b-0068c57082" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx24c109718c044c66ba224-0068c57082" "proxy-server 1824514" 0.0136 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx9de295e48e23415d8d38d-0068c57082" "proxy-server 1824514" 0.0174 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txc309d37664f24b97aa8e8-0068c57082" "proxy-server 1824514" 0.0129 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txc309d37664f24b97aa8e8-0068c57082" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx38f25347ab3545a699978-0068c57082" "proxy-server 1824514" 0.0173 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx5d026ab4fc7a4501bcdd5-0068c57082" "proxy-server 1824514" 0.0137 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx1446a2cdb6614431ae963-0068c57082" "proxy-server 1824514" 0.0128 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txfdc463e2fc494cdb8bbbf-0068c57082" "proxy-server 1824514" 0.0134 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx9711b9f7550f406fa171b-0068c57082" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx160ea3cb6ed547829cec1-0068c57082" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5fbc02240bcd445b9506c-0068c57082" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx62a7641bcacb497d9c42b-0068c57082" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx32f831022b8e44bfa3d70-0068c57082" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx134a6cef79074a1b89d0e-0068c57082" "proxy-server 1824514" 0.0094 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 200 384 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005?format=json&states=listing" "tx134a6cef79074a1b89d0e-0068c57082" "proxy-server 1824514" 0.0063 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx54546a3a72d4432b8857a-0068c57082" "proxy-server 1824514" 0.0163 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx8db14abd58ca433bbb126-0068c57082" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx4410bb689e1246d2991f0-0068c57082" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7ec1bda423394e44a118f-0068c57082" "proxy-server 1824514" 0.0056 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:18 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx72ec3ad3365b4fc2b663c-0068c57082" "proxy-server 1824514" 0.0062 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx714a7128f9ea4baf95eac-0068c57082" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2ddec3d596474e5294511-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx60da384036934ddba98d1-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txcdcdce67d71942ef942cf-0068c57083" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx872f3f62813d4904b8284-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx5a878cb17d7e410995ea7-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx3b752b2c1f6e4b53b1182-0068c57083" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb5e790663c8e412e812ca-0068c57083" "proxy-server 1824514" 0.0095 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx88c187b99f0f4014b0249-0068c57083" "proxy-server 1824514" 0.0094 "-" 1824514 1 proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server ERROR: Object returning 503 for [] (txn: txfc8b5c5278d741e495e8c-0068c57082) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from primary (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx63d19b8e86a447a682d2d-0068c57082) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from primary (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server ERROR: Object returning 503 for [] (txn: tx42913aa3ba9843d2b6e2f-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_with_write_affinity test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_with_write_affinity ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_mixed_frags_and_no_quorum_will_503 test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_mixed_frags_and_no_quorum_will_503 ... ok test.unit.common.ring.test_utils.TestUtils.test_dispersion_report test.unit.common.ring.test_utils.TestUtils.test_dispersion_report ... ok test.unit.common.ring.test_utils.TestUtils.test_is_local_device test.unit.common.ring.test_utils.TestUtils.test_is_local_device ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_write_affinity_after_replication test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_write_affinity_after_replication ... ok test.unit.common.ring.test_utils.TestUtils.test_is_valid_hostname test.unit.common.ring.test_utils.TestUtils.test_is_valid_hostname ... ok test.unit.common.ring.test_utils.TestUtils.test_normalized_device_tier_names test.unit.common.ring.test_utils.TestUtils.test_normalized_device_tier_names ... ok test.unit.common.ring.test_utils.TestUtils.test_parse_address_old_format test.unit.common.ring.test_utils.TestUtils.test_parse_address_old_format ... ok test.unit.common.ring.test_utils.TestUtils.test_parse_args test.unit.common.ring.test_utils.TestUtils.test_parse_args ... ok test.unit.common.ring.test_utils.TestUtils.test_parse_builder_ring_filename_args test.unit.common.ring.test_utils.TestUtils.test_parse_builder_ring_filename_args ... ok test.unit.common.ring.test_utils.TestUtils.test_parse_change_values_from_opts test.unit.common.ring.test_utils.TestUtils.test_parse_change_values_from_opts ... ok test.unit.common.ring.test_utils.TestUtils.test_parse_search_value test.unit.common.ring.test_utils.TestUtils.test_parse_search_value ... ok test.unit.common.ring.test_utils.TestUtils.test_parse_search_values_from_opts test.unit.common.ring.test_utils.TestUtils.test_parse_search_values_from_opts ... ok test.unit.common.ring.test_utils.TestUtils.test_replication_defaults test.unit.common.ring.test_utils.TestUtils.test_replication_defaults ... ok test.unit.common.ring.test_utils.TestUtils.test_tiers_for_dev test.unit.common.ring.test_utils.TestUtils.test_tiers_for_dev ... ok test.unit.common.ring.test_utils.TestUtils.test_validate_and_normalize_address test.unit.common.ring.test_utils.TestUtils.test_validate_and_normalize_address ... ok test.unit.common.ring.test_utils.TestUtils.test_validate_and_normalize_ip test.unit.common.ring.test_utils.TestUtils.test_validate_and_normalize_ip ... ok test.unit.common.ring.test_utils.TestUtils.test_validate_args test.unit.common.ring.test_utils.TestUtils.test_validate_args ... ok test.unit.common.ring.test_utils.TestUtils.test_validate_args_new_cmd_format test.unit.common.ring.test_utils.TestUtils.test_validate_args_new_cmd_format ... ok test.unit.common.ring.test_utils.TestUtils.test_validate_replicas_by_tier_close test.unit.common.ring.test_utils.TestUtils.test_validate_replicas_by_tier_close ... ok test.unit.common.ring.test_utils.TestUtils.test_validate_replicas_by_tier_errors test.unit.common.ring.test_utils.TestUtils.test_validate_replicas_by_tier_errors ... ok test.unit.common.ring.test_utils.TestUtils.test_validate_replicas_by_tier_exact test.unit.common.ring.test_utils.TestUtils.test_validate_replicas_by_tier_exact ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_write_affinity_before_replication test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_DELETE_write_affinity_before_replication ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_default test.unit.common.test_memcached.TestLoadMemcache.test_conf_default ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_default_read test.unit.common.test_memcached.TestLoadMemcache.test_conf_default_read ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_extra_no_option test.unit.common.test_memcached.TestLoadMemcache.test_conf_extra_no_option ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_extra_no_section test.unit.common.test_memcached.TestLoadMemcache.test_conf_extra_no_section ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_from_extra_conf test.unit.common.test_memcached.TestLoadMemcache.test_conf_from_extra_conf ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_from_extra_conf_bad_max_conn test.unit.common.test_memcached.TestLoadMemcache.test_conf_from_extra_conf_bad_max_conn ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_from_inline_and_maxc_from_extra_conf test.unit.common.test_memcached.TestLoadMemcache.test_conf_from_inline_and_maxc_from_extra_conf ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_from_inline_and_sers_from_extra_conf test.unit.common.test_memcached.TestLoadMemcache.test_conf_from_inline_and_sers_from_extra_conf ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_bad_item_warning_threshold test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_bad_item_warning_threshold ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_bad_max_conn test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_bad_max_conn ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_all_primaries_error_limited test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_all_primaries_error_limited ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_other_max_conn test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_other_max_conn ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_ratelimiting test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_ratelimiting ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_tls test.unit.common.test_memcached.TestLoadMemcache.test_conf_inline_tls ... ok test.unit.common.test_memcached.TestLoadMemcache.test_conf_set_no_read test.unit.common.test_memcached.TestLoadMemcache.test_conf_set_no_read ... ok test.unit.common.test_registry.TestSensitiveRegistry.test_get_sensitive_headers test.unit.common.test_registry.TestSensitiveRegistry.test_get_sensitive_headers ... ok test.unit.common.test_registry.TestSensitiveRegistry.test_get_sensitive_params test.unit.common.test_registry.TestSensitiveRegistry.test_get_sensitive_params ... ok test.unit.common.test_registry.TestSensitiveRegistry.test_register_sensitive_header test.unit.common.test_registry.TestSensitiveRegistry.test_register_sensitive_header ... ok test.unit.common.test_registry.TestSensitiveRegistry.test_register_sensitive_param test.unit.common.test_registry.TestSensitiveRegistry.test_register_sensitive_param ... ok test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_200 test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_200 ... ok test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_206_multiple_ranges test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_206_multiple_ranges ... ok test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_206_single_range test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_206_single_range ... ok test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_ignore_range_header test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_ignore_range_header ... ok test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_multiple_resolove_ignore_range_header test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_multiple_resolove_ignore_range_header ... ok test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_resolove_ignore_range_header test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_resolove_ignore_range_header ... ok test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_resolve_etag_is_at_header test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_resolve_etag_is_at_header ... ok test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_update_etag_is_at_header test.unit.common.test_request_helpers.TestHTTPResponseToDocumentIters.test_update_etag_is_at_header ... ok test.unit.common.test_swob.TestAccept.test_accept_invalid test.unit.common.test_swob.TestAccept.test_accept_invalid ... ok test.unit.common.test_swob.TestAccept.test_accept_json test.unit.common.test_swob.TestAccept.test_accept_json ... ok test.unit.common.test_swob.TestAccept.test_accept_plain test.unit.common.test_swob.TestAccept.test_accept_plain ... ok test.unit.common.test_swob.TestAccept.test_accept_xml test.unit.common.test_swob.TestAccept.test_accept_xml ... ok test.unit.common.test_swob.TestAccept.test_repr test.unit.common.test_swob.TestAccept.test_repr ... ok test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_absent test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_absent ... ok test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_before test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_before ... ok test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_greater test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_greater ... ok test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_out_of_range_is_ignored test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_out_of_range_is_ignored ... ok test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_same test.unit.common.test_swob.TestConditionalIfUnmodifiedSince.test_same ... ok test.unit.common.test_swob.TestResponse.test_200_with_body_and_headers test.unit.common.test_swob.TestResponse.test_200_with_body_and_headers ... ok test.unit.common.test_swob.TestResponse.test_507 test.unit.common.test_swob.TestResponse.test_507 ... ok test.unit.common.test_swob.TestResponse.test_app_iter test.unit.common.test_swob.TestResponse.test_app_iter ... ok test.unit.common.test_swob.TestResponse.test_call_finds_nonempty_chunk test.unit.common.test_swob.TestResponse.test_call_finds_nonempty_chunk ... ok test.unit.common.test_swob.TestResponse.test_call_preserves_closeability test.unit.common.test_swob.TestResponse.test_call_preserves_closeability ... ok test.unit.common.test_swob.TestResponse.test_call_reifies_request_if_necessary test.unit.common.test_swob.TestResponse.test_call_reifies_request_if_necessary ... ok test.unit.common.test_swob.TestResponse.test_call_requires_that_start_response_is_called test.unit.common.test_swob.TestResponse.test_call_requires_that_start_response_is_called ... ok test.unit.common.test_swob.TestResponse.test_charset test.unit.common.test_swob.TestResponse.test_charset ... ok test.unit.common.test_swob.TestResponse.test_charset_content_type test.unit.common.test_swob.TestResponse.test_charset_content_type ... ok test.unit.common.test_swob.TestResponse.test_content_type test.unit.common.test_swob.TestResponse.test_content_type ... ok test.unit.common.test_swob.TestResponse.test_empty_body test.unit.common.test_swob.TestResponse.test_empty_body ... ok test.unit.common.test_swob.TestResponse.test_etag test.unit.common.test_swob.TestResponse.test_etag ... ok test.unit.common.test_swob.TestResponse.test_host_url_default test.unit.common.test_swob.TestResponse.test_host_url_default ... ok test.unit.common.test_swob.TestResponse.test_host_url_default_port_squelched test.unit.common.test_swob.TestResponse.test_host_url_default_port_squelched ... ok test.unit.common.test_swob.TestResponse.test_host_url_host_https test.unit.common.test_swob.TestResponse.test_host_url_host_https ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_expansion_more_devices test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_expansion_more_devices ... ok test.unit.common.test_swob.TestResponse.test_host_url_host_override test.unit.common.test_swob.TestResponse.test_host_url_host_override ... ok test.unit.common.test_swob.TestResponse.test_host_url_host_port_override test.unit.common.test_swob.TestResponse.test_host_url_host_port_override ... ok test.unit.common.test_swob.TestResponse.test_host_url_https test.unit.common.test_swob.TestResponse.test_host_url_https ... ok test.unit.common.test_swob.TestResponse.test_host_url_https_port_squelched test.unit.common.test_swob.TestResponse.test_host_url_https_port_squelched ... ok test.unit.common.test_swob.TestResponse.test_init_with_body_headers_app_iter test.unit.common.test_swob.TestResponse.test_init_with_body_headers_app_iter ... ok test.unit.common.test_swob.TestResponse.test_location_no_rewrite test.unit.common.test_swob.TestResponse.test_location_no_rewrite ... ok test.unit.common.test_swob.TestResponse.test_location_no_rewrite_when_told_not_to test.unit.common.test_swob.TestResponse.test_location_no_rewrite_when_told_not_to ... ok test.unit.common.test_swob.TestResponse.test_location_rewrite test.unit.common.test_swob.TestResponse.test_location_rewrite ... ok test.unit.common.test_swob.TestResponse.test_location_rewrite_no_host test.unit.common.test_swob.TestResponse.test_location_rewrite_no_host ... ok test.unit.common.test_swob.TestResponse.test_multi_range_body test.unit.common.test_swob.TestResponse.test_multi_range_body ... ok test.unit.common.test_swob.TestResponse.test_multi_ranges_wo_iter_ranges test.unit.common.test_swob.TestResponse.test_multi_ranges_wo_iter_ranges ... ok test.unit.common.test_swob.TestResponse.test_multi_response_iter test.unit.common.test_swob.TestResponse.test_multi_response_iter ... ok test.unit.common.test_swob.TestResponse.test_properties test.unit.common.test_swob.TestResponse.test_properties ... ok test.unit.common.test_swob.TestResponse.test_range_body test.unit.common.test_swob.TestResponse.test_range_body ... ok test.unit.common.test_swob.TestResponse.test_single_range_wo_iter_range test.unit.common.test_swob.TestResponse.test_single_range_wo_iter_range ... ok test.unit.common.test_swob.TestResponse.test_swob_closes_large_HEAD_resp_iter test.unit.common.test_swob.TestResponse.test_swob_closes_large_HEAD_resp_iter ... ok test.unit.common.test_swob.TestResponse.test_swob_drains_small_HEAD_resp_iter test.unit.common.test_swob.TestResponse.test_swob_drains_small_HEAD_resp_iter ... ok test.unit.common.test_swob.TestResponse.test_unicode_body test.unit.common.test_swob.TestResponse.test_unicode_body ... ok test.unit.common.test_utils.TestFileLikeIter.test_close test.unit.common.test_utils.TestFileLikeIter.test_close ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_error test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_error ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_no_durable_files test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_GET_with_no_durable_files ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_handoff test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_handoff ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_simple test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_simple ... ok test.unit.common.test_utils.TestFileLikeIter.test_get_hub test.unit.common.test_utils.TestFileLikeIter.test_get_hub ... ok test.unit.common.test_utils.TestFileLikeIter.test_iter_file_iter test.unit.common.test_utils.TestFileLikeIter.test_iter_file_iter ... ok test.unit.common.test_utils.TestFileLikeIter.test_next test.unit.common.test_utils.TestFileLikeIter.test_next ... ok test.unit.common.test_utils.TestFileLikeIter.test_read test.unit.common.test_utils.TestFileLikeIter.test_read ... ok test.unit.common.test_utils.TestFileLikeIter.test_read_empty test.unit.common.test_utils.TestFileLikeIter.test_read_empty ... ok test.unit.common.test_utils.TestFileLikeIter.test_read_with_size test.unit.common.test_utils.TestFileLikeIter.test_read_with_size ... ok test.unit.common.test_utils.TestFileLikeIter.test_read_with_size_zero test.unit.common.test_utils.TestFileLikeIter.test_read_with_size_zero ... ok test.unit.common.test_utils.TestFileLikeIter.test_readline test.unit.common.test_utils.TestFileLikeIter.test_readline ... ok test.unit.common.test_utils.TestFileLikeIter.test_readline2 test.unit.common.test_utils.TestFileLikeIter.test_readline2 ... ok test.unit.common.test_utils.TestFileLikeIter.test_readline3 test.unit.common.test_utils.TestFileLikeIter.test_readline3 ... ok test.unit.common.test_utils.TestFileLikeIter.test_readline_size_unlimited test.unit.common.test_utils.TestFileLikeIter.test_readline_size_unlimited ... ok test.unit.common.test_utils.TestFileLikeIter.test_readline_with_size test.unit.common.test_utils.TestFileLikeIter.test_readline_with_size ... ok test.unit.common.test_utils.TestFileLikeIter.test_readlines test.unit.common.test_utils.TestFileLikeIter.test_readlines ... ok test.unit.common.test_utils.TestFileLikeIter.test_readlines_with_size test.unit.common.test_utils.TestFileLikeIter.test_readlines_with_size ... ok test.unit.common.test_utils.TestNamespaceBoundList.test_eq test.unit.common.test_utils.TestNamespaceBoundList.test_eq ... ok test.unit.common.test_utils.TestNamespaceBoundList.test_get_namespace test.unit.common.test_utils.TestNamespaceBoundList.test_get_namespace ... ok test.unit.common.test_utils.TestNamespaceBoundList.test_parse test.unit.common.test_utils.TestNamespaceBoundList.test_parse ... ok test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_exception test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_exception ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_full test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_full ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift ERROR: While processing manifest /v1/AUTH_test/gettest/manifest-abcd, max LO GET time of 86400s exceeded fake-swift ERROR: while fetching /v1/AUTH_test/gettest/manifest-manifest-a, GET of submanifest /v1/AUTH_test/gettest/manifest-a failed with status 403 (

Forbidden

Access was denied to this reso...) fake-swift ERROR: While processing manifest /v1/AUTH_test/gettest/manifest-abcd, got 401 (

Unauthorized

This server could not verif...) while retrieving /v1/AUTH_test/gettest/c_15 fake-swift ERROR: while fetching /v1/AUTH_test/gettest/manifest-abcd, GET of submanifest /v1/AUTH_test/gettest/manifest-bc failed with status 401 (

Unauthorized

This server could not verif...) fake-swift ERROR: Object segment no longer valid: /v1/AUTH_test/gettest/a_5 etag: 594f803b380a41396ed63dca39503542 != wrong! or 5 != 5. fake-swift ERROR: Object segment no longer valid: /v1/AUTH_test/gettest/a_5 etag: 594f803b380a41396ed63dca39503542 != 594f803b380a41396ed63dca39503542 or 5 != 999999. fake-swift ERROR: While processing manifest /v1/AUTH_test/gettest/manifest-not-avail, got 503 (

Service Unavailable

The server is curren...) while retrieving /v1/AUTH_test/gettest/not_avail_obj fake-swift ERROR: While processing manifest /v1/AUTH_test/gettest/manifest-not-exists, got 404 (

Not Found

The resource could not be foun...) while retrieving /v1/AUTH_test/gettest/not_exists_obj fake-swift ERROR: Unable to load SLO manifest: Expecting value: line 1 column 2 (char 1) fake-swift ERROR: Unable to load SLO manifest: Expecting value: line 1 column 2 (char 1) fake-swift ERROR: while fetching /v1/AUTH_test/gettest/manifest-abcd, JSON-decoding of submanifest /v1/AUTH_test/gettest/manifest-bc failed with 500 Internal Error fake-swift ERROR: Bad MD5 checksum for /v1/AUTH_test/gettest/a_5 as part of /v1/AUTH_test/gettest/manifest: headers had 594f803b380a41396ed63dca39503542, but object MD5 was actually fb0e22c79ac75679e9881e6ba183b354 fake-swift ERROR: Object segment no longer valid: /v1/AUTH_test/gettest/b_10 etag: 82136b4240d6ce4ea7d03e51469a393b != wrong! or 10 != 10. fake-swift ERROR: Bad response length for /v1/AUTH_test/gettest/a_5 as part of /v1/AUTH_test/gettest/manifest: headers had 5, but response length was actually 4 fake-swift ERROR: Object segment no longer valid: /v1/AUTH_test/gettest/b_10 etag: 82136b4240d6ce4ea7d03e51469a393b != 82136b4240d6ce4ea7d03e51469a393b or 10 != 999999. fake-swift ERROR: While processing manifest '/v1/AUTH_test/gettest/man1', max recursion depth was exceeded fake-swift ERROR: Unable to load SLO manifest: Expecting value: line 1 column 1 (char 0) fake-swift ERROR: While processing manifest '/v1/AUTH_test/gettest/man1', max recursion depth was exceeded hello test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_formatter_extras test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_formatter_extras ... ok hello test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_init test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_init ... ok my-prefix: hello test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_init_with_prefix test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_init_with_prefix ... ok test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_thread_locals test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_thread_locals ... ok test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_thread_locals_stacked_adapter test.unit.common.utils.test_logs.TestSwiftLogAdapter.test_thread_locals_stacked_adapter ... ok test.unit.common.utils.test_timestamp.TestTimestampEncoding.test_decoding test.unit.common.utils.test_timestamp.TestTimestampEncoding.test_decoding ... ok test.unit.common.utils.test_timestamp.TestTimestampEncoding.test_encoding test.unit.common.utils.test_timestamp.TestTimestampEncoding.test_encoding ... ok test.unit.container.test_backend.TestExpirerBytesCtypeTimestamp.test_in_order_expirer_bytes_ctype test.unit.container.test_backend.TestExpirerBytesCtypeTimestamp.test_in_order_expirer_bytes_ctype ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_x_newest test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_x_newest ... ok test.unit.container.test_backend.TestExpirerBytesCtypeTimestamp.test_out_of_order_expirer_bytes_ctype test.unit.container.test_backend.TestExpirerBytesCtypeTimestamp.test_out_of_order_expirer_bytes_ctype ... ok test.unit.container.test_backend.TestExpirerBytesCtypeTimestamp.test_unupgraded_expirer_bytes_ctype test.unit.container.test_backend.TestExpirerBytesCtypeTimestamp.test_unupgraded_expirer_bytes_ctype ... ok test.unit.container.test_backend.TestUpdateNewItemFromExisting.test_update_new_item_from_existing test.unit.container.test_backend.TestUpdateNewItemFromExisting.test_update_new_item_from_existing ... ok proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: tx86b28029926e42859bb58-0068c57083) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx86b28029926e42859bb58-0068c57083) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.3:1003/sda, error: ERROR Insufficient Storage (txn: tx86b28029926e42859bb58-0068c57083) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.4:1004/sda, error: ERROR Insufficient Storage (txn: tx86b28029926e42859bb58-0068c57083) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.5:1005/sda, error: ERROR Insufficient Storage (txn: tx86b28029926e42859bb58-0068c57083) proxy-server ERROR: Object DELETE returning 503 for (204, 503, 503) (txn: tx86b28029926e42859bb58-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txe378657c6f184458aa729-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: txe378657c6f184458aa729-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx48802b219c6e478e98a89-0068c57083) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx48802b219c6e478e98a89-0068c57083) proxy-server DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx48802b219c6e478e98a89-0068c57083) proxy-server ERROR: Object GET returning 503 for [] (txn: tx48802b219c6e478e98a89-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server INFO: Client disconnected on read of '/a/c/o' (txn: my-txn-id) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:1001/sdb (txn: txa7cc905259ee4800b39cf-0068c57083) proxy-server ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:1000/sda (txn: txa7cc905259ee4800b39cf-0068c57083) proxy-server ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:1002/sdc (txn: txa7cc905259ee4800b39cf-0068c57083) proxy-server INFO: Client disconnected on read of '/a/c/o' (txn: txa7cc905259ee4800b39cf-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_newest_will_not_resume test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_newest_will_not_resume ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_not_found test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_not_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_not_found_when_404_newer test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_not_found_when_404_newer ... ok test.unit.container.test_sharder.TestContainerSharderConf.test_bad_values test.unit.container.test_sharder.TestContainerSharderConf.test_bad_values ... ok test.unit.container.test_sharder.TestContainerSharderConf.test_combine_shard_ranges test.unit.container.test_sharder.TestContainerSharderConf.test_combine_shard_ranges ... ok test.unit.container.test_sharder.TestContainerSharderConf.test_conf test.unit.container.test_sharder.TestContainerSharderConf.test_conf ... ok test.unit.container.test_sharder.TestContainerSharderConf.test_default test.unit.container.test_sharder.TestContainerSharderConf.test_default ... ok test.unit.container.test_sharder.TestContainerSharderConf.test_deprecated_percent_conf test.unit.container.test_sharder.TestContainerSharderConf.test_deprecated_percent_conf ... ok test.unit.container.test_sharder.TestContainerSharderConf.test_validate test.unit.container.test_sharder.TestContainerSharderConf.test_validate ... ok test.unit.container.test_sharder.TestContainerSharderConf.test_validate_subset test.unit.container.test_sharder.TestContainerSharderConf.test_validate_subset ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_empty_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_empty_shard_container ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txdf7cc3894e1449ddbd31f-0068c57083" "proxy-server 1824514" 0.0008 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txdf7cc3894e1449ddbd31f-0068c57083" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx24371150e54b4be783460-0068c57083" "proxy-server 1824514" 0.0093 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx2218fd64da64440d97379-0068c57083" "proxy-server 1824514" 0.0094 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txe165eb73371141cfae39e-0068c57083" "proxy-server 1824514" 0.0129 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx90a41755d3a74332aca10-0068c57083" "proxy-server 1824514" 0.0094 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx75e5ed54cdec4ff88071d-0068c57083" "proxy-server 1824514" 0.0214 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx8afbdc5008b14c6fb5752-0068c57083" "proxy-server 1824514" 0.0144 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf68e52ee90f44513b5ec3-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx0394eca091844f4ebe9f3-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx320be1df4b7d4c38b8516-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6c4e4bb62680429598c6e-0068c57083" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx1ac6686f0af9469b9ba6e-0068c57083" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx3f7accf69eb64567b1c76-0068c57083" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0bde155dc9f04878a79f2-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx0d0844ffe508456bb2d68-0068c57083" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txd90baa4a200847599756a-0068c57083" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0bb6676b6f444ad8a93b9-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txcf042b1b32cf4967be065-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx64a44380cb4a43e4a6227-0068c57083" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx64a44380cb4a43e4a6227-0068c57083" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txefcec8766b2c43d3a9a57-0068c57083" "proxy-server 1824514" 0.0015 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx34bdc3e9b8e143a9962b1-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx367c81f7aa7547efa57a7-0068c57083" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb9e8e821f31c4c80ad18c-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx4d6000235afb49ff93e87-0068c57083" "proxy-server 1824514" 0.0015 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx3a602bbc3b57410295ada-0068c57083" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe45f885858434212b348f-0068c57083" "proxy-server 1824514" 0.0045 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx744911438d59461e88a26-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx225333a3fa1e444983d96-0068c57083" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx80ed7738c73a4270a6fb5-0068c57083" "proxy-server 1824514" 0.0056 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 200 384 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005?format=json&states=listing" "tx80ed7738c73a4270a6fb5-0068c57083" "proxy-server 1824514" 0.0026 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx83aa7486f8054275802d6-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx36440cbf2e13455b83ad7-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "PUT /sdb1/3/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "PUT http://foo:8080/sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" "tx38a914c111cd4550848c3-0068c57083" "object-server 1824514" 0.0005 "-" 1824514 1test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_overfull test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_overfull ... ok test.unit.container.test_sharder.TestSharderFunctions.test_finalize_shrinking test.unit.container.test_sharder.TestSharderFunctions.test_finalize_shrinking ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_and_rank_most_cleave_progress test.unit.container.test_sharder.TestSharderFunctions.test_find_and_rank_most_cleave_progress ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_and_rank_no_complete_path test.unit.container.test_sharder.TestSharderFunctions.test_find_and_rank_no_complete_path ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_and_rank_two_sub_path_splits test.unit.container.test_sharder.TestSharderFunctions.test_find_and_rank_two_sub_path_splits ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_and_rank_whole_path_split test.unit.container.test_sharder.TestSharderFunctions.test_find_and_rank_whole_path_split ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_all_donors_shrink_to_root test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_all_donors_shrink_to_root ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_x_newest_different_timestamps test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_x_newest_different_timestamps ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_donors_but_no_suitable_acceptor test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_donors_but_no_suitable_acceptor ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_part_moves_with_0_min_part_hours test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_part_moves_with_0_min_part_hours ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_enable_sharding test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_enable_sharding ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_eligible_states test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_eligible_states ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_expansion_limit test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_expansion_limit ... ok proxy-server INFO: Client disconnected on read of '/a/c/o' (txn: tx34f01a05a6cd4c5682ae6-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx69ea0dc850ab46fca8f1c-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx69ea0dc850ab46fca8f1c-0068c57083) proxy-server ERROR: Object GET returning 503 for [] (txn: tx69ea0dc850ab46fca8f1c-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx3bf56baee05244f08bf77-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx3bf56baee05244f08bf77-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx1290ad6aa5214c2ca6ea8-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txda104bd427e24e01a323f-0068c57083) proxy-server ERROR: Object GET returning 503 for [] (txn: txda104bd427e24e01a323f-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txab751b696f0f45dbafcc0-0068c57083) proxy-server ERROR: Object GET returning 503 for [] (txn: txab751b696f0f45dbafcc0-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx588cfcbc043b442681681-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx588cfcbc043b442681681-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx6c3c5823d0af43caa1385-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx6c3c5823d0af43caa1385-0068c57083) proxy-server ERROR: Object GET returning 503 for [] (txn: tx6c3c5823d0af43caa1385-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx4766889452654953a0c52-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx4766889452654953a0c52-0068c57083)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_primaries_error_during_rebalance test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_primaries_error_during_rebalance ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_expansion_limit_with_tombstones test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_expansion_limit_with_tombstones ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_primaries_explode test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_primaries_explode ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_four_donors_two_acceptors test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_four_donors_two_acceptors ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_x_newest_with_some_missing test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_x_newest_with_some_missing ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_part_moves_with_positive_min_part_hours test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_part_moves_with_positive_min_part_hours ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_max_expanding test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_max_expanding ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_max_shrinking test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_max_shrinking ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_exception test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_exception ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_nine_donors_one_acceptor test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_nine_donors_one_acceptor ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_no_donors test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_no_donors ... ok test.unit.common.test_manager.TestServer.test_wait test.unit.common.test_manager.TestServer.test_wait ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_no_gaps test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_no_gaps ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_partial test.unit.common.ring.test_builder.TestRingBuilder.test_multitier_partial ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_negative_min_part_hours test.unit.common.ring.test_builder.TestRingBuilder.test_negative_min_part_hours ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_x_newest_with_two_vector_timestamps test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_HEAD_x_newest_with_two_vector_timestamps ... ok proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx5de162d846604665a63d7-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx6fbdc74d5a6f48eb9fe39-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx6fbdc74d5a6f48eb9fe39-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx31c3b508dfb24419b4913-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx31c3b508dfb24419b4913-0068c57083) proxy-server ERROR: Object GET returning 503 for [] (txn: tx31c3b508dfb24419b4913-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx54d5e59acf4d4ed7b0437-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx54d5e59acf4d4ed7b0437-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx54d5e59acf4d4ed7b0437-0068c57083) proxy-server ERROR: Object GET returning 503 for [] (txn: tx54d5e59acf4d4ed7b0437-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx34ecf4064b7544d1a2bca-0068c57083)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_primaries_mixed_explode_and_timeout test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_primaries_mixed_explode_and_timeout ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_primaries_timeout test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_primaries_timeout ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_removes_swift_bytes test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_removes_swift_bytes ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_overlapping_ranges test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_overlapping_ranges ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_overlarge_part_powers test.unit.common.ring.test_builder.TestRingBuilder.test_overlarge_part_powers ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_overlapping_ranges_with_ineligible_state test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_overlapping_ranges_with_ineligible_state ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_resuming test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_resuming ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_shard_ranges_in_found_state test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_shard_ranges_in_found_state ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_shrink_threshold test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_shrink_threshold ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_resuming_ignores_416 test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_resuming_ignores_416 ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_shrink_threshold_with_tombstones test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_shrink_threshold_with_tombstones ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_simple test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_simple ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "PUT /sda1/3/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "PUT http://foo:8080/sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" "tx38a914c111cd4550848c3-0068c57083" "object-server 1824514" 0.0004 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "PUT /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "PUT http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx38a914c111cd4550848c3-0068c57083" "proxy-server 1824514" 0.0140 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "PUT /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "PUT http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx38a914c111cd4550848c3-0068c57083" "proxy-server 1824514" 0.0164 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9034af08a97e46e8b7fc5-0068c57083" "proxy-server 1824514" 0.0057 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx7abfb96d461843a5a7374-0068c57083" "proxy-server 1824514" 0.0067 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "PUT /sdb1/3/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "POST http://foo:8080/sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" "tx672255255a344bd3b37e4-0068c57083" "object-server 1824514" 0.0004 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "POST /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 202 76 "POST http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx672255255a344bd3b37e4-0068c57083" "proxy-server 1824514" 0.0100 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "PUT /sda1/3/a/b464c6f353c842c7a867e3a08081f005/o" 201 - "POST http://foo:8080/sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" "tx672255255a344bd3b37e4-0068c57083" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "POST /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 202 76 "POST http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx672255255a344bd3b37e4-0068c57083" "proxy-server 1824514" 0.0117 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9ed887b73c154753a93d8-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx49e6d9dec4cc418f903b5-0068c57083" "proxy-server 1824514" 0.0071 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx96acf45fe3824427839df-0068c57083" "proxy-server 1824514" 0.0111 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe0b540466c7d414a8731e-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx1631d32290854420987ca-0068c57083" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx6009411152044a12bd8f0-0068c57083" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txaf99ee51ae3948f3adf97-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txef70ddad2c9445159d381-0068c57083" "proxy-server 1824514" 0.0024 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx9ae698ec6f9d4f29a6da6-0068c57083" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txab615875244d4c64bfc26-0068c57083" "proxy-server 1824514" 0.0085 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx7d70f90966d843e5a7ade-0068c57083" "proxy-server 1824514" 0.0182 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx83fa0b6126cd498bb7434-0068c57083" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx8133dbddd8354350954cd-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx263832c9bfd34962b840a-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx854ad7129a954b7c9d185-0068c57083" "proxy-server 1824514" 0.0008 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx854ad7129a954b7c9d185-0068c57083" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx8084069ab817455bbde2f-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txadb0c73ae39c4d0686a30-0068c57083" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx599fb265a2314fea967b4-0068c57083" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5f4552c7f8f24310a2b24-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx53b0cf77fed54316a8da8-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx8765e14a077c425eaaba0-0068c57083" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txd719aedde51c4eb6bb232-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx6feba5ead30042dca924f-0068c57083" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "GET /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx64f75afd859041bebbfc6-0068c57083" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx55d9c3b8d0cc44d7b1421-0068c57083" "proxy-server 1824514" 0.0134 "-" 1824514 -test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_single_donor_shrink_to_root test.unit.container.test_sharder.TestSharderFunctions.test_find_compactible_single_donor_shrink_to_root ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_overlapping_ranges test.unit.container.test_sharder.TestSharderFunctions.test_find_overlapping_ranges ... ok proxy-server ERROR: Object returning 503 for [] (txn: txcbc13d355ec149018a5d1-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx8d534b2d27e54735be36e-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.16:1016/sdq re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.20:1020/sdu re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.18:1018/sds re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.23:1023/sdx re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.24:1024/sdy re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.17:1017/sdr re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.22:1022/sdw re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.21:1021/sdv re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.15:1015/sdp re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.14:1014/sdo re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.25:1025/sdz re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_all_primaries_fail_insufficient_handoff_succeeds test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_all_primaries_fail_insufficient_handoff_succeeds ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_paths_with_gaps test.unit.container.test_sharder.TestSharderFunctions.test_find_paths_with_gaps ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_all_primaries_fail_sufficient_handoff_succeeds test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_all_primaries_fail_sufficient_handoff_succeeds ... ok test.unit.container.test_sharder.TestSharderFunctions.test_find_shrinking_candidates test.unit.container.test_sharder.TestSharderFunctions.test_find_shrinking_candidates ... ok test.unit.container.test_sharder.TestSharderFunctions.test_is_sharding_candidate test.unit.container.test_sharder.TestSharderFunctions.test_is_sharding_candidate ... ok test.unit.container.test_sharder.TestSharderFunctions.test_is_shrinking_candidate test.unit.container.test_sharder.TestSharderFunctions.test_is_shrinking_candidate ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_slow_read test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_slow_read ... ok test.unit.container.test_sharder.TestSharderFunctions.test_process_compactible test.unit.container.test_sharder.TestSharderFunctions.test_process_compactible ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_all_primaries_succeed test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_all_primaries_succeed ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_transfer_encoding_chunked test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_transfer_encoding_chunked ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_delete_at_in_past test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_delete_at_in_past ... ok test.unit.container.test_sharder.TestSharderFunctions.test_update_own_shard_range_stats test.unit.container.test_sharder.TestSharderFunctions.test_update_own_shard_range_stats ... ok test.unit.container.test_updater.TestContainerUpdater.test_conf_params test.unit.container.test_updater.TestContainerUpdater.test_conf_params ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_delete_at_non_integer test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_delete_at_non_integer ... ok test.unit.common.test_memcached.TestMemcached.test_connection_pool_timeout test.unit.common.test_memcached.TestMemcached.test_connection_pool_timeout ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_overload test.unit.common.ring.test_builder.TestRingBuilder.test_overload ... ok test.unit.container.test_updater.TestContainerUpdater.test_creation test.unit.container.test_updater.TestContainerUpdater.test_creation ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_find_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_find_shard_ranges ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_unable_to_resume test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_unable_to_resume ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_overload_keeps_balanceable_things_balanced_initially test.unit.common.ring.test_builder.TestRingBuilder.test_overload_keeps_balanceable_things_balanced_initially ... ok proxy-server ERROR: ERROR with Object server 10.0.0.27:1027/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.26:1026/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.19:1019/sdt re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server ERROR: Object POST returning 503 for (202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503) (txn: tx5f1d2e04788a4461bc9b1-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.16:1016/sdq re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.19:1019/sdt re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.24:1024/sdy re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.27:1027/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.25:1025/sdz re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.14:1014/sdo re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.23:1023/sdx re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.21:1021/sdv re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.20:1020/sdu re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.17:1017/sdr re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.22:1022/sdw re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.26:1026/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.15:1015/sdp re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.18:1018/sds re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2393ad610ef4470ca6077-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_insufficient_primaries_others_fail_handoffs_404 test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_insufficient_primaries_others_fail_handoffs_404 ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_with_multirange_slow_body_resumes test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_with_multirange_slow_body_resumes ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_overload_keeps_balanceable_things_balanced_on_rebalance test.unit.common.ring.test_builder.TestRingBuilder.test_overload_keeps_balanceable_things_balanced_on_rebalance ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_oversmall_part_powers test.unit.common.ring.test_builder.TestRingBuilder.test_oversmall_part_powers ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_find_shard_ranges_errors test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_find_shard_ranges_errors ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_part_swapping_problem test.unit.common.ring.test_builder.TestRingBuilder.test_part_swapping_problem ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_with_multirange_slow_body_resumes_after_body_started test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_with_multirange_slow_body_resumes_after_body_started ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_rebalance_part_on_deleted_other_part_on_drained test.unit.common.ring.test_builder.TestRingBuilder.test_rebalance_part_on_deleted_other_part_on_drained ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_with_multirange_slow_body_resumes_before_body_started test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_with_multirange_slow_body_resumes_before_body_started ... ok proxy-server ERROR: ERROR with Object server 10.0.0.26:1026/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.17:1017/sdr re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.20:1020/sdu re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.19:1019/sdt re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.24:1024/sdy re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server ERROR: Object POST returning 503 for (202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503) (txn: tx8e0c54cb67c14fd5b41dd-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.17:1017/sdr re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.15:1015/sdp re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.14:1014/sdo re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.21:1021/sdv re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.24:1024/sdy re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to POST /a/c/o: Timeout (Nones) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.28:1028/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.29:1029/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.30:1030/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.31:1031/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.32:1032/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.33:1033/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.34:1034/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.35:1035/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.36:1036/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.37:1037/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.38:1038/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.39:1039/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.40:1040/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.41:1041/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.42:1042/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.43:1043/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.44:1044/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.45:1045/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.46:1046/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.47:1047/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.48:1048/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.49:1049/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.50:1050/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_insufficient_primaries_others_fail_handoffs_fail test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_insufficient_primaries_others_fail_handoffs_fail ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_insufficient_primaries_succeed_others_404 test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_insufficient_primaries_succeed_others_404 ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_limits_expirer_queue_deletes test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_limits_expirer_queue_deletes ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_rebalance_post_upgrade test.unit.common.ring.test_builder.TestRingBuilder.test_rebalance_post_upgrade ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_negative_delete_after test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_negative_delete_after ... ok proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx34ecf4064b7544d1a2bca-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx34ecf4064b7544d1a2bca-0068c57083) proxy-server ERROR: Object GET returning 503 for [] (txn: tx34ecf4064b7544d1a2bca-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txaf79a8e7ce2648449773b-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txaf79a8e7ce2648449773b-0068c57083) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txaf79a8e7ce2648449773b-0068c57083) proxy-server ERROR: Object GET returning 503 for [] (txn: txaf79a8e7ce2648449773b-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server INFO: Client disconnected on read of '/a/c/o' (txn: tx460b958b3bc949fa9343e-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read object during GET (retrying) 10.0.0.0:1000/sda (txn: tx2a1c5ce057e54babac6e1-0068c57083) proxy-server ERROR: Trying to read object during GET (retrying) 10.0.0.2:1002/sdc (txn: tx2a1c5ce057e54babac6e1-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read object during GET (retrying) 10.0.0.2:1002/sdc (txn: txf8a1bdd509874f43af217-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server INFO: Client disconnected on read of '/a/c/o' (txn: txcfdd784d9c5d462bb567d-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read object during GET (retrying) 10.0.0.2:1002/sdc (txn: tx5b7e3254e6314eb6a5107-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server INFO: Client disconnected on read of '/a/c/o' (txn: tx7f47dea57ece4cc3a3c62-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read object during GET (retrying) 10.0.0.2:1002/sdc (txn: tx2a44337fc3cc4ecf9249c-0068c57083) proxy-server ERROR: Trying to read object during GET (retrying) 10.0.0.1:1001/sdb (txn: tx2a44337fc3cc4ecf9249c-0068c57083) proxy-server ERROR: Trying to read object during GET (retrying) 10.0.0.0:1000/sda (txn: tx2a44337fc3cc4ecf9249c-0068c57083) proxy-server INFO: Client disconnected on read of '/a/c/o' (txn: tx2a44337fc3cc4ecf9249c-0068c57083) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read next part of object multi-part GET (retrying) 10.0.0.1:1001/sdb (txn: tx4dba83c8f1fd479e9376b-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read object during GET (retrying) 10.0.0.2:1002/sdc (txn: txbc125f4a5f8347ecb0f22-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read next part of object multi-part GET (retrying) 10.0.0.2:1002/sdc (txn: tx3cff72312cde4e2b94731-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_with_multirange_slow_body_unable_to_resume test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_with_multirange_slow_body_unable_to_resume ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_x_newest_not_found_when_404_newer test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_GET_x_newest_not_found_when_404_newer ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_find_shard_ranges_with_misplaced_objects test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_find_shard_ranges_with_misplaced_objects ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_with_crypto_different_root_secrets test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_with_crypto_different_root_secrets ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_non_int_delete_after test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_non_int_delete_after ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_sufficient_primaries_succeed_others_404 test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_sufficient_primaries_succeed_others_404 ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_error_limit_supression_count test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_error_limit_supression_count ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_rebalance_with_seed test.unit.common.ring.test_builder.TestRingBuilder.test_rebalance_with_seed ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_removes_swift_bytes test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_removes_swift_bytes ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_simple test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_simple ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_sufficient_primaries_succeed_others_fail test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_POST_sufficient_primaries_succeed_others_fail ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_reduce_replicas_after_remove_device test.unit.common.ring.test_builder.TestRingBuilder.test_reduce_replicas_after_remove_device ... ok Traceback (most recent call last): test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_delete_at_in_past test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_delete_at_in_past ... ok File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 420, in set raise MemcacheConnectionError('failed set: %s' % msg) swift.common.exceptions.MemcacheConnectionError: failed set: During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/queue.py", line 117, in switch self.greenlet.switch(value) ~~~~~~~~~~~~~~~~~~~~^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 998, in _timing_stats result = func(cache, *args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 424, in set self._exception_occurred(server, e, cmd, conn_start_time, ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ sock=sock, fp=fp) ^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 271, in _exception_occurred elif isinstance(e, (socket.error, MemcacheConnectionError)): ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: isinstance() arg 2 must be a type, a tuple of types, or a union test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_x_newest test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_x_newest ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_region_fullness_with_balanceable_ring test.unit.common.ring.test_builder.TestRingBuilder.test_region_fullness_with_balanceable_ring ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_delete_at_non_integer test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_delete_at_non_integer ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_x_newest_different_timestamps test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_x_newest_different_timestamps ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_region_fullness_with_unbalanceable_ring test.unit.common.ring.test_builder.TestRingBuilder.test_region_fullness_with_unbalanceable_ring ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_remove_a_lot test.unit.common.ring.test_builder.TestRingBuilder.test_remove_a_lot ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_x_newest_with_some_missing test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_x_newest_with_some_missing ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_limits_expirer_queue_deletes test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_limits_expirer_queue_deletes ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_x_newest_with_two_vector_timestamps test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_HEAD_x_newest_with_two_vector_timestamps ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_negative_delete_after test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_negative_delete_after ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_remove_dev test.unit.common.ring.test_builder.TestRingBuilder.test_remove_dev ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx630a6e3ee7124e1592741-0068c57083" "proxy-server 1824514" 0.0249 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "txb50fb7d63ba5478d8b64a-0068c57083" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx10ef0d819066437480331-0068c57083" "proxy-server 1824514" 0.0096 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx87d308638bd140f9bd50b-0068c57083" "proxy-server 1824514" 0.0102 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx52d30cad20274a7f9575d-0068c57083" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txae0d8b197acc4968a045b-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txba9ec63c9bea4f928cae7-0068c57083" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx3412ab361e154a19965fa-0068c57083" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:19 +0000] "HEAD /sdc1/0/a/b464c6f353c842c7a867e3a08081f005/o" 412 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx3412ab361e154a19965fa-0068c57083" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx57a68a8c637944b595322-0068c57083" "proxy-server 1824514" 0.0176 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "txbd2d981f5fd64dfcbd432-0068c57084" "proxy-server 1824514" 0.0175 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx7d9a371c63874869a9d8a-0068c57084" "proxy-server 1824514" 0.0129 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txedac79e992bb4f249a7b9-0068c57084" "proxy-server 1824514" 0.0094 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx683c2f06c73748caab409-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 304 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx3b7a78a00287423cb8591-0068c57084" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx836c0fa0ba754d4c8aa4a-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 204 - "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005" "tx2ae01411cc6b49f4a9577-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdd1/0/a/b464c6f353c842c7a867e3a08081f005/o" 200 24 "HEAD http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005/o" "tx0e48c8e72b484b3d91889-0068c57084" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7574116c3c3e4d63b3e6c-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sda1/3/a/b464c6f353c842c7a867e3a08081f005" 200 410 "GET http://foo:8080/v1/a/b464c6f353c842c7a867e3a08081f005?format=json&states=listing" "tx7574116c3c3e4d63b3e6c-0068c57084" "proxy-server 1824514" 0.0077 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx196bc2282d224cbd97f75-0068c57084" "proxy-server 1824514" 0.0012 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sda1/1/a/20792238ca1147c5a16b6fb2998a1aaf" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" "tx196bc2282d224cbd97f75-0068c57084" "container-server 1824514" 0.0052 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sdb1/1/a/20792238ca1147c5a16b6fb2998a1aaf" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/20792238ca1147c5a16b6fb2998a1aaf" "tx196bc2282d224cbd97f75-0068c57084" "container-server 1824514" 0.0011 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 201 - "PUT http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx196bc2282d224cbd97f75-0068c57084" "proxy-server 1824514" 0.0401 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sda1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 201 - "PUT http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx196bc2282d224cbd97f75-0068c57084" "proxy-server 1824514" 0.0327 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx920b097ba0d54deaaf20d-0068c57084" "proxy-server 1824514" 0.0141 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx920b097ba0d54deaaf20d-0068c57084" "proxy-server 1824514" 0.0135 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txde432190e99c422fa9de9-0068c57084" "proxy-server 1824514" 0.0039 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx92771087abf7446388040-0068c57084" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 201 - "PUT http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txcbede36659dd4c9da78d9-0068c57084" "proxy-server 1824514" 0.0415 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sda1/3/a/20792238ca1147c5a16b6fb2998a1aaf/o" 201 - "PUT http://foo:8080/sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txcbede36659dd4c9da78d9-0068c57084" "object-server 1824514" 0.0047 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf/o" 201 - "PUT http://foo:8080/sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txcbede36659dd4c9da78d9-0068c57084" "object-server 1824514" 0.0071 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 201 - "PUT http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txcbede36659dd4c9da78d9-0068c57084" "proxy-server 1824514" 0.0444 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 201 - "PUT http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txcbede36659dd4c9da78d9-0068c57084" "proxy-server 1824514" 0.0442 "-" 1824514 3test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_all_primaries_fail_insufficient_handoff_succeeds test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_all_primaries_fail_insufficient_handoff_succeeds ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_remove_last_partition_from_zero_weight test.unit.common.ring.test_builder.TestRingBuilder.test_remove_last_partition_from_zero_weight ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_non_int_delete_after test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_non_int_delete_after ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_all_primaries_fail_sufficient_handoff_succeeds test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_all_primaries_fail_sufficient_handoff_succeeds ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_requires_length test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_PUT_requires_length ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_remove_zero_weighted test.unit.common.ring.test_builder.TestRingBuilder.test_remove_zero_weighted ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_all_primaries_succeed test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_all_primaries_succeed ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_brokers test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_brokers ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_delete_at_configure_task_container_per_day test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_delete_at_configure_task_container_per_day ... ok proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.51:1051/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.52:1052/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.53:1053/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.54:1054/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.55:1055/sda, error: ERROR Insufficient Storage (txn: txf704f51cde00412884ee1-0068c57084) proxy-server ERROR: Object POST returning 503 for (202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 202, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503, 503) (txn: txf704f51cde00412884ee1-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.25:1025/sdz re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.14:1014/sdo re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.24:1024/sdy re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.17:1017/sdr re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.18:1018/sds re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.20:1020/sdu re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.15:1015/sdp re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx731554ca26c34f988c0b9-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_connect_put_node_timeout test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_connect_put_node_timeout ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_rerebalance test.unit.common.ring.test_builder.TestRingBuilder.test_rerebalance ... ok Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 420, in set raise MemcacheConnectionError('failed set: %s' % msg) swift.common.exceptions.MemcacheConnectionError: failed set: During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/queue.py", line 117, in switch self.greenlet.switch(value) ~~~~~~~~~~~~~~~~~~~~^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 998, in _timing_stats result = func(cache, *args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 424, in set self._exception_occurred(server, e, cmd, conn_start_time, ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ sock=sock, fp=fp) ^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 271, in _exception_occurred elif isinstance(e, (socket.error, MemcacheConnectionError)): ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ TypeError: isinstance() arg 2 must be a type, a tuple of types, or a union proxy-server ERROR: Trying to read next part of object multi-part GET (retrying) 10.0.0.1:1001/sdb (txn: tx77a1fe964a5042aca8a71-0068c57084) proxy-server ERROR: Trying to read next part of object multi-part GET (retrying) 10.0.0.0:1000/sda (txn: tx77a1fe964a5042aca8a71-0068c57084) proxy-server ERROR: Trying to read next part of object multi-part GET (retrying) 10.0.0.2:1002/sdc (txn: tx77a1fe964a5042aca8a71-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx073d484ac61d403982649-0068c57084) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx073d484ac61d403982649-0068c57084) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx99cdb0705bbd40a185198-0068c57084) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx7b155a30c900452aab1fc-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a/c/o: Timeout (Nones) (txn: tx7b155a30c900452aab1fc-0068c57084) proxy-server ERROR: Object HEAD returning 503 for [] (txn: tx7b155a30c900452aab1fc-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a/c/o: Timeout (Nones) (txn: tx504ee9c4c6ae4e70b1979-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx504ee9c4c6ae4e70b1979-0068c57084) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx504ee9c4c6ae4e70b1979-0068c57084) proxy-server ERROR: Object HEAD returning 503 for [507] (txn: tx504ee9c4c6ae4e70b1979-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a/c/o: Timeout (Nones) (txn: txd3fb69e0b7a049b78b30c-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: txd3fb69e0b7a049b78b30c-0068c57084) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: txd3fb69e0b7a049b78b30c-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx0e63c2e22560466da78b7-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx0e63c2e22560466da78b7-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx0e63c2e22560466da78b7-0068c57084) proxy-server ERROR: Object POST returning 503 for (202, 503, 503) (txn: tx0e63c2e22560466da78b7-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx42d3c00f82494b1cbbdb8-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx42d3c00f82494b1cbbdb8-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx42d3c00f82494b1cbbdb8-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_delete_at_in_past test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_delete_at_in_past ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_delete_at_non_integer test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_delete_at_non_integer ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_container_sync_delete test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_container_sync_delete ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_reuse_of_dev_holes_with_id test.unit.common.ring.test_builder.TestRingBuilder.test_reuse_of_dev_holes_with_id ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_delete_at_with_x_open_expired test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_delete_at_with_x_open_expired ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_insufficient_primaries_others_fail_handoffs_404 test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_insufficient_primaries_others_fail_handoffs_404 ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_container_update_backend_requests test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_container_update_backend_requests ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_insufficient_primaries_others_fail_handoffs_fail test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_insufficient_primaries_others_fail_handoffs_fail ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_insufficient_primaries_succeed_others_404 test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_insufficient_primaries_succeed_others_404 ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_reuse_of_dev_holes_without_id test.unit.common.ring.test_builder.TestRingBuilder.test_reuse_of_dev_holes_without_id ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_db_state test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_db_state ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_limits_expirer_queue_deletes test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_limits_expirer_queue_deletes ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_delete_at_backend_requests test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_delete_at_backend_requests ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_overlapping_shards_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_overlapping_shards_no_memcache ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_determine_chunk_destinations_prioritize_more_missing test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_determine_chunk_destinations_prioritize_more_missing ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_round_off_error test.unit.common.ring.test_builder.TestRingBuilder.test_round_off_error ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_negative_delete_after test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_negative_delete_after ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_non_int_delete_after test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_non_int_delete_after ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txbbb90f3290cb4986b360e-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "txba2425881b2a46cea5571-0068c57084" "proxy-server 1824514" 0.0099 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sda1/3/a/20792238ca1147c5a16b6fb2998a1aaf/o" 201 - "POST http://foo:8080/sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txfec91b6f5c1c499cae8e9-0068c57084" "object-server 1824514" 0.0005 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "PUT /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf/o" 201 - "POST http://foo:8080/sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txfec91b6f5c1c499cae8e9-0068c57084" "object-server 1824514" 0.0005 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "POST /sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 202 76 "POST http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txfec91b6f5c1c499cae8e9-0068c57084" "proxy-server 1824514" 0.0176 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "POST /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 202 76 "POST http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txfec91b6f5c1c499cae8e9-0068c57084" "proxy-server 1824514" 0.0171 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "POST /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 202 76 "POST http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txfec91b6f5c1c499cae8e9-0068c57084" "proxy-server 1824514" 0.0209 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx57551fa196044c739bbd0-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx55e42927fe8540bcaab90-0068c57084" "proxy-server 1824514" 0.0115 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx61346b8046c6422ca1c6a-0068c57084" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx61346b8046c6422ca1c6a-0068c57084" "proxy-server 1824514" 0.0087 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txcf8046fc0e364f92bfe95-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "txd11cb13ce1b245cb878f1-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx261819a8a1b34ae7ba7fc-0068c57084" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx43e5a4fee29e43b2b5409-0068c57084" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx41a79249d67c48ed82ba0-0068c57084" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txcad616bb198f43c590418-0068c57084" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txcad616bb198f43c590418-0068c57084" "proxy-server 1824514" 0.0009 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx00e28e139a32474e86bfd-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "txbabd3cc99a0543b1bda76-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx562e8e25f52946cc95964-0068c57084" "proxy-server 1824514" 0.0050 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx562e8e25f52946cc95964-0068c57084" "proxy-server 1824514" 0.0009 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf818d29e4b6048af822d0-0068c57084" "proxy-server 1824514" 0.0031 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx4181b34c41054efcbd617-0068c57084" "proxy-server 1824514" 0.0023 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 412 - "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx2ccfe38988d14994ab679-0068c57084" "proxy-server 1824514" 0.0050 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 412 - "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx2ccfe38988d14994ab679-0068c57084" "proxy-server 1824514" 0.0008 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx2ccfe38988d14994ab679-0068c57084) proxy DEBUG: Ignoring 412 from primary (txn: tx2ccfe38988d14994ab679-0068c57084) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 412 - "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx2ccfe38988d14994ab679-0068c57084" "proxy-server 1824514" 0.0009 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx2ccfe38988d14994ab679-0068c57084) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx818a488d61c840f1b7282-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx2d75fbebf5ff4b559596d-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 304 - "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txd5be98eb173746959aeb8-0068c57084" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 304 - "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txd5be98eb173746959aeb8-0068c57084" "proxy-server 1824514" 0.0090 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 304 - "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txd5be98eb173746959aeb8-0068c57084" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7da53ffcb42344b19abe9-0068c57084" "proxy-server 1824514" 0.0094 "-" 1824514 -test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_expirer_DELETE_suppresses_expirer_queue_updates test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_expirer_DELETE_suppresses_expirer_queue_updates ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_save test.unit.common.ring.test_builder.TestRingBuilder.test_save ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_sufficient_primaries_succeed_others_404 test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_sufficient_primaries_succeed_others_404 ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_handoff_local_first_default test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_handoff_local_first_default ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_find_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_find_shard_ranges ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_sufficient_primaries_succeed_others_fail test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_POST_sufficient_primaries_succeed_others_fail ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_handoff_local_first_non_default test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_handoff_local_first_non_default ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_local_first_best_effort test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_local_first_best_effort ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_chunkreadtimeout_during_transfer_data test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_chunkreadtimeout_during_transfer_data ... ok 1 RLock(s) were not greened, to fix this error make sure you run eventlet.monkey_patch() before importing any other modules. test.unit.common.ring.test_builder.TestRingBuilder.test_save_load test.unit.common.ring.test_builder.TestRingBuilder.test_save_load ... ok test.unit.container.test_updater.TestContainerUpdater.test_error_in_process test.unit.container.test_updater.TestContainerUpdater.test_error_in_process ... ok test.unit.container.test_updater.TestContainerUpdater.test_listdir_with_exception test.unit.container.test_updater.TestContainerUpdater.test_listdir_with_exception ... ok test.unit.container.test_updater.TestContainerUpdater.test_listdir_without_exception test.unit.container.test_updater.TestContainerUpdater.test_listdir_without_exception ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_search_devs test.unit.common.ring.test_builder.TestRingBuilder.test_search_devs ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx1a143dc8e17c4cf9bc432-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx1a143dc8e17c4cf9bc432-0068c57084) proxy-server ERROR: Object POST returning 503 for (202, 503, 503) (txn: tx1a143dc8e17c4cf9bc432-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: txb4900c0459ce47d7af233-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: txb4900c0459ce47d7af233-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.3:1003/sda, error: ERROR Insufficient Storage (txn: txb4900c0459ce47d7af233-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.4:1004/sda, error: ERROR Insufficient Storage (txn: txb4900c0459ce47d7af233-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.5:1005/sda, error: ERROR Insufficient Storage (txn: txb4900c0459ce47d7af233-0068c57084) proxy-server ERROR: Object POST returning 503 for (202, 503, 503) (txn: txb4900c0459ce47d7af233-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: txb7a4dd3729994c59bcb4b-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server WARNING: ERROR Client read timeout (Nones) (txn: tx25174a30a87c42f8b3b72-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Expect: 100-continue on /AUTH_kilroy/%ED%88%8E/%E9%90%89: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: Connection refused: Please insert ten dollars (txn: tx56bac3f6f75a4364b0dff-0068c57084)test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_find_shard_ranges_errors test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_find_shard_ranges_errors ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_pretend_to_be_giant_json test.unit.common.middleware.test_listing_formats.TestListingFormats.test_static_web_pretend_to_be_giant_json ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_text_content_type_on_invalid_format_qs test.unit.common.middleware.test_listing_formats.TestListingFormats.test_text_content_type_on_invalid_format_qs ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_update_vary_does_not_duplicate test.unit.common.middleware.test_listing_formats.TestListingFormats.test_update_vary_does_not_duplicate ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_update_vary_if_present test.unit.common.middleware.test_listing_formats.TestListingFormats.test_update_vary_if_present ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_connect_exception_with_unicode_path test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_connect_exception_with_unicode_path ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_gap_in_shards_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_gap_in_shards_no_memcache ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_account test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_account ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_connect_exceptions test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_connect_exceptions ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_account_with_reserved test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_account_with_reserved ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_container test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_container ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_server_per_port test.unit.common.ring.test_builder.TestRingBuilder.test_server_per_port ... ok test.unit.container.test_updater.TestContainerUpdater.test_old_style_shard_container test.unit.container.test_updater.TestContainerUpdater.test_old_style_shard_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info_is_deleted ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_converts_delete_after_to_delete_at test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_converts_delete_after_to_delete_at ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_delete_at test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_delete_at ... ok fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'X-Copy-From': '/bucket/object', 'Content-Length': 0} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:other:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000', 'User-Agent': 'Mozzarella Foxfire'} fake-swift DEBUG: test:testertest:testertest:full_controltest:full_controlFULL_CONTROLtest:readtest:readREADtest:writetest:writeWRITEtest:read_acptest:read_acpREAD_ACPtest:write_acptest:write_acpWRITE_ACP fake-swift DEBUG: permission denined: 403 Forbidden test:other READ fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: nojunk None HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Fri, 01 Apr 2014 12:00:00 GMT', 'X-Amz-Date': 'Sat, 13 Sep 2025 13:24:17 -0000', 'User-Agent': 'Mozzarella Foxfire'} test DEBUG: checking permission: bucket None GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000'} test DEBUG: checking permission: bucket object GET {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000'} test DEBUG: checking permission: bucket object HEAD {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000'} test DEBUG: checking permission: bucket None POST {'Host': 'localhost:80', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000'} test DEBUG: bucket None POST fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Content-Encoding': 'aws-chunked', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769857.83613', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Content-Encoding': 'aws-chunked', 'X-Amz-Content-Sha256': 'de1dd78ec9c5cc0534c531a4d61c68bc3995fac4934c971ea83d5d3c3d406c32', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769857.84792', 'Content-Length': '4', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: checking permission: bucket HEAD {'Host': 'localhost:80', 'Content-Encoding': 'aws-chunked', 'X-Amz-Content-Sha256': '230d8358dc8e8890b4c58deeb62912ee2f20357ae92a5cc861b98e68fe31acb5', 'Authorization': 'AWS test:tester:hmac', 'Date': 'Sat, 13 Sep 2025 13:24:17 -0000', 'User-Agent': 'Mozzarella Foxfire', 'X-Timestamp': '1757769857.86102', 'Content-Length': '4', 'Content-Type': 'binary/octet-stream'} fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: A key is specified for bucket API. test-listing WARNING: Account listing for a%E2%98%83 had reserved byte in name: '\x00bar\x00versions' test-listing WARNING: Account listing for a%E2%98%83 had reserved byte in subdir: '\x00foo_' test-listing WARNING: Account listing for a%E2%98%83 had reserved byte in name: '\x00bar\x00versions' test-listing WARNING: Account listing for a%E2%98%83 had reserved byte in subdir: '\x00foo_' test-listing WARNING: Account listing for a%E2%98%83 had reserved byte in name: '\x00bar\x00versions' test-listing WARNING: Account listing for a%E2%98%83 had reserved byte in subdir: '\x00foo_' test-listing WARNING: Account listing for a%E2%98%83 had reserved byte in name: '\x00bar\x00versions' test-listing WARNING: Account listing for a%E2%98%83 had reserved byte in subdir: '\x00foo_' test-listing WARNING: Container listing for a%E2%98%83/c%F0%9F%8C%B4 had reserved byte in name: '\x00bar\x00extra data'test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_delete_at_in_past test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_delete_at_in_past ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_container_with_reserved test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_container_with_reserved ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_content_type_on_txt_head test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_content_type_on_txt_head ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_content_type_on_xml_head test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_content_type_on_xml_head ... ok test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_content_type_on_xml_head_with_no_content_length test.unit.common.middleware.test_listing_formats.TestListingFormats.test_valid_content_type_on_xml_head_with_no_content_length ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_bytes_quota_copy_from_bad_src test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_bytes_quota_copy_from_bad_src ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_bytes_quota_copy_from_no_src test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_bytes_quota_copy_from_no_src ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_bytes_quota_copy_from test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_bytes_quota_copy_from ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_bytes_quota_copy_verb test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_bytes_quota_copy_verb ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_delete_at_non_integer test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_delete_at_non_integer ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_counts_quota_copy_cross_account_PUT_verb test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_counts_quota_copy_cross_account_PUT_verb ... ok test.unit.common.test_memcached.TestMemcached.test_connection_pooling test.unit.common.test_memcached.TestMemcached.test_connection_pooling ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_counts_quota_copy_cross_account_verb test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_counts_quota_copy_cross_account_verb ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_counts_quota_copy_from test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_counts_quota_copy_from ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_empty_bad_etag test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_empty_bad_etag ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_counts_quota_copy_verb test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_exceed_counts_quota_copy_verb ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_set_dev_weight test.unit.common.ring.test_builder.TestRingBuilder.test_set_dev_weight ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_set_replicas test.unit.common.ring.test_builder.TestRingBuilder.test_set_replicas ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_not_exceed_bytes_quota_copy_from test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_not_exceed_bytes_quota_copy_from ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_not_exceed_bytes_quota_copy_verb test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_not_exceed_bytes_quota_copy_verb ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_error_during_transfer_data test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_error_during_transfer_data ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_set_replicas_decrease test.unit.common.ring.test_builder.TestRingBuilder.test_set_replicas_decrease ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_error_with_footers test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_error_with_footers ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_not_exceed_counts_quota_copy_from test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_not_exceed_counts_quota_copy_from ... ok test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_not_exceed_counts_quota_copy_verb test.unit.common.middleware.test_quotas.ContainerQuotaCopyingTestCases.test_not_exceed_counts_quota_copy_verb ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_account_read_only_off test.unit.common.middleware.test_read_only.TestReadOnly.test_account_read_only_off ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info_no_stale_reads test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info_no_stale_reads ... ok test.unit.container.test_updater.TestContainerUpdater.test_run_once test.unit.container.test_updater.TestContainerUpdater.test_run_once ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_find_shard_ranges_with_misplaced_objects test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_find_shard_ranges_with_misplaced_objects ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_account_read_only_on test.unit.common.middleware.test_read_only.TestReadOnly.test_account_read_only_on ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_account_read_only_on_allow_deletes test.unit.common.middleware.test_read_only.TestReadOnly.test_account_read_only_on_allow_deletes ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_non_swift_path test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_non_swift_path ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_off test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_off ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_off_destination_account_on_on_copy test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_off_destination_account_on_on_copy ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_off_src_acct_on_dest_acct_off_on_copy test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_off_src_acct_on_dest_acct_off_on_copy ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_off_src_acct_on_dest_acct_on_on_copy test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_off_src_acct_on_dest_acct_on_on_copy ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_on test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_on ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_on_account_off test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_on_account_off ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_on_allow_deletes test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_on_allow_deletes ... ok test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_on_destination_account_off_on_copy test.unit.common.middleware.test_read_only.TestReadOnly.test_global_read_only_on_destination_account_off_on_copy ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_set_replicas_increase test.unit.common.ring.test_builder.TestRingBuilder.test_set_replicas_increase ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_get_range_manifest test.unit.common.middleware.test_slo.TestSloRangeRequests.test_get_range_manifest ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_with_crypto_ec test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_with_crypto_ec ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o.jpg From Object Server 10.0.0.0:1000/sda (txn: tx8f851856395249929846e-0068c57084) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o.jpg From Object Server 10.0.0.1:1001/sdb (txn: txaba4f446e99d41b980633-0068c57084) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o.jpg From Object Server 10.0.0.2:1002/sdc (txn: txb707a0312b814f978b687-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Expect: 100-continue on /a/c/o.jpg: Timeout (Nones) (txn: tx9f44e7c615084ee78f48d-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx2622e6d11c05493f91033-0068c57084) proxy-server ERROR: ERROR 503 Expect: 100-continue From Object Server 10.0.0.2:1002/sdc (txn: txd2fc381fcf7445afb4e9f-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: txeb128f1fd79c4027b1279-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to get final status of PUT to /v1/a/c/o.jpg: Timeout (Nones) (txn: txb37fcf05f8c74889b6709-0068c57084) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to get final status of PUT to /v1/a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 525, in _get_conn_response resp = putter.await_response( self.app.node_timeout, not final_phase) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1741, in await_response self.resp = self.conn.getresponse() ~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 834, in getresponse self.status = self._status.get_response_status() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 734, in get_response_status raise self.status Exception (txn: tx457238b7f371409e8db52-0068c57084) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.1:1001/sdb, error: ERROR Insufficient Storage (txn: tx97ef2b6c9fa0458db990e-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server WARNING: Client disconnected without sending last chunk (txn: tx31114d40d0344ec9b5953-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.0:1000/sda (txn: txea4748ce41f14b5f805ec-0068c57084) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.2:1002/sdc (txn: txea4748ce41f14b5f805ec-0068c57084) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.1:1001/sdb (txn: txea4748ce41f14b5f805ec-0068c57084) proxy-server ERROR: Object PUT returning 503 for [503, 503, 503] (txn: txea4748ce41f14b5f805ec-0068c57084) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_exception_during_transfer_data test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_exception_during_transfer_data ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_final_response_errors_with_unicode_path test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_final_response_errors_with_unicode_path ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_get_expect_errors_with_unicode_path test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_get_expect_errors_with_unicode_path ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_if_none_match test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_if_none_match ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_if_none_match_denied test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_if_none_match_denied ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_if_none_match_not_star test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_if_none_match_not_star ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_insufficient_data_from_client test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_insufficient_data_from_client ... ok sharder-test DEBUG: Unlinked retiring db '/tmp/tmp9_rq07di/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' test INFO: Begin container update single threaded sweep test ERROR: Error processing container /tmp/tmpnjxtk2ug/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db: Boom!: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/updater.py", line 224, in container_sweep self.process_container(dbfile) ~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception: Boom! test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 0 failures, 0 with no changes test ERROR: ERROR: Failed to get paths to drive partitions: permission_denied test INFO: Begin container update single threaded sweep test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 0 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 0 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test DEBUG: Update report failed for /.shards_a/c /tmp/tmpbgo98yt0/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.01s, 0 successes, 1 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test DEBUG: Update report failed for /.shards_a/c /tmp/tmpbgo98yt0/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.02s, 0 successes, 1 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test DEBUG: Update report sent for /.shards_a/c /tmp/tmpbgo98yt0/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.01s, 1 successes, 0 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 0 failures, 0 with no changes test INFO: Begin container update single threaded sweep test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 0 failures, 0 with no changes test INFO: Begin container update single threaded sweep test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test DEBUG: Update report failed for /a/c /tmp/tmpsz2q_w5l/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.02s, 0 successes, 1 failures, 0 with no changes test INFO: Begin container update single threaded sweep test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test DEBUG: Update report failed for /a/c /tmp/tmpsz2q_w5l/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.02s, 0 successes, 1 failures, 0 with no changes test INFO: Begin container update single threaded sweep test DEBUG: Update report sent for /a/c /tmp/tmpsz2q_w5l/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.02s, 1 successes, 0 failures, 0 with no changes test INFO: Begin container update single threaded sweep test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 0 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon'test.unit.container.test_updater.TestContainerUpdater.test_run_once_with_device_unmounted test.unit.container.test_updater.TestContainerUpdater.test_run_once_with_device_unmounted ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_get_segment_with_non_ascii_path test.unit.common.middleware.test_slo.TestSloRangeRequests.test_get_segment_with_non_ascii_path ... ok test.unit.container.test_updater.TestContainerUpdater.test_run_once_with_get_info_timeout test.unit.container.test_updater.TestContainerUpdater.test_run_once_with_get_info_timeout ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_shuffled_gather test.unit.common.ring.test_builder.TestRingBuilder.test_shuffled_gather ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_limits_expirer_queue_deletes test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_limits_expirer_queue_deletes ... ok test.unit.common.test_memcached.TestMemcached.test_connection_slow_connect test.unit.common.test_memcached.TestMemcached.test_connection_slow_connect ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_get_subrange_manifest test.unit.common.middleware.test_slo.TestSloRangeRequests.test_get_subrange_manifest ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_first_byte test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_first_byte ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_negative_delete_after test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_negative_delete_after ... ok test.unit.common.test_memcached.TestMemcached.test_decr test.unit.common.test_memcached.TestMemcached.test_decr ... ok test.unit.common.test_memcached.TestMemcached.test_delete test.unit.common.test_memcached.TestMemcached.test_delete ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_non_int_delete_after test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_non_int_delete_after ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_on_segment_boundaries test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_on_segment_boundaries ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_requires_length test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_requires_length ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_overlapping_end test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_overlapping_end ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_sub_slo test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_sub_slo ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_unsatisfiable test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_manifest_unsatisfiable ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_range_manifest test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_range_manifest ... ok test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_subrange_manifest test.unit.common.middleware.test_slo.TestSloRangeRequests.test_range_get_subrange_manifest ... ok test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_closed_response test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_closed_response ... ok test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_get_expect test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_get_expect ... ok test.unit.container.test_updater.TestContainerUpdater.test_shard_container test.unit.container.test_updater.TestContainerUpdater.test_shard_container ... ok test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_get_with_non_ascii test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_get_with_non_ascii ... ok test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_headers_setter_with_dict test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_headers_setter_with_dict ... ok test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_headers_setter_with_message test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_headers_setter_with_message ... ok test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_headers_setter_with_message_with_payload test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_headers_setter_with_message_with_payload ... ok test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_http_connect test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_http_connect ... ok test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_nonstr_header_values test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_nonstr_header_values ... ok test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_unicode_values test.unit.common.test_bufferedhttp.TestBufferedHTTP.test_unicode_values ... ok test.unit.common.test_container_sync_realms.TestUtils.test_bad_mtime_check_interval test.unit.common.test_container_sync_realms.TestUtils.test_bad_mtime_check_interval ... ok test.unit.common.test_container_sync_realms.TestUtils.test_empty test.unit.common.test_container_sync_realms.TestUtils.test_empty ... ok test.unit.common.test_container_sync_realms.TestUtils.test_empty_realm test.unit.common.test_container_sync_realms.TestUtils.test_empty_realm ... ok test.unit.common.test_container_sync_realms.TestUtils.test_error_parsing test.unit.common.test_container_sync_realms.TestUtils.test_error_parsing ... ok test.unit.common.test_container_sync_realms.TestUtils.test_get_sig test.unit.common.test_container_sync_realms.TestUtils.test_get_sig ... ok test.unit.common.test_container_sync_realms.TestUtils.test_no_file_there test.unit.common.test_container_sync_realms.TestUtils.test_no_file_there ... ok test.unit.common.test_container_sync_realms.TestUtils.test_one_realm test.unit.common.test_container_sync_realms.TestUtils.test_one_realm ... ok test.unit.common.test_container_sync_realms.TestUtils.test_os_error test.unit.common.test_container_sync_realms.TestUtils.test_os_error ... ok test.unit.common.test_container_sync_realms.TestUtils.test_two_realms_and_change_a_default test.unit.common.test_container_sync_realms.TestUtils.test_two_realms_and_change_a_default ... ok test.unit.common.test_db.TestDatabaseConnectionError.test_str test.unit.common.test_db.TestDatabaseConnectionError.test_str ... ok test.unit.container.test_updater.TestContainerUpdater.test_unicode test.unit.container.test_updater.TestContainerUpdater.test_unicode ... ok test.unit.obj.test_updater.TestSweepStats.test_copy test.unit.obj.test_updater.TestSweepStats.test_copy ... ok test.unit.obj.test_updater.TestSweepStats.test_reset test.unit.obj.test_updater.TestSweepStats.test_reset ... ok test.unit.obj.test_updater.TestSweepStats.test_since test.unit.obj.test_updater.TestSweepStats.test_since ... ok test.unit.obj.test_updater.TestSweepStats.test_str test.unit.obj.test_updater.TestSweepStats.test_str ... ok test-replicator WARNING: Skipping: /srv/node/sdb is not mounted test-replicator INFO: Beginning replication run test-replicator INFO: Replication run OVER test-replicator INFO: Attempted to replicate 0 dbs in 0.00034 seconds (0.00000/s) test-replicator INFO: Removed 0 dbs test-replicator INFO: 0 successes, 6 failures test-replicator INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test-replicator INFO: Attempted to replicate 0 dbs in 0.00000 seconds (0.00000/s) test-replicator INFO: Removed 0 dbs test-replicator INFO: 0 successes, 0 failures test-replicator INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test-replicator INFO: Attempted to replicate 30 dbs in 246.81358 seconds (0.12155/s) test-replicator INFO: Removed 9 dbs test-replicator INFO: 25 successes, 1 failures test-replicator INFO: diff:5 diff_capped:4 empty:7 hashmatch:8 no_change:6 remote_merge:2 rsync:3 ts_repl:10 Unable to locate config number 5 for account-server Unable to locate config number 5 for object-server Signal object-server pid: 1 signal: 15 Signal object-server pid: 1 signal: 15 Signal object-server pid: 1 signal: 1 Signal object-replicator pid: 11 signal: 15 Signal object-replicator pid: 12 signal: 15 Signal proxy-server pid: 1 signal: 1 output Removing pid file /tmp/tmp8pcuj4jb/var/run/one-server.pid with wrong pid 3 output Removing pid file /tmp/tmp8pcuj4jb/var/run/zero-server.pid with invalid pid output Removing pid file /tmp/tmp8pcuj4jb/var/run/invalid-server.pid with invalid pid Signal account-reaper pid: 1 signal: 15 Signal account-reaper pid: 2 signal: 15 Signal account-reaper pid: 3 signal: 15 Signal account-reaper pid: 4 signal: 15 Signal account-reaper pid: 1 signal: 15 Signal account-reaper pid: 2 signal: 15 Signal account-reaper pid: 3 signal: 15 Signal account-reaper pid: 4 signal: 15 Signal account-reaper pid: 3 signal: 15 test ERROR: Timeout getting a connection to memcached: 1.2.3.5:11211: with key_prefix key, method set, config_timeout 0.1, time_spent 0.10553908348083496 test ERROR: Timeout getting a connection to memcached: 1.2.3.5:11211: with key_prefix key, method set, config_timeout 0.1, time_spent 0.10617256164550781 test ERROR: Timeout getting a connection to memcached: 1.2.3.5:11211: with key_prefix key, method set, config_timeout 0.1, time_spent 0.10635662078857422 test ERROR: Timeout getting a connection to memcached: 1.2.3.5:11211: with key_prefix key, method set, config_timeout 0.1, time_spent 0.10650086402893066 test ERROR: Timeout getting a connection to memcached: 1.2.3.5:11211: with key_prefix key, method set, config_timeout 0.1, time_spent 0.10663747787475586 test ERROR: Timeout getting a connection to memcached: 1.2.3.5:11211: with key_prefix key, method set, config_timeout 0.1, time_spent 0.10676884651184082 test ERROR: Timeout getting a connection to memcached: 1.2.3.5:11211: with key_prefix key, method set, config_timeout 0.1, time_spent 0.10689783096313477 test ERROR: Timeout getting a connection to memcached: 1.2.3.5:11211: with key_prefix key, method set, config_timeout 0.1, time_spent 0.10702371597290039 test ERROR: Timeout getting a connection to memcached: 1.2.3.4:11211: with key_prefix key, method set, config_timeout 1.0, time_spent 1.0001072883605957 test ERROR: Error connecting to memcached: ALL: with key_prefix key, method set: No more memcached servers to try test ERROR: Timeout getting a connection to memcached: 1.2.3.4:11211: with key_prefix key, method set, config_timeout 1.0, time_spent 1.0004520416259766 test ERROR: Error connecting to memcached: ALL: with key_prefix key, method set: No more memcached servers to try test ERROR: Timeout getting a connection to memcached: 1.2.3.4:11211: with key_prefix key, method set, config_timeout 1.0, time_spent 1.0006096363067627 test ERROR: Error connecting to memcached: ALL: with key_prefix key, method set: No more memcached servers to try test ERROR: Timeout getting a connection to memcached: 1.2.3.4:11211: with key_prefix key, method set, config_timeout 1.0, time_spent 1.0007352828979492 test ERROR: Error connecting to memcached: ALL: with key_prefix key, method set: No more memcached servers to try test ERROR: Timeout getting a connection to memcached: 1.2.3.4:11211: with key_prefix key, method set, config_timeout 1.0, time_spent 1.0008630752563477 test ERROR: Error connecting to memcached: ALL: with key_prefix key, method set: No more memcached servers to try test ERROR: Timeout getting a connection to memcached: 1.2.3.4:11211: with key_prefix key, method set, config_timeout 1.0, time_spent 1.0009827613830566 test ERROR: Error connecting to memcached: ALL: with key_prefix key, method set: No more memcached servers to try test ERROR: Timeout getting a connection to memcached: 1.2.3.4:11211: with key_prefix key, method set, config_timeout 1.0, time_spent 1.0010933876037598 test ERROR: Error connecting to memcached: ALL: with key_prefix key, method set: No more memcached servers to try test ERROR: Timeout getting a connection to memcached: 1.2.3.4:11211: with key_prefix key, method set, config_timeout 1.0, time_spent 1.001206636428833 test ERROR: Error connecting to memcached: ALL: with key_prefix key, method set: No more memcached servers to try test ERROR: Timeout connecting to memcached: 1.2.3.4:11211: with key_prefix key, method set, config_timeout 0.1, time_spent 0.10226988792419434 test ERROR: Error connecting to memcached: ALL: with key_prefix key, method set: No more memcached servers to try test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method decr, time_spent 2.1457672119140625e-05: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 515, in incr new_val = self._incr_or_decr(fp, sock, cmd, delta_val) File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 475, in _incr_or_decr line = fp.readline().strip().split() ^^^^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'strip' test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipetest.unit.common.test_memcached.TestMemcached.test_error_disabled test.unit.common.test_memcached.TestMemcached.test_error_disabled ... ok test.unit.common.test_memcached.TestMemcached.test_error_limiting test.unit.common.test_memcached.TestMemcached.test_error_limiting ... ok proxy-server ERROR: ERROR Exception transferring data to object servers {'path': '/v1/a/c/o.jpg'}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1011, in _transfer_data chunk = next(data_source) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2446, in __next__ return self._get_next_item() ~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 5231, in _get_next_item return super(CooperativeIterator, self)._get_next_item() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2442, in _get_next_item return next(self.wrapped_iter) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 878, in reader return req.environ['wsgi.input'].read( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ self.app.client_chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/controllers/test_obj.py", line 1992, in read raise Exception('exception message') Exception: exception message (txn: txfa20969ed02c43229b3d2-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to get final status of PUT to /v1/AUTH_kilroy/%ED%88%8E/%E9%90%89: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 525, in _get_conn_response resp = putter.await_response( self.app.node_timeout, not final_phase) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1741, in await_response self.resp = self.conn.getresponse() ~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 834, in getresponse self.status = self._status.get_response_status() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 734, in get_response_status raise self.status Exception: boom (txn: tx4701ad25696342b1a357b-0068c57085) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to get final status of PUT to /v1/AUTH_kilroy/%ED%88%8E/%E9%90%89: Timeout (Nones) (txn: txa36656787819414facb05-0068c57085) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx380a1e20ee7e4cf089a02-0068c57085) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: txd00e2aade89247d09e6f1-0068c57085) proxy-server ERROR: ERROR 500 b'' Trying to PUT /v1/AUTH_kilroy/%ED%88%8E/%E9%90%89 From Object Server 10.0.0.1:1001/sdb (txn: txd00e2aade89247d09e6f1-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: tx6aa9d964255b442e8f769-0068c57085) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx424abdd726ea44f695bc9-0068c57085) proxy-server ERROR: ERROR 503 Expect: 100-continue From Object Server 10.0.0.2:1002/sdc (txn: tx424abdd726ea44f695bc9-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Object PUT returning 412, [412] (txn: txde8366427a08436d9c4f8-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server WARNING: Client disconnected without sending enough data (txn: tx533a569b5731459bbd04e-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to write to /AUTH_kilroy/%ED%88%8E/%E9%90%89: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1784, in _send_chunk self.conn.send(to_send) ~~~~~~~~~~~~~~^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 912, in send self.give_send(self, data) ~~~~~~~~~~~~~~^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/controllers/test_obj.py", line 1780, in capture_send raise exc Exception: Exception while sending data on connection (txn: tx74aa0834d94a4bcc9e5fa-0068c57085)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_send_exception_with_unicode_path test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_send_exception_with_unicode_path ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_simple test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_simple ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_timeout_during_transfer_data test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_timeout_during_transfer_data ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_with_body_and_no_footers test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_with_body_and_no_footers ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_with_chunked_body_and_no_footers test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_with_chunked_body_and_no_footers ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_with_no_body_and_no_footers test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_PUT_with_no_body_and_no_footers ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx80e23940b102402e87f10-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 304 - "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx0212279ece5f4a508a97f-0068c57084" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 304 - "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx0212279ece5f4a508a97f-0068c57084" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 304 - "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx0212279ece5f4a508a97f-0068c57084" "proxy-server 1824514" 0.0009 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx74939c20188541f7864e6-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx17da7d309f63477fa1a9b-0068c57084" "proxy-server 1824514" 0.0093 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx291cb833f1b545168fe81-0068c57084" "proxy-server 1824514" 0.0092 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "GET /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx291cb833f1b545168fe81-0068c57084" "proxy-server 1824514" 0.0009 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txbe8900a20f60411f804d4-0068c57084" "proxy-server 1824514" 0.0094 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "txcc800877f37a4374af260-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx737cb73148514cf2a27f4-0068c57084" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7fdbb3b2eea64e6eb3d16-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "txad95c8253a8b45cda33c6-0068c57084" "proxy-server 1824514" 0.0024 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txa6c7ca3079044e21b6a6a-0068c57084" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7221f23f504d41cd83be3-0068c57084" "proxy-server 1824514" 0.0080 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "txee8250ac50164bdeb65c3-0068c57084" "proxy-server 1824514" 0.0047 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 412 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx5556d3a12b8d4ce39bf07-0068c57084" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdi1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 412 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx5556d3a12b8d4ce39bf07-0068c57084" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 412 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx5556d3a12b8d4ce39bf07-0068c57084" "proxy-server 1824514" 0.0036 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txbaddedd3008347c597201-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "txae4e364ce4bc4ef2986a0-0068c57084" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 304 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx9833ea5e7a7c442884e0e-0068c57084" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3c7b75b325e243939469e-0068c57084" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx70f6e348745e413e80bd2-0068c57084" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:20 +0000] "HEAD /sdh1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 304 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "tx7d93fcc06962420895887-0068c57084" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx73d82eea18f140268b043-0068c57085" "proxy-server 1824514" 0.0011 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 204 - "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf" "tx12df6dda8bd34ec2a6f1e-0068c57085" "proxy-server 1824514" 0.0011 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdg1/0/a/20792238ca1147c5a16b6fb2998a1aaf/o" 200 92 "HEAD http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf/o" "txadbd683cd6764e768b76e-0068c57085" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx02dcc4386aeb4bb5a3c6f-0068c57085" "proxy-server 1824514" 0.0054 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sdb1/3/a/20792238ca1147c5a16b6fb2998a1aaf" 200 380 "GET http://foo:8080/v1/a/20792238ca1147c5a16b6fb2998a1aaf?format=json&states=listing" "tx02dcc4386aeb4bb5a3c6f-0068c57085" "proxy-server 1824514" 0.0063 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6645c800a41948f793bec-0068c57085" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/1/a/1abad7d5809f4a7c93d04fc36bc996c3" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx6645c800a41948f793bec-0068c57085" "container-server 1824514" 0.0011 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/1/a/1abad7d5809f4a7c93d04fc36bc996c3" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx6645c800a41948f793bec-0068c57085" "container-server 1824514" 0.0010 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 201 - "PUT http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx6645c800a41948f793bec-0068c57085" "proxy-server 1824514" 0.0364 "-" 1824514 1test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_connect_put_node_timeout test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_connect_put_node_timeout ... ok test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error limiting server 1.2.3.5:11211 test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error limiting server 1.2.3.4:11211 test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method get: No more memcached servers to try test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error limiting server 1.2.3.5:11211 test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipetest.unit.common.test_memcached.TestMemcached.test_error_limiting_custom_config test.unit.common.test_memcached.TestMemcached.test_error_limiting_custom_config ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_undispersable_server_converge_on_balance test.unit.common.ring.test_builder.TestRingBuilder.test_undispersable_server_converge_on_balance ... ok test.unit.common.test_memcached.TestMemcached.test_error_raising test.unit.common.test_memcached.TestMemcached.test_error_raising ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_delete test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_delete ... ok test.unit.common.test_db.TestGreenDBConnection.test_execute_when_locked test.unit.common.test_db.TestGreenDBConnection.test_execute_when_locked ... ok test.unit.common.test_db.TestHelperFunctions.test_zero_like test.unit.common.test_db.TestHelperFunctions.test_zero_like ... ok test.unit.common.test_memcached.TestMemcached.test_get_conns test.unit.common.test_memcached.TestMemcached.test_get_conns ... ok test.unit.common.test_memcached.TestMemcached.test_get_conns_bad_v6 test.unit.common.test_memcached.TestMemcached.test_get_conns_bad_v6 ... ok test.unit.common.test_memcached.TestMemcached.test_get_conns_hostname test.unit.common.test_memcached.TestMemcached.test_get_conns_hostname ... ok test.unit.common.test_memcached.TestMemcached.test_get_failed_connection_mid_request test.unit.common.test_memcached.TestMemcached.test_get_failed_connection_mid_request ... ok test.unit.common.test_memcached.TestMemcached.test_incr test.unit.common.test_memcached.TestMemcached.test_incr ... ok test.unit.common.test_memcached.TestMemcached.test_incr_add_expires test.unit.common.test_memcached.TestMemcached.test_incr_add_expires ... ok test.unit.common.test_memcached.TestMemcached.test_incr_expiration_time test.unit.common.test_memcached.TestMemcached.test_incr_expiration_time ... ok test.unit.common.test_memcached.TestMemcached.test_incr_failed_connection_mid_request test.unit.common.test_memcached.TestMemcached.test_incr_failed_connection_mid_request ... ok test.unit.common.test_memcached.TestMemcached.test_incr_unexpected_response test.unit.common.test_memcached.TestMemcached.test_incr_unexpected_response ... ok test.unit.common.test_memcached.TestMemcached.test_incr_w_timeout test.unit.common.test_memcached.TestMemcached.test_incr_w_timeout ... ok test.unit.common.test_memcached.TestMemcached.test_item_size_warning_threshold test.unit.common.test_memcached.TestMemcached.test_item_size_warning_threshold ... ok test.unit.common.test_memcached.TestMemcached.test_logger_kwarg test.unit.common.test_memcached.TestMemcached.test_logger_kwarg ... ok test.unit.common.test_memcached.TestMemcached.test_multi test.unit.common.test_memcached.TestMemcached.test_multi ... ok test.unit.common.test_memcached.TestMemcached.test_multi_delete test.unit.common.test_memcached.TestMemcached.test_multi_delete ... ok test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats ... ok test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_get_error test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_get_error ... ok test INFO: Begin container update single threaded sweep test WARNING: /tmp/tmp1j6z0b91/tmp_test_container_updater/devices/sda1 is not mounted test INFO: Container update single threaded sweep completed: 0.01s, 0 successes, 0 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test INFO: Failed to get container info (Lock timeout: 10 seconds: /tmp/tmpbwktbnl2/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db); skipping. test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 0 failures, 0 with no changes test INFO: Begin container update single threaded sweep test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 0 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 0 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test DEBUG: Update report failed for /.shards_a/c /tmp/tmpzsy7es0r/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.00s, 0 successes, 1 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test ERROR: ERROR account update failed with 127.0.0.1:67890/sda1 (will retry later):: Connection refused test DEBUG: Update report failed for /.shards_a/c /tmp/tmpzsy7es0r/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.01s, 0 successes, 1 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test DEBUG: Update report sent for /.shards_a/c /tmp/tmpzsy7es0r/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.03s, 1 successes, 0 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test INFO: Begin container update single threaded sweep test DEBUG: Update report sent for /a/Ω /tmp/tmpf5v006ao/tmp_test_container_updater/devices/sda1/containers/subdir/hash.db test INFO: Container update single threaded sweep completed: 0.03s, 1 successes, 0 failures, 0 with no changes test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.controllers.test_base.TestGetOrHeadHandler.test_init_node_timeout test.unit.proxy.controllers.test_base.TestGetOrHeadHandler.test_init_node_timeout ... ok test.unit.proxy.controllers.test_base.TestGetOrHeadHandler.test_range_fast_forward test.unit.proxy.controllers.test_base.TestGetOrHeadHandler.test_range_fast_forward ... ok test.unit.proxy.controllers.test_base.TestGetOrHeadHandler.test_range_fast_forward_after_data_timeout test.unit.proxy.controllers.test_base.TestGetOrHeadHandler.test_range_fast_forward_after_data_timeout ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_match test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_match ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info_sharding_states test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info_sharding_states ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_brokers test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_brokers ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_newer test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_newer ... ok test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error limiting server 1.2.3.5:11211 test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error limiting server 1.2.3.5:11211 test ERROR: Error connecting to memcached: ALL: with key_prefix some_key, method set: No more memcached servers to try test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method get, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix shard-updating-v2/acc, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method get, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix shard-updating-v2/acc, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix some_key, method decr, time_spent 2.2172927856445312e-05: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 515, in incr new_val = self._incr_or_decr(fp, sock, cmd, delta_val) File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 475, in _incr_or_decr line = fp.readline().strip().split() ^^^^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'strip' test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix shard-updating-v2/acc, method incr, time_spent 1.0, expired ttl=1.23 test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix shard-updating-v2/acc, method incr, time_spent 1.0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 515, in incr new_val = self._incr_or_decr(fp, sock, cmd, delta_val) File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 480, in _incr_or_decr return int(line[0].strip()) ValueError: invalid literal for int() with base 10: b'UNEXPECTED' test WARNING: Item size larger than warning threshold: 80 (80) >= 80 (80) test WARNING: Item size larger than warning threshold: 81 (81) >= 80 (80) test WARNING: Item size larger than warning threshold: 99 (99) >= 80 (80) test WARNING: Item size larger than warning threshold: 100 (100) >= 80 (80) test WARNING: Item size larger than warning threshold: 0 (0) >= 0 (0) test WARNING: Item size larger than warning threshold: 1 (1) >= 0 (0) test WARNING: Item size larger than warning threshold: 50 (50) >= 0 (0) test WARNING: Item size larger than warning threshold: 99 (99) >= 0 (0) test WARNING: Item size larger than warning threshold: 100 (100) >= 0 (0) test WARNING: Item size larger than warning threshold: 2048576 (2Mi) >= 1000000 (977Ki) test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix multi_key, method get_multi, time_spent 1.9311904907226562e-05, incomplete read test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix get_key, method get, time_spent 0.0, failed to connect test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix get_key, method get, time_spent 0.0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 447, in get sock.sendall(b'get ' + cmd.hash_key + b'\r\n') ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_memcached.py", line 119, in sendall handler(*parts[1:]) ~~~~~~~^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_memcached.py", line 1375, in handle_get raise Exception('get failed') Exception: get failedtest.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_get_exception test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_get_exception ... ok test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_get_timeout test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_get_timeout ... ok test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_incr_exception test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_incr_exception ... ok test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_set_exception test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_set_exception ... ok test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_set_timeout test.unit.common.test_memcached.TestMemcached.test_operations_timing_stats_with_set_timeout ... ok test.unit.common.test_memcached.TestMemcached.test_retry test.unit.common.test_memcached.TestMemcached.test_retry ... ok test.unit.common.test_memcached.TestMemcached.test_serialization test.unit.common.test_memcached.TestMemcached.test_serialization ... ok test.unit.common.test_memcached.TestMemcached.test_set_error test.unit.common.test_memcached.TestMemcached.test_set_error ... ok test.unit.common.test_memcached.TestMemcached.test_set_error_raise_on_error test.unit.common.test_memcached.TestMemcached.test_set_error_raise_on_error ... ok test.unit.common.test_memcached.TestMemcached.test_set_expiration_time test.unit.common.test_memcached.TestMemcached.test_set_expiration_time ... ok test.unit.common.test_memcached.TestMemcached.test_set_get_json test.unit.common.test_memcached.TestMemcached.test_set_get_json ... ok test.unit.common.test_memcached.TestMemcached.test_tls_context_kwarg test.unit.common.test_memcached.TestMemcached.test_tls_context_kwarg ... ok test.unit.common.test_splice.TestSplice.test_available test.unit.common.test_splice.TestSplice.test_available ... ok test.unit.common.test_splice.TestSplice.test_errno test.unit.common.test_splice.TestSplice.test_errno ... ok test.unit.common.test_splice.TestSplice.test_fileno test.unit.common.test_splice.TestSplice.test_fileno ... ok test.unit.common.test_splice.TestSplice.test_flags test.unit.common.test_splice.TestSplice.test_flags ... ok test.unit.common.test_splice.TestSplice.test_flags_list test.unit.common.test_splice.TestSplice.test_flags_list ... ok test.unit.common.test_splice.TestSplice.test_splice_file_to_pipe test.unit.common.test_splice.TestSplice.test_splice_file_to_pipe ... ok test.unit.common.test_splice.TestSplice.test_splice_pipe_to_file test.unit.common.test_splice.TestSplice.test_splice_pipe_to_file ... ok test.unit.common.test_splice.TestSplice.test_splice_pipe_to_pipe test.unit.common.test_splice.TestSplice.test_splice_pipe_to_pipe ... ok test.unit.common.test_splice.TestSplice.test_unavailable test.unit.common.test_splice.TestSplice.test_unavailable ... ok test.unit.common.test_splice.TestSplice.test_unavailable_in_libc test.unit.common.test_splice.TestSplice.test_unavailable_in_libc ... ok test.unit.common.test_swob.TestStatusMap.test_status_map test.unit.common.test_swob.TestStatusMap.test_status_map ... ok test.unit.common.test_utils.TestHashForFileFunction.test_hash_for_file_big test.unit.common.test_utils.TestHashForFileFunction.test_hash_for_file_big ... ok test.unit.common.test_utils.TestHashForFileFunction.test_hash_for_file_brittle test.unit.common.test_utils.TestHashForFileFunction.test_hash_for_file_brittle ... ok test.unit.common.test_utils.TestHashForFileFunction.test_hash_for_file_empty test.unit.common.test_utils.TestHashForFileFunction.test_hash_for_file_empty ... ok test.unit.common.test_utils.TestHashForFileFunction.test_hash_for_file_smallish test.unit.common.test_utils.TestHashForFileFunction.test_hash_for_file_smallish ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_bad_start test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_bad_start ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_basic test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_basic ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_basic2 test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_basic2 ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_big_reads test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_big_reads ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_broken_mid_stream test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_broken_mid_stream ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_empty test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_empty ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_leading_crlfs test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_leading_crlfs ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_readline test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_readline ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_readline_with_tiny_chunks test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_readline_with_tiny_chunks ... ok test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_tiny_reads test.unit.common.test_utils.TestIterMultipartMimeDocuments.test_tiny_reads ... ok test.unit.common.test_utils.TestLRUCache.test_maxsize test.unit.common.test_utils.TestLRUCache.test_maxsize ... ok test.unit.common.test_utils.TestLRUCache.test_maxtime test.unit.common.test_utils.TestLRUCache.test_maxtime ... ok test.unit.common.test_utils.TestLRUCache.test_set_maxsize test.unit.common.test_utils.TestLRUCache.test_set_maxsize ... ok test.unit.common.test_utils.TestLRUCache.test_set_maxtime test.unit.common.test_utils.TestLRUCache.test_set_maxtime ... ok test.unit.common.test_utils.TestShardRangeList.test_filter test.unit.common.test_utils.TestShardRangeList.test_filter ... ok test.unit.common.test_utils.TestShardRangeList.test_find_lower test.unit.common.test_utils.TestShardRangeList.test_find_lower ... ok test.unit.common.test_utils.TestShardRangeList.test_includes test.unit.common.test_utils.TestShardRangeList.test_includes ... ok test.unit.common.test_utils.TestShardRangeList.test_init test.unit.common.test_utils.TestShardRangeList.test_init ... ok test.unit.common.test_utils.TestShardRangeList.test_init_with_list test.unit.common.test_utils.TestShardRangeList.test_init_with_list ... ok test.unit.common.test_utils.TestShardRangeList.test_pop test.unit.common.test_utils.TestShardRangeList.test_pop ... ok test.unit.common.test_utils.TestShardRangeList.test_slice test.unit.common.test_utils.TestShardRangeList.test_slice ... ok test.unit.common.test_utils.TestShardRangeList.test_states test.unit.common.test_utils.TestShardRangeList.test_states ... ok test.unit.common.test_utils.TestShardRangeList.test_timestamps test.unit.common.test_utils.TestShardRangeList.test_timestamps ... ok test.unit.common.utils.test_checksum.TestCRC32C.test_anycrc test.unit.common.utils.test_checksum.TestCRC32C.test_anycrc ... skipped 'No anycrc CRC32C' test.unit.common.utils.test_checksum.TestCRC32C.test_isal test.unit.common.utils.test_checksum.TestCRC32C.test_isal ... skipped 'No ISA-L CRC32C' test.unit.common.utils.test_checksum.TestCRC32C.test_kern test.unit.common.utils.test_checksum.TestCRC32C.test_kern ... ok test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_after_recv_error test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_after_recv_error ... ok test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_after_sendall_error test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_after_sendall_error ... ok test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_close_after_accept_error test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_close_after_accept_error ... ok test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_close_after_bind_error test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_close_after_bind_error ... ok test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_close_after_setsockopt_error test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_close_after_setsockopt_error ... ok test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_close_happy_path test.unit.common.utils.test_checksum.TestCRC32C.test_kern_socket_close_happy_path ... ok test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_empty test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_empty ... ok test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_invalid test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_invalid ... ok test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_multiple test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_multiple ... ok test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_region test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_region ... ok test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_zone test.unit.common.utils.test_config.TestAffinityLocalityPredicate.test_zone ... ok test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips ... ok test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_bind_ip_specific test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_bind_ip_specific ... ok test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_bind_to_all test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_bind_to_all ... ok test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_getifaddrs test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_getifaddrs ... ok test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_netifaces_error test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_netifaces_error ... ok test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_netifaces_ipv6 test.unit.common.utils.test_ipaddrs.TestWhatAreMyIPs.test_whataremyips_netifaces_ipv6 ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_not_found test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_not_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_older test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_older ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_commit_pending test.unit.container.test_backend.TestCommonContainerBroker.test_commit_pending ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_delete_db test.unit.container.test_backend.TestCommonContainerBroker.test_delete_db ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_get_info test.unit.container.test_backend.TestCommonContainerBroker.test_get_info ... ok test.unit.common.test_db.TestTombstoneReclaimer.test_batched_reclaim_exactly_two_batches test.unit.common.test_db.TestTombstoneReclaimer.test_batched_reclaim_exactly_two_batches ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info_stale_read_ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_info_stale_read_ok ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_race test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_race ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_get_max_row test.unit.container.test_backend.TestCommonContainerBroker.test_get_max_row ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_get_raw_metadata test.unit.container.test_backend.TestCommonContainerBroker.test_get_raw_metadata ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_unsynced_race test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_sync_put_x_timestamp_unsynced_race ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_get_syncs test.unit.container.test_backend.TestCommonContainerBroker.test_get_syncs ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_maybe_get test.unit.container.test_backend.TestCommonContainerBroker.test_maybe_get ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_delete_with_objects test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_delete_with_objects ... ok proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to write to /AUTH_kilroy/%ED%88%8E/%E9%90%89: ChunkWriteTimeout (Nones) (txn: tx6b445f80853e44f3b65a2-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR Exception causing client disconnect: Timeout (Nones) (txn: txede8c681df5344bd8bc78-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server :/ re: Expect: 100-continue on /a/c/o: ConnectionTimeout (0.05s) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769861.28482 <= '409 (1757769861.28482), 409 (1757769861.28482), 409 (1757769861.28482)' (txn: txeb4a3386e40a483891e25-0068c57085) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769861.29490 <= '409 (1757769861.29490), 409 (1757769861.29490), 409 (1757769861.29490)' (txn: txcf23e0d72cda4222aafca-0068c57085) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769861.29691 <= '409 (1757769861.29691), 409 (1757769861.29691), 409 (1757769861.29691)' (txn: tx4e3286dbdadc42d8bbd00-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769861.00000 <= '409 (1757769862.00000), 409 (1757769862.00000), 409 (1757769862.00000)' (txn: tx7fcb35b31ccf4d0aab92f-0068c57085) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769863.00000 <= '409 (1757769864.00000), 409 (1757769864.00000), 409 (1757769864.00000)' (txn: tx4022d02fec604360b7528-0068c57085) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769865.00000 <= '409 (1757769866.00000), 409 (1757769866.00000), 409 (1757769866.00000)' (txn: tx8a9b3ac93fe445b9bf5d4-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769861.00000 <= '409 (1757769861.00000), 409 (1757769861.00000), 409 (1757769861.00000)' (txn: txfcbcf14db5544fc3bfa65-0068c57085) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769862.00000 <= '409 (1757769862.00000), 409 (1757769862.00000), 409 (1757769862.00000)' (txn: tx085bdb11934a44f88ac0e-0068c57085) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769863.00000 <= '409 (1757769863.00000), 409 (1757769863.00000), 409 (1757769863.00000)' (txn: tx2732386a394d4adb97bdb-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769861.00000 <= '409 (1757769861.00000)' (txn: tx2a4b35d3d3e947eb8384b-0068c57085) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769862.00000 <= '409 (1757769862.00000)' (txn: tx45dcbcdcf1884c1289ced-0068c57085) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769863.00000 <= '409 (1757769863.00000)' (txn: tx8e57649c757c4d5c8e22c-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_update_backend_requests test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_container_update_backend_requests ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_delete_at_backend_requests test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_delete_at_backend_requests ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_expirer_DELETE_suppresses_expirer_queue_updates test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_expirer_DELETE_suppresses_expirer_queue_updates ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_handoff_local_first_default test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_handoff_local_first_default ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_handoff_local_first_non_default test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_handoff_local_first_non_default ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_recreate_with_objects test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_recreate_with_objects ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_undispersable_zone_converge_on_balance test.unit.common.ring.test_builder.TestRingBuilder.test_undispersable_zone_converge_on_balance ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_db_state test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_db_state ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_simple_delete test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_simple_delete ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_local_first_best_effort test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_local_first_best_effort ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_simple_recreate test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_simple_recreate ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_items_since test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_items_since ... ok test.unit.common.test_db.TestTombstoneReclaimer.test_batched_reclaim_one_large_batch test.unit.common.test_db.TestTombstoneReclaimer.test_batched_reclaim_one_large_batch ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_update_delete_no_status_change test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_update_delete_no_status_change ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_update_put_no_status_change test.unit.container.test_backend.TestCommonContainerBroker.test_merge_timestamps_update_put_no_status_change ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_put_timestamp test.unit.container.test_backend.TestCommonContainerBroker.test_put_timestamp ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_local_first_moves_locals_first test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_local_first_moves_locals_first ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_local_first_noops_when_no_affinity test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_local_first_noops_when_no_affinity ... ok test.unit.container.test_backend.TestCommonContainerBroker.test_status_changed_at test.unit.container.test_backend.TestCommonContainerBroker.test_status_changed_at ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_local_handoff_first_noops_when_no_affinity test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_iter_nodes_local_handoff_first_noops_when_no_affinity ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_object_DELETE_backend_update_container_ip_default test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_object_DELETE_backend_update_container_ip_default ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_repl_object_DELETE_backend_update_container_repl_ip test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_repl_object_DELETE_backend_update_container_repl_ip ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_unoverload test.unit.common.ring.test_builder.TestRingBuilder.test_unoverload ... ok test.unit.common.test_db.TestTombstoneReclaimer.test_batched_reclaim_several_small_batches test.unit.common.test_db.TestTombstoneReclaimer.test_batched_reclaim_several_small_batches ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_local_first_moves_locals_first test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_local_first_moves_locals_first ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_smooth_distributed_backend_requests test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_smooth_distributed_backend_requests ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_local_first_noops_when_no_affinity test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_local_first_noops_when_no_affinity ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_namespaces test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_namespaces ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_local_handoff_first_noops_when_no_affinity test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_iter_nodes_local_handoff_first_noops_when_no_affinity ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 201 - "PUT http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx6645c800a41948f793bec-0068c57085" "proxy-server 1824514" 0.0618 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txabf3943cca5d4348aeb23-0068c57085" "proxy-server 1824514" 0.0141 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "txabf3943cca5d4348aeb23-0068c57085" "proxy-server 1824514" 0.0013 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txcae844812e8248b7b9978-0068c57085" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx227d39eec7c640068bd25-0068c57085" "proxy-server 1824514" 0.0013 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 201 - "PUT http://foo:8080/sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx299666a683074ecb8326e-0068c57085" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 201 - "PUT http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx299666a683074ecb8326e-0068c57085" "proxy-server 1824514" 0.0333 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 201 - "PUT http://foo:8080/sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx299666a683074ecb8326e-0068c57085" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 201 - "PUT http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx299666a683074ecb8326e-0068c57085" "proxy-server 1824514" 0.0481 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx68a671324ec2460a8d656-0068c57085" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx6d0a00f059dd4425bc577-0068c57085" "proxy-server 1824514" 0.0147 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 201 - "POST http://foo:8080/sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx5d44fc5535f2409083934-0068c57085" "object-server 1824514" 0.0005 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 201 - "POST http://foo:8080/sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx5d44fc5535f2409083934-0068c57085" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "POST /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 202 76 "POST http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx5d44fc5535f2409083934-0068c57085" "proxy-server 1824514" 0.0240 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "POST /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 202 76 "POST http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx5d44fc5535f2409083934-0068c57085" "proxy-server 1824514" 0.0237 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe8dc82627b374a638169e-0068c57085" "proxy-server 1824514" 0.0180 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "txb1d632ebd24d448395184-0068c57085" "proxy-server 1824514" 0.0160 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx896b1b70e8c24864ba165-0068c57085" "proxy-server 1824514" 0.0130 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txfb7a1a0ae9c4473cbdc24-0068c57085" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx95ba1495cf7f438d91f38-0068c57085" "proxy-server 1824514" 0.0049 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx96f4f7646f574105ae599-0068c57085" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx645e6d5d413c480daef74-0068c57085" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "txaecd6e70aa3b4ceeac7fa-0068c57085" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx72e47c4750f34aa69857a-0068c57085" "proxy-server 1824514" 0.0166 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa3ed23e5e66c4efc98967-0068c57085" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx8c558b3fe7ef483f96218-0068c57085" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "txd3903417ffe1450f9e151-0068c57085" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3de8dcc8401745aca3071-0068c57085" "proxy-server 1824514" 0.0133 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 200 382 "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3?format=json&states=listing" "tx3de8dcc8401745aca3071-0068c57085" "proxy-server 1824514" 0.0143 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4e769b42819d48d2ab203-0068c57085" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx932fcd00e3ea4dfcbd3d0-0068c57085" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx7eba6718f90e4b8daa3c0-0068c57085" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9cfbd5861231469b95c4a-0068c57085" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx5397bf8971ff401587f3c-0068c57085" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "txa0c5c9a1c91346fd91ebd-0068c57085" "proxy-server 1824514" 0.0008 "-" 1824514 1test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info_is_deleted ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_object_DELETE_backend_update_container_ip_default test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_object_DELETE_backend_update_container_ip_default ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_primary_returns_some_nonsense_timestamp test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_primary_returns_some_nonsense_timestamp ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_put_x_timestamp_conflict test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_put_x_timestamp_conflict ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_put_x_timestamp_conflict_with_if_none_match test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_put_x_timestamp_conflict_with_if_none_match ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_some_404s_and_507s test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_some_404s_and_507s ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_batch_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_batch_reclaim ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_put_x_timestamp_conflict_with_missing_backend_timestamp test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_put_x_timestamp_conflict_with_missing_backend_timestamp ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_validate test.unit.common.ring.test_builder.TestRingBuilder.test_validate ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_put_x_timestamp_conflict_with_other_weird_success_response test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_put_x_timestamp_conflict_with_other_weird_success_response ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_repl_object_DELETE_backend_update_container_repl_ip test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_repl_object_DELETE_backend_update_container_repl_ip ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_smooth_distributed_backend_requests test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_smooth_distributed_backend_requests ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_some_404s_and_507s test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_some_404s_and_507s ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_validate_duplicate_part_assignment test.unit.common.ring.test_builder.TestRingBuilder.test_validate_duplicate_part_assignment ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_write_affinity_not_configured test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_write_affinity_not_configured ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info_no_stale_reads test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info_no_stale_reads ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_chexor test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_chexor ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_validate_partial_replica test.unit.common.ring.test_builder.TestRingBuilder.test_validate_partial_replica ... ok test.unit.common.test_db.TestTombstoneReclaimer.test_get_tombstone_count_with_leftover test.unit.common.test_db.TestTombstoneReclaimer.test_get_tombstone_count_with_leftover ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmp5nj7plsb/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp5nj7plsb/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmp5nj7plsb/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp5nj7plsb/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/0/a" 201 - "-" "test" "-" 0.0115 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/0/a" 201 - "-" "test" "-" 0.0486 "-" 1824509 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0150 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0190 "-" 1824509 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx666f19b61c7349d3a2c10-0068c57085" "proxy-server 1824509" 0.0012 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://127.0.0.1:36297/sda1/3/a/c" "tx666f19b61c7349d3a2c10-0068c57085" "container-server 1824509" 0.0010 "-" 1824509 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://127.0.0.1:41753/sdb1/3/a/c" "tx666f19b61c7349d3a2c10-0068c57085" "container-server 1824509" 0.0092 "-" 1824509 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "tx666f19b61c7349d3a2c10-0068c57085" "proxy-server 1824509" 0.0553 "-" 1824509 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "tx666f19b61c7349d3a2c10-0068c57085" "proxy-server 1824509" 0.0453 "-" 1824509 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/21 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx666f19b61c7349d3a2c10-0068c57085 - 0.0880 - - 1757769861.446428061 1757769861.534456015 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx6efb274434884a2ba8c5e-0068c57085" "proxy-server 1824509" 0.0095 "-" 1824509 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:41753/sdb1/0/a1/c1" "tx6efb274434884a2ba8c5e-0068c57085" "container-server 1824509" 0.0010 "-" 1824509 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:36297/sda1/0/a1/c1" "tx6efb274434884a2ba8c5e-0068c57085" "container-server 1824509" 0.0010 "-" 1824509 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx6efb274434884a2ba8c5e-0068c57085" "proxy-server 1824509" 0.0401 "-" 1824509 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx6efb274434884a2ba8c5e-0068c57085" "proxy-server 1824509" 0.0371 "-" 1824509 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/21 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx6efb274434884a2ba8c5e-0068c57085 - 0.0687 - - 1757769861.548154116 1757769861.616804600 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx45d58dd4dbd4444e950ff-0068c57085" "proxy-server 1824509" 0.0018 "-" 1824509 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://127.0.0.1:41753/sdb1/3/a/c1" "tx45d58dd4dbd4444e950ff-0068c57085" "container-server 1824509" 0.0011 "-" 1824509 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://127.0.0.1:36297/sda1/3/a/c1" "tx45d58dd4dbd4444e950ff-0068c57085" "container-server 1824509" 0.0137 "-" 1824509 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx45d58dd4dbd4444e950ff-0068c57085" "proxy-server 1824509" 0.0379 "-" 1824509 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx45d58dd4dbd4444e950ff-0068c57085" "proxy-server 1824509" 0.0507 "-" 1824509 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/21 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx45d58dd4dbd4444e950ff-0068c57085 - 0.0751 - - 1757769861.618234634 1757769861.693289757 1 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0701a1d062544b499458c-0068c57085" "proxy-server 1824509" 0.0019 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://127.0.0.1:36297/sda1/0/a/c2" "tx0701a1d062544b499458c-0068c57085" "container-server 1824509" 0.0019 "-" 1824509 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://127.0.0.1:41753/sdb1/0/a/c2" "tx0701a1d062544b499458c-0068c57085" "container-server 1824509" 0.0149 "-" 1824509 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx0701a1d062544b499458c-0068c57085" "proxy-server 1824509" 0.0691 "-" 1824509 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx0701a1d062544b499458c-0068c57085" "proxy-server 1824509" 0.0594 "-" 1824509 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/21 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - tx0701a1d062544b499458c-0068c57085 - 0.1020 - - 1757769861.706181049 1757769861.808207035 2 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx946e5dee59454b4491913-0068c57085" "proxy-server 1824509" 0.0020 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/0/a/a1bcc9e95a14409f8e1be899564ecf81" 201 - "PUT http://127.0.0.1:41753/sdb1/2/a/a1bcc9e95a14409f8e1be899564ecf81" "tx946e5dee59454b4491913-0068c57085" "container-server 1824509" 0.0017 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/0/a/a1bcc9e95a14409f8e1be899564ecf81" 201 - "PUT http://127.0.0.1:36297/sda1/2/a/a1bcc9e95a14409f8e1be899564ecf81" "tx946e5dee59454b4491913-0068c57085" "container-server 1824509" 0.0114 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sda1/2/a/a1bcc9e95a14409f8e1be899564ecf81" 201 - "PUT http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81" "tx946e5dee59454b4491913-0068c57085" "proxy-server 1824509" 0.0460 "-" 1824509 3 proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server INFO: Client disconnected on read of '/a/c/o' (txn: tx67c9e632cde6400bb7c9a-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769861.00000 <= '409 (1757769862.00000)' (txn: tx45abd3cf7c1d4cada4f89-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Object PUT returning 412, [409, 412, 412] (txn: tx8478be2b814f46259ea20-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769861.00000 <= '409 (unknown), 409 (unknown), 409 (unknown)' (txn: tx535b0715829e4d2297e93-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Object PUT returning 202 for 409: 1757769861.00000 <= '409 (1757769862.00000), 201 (unknown), 201 (unknown)' (txn: txddbeeadf3a904501958a4-0068c57085) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_namespaces_root_container_fill_gap test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_namespaces_root_container_fill_gap ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_txn_id_logging_on_PUT test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_txn_id_logging_on_PUT ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_write_affinity_not_configured test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_write_affinity_not_configured ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_write_affinity_per_policy_config test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_write_affinity_per_policy_config ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_write_affinity_per_policy_config_overrides_and_inherits test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_write_affinity_per_policy_config_overrides_and_inherits ... ok proxy-server ERROR: ERROR with Object server :/ re: Expect: 100-continue on /a/c/o: ConnectionTimeout (0.05s) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_write_affinity_per_policy_config test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_write_affinity_per_policy_config ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_write_affinity_per_policy_config_overrides_and_inherits test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_write_affinity_per_policy_config_overrides_and_inherits ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '3 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '3 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_write_affinity_proxy_server_config test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_write_affinity_proxy_server_config ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_x_open_expired_custom_config test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_x_open_expired_custom_config ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_write_affinity_proxy_server_config test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_write_affinity_proxy_server_config ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_x_open_expired_default_config test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_x_open_expired_default_config ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_x_timestamp_not_overridden test.unit.proxy.controllers.test_obj.TestReplicatedObjController.test_x_timestamp_not_overridden ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_create_broker test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_create_broker ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_wide_device_limits test.unit.common.ring.test_builder.TestRingBuilder.test_wide_device_limits ... ok test.unit.common.ring.test_builder.TestRingBuilder.test_wrong_tier_with_no_where_to_go test.unit.common.ring.test_builder.TestRingBuilder.test_wrong_tier_with_no_where_to_go ... ok test.unit.common.test_db.TestChexor.test_chexor test.unit.common.test_db.TestChexor.test_chexor ... ok test.unit.common.test_db.TestChexor.test_invalid_old_hash test.unit.common.test_db.TestChexor.test_invalid_old_hash ... ok test.unit.common.test_db.TestChexor.test_no_name test.unit.common.test_db.TestChexor.test_no_name ... ok test.unit.common.test_db.TestChexor.test_normal_case test.unit.common.test_db.TestChexor.test_normal_case ... ok test.unit.common.test_http_protocol.TestProxyProtocol.test_address_and_environ test.unit.common.test_http_protocol.TestProxyProtocol.test_address_and_environ ... ok test.unit.common.test_db.TestTombstoneReclaimer.test_reclaim_get_tombstone_count test.unit.common.test_db.TestTombstoneReclaimer.test_reclaim_get_tombstone_count ... ok test.unit.common.test_http_protocol.TestProxyProtocol.test_malformed_proxy_lines test.unit.common.test_http_protocol.TestProxyProtocol.test_malformed_proxy_lines ... ok test.unit.common.test_http_protocol.TestProxyProtocol.test_missing_proxy_line test.unit.common.test_http_protocol.TestProxyProtocol.test_missing_proxy_line ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_namespaces_state_filtering test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_namespaces_state_filtering ... ok test.unit.common.test_http_protocol.TestProxyProtocol.test_multiple_requests_with_proxy test.unit.common.test_http_protocol.TestProxyProtocol.test_multiple_requests_with_proxy ... ok test.unit.common.test_http_protocol.TestProxyProtocol.test_request_with_proxy test.unit.common.test_http_protocol.TestProxyProtocol.test_request_with_proxy ... ok test.unit.common.test_http_protocol.TestProxyProtocol.test_request_with_proxy_https test.unit.common.test_http_protocol.TestProxyProtocol.test_request_with_proxy_https ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info_sharding_states test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info_sharding_states ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_creation test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_creation ... ok test.unit.common.test_http_protocol.TestProxyProtocol.test_unknown_client_addr test.unit.common.test_http_protocol.TestProxyProtocol.test_unknown_client_addr ... ok test.unit.common.test_internal_client.TestCompressingfileReader.test_init test.unit.common.test_internal_client.TestCompressingfileReader.test_init ... ok test.unit.common.test_internal_client.TestCompressingfileReader.test_read test.unit.common.test_internal_client.TestCompressingfileReader.test_read ... ok test.unit.common.test_internal_client.TestCompressingfileReader.test_seek test.unit.common.test_internal_client.TestCompressingfileReader.test_seek ... ok test.unit.common.test_internal_client.TestCompressingfileReader.test_seek_not_implemented_exception test.unit.common.test_internal_client.TestCompressingfileReader.test_seek_not_implemented_exception ... ok test.unit.common.test_utils.TestPairs.test_pairs test.unit.common.test_utils.TestPairs.test_pairs ... ok test.unit.common.utils.test_libc.TestModifyPriority.test__NR_ioprio_set test.unit.common.utils.test_libc.TestModifyPriority.test__NR_ioprio_set ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info_stale_read_ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_info_stale_read_ok ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_objects test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_objects ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_items_since test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_items_since ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_db_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_db_file ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_with_disable_encryption_conf test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_with_disable_encryption_conf ... ok test.unit.common.test_db.TestTombstoneReclaimer.test_reclaim_get_tombstone_count_with_leftover test.unit.common.test_db.TestTombstoneReclaimer.test_reclaim_get_tombstone_count_with_leftover ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_client_exception test.unit.common.test_direct_client.TestDirectClient.test_direct_client_exception ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_account test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_account ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_account_failure test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_account_failure ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_account_replication_net test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_account_replication_net ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_error test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_error ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/2/a/a1bcc9e95a14409f8e1be899564ecf81" 201 - "PUT http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81" "tx946e5dee59454b4491913-0068c57085" "proxy-server 1824509" 0.0305 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx96ebbad389f7411eb026b-0068c57085" "proxy-server 1824509" 0.0173 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/2/a/a1bcc9e95a14409f8e1be899564ecf81" 204 - "HEAD http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81" "tx81afc0eae2784b0eb256c-0068c57085" "proxy-server 1824509" 0.0174 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdi1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 201 - "PUT http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx1caa7f1990164eeb8e30c-0068c57085" "proxy-server 1824509" 0.0488 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "PUT /sdb1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 201 - "PUT http://localhost/sdg1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx1caa7f1990164eeb8e30c-0068c57085" "object-server 1824509" 0.0005 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 201 - "PUT http://localhost/sdh1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx1caa7f1990164eeb8e30c-0068c57085" "object-server 1824509" 0.0005 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdg1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 201 - "PUT http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx1caa7f1990164eeb8e30c-0068c57085" "proxy-server 1824509" 0.0602 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdh1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 201 - "PUT http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx1caa7f1990164eeb8e30c-0068c57085" "proxy-server 1824509" 0.0670 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6c6de1f7660d40b8a6133-0068c57086" "proxy-server 1824509" 0.0101 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/2/a/a1bcc9e95a14409f8e1be899564ecf81" 204 - "HEAD http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81" "tx9aa99a9557a34fb089fc2-0068c57086" "proxy-server 1824509" 0.0087 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdg1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 200 82 "GET http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx14b50c5d0c494cb7b02dd-0068c57086" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdh1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 200 82 "GET http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx14b50c5d0c494cb7b02dd-0068c57086" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb373e5ead3c7483ba2f32-0068c57086" "proxy-server 1824509" 0.0174 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/2/a/a1bcc9e95a14409f8e1be899564ecf81" 204 - "HEAD http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81" "tx39fa81e62c8347acbc714-0068c57086" "proxy-server 1824509" 0.0125 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdh1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 404 70 "GET http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx1e36bc4654cd4826b218d-0068c57086" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdi1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 404 70 "GET http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx1e36bc4654cd4826b218d-0068c57086" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx1e36bc4654cd4826b218d-0068c57086) proxy DEBUG: Ignoring 404 from primary (txn: tx1e36bc4654cd4826b218d-0068c57086) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdg1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 404 70 "GET http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx1e36bc4654cd4826b218d-0068c57086" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx1e36bc4654cd4826b218d-0068c57086) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfb4640a874694d96a826b-0068c57086" "proxy-server 1824509" 0.0135 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/2/a/a1bcc9e95a14409f8e1be899564ecf81" 204 - "HEAD http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81" "tx2f0d194bde984edc8b3fd-0068c57086" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdh1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 200 82 "GET http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx234c36b745f641f59a439-0068c57086" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdg1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 200 82 "GET http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx234c36b745f641f59a439-0068c57086" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdi1/2/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" 200 82 "GET http://localhost/v1/a/a1bcc9e95a14409f8e1be899564ecf81/fe00f5c223a248449f878af68f693513" "tx234c36b745f641f59a439-0068c57086" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4dbcb971133849b5943aa-0068c57086" "proxy-server 1824509" 0.0096 "-" 1824509 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/0/a/e813f6d4fd9342ffb96c27847f184a4e" 201 - "PUT http://127.0.0.1:36297/sda1/3/a/e813f6d4fd9342ffb96c27847f184a4e" "tx4dbcb971133849b5943aa-0068c57086" "container-server 1824509" 0.0011 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/0/a/e813f6d4fd9342ffb96c27847f184a4e" 201 - "PUT http://127.0.0.1:41753/sdb1/3/a/e813f6d4fd9342ffb96c27847f184a4e" "tx4dbcb971133849b5943aa-0068c57086" "container-server 1824509" 0.0092 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/3/a/e813f6d4fd9342ffb96c27847f184a4e" 201 - "PUT http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e" "tx4dbcb971133849b5943aa-0068c57086" "proxy-server 1824509" 0.0246 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/3/a/e813f6d4fd9342ffb96c27847f184a4e" 201 - "PUT http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e" "tx4dbcb971133849b5943aa-0068c57086" "proxy-server 1824509" 0.0417 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx16da647300be46fe9cc98-0068c57086" "proxy-server 1824509" 0.0019 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/e813f6d4fd9342ffb96c27847f184a4e" 204 - "HEAD http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e" "tx09972454ac2b43549f142-0068c57086" "proxy-server 1824509" 0.0012 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/3/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 201 - "PUT http://localhost/sdg1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "txa6131f8a232e49fbbe3b9-0068c57086" "object-server 1824509" 0.0005 "-" 1824509 3test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_obj_error test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_obj_error ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_object test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_object ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_replication_net test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_replication_net ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_with_timestamp test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_container_with_timestamp ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_object test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_object ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_object_error test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_object_error ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_object_with_timestamp test.unit.common.test_direct_client.TestDirectClient.test_direct_delete_object_with_timestamp ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_account test.unit.common.test_direct_client.TestDirectClient.test_direct_get_account ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_account_error test.unit.common.test_direct_client.TestDirectClient.test_direct_get_account_error ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_account_no_content_does_not_parse_body test.unit.common.test_direct_client.TestDirectClient.test_direct_get_account_no_content_does_not_parse_body ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_container test.unit.common.test_direct_client.TestDirectClient.test_direct_get_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_delete_db_does_not_clear_particular_sharding_meta test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_delete_db_does_not_clear_particular_sharding_meta ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_container_no_content_does_not_decode_body test.unit.common.test_direct_client.TestDirectClient.test_direct_get_container_no_content_does_not_decode_body ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_container_with_extra_params test.unit.common.test_direct_client.TestDirectClient.test_direct_get_container_with_extra_params ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_object test.unit.common.test_direct_client.TestDirectClient.test_direct_get_object ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_object_chunks test.unit.common.test_direct_client.TestDirectClient.test_direct_get_object_chunks ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_object_error test.unit.common.test_direct_client.TestDirectClient.test_direct_get_object_error ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_recon test.unit.common.test_direct_client.TestDirectClient.test_direct_get_recon ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_suffix_hashes test.unit.common.test_direct_client.TestDirectClient.test_direct_get_suffix_hashes ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_suffix_hashes_503 test.unit.common.test_direct_client.TestDirectClient.test_direct_get_suffix_hashes_503 ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_get_suffix_hashes_507 test.unit.common.test_direct_client.TestDirectClient.test_direct_get_suffix_hashes_507 ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_head_container test.unit.common.test_direct_client.TestDirectClient.test_direct_head_container ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_head_container_deleted test.unit.common.test_direct_client.TestDirectClient.test_direct_head_container_deleted ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_head_container_error test.unit.common.test_direct_client.TestDirectClient.test_direct_head_container_error ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_head_container_replication_net test.unit.common.test_direct_client.TestDirectClient.test_direct_head_container_replication_net ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_head_object test.unit.common.test_direct_client.TestDirectClient.test_direct_head_object ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_head_object_error test.unit.common.test_direct_client.TestDirectClient.test_direct_head_object_error ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_head_object_not_found test.unit.common.test_direct_client.TestDirectClient.test_direct_head_object_not_found ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_post_container test.unit.common.test_direct_client.TestDirectClient.test_direct_post_container ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_post_object test.unit.common.test_direct_client.TestDirectClient.test_direct_post_object ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_post_object_error test.unit.common.test_direct_client.TestDirectClient.test_direct_post_object_error ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container_chunked test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container_chunked ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container_fail test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container_fail ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container_object test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container_object ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container_object_error test.unit.common.test_direct_client.TestDirectClient.test_direct_put_container_object_error ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_args test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_args ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_chunked test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_chunked ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_fail test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_fail ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_header_content_length test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_header_content_length ... ok test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_with_content_length test.unit.common.test_direct_client.TestDirectClient.test_direct_put_object_with_content_length ... ok test.unit.common.test_direct_client.TestDirectClient.test_gen_headers test.unit.common.test_direct_client.TestDirectClient.test_gen_headers ... ok test.unit.common.test_direct_client.TestDirectClient.test_retry test.unit.common.test_direct_client.TestDirectClient.test_retry ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx68eaf155e46b497db35a8-0068c57085" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx461079ff06f44d03869a5-0068c57085" "proxy-server 1824514" 0.0011 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 412 - "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx07cdf4505a734b8db6465-0068c57085" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 412 - "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx07cdf4505a734b8db6465-0068c57085" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx49fcc1dd4ff140d4ab35e-0068c57085" "proxy-server 1824514" 0.0105 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx382de70f3a5043caa328d-0068c57085" "proxy-server 1824514" 0.0174 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 304 - "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "txc1de02d0fa444843b6ac9-0068c57085" "proxy-server 1824514" 0.0128 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc68fd6e9de0c42c7a9aa0-0068c57085" "proxy-server 1824514" 0.0134 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx1b8bffc7f68d467793418-0068c57085" "proxy-server 1824514" 0.0213 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "GET /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 304 - "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx7fe13f6cc7774c6a8de86-0068c57085" "proxy-server 1824514" 0.0124 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txec02c6b0015940198ec53-0068c57085" "proxy-server 1824514" 0.0134 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:21 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "txa3f28403420c47e788c08-0068c57085" "proxy-server 1824514" 0.0174 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "GET http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "txdd5dd0d95830423083887-0068c57085" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx10cf7f5a6c9b448fb9635-0068c57086" "proxy-server 1824514" 0.0174 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "txd1ae109a9d2c4e3ebdd2e-0068c57086" "proxy-server 1824514" 0.0136 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx253c681dcfee42249f368-0068c57086" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7ca08f27db34482a9ab0d-0068c57086" "proxy-server 1824514" 0.0134 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx547ab5b4e7c6482eb02e9-0068c57086" "proxy-server 1824514" 0.0174 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "txc8518a22a5554bda833a3-0068c57086" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9a94a4eb5d5f47ba960d2-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "txfe1f324590c04d1fa620c-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 412 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx1a3c5576bf444430a2685-0068c57086" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 412 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx1a3c5576bf444430a2685-0068c57086" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb20a213901064a0b8756d-0068c57086" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx7d3ac8f72840490ca044d-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 304 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx49cb3316a8ca44649ed1c-0068c57086" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa616e7eddd1240ad9f26e-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx94c79cf2412147a1ac234-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdc1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 304 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx38fe95657f144b1a90f09-0068c57086" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4d30e83c381945e68bce5-0068c57086" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/3/a/1abad7d5809f4a7c93d04fc36bc996c3" 204 - "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3" "tx371765ff02b246148da34-0068c57086" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdd1/2/a/1abad7d5809f4a7c93d04fc36bc996c3/o" 200 24 "HEAD http://foo:8080/v1/a/1abad7d5809f4a7c93d04fc36bc996c3/o" "tx280662650c384385861e7-0068c57086" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx600dbdb9ef8d420d85d6b-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 201 - "PUT http://127.0.0.1:40941/sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "tx600dbdb9ef8d420d85d6b-0068c57086" "container-server 1824514" 0.0191 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 201 - "PUT http://127.0.0.1:60751/sdb1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "tx600dbdb9ef8d420d85d6b-0068c57086" "container-server 1824514" 0.0011 "-" 1824514 1test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_namespaces test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_namespaces ... ok test.unit.common.test_direct_client.TestDirectClient.test_retry_client_exception test.unit.common.test_direct_client.TestDirectClient.test_retry_client_exception ... ok test.unit.common.test_direct_client.TestDirectClient.test_retry_http_exception test.unit.common.test_direct_client.TestDirectClient.test_retry_http_exception ... ok test.unit.common.test_recon.TestCommonRecon.test_server_type_to_recon_file test.unit.common.test_recon.TestCommonRecon.test_server_type_to_recon_file ... ok test.unit.common.test_splice.TestTee.test_available test.unit.common.test_splice.TestTee.test_available ... ok test.unit.common.test_splice.TestTee.test_errno test.unit.common.test_splice.TestTee.test_errno ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_objects_since_row test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_objects_since_row ... ok test-listing WARNING: Container listing for a%E2%98%83/c%F0%9F%8C%B4 had reserved byte in subdir: '\x00foo/' test-listing WARNING: Container listing for a%E2%98%83/c%F0%9F%8C%B4 had reserved byte in name: '\x00bar\x00extra data' test-listing WARNING: Container listing for a%E2%98%83/c%F0%9F%8C%B4 had reserved byte in subdir: '\x00foo/' test-listing WARNING: Container listing for a%E2%98%83/c%F0%9F%8C%B4 had reserved byte in name: '\x00bar\x00extra data' test-listing WARNING: Container listing for a%E2%98%83/c%F0%9F%8C%B4 had reserved byte in subdir: '\x00foo/' test-listing WARNING: Container listing for a%E2%98%83/c%F0%9F%8C%B4 had reserved byte in name: '\x00bar\x00extra data' test-listing WARNING: Container listing for a%E2%98%83/c%F0%9F%8C%B4 had reserved byte in subdir: '\x00foo/' test ERROR: Error in '/tmp/tmpf4_gnufn/container-sync-realms.conf' with mtime_check_interval: could not convert string to float: 'invalid' test ERROR: Could not load '/tmp/tmpkolzmd8d/container-sync-realms.conf': File contains no section headers. file: '/tmp/tmpkolzmd8d/container-sync-realms.conf', line: 1 'invalid' test DEBUG: Could not load '12ec8c2054494d5987993919456d63b8': [Errno 2] No such file or directory: '12ec8c2054494d5987993919456d63b8' test ERROR: Could not load '/tmp/tmpy0gp9jjd/container-sync-realms.conf': [Errno 13] Permission denied: '/tmp/tmpy0gp9jjd/container-sync-realms.conf' direct-client-test ERROR: Object server 1.2.3.4:6200 direct DELETE '/sda/0/%D8%AA%20account/%D8%AA%20container/%D8%AA%20obj/name' gave status 500: 1.2.3.4:6200 500 Internal Error: device sda direct-client-test ERROR: Object server 1.2.3.4:6200 direct DELETE '/sda/0/%D8%AA%20account/%D8%AA%20container/%D8%AA%20obj/name' gave status 500: 1.2.3.4:6200 500 Internal Error: device sda direct-client-test ERROR: Object server 1.2.3.4:6200 direct DELETE '/sda/0/%D8%AA%20account/%D8%AA%20container/%D8%AA%20obj/name' gave status 500: 1.2.3.4:6200 500 Internal Error: device sda direct-client-test ERROR: Kaboom! direct-client-test ERROR: Kaboom! direct-client-test ERROR: Kaboom! Error while closing FD Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_splice.py", line 38, in safe_close os.close(fd) ~~~~~~~~^^^^ OSError: [Errno 9] Bad file descriptor Error while closing FD Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_splice.py", line 38, in safe_close os.close(fd) ~~~~~~~~^^^^ OSError: [Errno 9] Bad file descriptor test.unit.common.test_splice.TestTee.test_fileno test.unit.common.test_splice.TestTee.test_fileno ... ok test.unit.common.test_splice.TestTee.test_flags_list test.unit.common.test_splice.TestTee.test_flags_list ... ok test.unit.common.test_splice.TestTee.test_tee_pipe_to_pipe test.unit.common.test_splice.TestTee.test_tee_pipe_to_pipe ... ok test.unit.common.test_splice.TestTee.test_unavailable test.unit.common.test_splice.TestTee.test_unavailable ... ok test.unit.common.test_splice.TestTee.test_unavailable_in_libc test.unit.common.test_splice.TestTee.test_unavailable_in_libc ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_bad_hostname_instantiation test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_bad_hostname_instantiation ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_ipv4_instantiation_and_socket_creation test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_ipv4_instantiation_and_socket_creation ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_ipv4_or_ipv6_hostname_defaults_to_ipv4 test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_ipv4_or_ipv6_hostname_defaults_to_ipv4 ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_ipv6_instantiation_and_socket_creation test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_ipv6_instantiation_and_socket_creation ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_no_exception_when_cant_send_udp_packet test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_no_exception_when_cant_send_udp_packet ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_sample_rates test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_sample_rates ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_sample_rates_with_sample_rate_factor test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_sample_rates_with_sample_rate_factor ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_sending_ipv6 test.unit.common.test_statsd_client.TestGetLabeledStatsdClient.test_sending_ipv6/usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_conf_defaults test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_conf_defaults ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_conf_non_defaults test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_conf_non_defaults ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_disabled_by_default test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_disabled_by_default ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_invalid_label_mode test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_invalid_label_mode ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_label_must_be_kwarg test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_label_must_be_kwarg ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_label_values_to_str test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_label_values_to_str ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label_invalid_chars test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label_invalid_chars ... ok test.unit.common.utils.test_libc.TestModifyPriority.test_modify_priority test.unit.common.utils.test_libc.TestModifyPriority.test_modify_priority ... ok test.unit.container.test_reconciler.TestReconciler.test_can_reconcile_policy test.unit.container.test_reconciler.TestReconciler.test_can_reconcile_policy ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_delete_object test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_delete_object ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label_overridden_by_call_label test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label_overridden_by_call_label ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label_sorting test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label_sorting ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label_value_invalid_chars test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_user_label_value_invalid_chars ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_x_open_expired_custom_config test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_x_open_expired_custom_config ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_valid_label_mode test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_valid_label_mode ... ok test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_weird_invalid_attrname_label_mode test.unit.common.test_statsd_client.TestGetLabeledStatsdClientConfParsing.test_weird_invalid_attrname_label_mode ... ok test.unit.common.test_swob.TestEtag.test_normalize_bytes test.unit.common.test_swob.TestEtag.test_normalize_bytes ... ok test.unit.common.test_swob.TestEtag.test_normalize_etag test.unit.common.test_swob.TestEtag.test_normalize_etag ... ok test.unit.common.test_utils.TestContextPool.test_close test.unit.common.test_utils.TestContextPool.test_close ... ok test.unit.common.test_utils.TestContextPool.test_context_manager test.unit.common.test_utils.TestContextPool.test_context_manager ... ok test.unit.common.test_utils.TestGetPpid.test_happy_path test.unit.common.test_utils.TestGetPpid.test_happy_path ... ok test.unit.common.test_utils.TestGetPpid.test_not_allowed test.unit.common.test_utils.TestGetPpid.test_not_allowed ... ok test.unit.common.test_utils.TestGetPpid.test_not_found test.unit.common.test_utils.TestGetPpid.test_not_found ... ok test.unit.common.test_utils.TestUnlinkOlder.test_unlink_empty_paths test.unit.common.test_utils.TestUnlinkOlder.test_unlink_empty_paths ... ok test.unit.common.test_utils.TestUnlinkOlder.test_unlink_mixed test.unit.common.test_utils.TestUnlinkOlder.test_unlink_mixed ... ok test.unit.common.test_utils.TestUnlinkOlder.test_unlink_not_exists_paths test.unit.common.test_utils.TestUnlinkOlder.test_unlink_not_exists_paths ... ok test.unit.common.test_utils.TestUnlinkOlder.test_unlink_not_old_enough test.unit.common.test_utils.TestUnlinkOlder.test_unlink_not_old_enough ... ok test.unit.common.test_utils.TestUnlinkOlder.test_unlink_older_than_file test.unit.common.test_utils.TestUnlinkOlder.test_unlink_older_than_file ... ok test.unit.common.test_utils.TestUnlinkOlder.test_unlink_older_than_now test.unit.common.test_utils.TestUnlinkOlder.test_unlink_older_than_now ... ok test.unit.common.test_utils.TestUnlinkOlder.test_unlink_older_than_path_not_exists test.unit.common.test_utils.TestUnlinkOlder.test_unlink_older_than_path_not_exists ... ok test.unit.common.test_utils.TestUnlinkOlder.test_unlink_paths test.unit.common.test_utils.TestUnlinkOlder.test_unlink_paths ... ok test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_pyeclib_dist_info_missing test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_pyeclib_dist_info_missing ... ok test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_pyeclib_dist_missing_files test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_pyeclib_dist_missing_files ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_namespaces_root_container_fill_gap test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_namespaces_root_container_fill_gap ... ok test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_pyeclib_install_found test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_pyeclib_install_found ... ok test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_pyeclib_install_not_found test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_pyeclib_install_not_found ... ok test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_sys_package_preferred test.unit.common.utils.test_checksum.TestModuleFunctions.test_find_isal_sys_package_preferred ... ok test.unit.common.utils.test_config.ResellerConfReader.test_defaults test.unit.common.utils.test_config.ResellerConfReader.test_defaults ... ok test.unit.common.utils.test_config.ResellerConfReader.test_multiple_same_resellers test.unit.common.utils.test_config.ResellerConfReader.test_multiple_same_resellers ... ok test.unit.common.utils.test_config.ResellerConfReader.test_multiple_stray_commas_resellers test.unit.common.utils.test_config.ResellerConfReader.test_multiple_stray_commas_resellers ... ok test.unit.common.utils.test_config.ResellerConfReader.test_same_as_default test.unit.common.utils.test_config.ResellerConfReader.test_same_as_default ... ok test.unit.common.utils.test_config.ResellerConfReader.test_several_resellers_first_blank test.unit.common.utils.test_config.ResellerConfReader.test_several_resellers_first_blank ... ok test.unit.common.utils.test_config.ResellerConfReader.test_several_resellers_with_blank_comma test.unit.common.utils.test_config.ResellerConfReader.test_several_resellers_with_blank_comma ... ok test.unit.common.utils.test_config.ResellerConfReader.test_several_resellers_with_conf test.unit.common.utils.test_config.ResellerConfReader.test_several_resellers_with_conf ... ok test.unit.common.utils.test_config.ResellerConfReader.test_single_blank_reseller test.unit.common.utils.test_config.ResellerConfReader.test_single_blank_reseller ... ok test.unit.common.utils.test_config.ResellerConfReader.test_single_blank_reseller_with_conf test.unit.common.utils.test_config.ResellerConfReader.test_single_blank_reseller_with_conf ... ok test.unit.common.utils.test_config.ResellerConfReader.test_stray_comma test.unit.common.utils.test_config.ResellerConfReader.test_stray_comma ... ok test.unit.common.utils.test_config.ResellerConfReader.test_unprefixed_options test.unit.common.utils.test_config.ResellerConfReader.test_unprefixed_options ... ok :0(getcwd) 1 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 1 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile1824512 Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile123 Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile456 30 function calls in 0.001 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 6 0.000 0.000 0.001 0.000 profile:0(import os;os.getcwd();) 6 0.000 0.000 0.000 0.000 :0(exec) 6 0.000 0.000 0.000 0.000 :0(getcwd) 6 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 6 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile1824512 Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile123 Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile456 30 function calls in 0.001 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 6 0.000 0.000 0.001 0.000 profile:0(import os;os.getcwd();) 6 0.000 0.000 0.000 0.000 :0(exec) 6 0.000 0.000 0.000 0.000 :0(getcwd) 6 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 6 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile1824512 Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile123 Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile456 30 function calls in 0.001 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 6 0.000 0.000 0.001 0.000 profile:0(import os;os.getcwd();) 6 0.000 0.000 0.000 0.000 :0(exec) 6 0.000 0.000 0.000 0.000 :0(getcwd) 6 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 6 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile1824512 15 function calls in 0.000 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 3 0.000 0.000 0.000 0.000 profile:0(import os;os.getcwd();) 3 0.000 0.000 0.000 0.000 :0(exec) 3 0.000 0.000 0.000 0.000 :0(getcwd) 3 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 3 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile1824512 15 function calls in 0.000 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 3 0.000 0.000 0.000 0.000 profile:0(import os;os.getcwd();) 3 0.000 0.000 0.000 0.000 :0(exec) 3 0.000 0.000 0.000 0.000 :0(getcwd) 3 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 3 0.000 0.000 0.000 0.000 :0(setprofile) Sun Sep 14 03:24:17 2025 /tmp/tmpx3fzga28/unittest.profile1824512 15 function calls in 0.000 seconds Ordered by: internal time ncalls tottime percall cumtime percall filename:lineno(function) 3 0.000 0.000 0.000 0.000 profile:0(import os;os.getcwd();) 3 0.000 0.000 0.000 0.000 :0(exec) 3 0.000 0.000 0.000 0.000 :0(getcwd) 3 0.000 0.000 0.000 0.000 :1() 0 0.000 0.000 profile:0(profiler) 3 0.000 0.000 0.000 0.000 :0(setprofile) proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: ERROR WSGI: code 400, message Invalid PROXY line 'PROXY jojo', (txn: tx65479ed88ffa441b987e9-0068c57086) proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: ERROR WSGI: code 400, message Invalid PROXY line 'PROXYjojo a b c d e', (txn: tx1440ebdc862b475caeffa-0068c57086) proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: ERROR WSGI: code 400, message Invalid PROXY line 'PROXY a b c d e', (txn: txd07c0e82d62943b0be9b7-0068c57086) proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: ERROR WSGI: code 400, message Invalid PROXY line 'GET /someurl HTTP/1.0\r\n', (txn: test-bad-req-trans-id) proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: 192.168.0.1 - - [14/Sep/2025 03:24:22] "GET /someurl HTTP/1.1" 200 160 0.000077 proxy INFO: 192.168.0.1 - - [14/Sep/2025 03:24:22] "GET /otherurl HTTP/1.1" 200 179 0.000030 proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: 192.168.0.1 - - [14/Sep/2025 03:24:22] "GET /someurl HTTP/1.0" 200 186 0.012135 proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: 192.168.0.1 - - [14/Sep/2025 03:24:22] "GET /someurl HTTP/1.0" 200 179 0.000039 proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:22] "GET /someurl HTTP/1.0" 200 180 0.000036 proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:22] "GET /someurl HTTP/1.0" 200 180 0.000045 proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True proxy INFO: (1824512) wsgi starting up on http:('127.0.0.1', 8359) proxy DEBUG: (1824512) accepted ('127.0.0.1', 8359) proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:22] "GET /someurl HTTP/1.0" 200 180 0.000038 proxy INFO: wsgi exiting proxy INFO: (1824512) wsgi exited, is_accepting=True test DEBUG: set nice priority to 1 test DEBUG: set ionice class 1 priority 0 WARNING: Unable to modify I/O scheduling class and priority of process. Keeping unchanged! Check logs for more info. test ERROR: Unable to modify ionice priority: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/libc.py", line 326, in _ioprio_set io_class = IO_CLASS_ENUM[io_class] ~~~~~~~~~~~~~^^^^^^^^^^ KeyError: 'class_foo' test DEBUG: set ionice class 2 priority 4 test DEBUG: set nice priority to -15 test DEBUG: set ionice class 3 priority 6 test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3618.841870) in policy_index 1test.unit.container.test_reconciler.TestReconciler.test_concurrency test.unit.container.test_reconciler.TestReconciler.test_concurrency ... ok test.unit.container.test_reconciler.TestReconciler.test_concurrency_config test.unit.container.test_reconciler.TestReconciler.test_concurrency_config ... ok test.unit.container.test_reconciler.TestReconciler.test_delete_old_empty_queue_containers test.unit.container.test_reconciler.TestReconciler.test_delete_old_empty_queue_containers ... ok test.unit.container.test_reconciler.TestReconciler.test_error_in_iter_containers test.unit.container.test_reconciler.TestReconciler.test_error_in_iter_containers ... ok test.unit.container.test_reconciler.TestReconciler.test_fail_to_move_if_ppi test.unit.container.test_reconciler.TestReconciler.test_fail_to_move_if_ppi ... ok test.unit.container.test_reconciler.TestReconciler.test_init_internal_client_log_name test.unit.container.test_reconciler.TestReconciler.test_init_internal_client_log_name ... ok test.unit.container.test_reconciler.TestReconciler.test_invalid_queue_name test.unit.container.test_reconciler.TestReconciler.test_invalid_queue_name ... ok test.unit.container.test_reconciler.TestReconciler.test_invalid_queue_name_marches_onward test.unit.container.test_reconciler.TestReconciler.test_invalid_queue_name_marches_onward ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_bad_value_workers test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_bad_value_workers ... ok proxy-server DEBUG: Loaded override config for policy 0 (ec): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (ec): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (ec): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '3 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (ec): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '3 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086)test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_dump_recon_run_once_in_worker test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_dump_recon_run_once_in_worker ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_double_check_trailing_delimiter test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_double_check_trailing_delimiter ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_dump_recon_run_once_inline test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_dump_recon_run_once_inline ... ok test.unit.container.test_reconciler.TestReconciler.test_iter_over_old_containers_in_reverse test.unit.container.test_reconciler.TestReconciler.test_iter_over_old_containers_in_reverse ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_own_shard_range test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_own_shard_range ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_final_recon_dump test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_final_recon_dump ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_is_healthy test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_is_healthy ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_is_healthy_detects_ring_change test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_is_healthy_detects_ring_change ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf4a2abb171164a728b137-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086)test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_is_healthy_rcache_update_waits_for_next_update test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_is_healthy_rcache_update_waits_for_next_update ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_namespaces_state_filtering test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_namespaces_state_filtering ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_next_rcache_update_configured_with_stats_interval test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_next_rcache_update_configured_with_stats_interval ... ok test.unit.container.test_backend.TestContainerBroker.test_reclaim_deadlock test.unit.container.test_backend.TestContainerBroker.test_reclaim_deadlock ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_double_check_trailing_delimiter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_double_check_trailing_delimiter_non_slash ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdg1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 201 - "PUT http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "txa6131f8a232e49fbbe3b9-0068c57086" "proxy-server 1824509" 0.0417 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdi1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 201 - "PUT http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "txa6131f8a232e49fbbe3b9-0068c57086" "proxy-server 1824509" 0.0505 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/3/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 201 - "PUT http://localhost/sdh1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "txa6131f8a232e49fbbe3b9-0068c57086" "object-server 1824509" 0.0090 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdh1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 201 - "PUT http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "txa6131f8a232e49fbbe3b9-0068c57086" "proxy-server 1824509" 0.0815 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc5f978b36e8d4662a4eb1-0068c57086" "proxy-server 1824509" 0.0105 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/3/a/e813f6d4fd9342ffb96c27847f184a4e" 204 - "HEAD http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e" "txe4bd9435a2b54b84a5025-0068c57086" "proxy-server 1824509" 0.0144 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdi1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 200 82 "GET http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "tx08cda6ddb1bd42578a990-0068c57086" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdh1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 200 82 "GET http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "tx08cda6ddb1bd42578a990-0068c57086" "proxy-server 1824509" 0.0168 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4e72f53a968141dfa4a18-0068c57086" "proxy-server 1824509" 0.0019 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/3/a/e813f6d4fd9342ffb96c27847f184a4e" 204 - "HEAD http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e" "tx76fbcb2e2e494ad8a8a09-0068c57086" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdi1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 404 70 "GET http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "txf06257ffd0724349ab0ad-0068c57086" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdg1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 404 70 "GET http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "txf06257ffd0724349ab0ad-0068c57086" "proxy-server 1824509" 0.0124 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txf06257ffd0724349ab0ad-0068c57086) proxy DEBUG: Ignoring 404 from primary (txn: txf06257ffd0724349ab0ad-0068c57086) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdh1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 404 70 "GET http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "txf06257ffd0724349ab0ad-0068c57086" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txf06257ffd0724349ab0ad-0068c57086) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx361254439273438da62e4-0068c57086" "proxy-server 1824509" 0.0135 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/3/a/e813f6d4fd9342ffb96c27847f184a4e" 204 - "HEAD http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e" "txfeb111d7bc70429e84c0e-0068c57086" "proxy-server 1824509" 0.0174 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdi1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 200 82 "GET http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "tx0c9a26a58d3a41c485561-0068c57086" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdg1/0/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" 200 82 "GET http://localhost/v1/a/e813f6d4fd9342ffb96c27847f184a4e/028c0e3d239c40b489061e9221d579c8" "tx0c9a26a58d3a41c485561-0068c57086" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfa742b4243a84782b2b12-0068c57086" "proxy-server 1824509" 0.0141 "-" 1824509 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/0/a/2a29e6f491374f9ca915f16f65a26ac6" 201 - "PUT http://127.0.0.1:41753/sdb1/2/a/2a29e6f491374f9ca915f16f65a26ac6" "txfa742b4243a84782b2b12-0068c57086" "container-server 1824509" 0.0011 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/0/a/2a29e6f491374f9ca915f16f65a26ac6" 201 - "PUT http://127.0.0.1:36297/sda1/2/a/2a29e6f491374f9ca915f16f65a26ac6" "txfa742b4243a84782b2b12-0068c57086" "container-server 1824509" 0.0212 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/2/a/2a29e6f491374f9ca915f16f65a26ac6" 201 - "PUT http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6" "txfa742b4243a84782b2b12-0068c57086" "proxy-server 1824509" 0.0409 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/2/a/2a29e6f491374f9ca915f16f65a26ac6" 201 - "PUT http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6" "txfa742b4243a84782b2b12-0068c57086" "proxy-server 1824509" 0.0851 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe0278815e53f43f7b494f-0068c57086" "proxy-server 1824509" 0.0019 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/2/a/2a29e6f491374f9ca915f16f65a26ac6" 204 - "HEAD http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6" "txb4f3efdaa692420187cbe-0068c57086" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdg1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 201 - "PUT http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "tx93c29b14b3e8479d94b63-0068c57086" "proxy-server 1824509" 0.0537 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/2/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 201 - "PUT http://localhost/sdi1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "tx93c29b14b3e8479d94b63-0068c57086" "object-server 1824509" 0.0005 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdi1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 201 - "PUT http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "tx93c29b14b3e8479d94b63-0068c57086" "proxy-server 1824509" 0.0682 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/2/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 201 - "PUT http://localhost/sdh1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "tx93c29b14b3e8479d94b63-0068c57086" "object-server 1824509" 0.0005 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdh1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 201 - "PUT http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "tx93c29b14b3e8479d94b63-0068c57086" "proxy-server 1824509" 0.0874 "-" 1824509 3test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_no_dump_recon_run_once test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_no_dump_recon_run_once ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_no_workers_by_default test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_no_workers_by_default ... ok test.unit.container.test_backend.TestContainerBroker.test_reclaim_shard_ranges test.unit.container.test_backend.TestContainerBroker.test_reclaim_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_policy_info test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_policy_info ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_recon_aggregation_at_end_of_run_once test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_recon_aggregation_at_end_of_run_once ... ok test.unit.container.test_backend.TestContainerBroker.test_reclaim_with_duplicate_names test.unit.container.test_backend.TestContainerBroker.test_reclaim_with_duplicate_names ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_without_crypto test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_without_crypto ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_recon_aggregation_races_with_final_recon_dump test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_recon_aggregation_races_with_final_recon_dump ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_objects test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_objects ... ok test.unit.container.test_backend.TestContainerBroker.test_reconciler_sync test.unit.container.test_backend.TestContainerBroker.test_reconciler_sync ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_recon_aggregation_removes_devices test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_recon_aggregation_removes_devices ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_recon_aggregation_waits_for_all_devices test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_recon_aggregation_waits_for_all_devices ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_run_forever_recon_no_devices test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_run_forever_recon_no_devices ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_worker_logging test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_worker_logging ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_devices test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_devices ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_devices_and_no_valid_overrides test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_devices_and_no_valid_overrides ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_devices_and_overrides test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_devices_and_overrides ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_server.TestECGets.test_GET_with_missing_durables test.unit.proxy.test_server.TestECGets.test_GET_with_missing_durables ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_lots_of_devices test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_lots_of_devices ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_lots_of_devices_and_overrides test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_lots_of_devices_and_overrides ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_replication_info test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_replication_info ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_lots_of_workers test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_lots_of_workers ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_lots_of_workers_and_devices test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_lots_of_workers_and_devices ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_no_devices test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_no_devices ... ok test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_some_workers_and_devices test.unit.obj.test_reconstructor.TestWorkerReconstructor.test_workers_with_some_workers_and_devices ... ok test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_x_open_expired_default_config test.unit.proxy.controllers.test_obj.TestECDuplicationObjController.test_x_open_expired_default_config ... ok test.unit.proxy.controllers.test_obj.TestNumContainerUpdates.test_it test.unit.proxy.controllers.test_obj.TestNumContainerUpdates.test_it ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 201 - "PUT http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "tx600dbdb9ef8d420d85d6b-0068c57086" "proxy-server 1824514" 0.0449 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 201 - "PUT http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "tx600dbdb9ef8d420d85d6b-0068c57086" "proxy-server 1824514" 0.0644 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf4b364a611fd4890b7fef-0068c57086" "proxy-server 1824514" 0.0019 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 204 - "HEAD http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "txf4b364a611fd4890b7fef-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx33e4286719cf4bae9b07a-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 204 - "HEAD http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "tx1ae2700827ff4addb27fb-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 201 - "PUT http://foo:8080/sdc1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx5765573b12834ee1b3538-0068c57086" "object-server 1824514" 0.0005 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 201 - "PUT http://foo:8080/sdd1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx5765573b12834ee1b3538-0068c57086" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdd1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 201 - "PUT http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx5765573b12834ee1b3538-0068c57086" "proxy-server 1824514" 0.0330 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdc1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 201 - "PUT http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx5765573b12834ee1b3538-0068c57086" "proxy-server 1824514" 0.0327 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txed4c0bd576f144d189b5e-0068c57086" "proxy-server 1824514" 0.0100 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 204 - "HEAD http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "tx0216595a7459427b9a175-0068c57086" "proxy-server 1824514" 0.0042 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 201 - "POST http://foo:8080/sdc1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx4afbae3879414d36a24c4-0068c57086" "object-server 1824514" 0.0004 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "PUT /sdb1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 201 - "POST http://foo:8080/sdd1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx4afbae3879414d36a24c4-0068c57086" "object-server 1824514" 0.0004 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "POST /sdd1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 202 76 "POST http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx4afbae3879414d36a24c4-0068c57086" "proxy-server 1824514" 0.0065 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "POST /sdc1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 202 76 "POST http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx4afbae3879414d36a24c4-0068c57086" "proxy-server 1824514" 0.0156 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx41267f1d099749e090106-0068c57086" "proxy-server 1824514" 0.0094 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 204 - "HEAD http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "tx1ac34b3cbbc14aa681660-0068c57086" "proxy-server 1824514" 0.0044 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdc1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 200 24 "GET http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "txba1f8d46bbdc4441963ca-0068c57086" "proxy-server 1824514" 0.0129 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txed5f7d62850645bd98232-0068c57086" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 204 - "HEAD http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "txf310567330a14eb5955df-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdd1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 200 24 "HEAD http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx6518424a2ce44279911f2-0068c57086" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx362e9f718ef944db9306d-0068c57086" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 204 - "HEAD http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "tx81b17326e5944d92b3adf-0068c57086" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdc1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 200 24 "GET http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "tx8db14edae5064761b00d1-0068c57086" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe994663e2e3345b5a80d3-0068c57086" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 204 - "HEAD http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" "tx5abdcb1e1e014f9183f53-0068c57086" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdc1/0/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" 200 24 "HEAD http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d/o" "txc56309e44f9246c8bb6c6-0068c57086" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txae2754ede5a54979bd4b4-0068c57086" "proxy-server 1824514" 0.0258 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdb1/3/a/98c8f3b27b2b46448dcd81ca0aa7ea7d" 200 382 "GET http://foo:8080/v1/a/98c8f3b27b2b46448dcd81ca0aa7ea7d?format=json&states=listing" "txae2754ede5a54979bd4b4-0068c57086" "proxy-server 1824514" 0.0089 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb5e905affe6349b086274-0068c57087" "proxy-server 1824514" 0.0133 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 201 - "PUT http://127.0.0.1:60751/sdb1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" "txb5e905affe6349b086274-0068c57087" "container-server 1824514" 0.0010 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 201 - "PUT http://127.0.0.1:40941/sda1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" "txb5e905affe6349b086274-0068c57087" "container-server 1824514" 0.0009 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 201 - "PUT http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198" "txb5e905affe6349b086274-0068c57087" "proxy-server 1824514" 0.0691 "-" 1824514 3test.unit.obj.test_server.TestObjectController.test_DELETE test.unit.obj.test_server.TestObjectController.test_DELETE ... ok test.unit.obj.test_server.TestObjectController.test_DELETE_bad_timestamp test.unit.obj.test_server.TestObjectController.test_DELETE_bad_timestamp ... ok test.unit.obj.test_server.TestObjectController.test_DELETE_but_expired test.unit.obj.test_server.TestObjectController.test_DELETE_but_expired ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_objects_since_row test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_objects_since_row ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_report_info test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_report_info ... ok test.unit.obj.test_server.TestObjectController.test_DELETE_calls_delete_at test.unit.obj.test_server.TestObjectController.test_DELETE_calls_delete_at ... ok test.unit.obj.test_server.TestObjectController.test_DELETE_can_skip_updating_expirer_queue test.unit.obj.test_server.TestObjectController.test_DELETE_can_skip_updating_expirer_queue ... ok test.unit.container.test_backend.TestContainerBroker.test_remove_objects test.unit.container.test_backend.TestContainerBroker.test_remove_objects ... ok test.unit.container.test_backend.TestContainerBroker.test_resolve_shard_range_states test.unit.container.test_backend.TestContainerBroker.test_resolve_shard_range_states ... ok test.unit.obj.test_server.TestObjectController.test_DELETE_container_updates test.unit.obj.test_server.TestObjectController.test_DELETE_container_updates ... ok test.unit.obj.test_server.TestObjectController.test_DELETE_full_drive test.unit.obj.test_server.TestObjectController.test_DELETE_full_drive ... ok test.unit.container.test_backend.TestContainerBroker.test_reverse_prefix_delim test.unit.container.test_backend.TestContainerBroker.test_reverse_prefix_delim ... ok test.unit.obj.test_server.TestObjectController.test_DELETE_if_delete_at test.unit.obj.test_server.TestObjectController.test_DELETE_if_delete_at ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx49bedfbffb75427cb3b46-0068c57086" "proxy-server 1824509" 0.0182 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sdb1/2/a/2a29e6f491374f9ca915f16f65a26ac6" 204 - "HEAD http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6" "tx9762c67e10d841c0bb841-0068c57086" "proxy-server 1824509" 0.0084 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdh1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 200 82 "GET http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "txec909d2b268944db93b35-0068c57086" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "GET /sdi1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 200 82 "GET http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "txec909d2b268944db93b35-0068c57086" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:22 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9f9951bc5a734bd88ac5b-0068c57086" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/2/a/2a29e6f491374f9ca915f16f65a26ac6" 204 - "HEAD http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6" "tx201ddfb58f66429db83f9-0068c57086" "proxy-server 1824509" 0.0111 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 404 70 "GET http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "txce157680c1fc4eb6a5284-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdh1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 404 70 "GET http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "txce157680c1fc4eb6a5284-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txce157680c1fc4eb6a5284-0068c57087) proxy DEBUG: Ignoring 404 from primary (txn: txce157680c1fc4eb6a5284-0068c57087) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 404 70 "GET http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "txce157680c1fc4eb6a5284-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txce157680c1fc4eb6a5284-0068c57087) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx250259d4d4324c1dbc536-0068c57087" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/2/a/2a29e6f491374f9ca915f16f65a26ac6" 204 - "HEAD http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6" "txf4fcefc60fd8497cbc47c-0068c57087" "proxy-server 1824509" 0.0012 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 200 82 "GET http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "tx5ea71b638c0d491a81bd2-0068c57087" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 200 82 "GET http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "tx5ea71b638c0d491a81bd2-0068c57087" "proxy-server 1824509" 0.0208 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdh1/0/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" 200 82 "GET http://localhost/v1/a/2a29e6f491374f9ca915f16f65a26ac6/dfae721ce7db4aae806b4c7ebc211050" "tx5ea71b638c0d491a81bd2-0068c57087" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6dc6e5425ba441deb9f68-0068c57087" "proxy-server 1824509" 0.0013 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/864fe09558bc4dc89fc60f1c685cb5df" 201 - "PUT http://127.0.0.1:36297/sda1/0/a/864fe09558bc4dc89fc60f1c685cb5df" "tx6dc6e5425ba441deb9f68-0068c57087" "container-server 1824509" 0.0103 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/864fe09558bc4dc89fc60f1c685cb5df" 201 - "PUT http://127.0.0.1:41753/sdb1/0/a/864fe09558bc4dc89fc60f1c685cb5df" "tx6dc6e5425ba441deb9f68-0068c57087" "container-server 1824509" 0.0010 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/864fe09558bc4dc89fc60f1c685cb5df" 201 - "PUT http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df" "tx6dc6e5425ba441deb9f68-0068c57087" "proxy-server 1824509" 0.0360 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/864fe09558bc4dc89fc60f1c685cb5df" 201 - "PUT http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df" "tx6dc6e5425ba441deb9f68-0068c57087" "proxy-server 1824509" 0.0245 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8d36e63201684cc6aa14e-0068c57087" "proxy-server 1824509" 0.0019 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a/864fe09558bc4dc89fc60f1c685cb5df" 204 - "HEAD http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df" "txb3d47972617e436992d8d-0068c57087" "proxy-server 1824509" 0.0012 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdh1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 201 - "PUT http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx2ae212e9d41443e9a658d-0068c57087" "proxy-server 1824509" 0.0300 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 201 - "PUT http://localhost/sdg1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx2ae212e9d41443e9a658d-0068c57087" "object-server 1824509" 0.0005 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 201 - "PUT http://localhost/sdi1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx2ae212e9d41443e9a658d-0068c57087" "object-server 1824509" 0.0005 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdg1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 201 - "PUT http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx2ae212e9d41443e9a658d-0068c57087" "proxy-server 1824509" 0.0345 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdi1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 201 - "PUT http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx2ae212e9d41443e9a658d-0068c57087" "proxy-server 1824509" 0.0407 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx124fe97af38a4c6bbceee-0068c57087" "proxy-server 1824509" 0.0096 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a/864fe09558bc4dc89fc60f1c685cb5df" 204 - "HEAD http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df" "tx121966d7b294498b8d85b-0068c57087" "proxy-server 1824509" 0.0022 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 200 82 "GET http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "txfbb640de58b148fd922d3-0068c57087" "proxy-server 1824509" 0.0007 "-" 1824509 3test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_range_rows_with_limit test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_range_rows_with_limit ... ok test.unit.container.test_backend.TestContainerBroker.test_root_account_container_path test.unit.container.test_backend.TestContainerBroker.test_root_account_container_path ... ok test.unit.container.test_backend.TestContainerBroker.test_save_and_load_record_from_pending_file test.unit.container.test_backend.TestContainerBroker.test_save_and_load_record_from_pending_file ... ok test ERROR: Returning 497 because of blacklisting: b test ERROR: Returning 497 because of blacklisting: b test ERROR: Returning 497 because of blacklisting: b test ERROR: Returning 497 because of blacklisting: b test ERROR: Returning 497 because of blacklisting: b test WARNING: More than one part in a single-part response? test ERROR: Problem finding shard upper in '/tmp/tmpw8ic_5k2/test_container.db': : LockTimeout (Nones) test ERROR: Problem finding shard upper in '/tmp/tmpw8ic_5k2/test_container.db': : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2498, in find_shard_ranges next_shard_upper = sub_broker._get_next_shard_range_upper( shard_size, last_shard_upper) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect sqlite3.OperationalError test DEBUG: Unlinked retiring db '/tmp/tmpj6v04okl/containers/part/suffix/hash/container.db' test WARNING: Unexpected db files will be ignored: ['/tmp/tmpj6v04okl/containers/part/suffix/hash/container.db'] Container 'a/c' cannot be set to sharded state while in unsharded state Container 'a/c' cannot be set to sharding state: missing epoch test DEBUG: Labeled statsd mode: dogstatsd (test) test DEBUG: Labeled statsd mode: dogstatsd (test) test DEBUG: Labeled statsd mode: dogstatsd (test) test DEBUG: Labeled statsd mode: dogstatsd (test) test WARNING: Error sending UDP message to ('some.host.com', 8125): [Errno 1] test errno 1 test DEBUG: Labeled statsd mode: dogstatsd (test) test DEBUG: Labeled statsd mode: disabled (test) test DEBUG: Labeled statsd mode: disabled (my-log-route) test DEBUG: Labeled statsd mode: dogstatsd (my-log-route) test INFO: [worker 1/1 pid=1824531] Running object reconstructor in script mode. test INFO: [worker 1/1 pid=1824531] Object reconstruction complete (once). (5.00 minutes) test INFO: [worker 1/1 pid=1824531] Running object reconstructor in script mode. test INFO: [worker 1/1 pid=1824531] Object reconstruction complete (once). (5.00 minutes) test INFO: [worker 1/1 pid=1824531] Running object reconstructor in script mode. test INFO: [worker 1/1 pid=1824531] Object reconstruction complete (once). (5.00 minutes) test INFO: [worker 1/1 pid=1824531] Running object reconstructor in script mode. test INFO: [worker 1/1 pid=1824531] Object reconstruction complete (once). (5.00 minutes) test INFO: [worker 1/1 pid=1824531] Running object reconstructor in script mode. test INFO: [worker 1/1 pid=1824531] Object reconstruction complete (once). (10.00 minutes) test INFO: Running object reconstructor in script mode. test INFO: Object reconstruction complete (once). (5.00 minutes) test INFO: Running object reconstructor in script mode. test INFO: Object reconstruction complete (once). (5.00 minutes) test INFO: Running object reconstructor in script mode. test INFO: Object reconstruction complete (once). (5.00 minutes) test INFO: [worker 1/1 pid=1824531] Running object reconstructor in script mode. test INFO: [worker 1/1 pid=1824531] Object reconstruction complete (once). (5.00 minutes) test INFO: [worker 1/1 pid=1824531] Running object reconstructor in script mode. test INFO: [worker 1/1 pid=1824531] Object reconstruction complete (once). (5.00 minutes) test INFO: [worker 1/1 pid=1824531] Running object reconstructor in script mode. test INFO: [worker 1/1 pid=1824531] Object reconstruction complete (once). (5.00 minutes) test INFO: [worker 1/1 pid=1824531] Running object reconstructor in script mode. test INFO: [worker 1/1 pid=1824531] Object reconstruction complete (once). (5.00 minutes) test INFO: [worker 1/2 pid=pid-1] Starting object reconstructor in daemon mode. test INFO: [worker 1/2 pid=pid-1] Starting object reconstruction pass. test INFO: [worker 1/2 pid=pid-1] Object reconstruction complete. (0.10 minutes) test DEBUG: [worker 1/2 pid=pid-1] reconstruction sleeping for 30.0 seconds. test INFO: [worker 2/4 pid=20641] Running object reconstructor in script mode. test DEBUG: [worker 2/4 pid=20641] debug message test INFO: [worker 2/4 pid=20641] info message test WARNING: [worker 2/4 pid=20641] warning message test ERROR: [worker 2/4 pid=20641] error message test INFO: [worker 2/4 pid=20641] Object reconstruction complete (once). (0.00 minutes) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [01/Jan/1970:01:23:20 +0000] "DELETE /sda1/p/a/c" 400 25 "-" "-" "-" - "-" 1824531 - test-object-controller INFO: - - - [01/Jan/1970:01:23:20 +0000] "DELETE /sda1/p/a/c/o" 400 26 "-" "-" "-" - "-" 1824531 - test-object-controller INFO: - - - [01/Jan/1970:01:23:20 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" - "-" 1824531 - test-object-controller INFO: - - - [01/Jan/1970:01:23:20 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" - "-" 1824531 - test-object-controller INFO: - - - [01/Jan/1970:01:23:20 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" - "-" 1824531 - test-object-controller INFO: - - - [01/Jan/1970:01:23:20 +0000] "DELETE /sda1/p/a/c/o" 409 95 "-" "-" "-" - "-" 1824531 - test-object-controller INFO: - - - [01/Jan/1970:01:23:20 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 400 26 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0070 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0039 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0170 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0101 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0128 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 507 109 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0008 "-" 1824531 - test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0020 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 412 43 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0133 "-" 1824531 - test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0018 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 412 43 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0094 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 400 31 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0020 "-" 1824531 -test.unit.obj.test_server.TestObjectController.test_DELETE_if_delete_at_expired_still_deletes test.unit.obj.test_server.TestObjectController.test_DELETE_if_delete_at_expired_still_deletes ... ok proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4cbc46376024478e87f38-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0236e034c9964ec5b7f6f-0068c57086) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmp1wzlvn5u/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp1wzlvn5u/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmp1wzlvn5u/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp1wzlvn5u/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a" 201 - "-" "test" "-" 0.0153 "-" 1824529 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a" 201 - "-" "test" "-" 0.0152 "-" 1824529 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0029 "-" 1824529 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0149 "-" 1824529 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5065b62c7fe74f8091a01-0068c57087" "proxy-server 1824529" 0.0012 "-" 1824529 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://127.0.0.1:44785/sdb1/3/a/c" "tx5065b62c7fe74f8091a01-0068c57087" "container-server 1824529" 0.0011 "-" 1824529 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://127.0.0.1:52139/sda1/3/a/c" "tx5065b62c7fe74f8091a01-0068c57087" "container-server 1824529" 0.0010 "-" 1824529 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "tx5065b62c7fe74f8091a01-0068c57087" "proxy-server 1824529" 0.0616 "-" 1824529 0test.unit.obj.test_server.TestObjectController.test_DELETE_metafile_unavailable test.unit.obj.test_server.TestObjectController.test_DELETE_metafile_unavailable ... ok test.unit.obj.test_server.TestObjectController.test_DELETE_succeeds_with_later_POST test.unit.obj.test_server.TestObjectController.test_DELETE_succeeds_with_later_POST ... ok test.unit.obj.test_server.TestObjectController.test_DELETE_with_full_drive test.unit.obj.test_server.TestObjectController.test_DELETE_with_full_drive ... ok Container 'a/c' cannot be set to sharding state while in sharding state test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_own_shard_range test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_own_shard_range ... ok Container 'a/c' cannot be set to sharded state while in sharded state test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_ranges ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_without_crypto_ec test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_with_crypto_read_without_crypto_ec ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_policy_info test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_policy_info ... ok test.unit.container.test_backend.TestContainerBroker.test_set_db_states test.unit.container.test_backend.TestContainerBroker.test_set_db_states ... ok test.unit.obj.test_server.TestObjectController.test_EC_GET_quarantine_invalid_frag_archive test.unit.obj.test_server.TestObjectController.test_EC_GET_quarantine_invalid_frag_archive ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.container.test_reconciler.TestReconciler.test_multi_process_should_process test.unit.container.test_reconciler.TestReconciler.test_multi_process_should_process ... ok test.unit.container.test_backend.TestContainerBroker.test_set_sharded_state_errors test.unit.container.test_backend.TestContainerBroker.test_set_sharded_state_errors ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 200 82 "GET http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "txfbb640de58b148fd922d3-0068c57087" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0fe3314b88794d25b54bc-0068c57087" "proxy-server 1824509" 0.0014 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a/864fe09558bc4dc89fc60f1c685cb5df" 204 - "HEAD http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df" "tx567f5fff3d3340a588bdd-0068c57087" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdh1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 404 70 "GET http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx6288c6fe6d3148d68314d-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 404 70 "GET http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx6288c6fe6d3148d68314d-0068c57087" "proxy-server 1824509" 0.0070 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx6288c6fe6d3148d68314d-0068c57087) proxy DEBUG: Ignoring 404 from primary (txn: tx6288c6fe6d3148d68314d-0068c57087) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 404 70 "GET http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx6288c6fe6d3148d68314d-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx6288c6fe6d3148d68314d-0068c57087) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbc807968c8ed48c09ad14-0068c57087" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a/864fe09558bc4dc89fc60f1c685cb5df" 204 - "HEAD http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df" "tx8b2f6924fcd441fe8b228-0068c57087" "proxy-server 1824509" 0.0078 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 404 70 "GET http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx237187fec6d043c8bacee-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 200 82 "GET http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx237187fec6d043c8bacee-0068c57087" "proxy-server 1824509" 0.0007 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx237187fec6d043c8bacee-0068c57087) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/2/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" 200 82 "GET http://localhost/v1/a/864fe09558bc4dc89fc60f1c685cb5df/01ee38a54c1e45f9984576030890cf98" "tx237187fec6d043c8bacee-0068c57087" "proxy-server 1824509" 0.0008 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txda0ba9979178443a9fa4c-0068c57087" "proxy-server 1824509" 0.0012 "-" 1824509 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/147f065b0da64694b69bfde87befe050" 201 - "PUT http://127.0.0.1:36297/sda1/0/a/147f065b0da64694b69bfde87befe050" "txda0ba9979178443a9fa4c-0068c57087" "container-server 1824509" 0.0012 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/147f065b0da64694b69bfde87befe050" 201 - "PUT http://127.0.0.1:41753/sdb1/0/a/147f065b0da64694b69bfde87befe050" "txda0ba9979178443a9fa4c-0068c57087" "container-server 1824509" 0.0010 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/147f065b0da64694b69bfde87befe050" 201 - "PUT http://localhost/v1/a/147f065b0da64694b69bfde87befe050" "txda0ba9979178443a9fa4c-0068c57087" "proxy-server 1824509" 0.0276 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/147f065b0da64694b69bfde87befe050" 201 - "PUT http://localhost/v1/a/147f065b0da64694b69bfde87befe050" "txda0ba9979178443a9fa4c-0068c57087" "proxy-server 1824509" 0.0366 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7129500754814f499a859-0068c57087" "proxy-server 1824509" 0.0059 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a/147f065b0da64694b69bfde87befe050" 204 - "HEAD http://localhost/v1/a/147f065b0da64694b69bfde87befe050" "txe4c16d194f834b7d82cb2-0068c57087" "proxy-server 1824509" 0.0095 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdg1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 201 - "PUT http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx4ff1de5400bb4e13b2402-0068c57087" "proxy-server 1824509" 0.0206 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 201 - "PUT http://localhost/sdh1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx4ff1de5400bb4e13b2402-0068c57087" "object-server 1824509" 0.0006 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 201 - "PUT http://localhost/sdi1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx4ff1de5400bb4e13b2402-0068c57087" "object-server 1824509" 0.0046 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdi1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 201 - "PUT http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx4ff1de5400bb4e13b2402-0068c57087" "proxy-server 1824509" 0.0316 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdh1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 201 - "PUT http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx4ff1de5400bb4e13b2402-0068c57087" "proxy-server 1824509" 0.0315 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7f8b1dbfbe6c4cf79b3f3-0068c57087" "proxy-server 1824509" 0.0019 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a/147f065b0da64694b69bfde87befe050" 204 - "HEAD http://localhost/v1/a/147f065b0da64694b69bfde87befe050" "txab8d50a66b8f4dc2b7838-0068c57087" "proxy-server 1824509" 0.0076 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdh1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 200 82 "GET http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx3ad3208b81b147a7b69eb-0068c57087" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 200 82 "GET http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx3ad3208b81b147a7b69eb-0068c57087" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb8cf9fd1c4c8499fa4495-0068c57087" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a/147f065b0da64694b69bfde87befe050" 204 - "HEAD http://localhost/v1/a/147f065b0da64694b69bfde87befe050" "tx1c116d534d364ea4aa154-0068c57087" "proxy-server 1824509" 0.0058 "-" 1824509 3test.unit.proxy.test_server.TestECGets.test_GET_with_multiple_frags_per_node test.unit.proxy.test_server.TestECGets.test_GET_with_multiple_frags_per_node ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_json test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_json ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_unknown test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_unknown ... ok test.unit.container.test_reconciler.TestReconciler.test_no_concurrency test.unit.container.test_reconciler.TestReconciler.test_no_concurrency ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 201 - "PUT http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198" "txb5e905affe6349b086274-0068c57087" "proxy-server 1824514" 0.0533 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx19ed926482c6418e8a51d-0068c57087" "proxy-server 1824514" 0.0019 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 204 - "HEAD http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198" "tx19ed926482c6418e8a51d-0068c57087" "proxy-server 1824514" 0.0013 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6c5ad39f131d445687348-0068c57087" "proxy-server 1824514" 0.0019 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 204 - "HEAD http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198" "tx1e215203990d437e853b6-0068c57087" "proxy-server 1824514" 0.0012 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 201 - "PUT http://foo:8080/sdh1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "tx6dd0abedc43040ba80756-0068c57087" "object-server 1824514" 0.0005 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 201 - "PUT http://foo:8080/sdg1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "tx6dd0abedc43040ba80756-0068c57087" "object-server 1824514" 0.0086 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdh1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 201 - "PUT http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "tx6dd0abedc43040ba80756-0068c57087" "proxy-server 1824514" 0.0500 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdg1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 201 - "PUT http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "tx6dd0abedc43040ba80756-0068c57087" "proxy-server 1824514" 0.0370 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdi1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 201 - "PUT http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "tx6dd0abedc43040ba80756-0068c57087" "proxy-server 1824514" 0.0480 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx00dbd4453257440fa265c-0068c57087" "proxy-server 1824514" 0.0135 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 204 - "HEAD http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198" "tx84b1244004cd4112b4b0c-0068c57087" "proxy-server 1824514" 0.0104 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 201 - "POST http://foo:8080/sdg1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "txd4dbbab191594d8c8d0cc-0068c57087" "object-server 1824514" 0.0004 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 201 - "POST http://foo:8080/sdh1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "txd4dbbab191594d8c8d0cc-0068c57087" "object-server 1824514" 0.0004 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "POST /sdg1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 202 76 "POST http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "txd4dbbab191594d8c8d0cc-0068c57087" "proxy-server 1824514" 0.0326 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "POST /sdi1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 202 76 "POST http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "txd4dbbab191594d8c8d0cc-0068c57087" "proxy-server 1824514" 0.0255 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "POST /sdh1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 202 76 "POST http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "txd4dbbab191594d8c8d0cc-0068c57087" "proxy-server 1824514" 0.0484 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa749453ea42b430eb64f6-0068c57087" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 204 - "HEAD http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198" "tx23a4715a1e53444f8ffa6-0068c57087" "proxy-server 1824514" 0.0115 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 200 92 "GET http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "tx4678e6592d464cf1bb170-0068c57087" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 200 92 "GET http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "tx4678e6592d464cf1bb170-0068c57087" "proxy-server 1824514" 0.0089 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5862215292834c9ea0736-0068c57087" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 204 - "HEAD http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198" "txc287de43f7b74e20a6a64-0068c57087" "proxy-server 1824514" 0.0078 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdh1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 200 92 "HEAD http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "tx5771de38212140178607c-0068c57087" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx11143bf7bfc149858098c-0068c57087" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 204 - "HEAD http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198" "tx0548933fede94ce0a05b9-0068c57087" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 200 92 "GET http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "txc21b1a730e134eaa81d88-0068c57087" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 200 92 "GET http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "txc21b1a730e134eaa81d88-0068c57087" "proxy-server 1824514" 0.0090 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txd93f2e9fc64b44619b86f-0068c57087" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 204 - "HEAD http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198" "txd1d90df42a4142308b924-0068c57087" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdi1/1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" 200 92 "HEAD http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198/o" "txf6a9236fc74647f598231-0068c57087" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5fed5806125a4de9a13de-0068c57087" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdb1/1/a/b2d66441a69b4fd7b0578d5c3aa28198" 200 384 "GET http://foo:8080/v1/a/b2d66441a69b4fd7b0578d5c3aa28198?format=json&states=listing" "tx5fed5806125a4de9a13de-0068c57087" "proxy-server 1824514" 0.0022 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9edf124b24944956b1092-0068c57087" "proxy-server 1824514" 0.0134 "-" 1824514 -test.unit.container.test_backend.TestContainerBroker.test_set_sharding_state test.unit.container.test_backend.TestContainerBroker.test_set_sharding_state ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_xml test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_xml ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_ranges_includes test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_ranges_includes ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_bad_accept test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_bad_accept ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_invalid_utf8 test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_invalid_utf8 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_replication_info test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_replication_info ... ok test.unit.container.test_backend.TestContainerBroker.test_set_sharding_state_deleted test.unit.container.test_backend.TestContainerBroker.test_set_sharding_state_deleted ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_json test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_json ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_xml test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_xml ... ok test.unit.container.test_backend.TestContainerBroker.test_set_sharding_state_errors test.unit.container.test_backend.TestContainerBroker.test_set_sharding_state_errors ... ok test.unit.obj.test_server.TestObjectController.test_EC_PUT_GET_data test.unit.obj.test_server.TestObjectController.test_EC_PUT_GET_data ... ok test DEBUG: checking placement for '/AUTH_bob/c/o2' (3724.234560) in policy_index 1 test INFO: success: '/AUTH_bob/c/o2' (3724.234560) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o2' (3724.234560) from the queue (0000003724.23456_0000000000000002) test INFO: success: '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (3618.841870) from the queue (0000003618.84187_0000000000000002) test INFO: Reconciler Stats: {'success': 2, 'pop_queue': 2} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 1757102400 test DEBUG: looking for objects in 1757102400 test DEBUG: checking container 1757098800 test DEBUG: looking for objects in 1757098800 test ERROR: invalid_record: invalid queue record: {'bytes': 0, 'name': 'something', 'last_modified': '1970-01-01T00:00:00.000000', 'hash': '0000000000.00000', 'content_type': 'application/x-put'} Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 827, in reconcile queue_item = parse_raw_obj(raw_obj) File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 275, in parse_raw_obj policy_index, obj_name = raw_obj_name.split(':', 1) ^^^^^^^^^^^^^^^^^^^^^^ ValueError: not enough values to unpack (expected 2, got 1) test INFO: Reconciler Stats: {'invalid_record': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test ERROR: Error listing containers in account .misplaced_objects (Unexpected response: 503 Service Unavailable) test INFO: Reconciler Stats: {} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 test DEBUG: ppi_skip: Container policy (0) in the middle of a part power increase (PPI) test INFO: retry: '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 must be retried test INFO: Reconciler Stats: {'ppi_skip': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test ERROR: invalid_record: invalid queue record: {'bytes': 0, 'name': 'bogus', 'last_modified': '1970-01-01T01:00:18.841870', 'hash': '0000003618.84187', 'content_type': 'application/x-put'} Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 827, in reconcile queue_item = parse_raw_obj(raw_obj) File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 275, in parse_raw_obj policy_index, obj_name = raw_obj_name.split(':', 1) ^^^^^^^^^^^^^^^^^^^^^^ ValueError: not enough values to unpack (expected 2, got 1) test INFO: Reconciler Stats: {'invalid_record': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test ERROR: invalid_record: invalid queue record: {'bytes': 0, 'name': '00000bogus', 'last_modified': '1970-01-01T01:00:00.000000', 'hash': '0000003600.00000', 'content_type': 'application/x-put'} Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 827, in reconcile queue_item = parse_raw_obj(raw_obj) File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 275, in parse_raw_obj policy_index, obj_name = raw_obj_name.split(':', 1) ^^^^^^^^^^^^^^^^^^^^^^ ValueError: not enough values to unpack (expected 2, got 1) test DEBUG: checking placement for '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 test DEBUG: noop_object: '/AUTH_bob/c/o1' (3618.841870) container policy_index 1 matches queue policy index 1 test INFO: success: '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (3618.841870) from the queue (0000003618.84187_0000000000000002) test INFO: Reconciler Stats: {'invalid_record': 1, 'noop_object': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 1757764800 test DEBUG: looking for objects in 1757764800 test DEBUG: checking container 1757761200 test DEBUG: looking for objects in 1757761200 test DEBUG: checking container 1757757600 test DEBUG: looking for objects in 1757757600 test DEBUG: checking container 1757754000 test DEBUG: looking for objects in 1757754000 test DEBUG: checking container 1757750400 test DEBUG: looking for objects in 1757750400 test DEBUG: checking container 1757746800 test DEBUG: looking for objects in 1757746800 test DEBUG: checking container 1757743200 test DEBUG: looking for objects in 1757743200 test DEBUG: checking container 1757739600 test DEBUG: looking for objects in 1757739600 test DEBUG: checking container 1757736000 test DEBUG: looking for objects in 1757736000 test DEBUG: checking container 1757163600 test DEBUG: looking for objects in 1757163600 test DEBUG: checking container 1757160000 test DEBUG: looking for objects in 1757160000 test DEBUG: checking container 1757156400 test DEBUG: looking for objects in 1757156400 test DEBUG: checking container 1757152800 test DEBUG: looking for objects in 1757152800 test DEBUG: checking container 1757149200 test DEBUG: looking for objects in 1757149200 test DEBUG: checking container 1757145600 test DEBUG: looking for objects in 1757145600 test DEBUG: checking container 1757142000 test DEBUG: looking for objects in 1757142000 test DEBUG: checking container 1757138400 test DEBUG: looking for objects in 1757138400 test DEBUG: checking container 1757134800 test DEBUG: looking for objects in 1757134800 test DEBUG: checking container 1757131200 test DEBUG: looking for objects in 1757131200 test INFO: Reconciler Stats: {} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 test INFO: success: '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (3618.841870) from the queue (0000003618.84187_0000000000000002) test DEBUG: checking placement for '/AUTH_bob/c/o2' (3724.234560) in policy_index 1 test INFO: success: '/AUTH_bob/c/o2' (3724.234560) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o2' (3724.234560) from the queue (0000003724.23456_0000000000000002) test INFO: Reconciler Stats: {'success': 2, 'pop_queue': 2} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (1757769863.739680) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (1757769863.739680) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (1757769863.739680) in policy_index 1 should be in policy_index 0test.unit.container.test_reconciler.TestReconciler.test_object_delete test.unit.container.test_reconciler.TestReconciler.test_object_delete ... ok test.unit.container.test_reconciler.TestReconciler.test_object_enqueued_for_the_correct_dest_noop test.unit.container.test_reconciler.TestReconciler.test_object_enqueued_for_the_correct_dest_noop ... ok test.unit.container.test_backend.TestContainerBroker.test_set_storage_policy_index test.unit.container.test_backend.TestContainerBroker.test_set_storage_policy_index ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_ranges_with_sharding_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_ranges_with_sharding_overlaps ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_utf8 test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_utf8 ... ok test.unit.container.test_backend.TestContainerBroker.test_set_storage_policy_index_empty test.unit.container.test_backend.TestContainerBroker.test_set_storage_policy_index_empty ... ok test.unit.container.test_backend.TestContainerBroker.test_set_x_syncs test.unit.container.test_backend.TestContainerBroker.test_set_x_syncs ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_ranges_with_shrinking_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_ranges_with_shrinking_overlaps ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_account_acl_header_access test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_account_acl_header_access ... ok test.unit.container.test_backend.TestContainerBroker.test_sharding_initiated_and_required test.unit.container.test_backend.TestContainerBroker.test_sharding_initiated_and_required ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_report_info test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_report_info ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_usage test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_get_shard_usage ... ok test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_account_acls_through_delegation test.unit.proxy.test_mem_server.TestAccountControllerFakeGetResponse.test_account_acls_through_delegation ... ok test.unit.container.test_backend.TestContainerBroker.test_sharding_state_is_not_reclaimable test.unit.container.test_backend.TestContainerBroker.test_sharding_state_is_not_reclaimable ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_has_multiple_policies test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_has_multiple_policies ... ok test.unit.container.test_backend.TestContainerBroker.test_sharding_sysmeta test.unit.container.test_backend.TestContainerBroker.test_sharding_sysmeta ... ok test.unit.proxy.test_mem_server.TestController.test_account_info_200 test.unit.proxy.test_mem_server.TestController.test_account_info_200 ... ok test.unit.proxy.test_mem_server.TestController.test_account_info_404 test.unit.proxy.test_mem_server.TestController.test_account_info_404 ... ok test.unit.proxy.test_mem_server.TestController.test_account_info_container_count test.unit.proxy.test_mem_server.TestController.test_account_info_container_count ... ok test.unit.obj.test_server.TestObjectController.test_EC_PUT_GET_data_no_commit test.unit.obj.test_server.TestObjectController.test_EC_PUT_GET_data_no_commit ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 404 70 "GET http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx497867abedb9473cbc18f-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 404 70 "GET http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx497867abedb9473cbc18f-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx497867abedb9473cbc18f-0068c57087) proxy DEBUG: Ignoring 404 from primary (txn: tx497867abedb9473cbc18f-0068c57087) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdh1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 404 70 "GET http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx497867abedb9473cbc18f-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx497867abedb9473cbc18f-0068c57087) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx407d20a613fb4a63a3992-0068c57087" "proxy-server 1824509" 0.0012 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a/147f065b0da64694b69bfde87befe050" 204 - "HEAD http://localhost/v1/a/147f065b0da64694b69bfde87befe050" "tx10df77bc7564408eb0c27-0068c57087" "proxy-server 1824509" 0.0090 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 404 70 "GET http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx49523bbca7ea4e6eacff8-0068c57087" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 200 82 "GET http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx49523bbca7ea4e6eacff8-0068c57087" "proxy-server 1824509" 0.0089 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx49523bbca7ea4e6eacff8-0068c57087) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdi1/1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" 200 82 "GET http://localhost/v1/a/147f065b0da64694b69bfde87befe050/b6f89a0e04f34143a11995f31750974c" "tx49523bbca7ea4e6eacff8-0068c57087" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb267944e5ab94d24a4719-0068c57087" "proxy-server 1824509" 0.0012 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 201 - "PUT http://127.0.0.1:41753/sdb1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" "txb267944e5ab94d24a4719-0068c57087" "container-server 1824509" 0.0053 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 201 - "PUT http://127.0.0.1:36297/sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" "txb267944e5ab94d24a4719-0068c57087" "container-server 1824509" 0.0010 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "txb267944e5ab94d24a4719-0068c57087" "proxy-server 1824509" 0.0301 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "txb267944e5ab94d24a4719-0068c57087" "proxy-server 1824509" 0.0325 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1fd43ffe630b4d2fb9f60-0068c57087" "proxy-server 1824509" 0.0143 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 204 - "HEAD http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "txe75123a4e4164af6b2c6f-0068c57087" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdg1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txec572ab2be714310b7136-0068c57087" "proxy-server 1824509" 0.0341 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txec572ab2be714310b7136-0068c57087" "object-server 1824509" 0.0006 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txec572ab2be714310b7136-0068c57087" "object-server 1824509" 0.0004 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txec572ab2be714310b7136-0068c57087" "proxy-server 1824509" 0.0432 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txec572ab2be714310b7136-0068c57087" "proxy-server 1824509" 0.0452 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe12d38adc3be427ea3660-0068c57087" "proxy-server 1824509" 0.0060 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 204 - "HEAD http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "txa9f6f0e0c6b24cf6a2ff1-0068c57087" "proxy-server 1824509" 0.0120 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txc214073a9fb742f4b2d38-0068c57087" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdg1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txc214073a9fb742f4b2d38-0068c57087" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcbd03dc5aff24f4abbc2a-0068c57087" "proxy-server 1824509" 0.0012 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 204 - "HEAD http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "txaa2f74754eec45b9a4ea9-0068c57087" "proxy-server 1824509" 0.0110 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdg1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txdbaaa292a6a1424ea80aa-0068c57087" "proxy-server 1824509" 0.0387 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txdbaaa292a6a1424ea80aa-0068c57087" "object-server 1824509" 0.0005 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txdbaaa292a6a1424ea80aa-0068c57087" "object-server 1824509" 0.0004 "-" 1824509 3test.unit.proxy.test_mem_server.TestController.test_account_info_no_account test.unit.proxy.test_mem_server.TestController.test_account_info_no_account ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_has_other_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_has_other_shard_ranges ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_gap_in_shards_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_gap_in_shards_with_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_range_rows_with_limit test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_range_rows_with_limit ... ok test.unit.container.test_backend.TestContainerBroker.test_storage_policy_property test.unit.container.test_backend.TestContainerBroker.test_storage_policy_property ... ok test.unit.proxy.test_mem_server.TestController.test_account_info_no_cache test.unit.proxy.test_mem_server.TestController.test_account_info_no_cache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_initialize_container_broker_in_default test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_initialize_container_broker_in_default ... ok test.unit.container.test_backend.TestContainerBroker.test_sync_merging test.unit.container.test_backend.TestContainerBroker.test_sync_merging ... ok test.unit.obj.test_server.TestObjectController.test_GET test.unit.obj.test_server.TestObjectController.test_GET ... ok test.unit.proxy.test_mem_server.TestController.test_container_info_200 test.unit.proxy.test_mem_server.TestController.test_container_info_200 ... ok test.unit.container.test_sharder.TestSharder.test_audit_cleave_contexts test.unit.container.test_sharder.TestSharder.test_audit_cleave_contexts ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "tx5065b62c7fe74f8091a01-0068c57087" "proxy-server 1824529" 0.0457 "-" 1824529 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/23 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx5065b62c7fe74f8091a01-0068c57087 - 0.0969 - - 1757769863.304302931 1757769863.401172638 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx8730217629174c5ca9b98-0068c57087" "proxy-server 1824529" 0.0011 "-" 1824529 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:44785/sdb1/0/a1/c1" "tx8730217629174c5ca9b98-0068c57087" "container-server 1824529" 0.0010 "-" 1824529 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:52139/sda1/0/a1/c1" "tx8730217629174c5ca9b98-0068c57087" "container-server 1824529" 0.0010 "-" 1824529 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx8730217629174c5ca9b98-0068c57087" "proxy-server 1824529" 0.0487 "-" 1824529 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx8730217629174c5ca9b98-0068c57087" "proxy-server 1824529" 0.0291 "-" 1824529 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/23 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx8730217629174c5ca9b98-0068c57087 - 0.0887 - - 1757769863.402516842 1757769863.491246223 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx08a381e4af7e47519b349-0068c57087" "proxy-server 1824529" 0.0139 "-" 1824529 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://127.0.0.1:44785/sdb1/3/a/c1" "tx08a381e4af7e47519b349-0068c57087" "container-server 1824529" 0.0069 "-" 1824529 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://127.0.0.1:52139/sda1/3/a/c1" "tx08a381e4af7e47519b349-0068c57087" "container-server 1824529" 0.0016 "-" 1824529 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx08a381e4af7e47519b349-0068c57087" "proxy-server 1824529" 0.0264 "-" 1824529 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx08a381e4af7e47519b349-0068c57087" "proxy-server 1824529" 0.0432 "-" 1824529 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/23 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx08a381e4af7e47519b349-0068c57087 - 0.0955 - - 1757769863.492671728 1757769863.588154793 1 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc0b7e6acf9de4cbda0c52-0068c57087" "proxy-server 1824529" 0.0020 "-" 1824529 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://127.0.0.1:52139/sda1/0/a/c2" "txc0b7e6acf9de4cbda0c52-0068c57087" "container-server 1824529" 0.0093 "-" 1824529 2 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://127.0.0.1:44785/sdb1/0/a/c2" "txc0b7e6acf9de4cbda0c52-0068c57087" "container-server 1824529" 0.0016 "-" 1824529 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txc0b7e6acf9de4cbda0c52-0068c57087" "proxy-server 1824529" 0.0615 "-" 1824529 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txc0b7e6acf9de4cbda0c52-0068c57087" "proxy-server 1824529" 0.0431 "-" 1824529 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/23 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txc0b7e6acf9de4cbda0c52-0068c57087 - 0.1073 - - 1757769863.589563847 1757769863.696848154 2 - test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: txeb4450af62f142bebab37-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.1:1001/sdb (txn: txeb4450af62f142bebab37-0068c57088) test ERROR: Account HEAD returning 503 for [503, 503] (txn: txeb4450af62f142bebab37-0068c57088) test ERROR: ERROR 504 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: tx7583b58e500b43f59fd67-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: tx7583b58e500b43f59fd67-0068c57088) test ERROR: Account HEAD returning 503 for [504, 503] (txn: tx7583b58e500b43f59fd67-0068c57088) test ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx527223ab266149fab1818-0068c57088) test DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx527223ab266149fab1818-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: tx527223ab266149fab1818-0068c57088) test ERROR: Account HEAD returning 503 for [507, 503] (txn: tx527223ab266149fab1818-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.1:1001/sdb (txn: tx6cef60f4cdc3454ca16ec-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: tx6cef60f4cdc3454ca16ec-0068c57088) test DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx6cef60f4cdc3454ca16ec-0068c57088) test ERROR: Account HEAD returning 503 for [503, 503] (txn: tx6cef60f4cdc3454ca16ec-0068c57088) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestController.test_container_info_404 test.unit.proxy.test_mem_server.TestController.test_container_info_404 ... ok test.unit.proxy.test_mem_server.TestController.test_container_info_invalid_account test.unit.proxy.test_mem_server.TestController.test_container_info_invalid_account ... ok test.unit.container.test_sharder.TestSharder.test_audit_deleted_root_container test.unit.container.test_sharder.TestSharder.test_audit_deleted_root_container ... ok test.unit.proxy.test_mem_server.TestController.test_container_info_no_cache test.unit.proxy.test_mem_server.TestController.test_container_info_no_cache ... ok test.unit.proxy.test_mem_server.TestController.test_get_account_info_returns_values_as_strings test.unit.proxy.test_mem_server.TestController.test_get_account_info_returns_values_as_strings ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 201 - "PUT http://127.0.0.1:40941/sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx9edf124b24944956b1092-0068c57087" "container-server 1824514" 0.0011 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 201 - "PUT http://127.0.0.1:60751/sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx9edf124b24944956b1092-0068c57087" "container-server 1824514" 0.0010 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 201 - "PUT http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx9edf124b24944956b1092-0068c57087" "proxy-server 1824514" 0.0851 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 201 - "PUT http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx9edf124b24944956b1092-0068c57087" "proxy-server 1824514" 0.0497 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc246c05c127c4807a1c20-0068c57087" "proxy-server 1824514" 0.0020 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txc246c05c127c4807a1c20-0068c57087" "proxy-server 1824514" 0.0013 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txf4de663d2db7452d89fa5-0068c57087" "proxy-server 1824514" 0.0019 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx884c4b3582cb4e088aa01-0068c57087" "proxy-server 1824514" 0.0012 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 201 - "PUT http://foo:8080/sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txa63fac9e344e4b159d59f-0068c57087" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 201 - "PUT http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txa63fac9e344e4b159d59f-0068c57087" "proxy-server 1824514" 0.0318 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 201 - "PUT http://foo:8080/sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txa63fac9e344e4b159d59f-0068c57087" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 201 - "PUT http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txa63fac9e344e4b159d59f-0068c57087" "proxy-server 1824514" 0.0433 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx27a699e61cf14aea830e9-0068c57087" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx531d6645c7f4436188cc5-0068c57087" "proxy-server 1824514" 0.0109 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 201 - "POST http://foo:8080/sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx4757d2704c0f4952a3c64-0068c57087" "object-server 1824514" 0.0005 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "POST /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 202 76 "POST http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx4757d2704c0f4952a3c64-0068c57087" "proxy-server 1824514" 0.0133 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "PUT /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 201 - "POST http://foo:8080/sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx4757d2704c0f4952a3c64-0068c57087" "object-server 1824514" 0.0005 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "POST /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 202 76 "POST http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx4757d2704c0f4952a3c64-0068c57087" "proxy-server 1824514" 0.0239 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx1f197a44648445a5923e2-0068c57087" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx008f162a5eb74527bbe60-0068c57087" "proxy-server 1824514" 0.0110 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:23 +0000] "GET /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txa7dc1b2f525046d288e72-0068c57087" "proxy-server 1824514" 0.0089 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx5cdc84619b1c447584976-0068c57087" "proxy-server 1824514" 0.0134 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx68bc86e46b8645fa84c16-0068c57088" "proxy-server 1824514" 0.0177 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txd4a2e09eb43449679c657-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx82c14a7577544e9fb8d40-0068c57088" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx5ae7b65c5fbf49a5aff2c-0068c57088" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx24706551648e43559490c-0068c57088" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb70e055e57294a5a8c548-0068c57088" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx54fc602c5a0c4f77992d4-0068c57088" "proxy-server 1824514" 0.0011 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txb2bfaaf8710e4f7d9ebf2-0068c57088" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx738dbcf734af41f5945a0-0068c57088" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txed5214877ea0498c8a485-0068c57088" "proxy-server 1824514" 0.0015 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txb54d46de0cf5414189442-0068c57088" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4f492e2ef0e3449f931d9-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0085 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 412 43 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0131 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o-not-found" 404 70 "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 503 118 "-" "-" "-" 0.0021 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "HEAD /sda1/p/a/c/o" 200 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0094 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0150 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "GET /sda1/p/a/c/o" 200 629586 "-" "-" "-" 0.0007 "-" 1824531 1 test-object-controller WARNING: Quarantined object /tmp/tmp7p2mazgj/tmp_test_object_server_ObjectController/sda1/objects-1/p/a43/615cd4810e0d969889af154f7b02ba43/1757769863.00000#13#d.data: Invalid EC metadata at offset 0x0 test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0003 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0029 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:23 +0000] "GET /sda1/p/a/c/o" 200 629586 "-" "-" "-" 0.0007 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0188 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0003 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 629586 "-" "-" "-" 0.0005 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 400 25 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 3 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 5 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 2 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 416 97 "-" "-" "-" 0.0128 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 3 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0131 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0005 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0125 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0006 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0004 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0004 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0003 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0126 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0004 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0005 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0003 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0004 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0126 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0015 "-" 1824531 1test.unit.obj.test_server.TestObjectController.test_GET_HEAD_with_fragment_preferences test.unit.obj.test_server.TestObjectController.test_GET_HEAD_with_fragment_preferences ... ok test.unit.obj.test_server.TestObjectController.test_GET_but_expired test.unit.obj.test_server.TestObjectController.test_GET_but_expired ... ok test.unit.proxy.test_mem_server.TestController.test_get_container_info_returns_values_as_strings test.unit.proxy.test_mem_server.TestController.test_get_container_info_returns_values_as_strings ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_ranges ... ok test.unit.proxy.test_mem_server.TestController.test_make_requests test.unit.proxy.test_mem_server.TestController.test_make_requests ... ok test.unit.proxy.test_mem_server.TestController.test_transfer_headers test.unit.proxy.test_mem_server.TestController.test_transfer_headers ... ok test.unit.obj.test_server.TestObjectController.test_GET_cooperative_period_config test.unit.obj.test_server.TestObjectController.test_GET_cooperative_period_config ... ok test.unit.container.test_sharder.TestSharder.test_audit_old_style_shard_container test.unit.container.test_sharder.TestSharder.test_audit_old_style_shard_container ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move test.unit.container.test_reconciler.TestReconciler.test_object_move ... ok test.unit.obj.test_server.TestObjectController.test_GET_if_match test.unit.obj.test_server.TestObjectController.test_GET_if_match ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_dest_already_moved test.unit.container.test_reconciler.TestReconciler.test_object_move_dest_already_moved ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_dest_object_newer_than_queue_entry test.unit.container.test_reconciler.TestReconciler.test_object_move_dest_object_newer_than_queue_entry ... ok test.unit.obj.test_server.TestObjectController.test_GET_if_match_etag_is_at test.unit.obj.test_server.TestObjectController.test_GET_if_match_etag_is_at ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_dest_object_older_than_queue_entry test.unit.container.test_reconciler.TestReconciler.test_object_move_dest_object_older_than_queue_entry ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txdbaaa292a6a1424ea80aa-0068c57087" "proxy-server 1824509" 0.0446 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txdbaaa292a6a1424ea80aa-0068c57087" "proxy-server 1824509" 0.0438 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx000c4c64442845d5acbd6-0068c57088" "proxy-server 1824509" 0.0013 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 204 - "HEAD http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "tx76407be0b57248d7ae35c-0068c57088" "proxy-server 1824509" 0.0098 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx0f47df9f39394e45acc6e-0068c57088" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdg1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx0f47df9f39394e45acc6e-0068c57088" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7b158baaf28547128e587-0068c57088" "proxy-server 1824509" 0.0093 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 204 - "HEAD http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "tx7497716ee58c4a7cbee0d-0068c57088" "proxy-server 1824509" 0.0265 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/sdg1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx2e258ce293d44a70809c3-0068c57088" "object-server 1824509" 0.0004 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx2e258ce293d44a70809c3-0068c57088" "object-server 1824509" 0.0004 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdg1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx2e258ce293d44a70809c3-0068c57088" "proxy-server 1824509" 0.0568 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx2e258ce293d44a70809c3-0068c57088" "proxy-server 1824509" 0.0568 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 201 - "PUT http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx2e258ce293d44a70809c3-0068c57088" "proxy-server 1824509" 0.0634 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx72fc344921e342fa99232-0068c57088" "proxy-server 1824509" 0.0118 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 204 - "HEAD http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "txe8bf27fc0042458bb81e3-0068c57088" "proxy-server 1824509" 0.0165 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx6199acdaaceb4790bd80a-0068c57088" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx6199acdaaceb4790bd80a-0068c57088" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6d4825c9a806453687a24-0068c57088" "proxy-server 1824509" 0.0174 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 204 - "HEAD http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "txdea09d966b1a41e8a97b2-0068c57088" "proxy-server 1824509" 0.0071 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 404 70 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx3d972a7693dd4b55abf68-0068c57088" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 404 70 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx3d972a7693dd4b55abf68-0068c57088" "proxy-server 1824509" 0.0004 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx3d972a7693dd4b55abf68-0068c57088) proxy DEBUG: Ignoring 404 from primary (txn: tx3d972a7693dd4b55abf68-0068c57088) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdg1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 404 70 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "tx3d972a7693dd4b55abf68-0068c57088" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx3d972a7693dd4b55abf68-0068c57088) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb4183405d9784e159eb3f-0068c57088" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a/945e7ab8f45b4edf87c8e2e89b5b50de" 204 - "HEAD http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de" "tx3ccbd3218d3d4f7b8a90f-0068c57088" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txb810fbf1ef6c4f4a9b5e8-0068c57088" "proxy-server 1824509" 0.0152 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txb810fbf1ef6c4f4a9b5e8-0068c57088" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdh1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txb810fbf1ef6c4f4a9b5e8-0068c57088" "proxy-server 1824509" 0.0153 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" 200 84 "GET http://localhost/v1/a/945e7ab8f45b4edf87c8e2e89b5b50de/985c1be762a647adbbdc63b277688246" "txb810fbf1ef6c4f4a9b5e8-0068c57088" "proxy-server 1824509" 0.0007 "-" 1824509 3test.unit.obj.test_server.TestObjectController.test_GET_if_modified_since test.unit.obj.test_server.TestObjectController.test_GET_if_modified_since ... ok Traceback (most recent call last): test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: tx4724557beed843dd8d9af-0068c57088) test ERROR: ERROR 504 b'' Trying to HEAD /some_account/some_container From Container Server 10.0.0.1:1001/sdb (txn: tx6a0ae9f618d94fb28c6a9-0068c57088) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/some_account: Network unreachable (txn: tx57e0663f5f6142678a725-0068c57088) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/some_account: Network unreachable (txn: tx57e0663f5f6142678a725-0068c57088) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/some_account: Network unreachable (txn: tx57e0663f5f6142678a725-0068c57088) test ERROR: Account HEAD returning 503 for [] (txn: tx57e0663f5f6142678a725-0068c57088) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: tx2d81b280ff4245a5a76e2-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.1:1001/sdb (txn: tx2d81b280ff4245a5a76e2-0068c57088) test ERROR: Account HEAD returning 503 for [503, 503] (txn: tx2d81b280ff4245a5a76e2-0068c57088) test ERROR: ERROR 504 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: tx10d2f247ee0f4706b16c3-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: tx10d2f247ee0f4706b16c3-0068c57088) test ERROR: Account HEAD returning 503 for [504, 503] (txn: tx10d2f247ee0f4706b16c3-0068c57088) test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: tx98bbfe0e26c345378b745-0068c57088) test DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx98bbfe0e26c345378b745-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.1:1001/sdb (txn: tx98bbfe0e26c345378b745-0068c57088) test ERROR: Account HEAD returning 503 for [507, 503] (txn: tx98bbfe0e26c345378b745-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.1:1001/sdb (txn: tx7b115f2b58464d2b95373-0068c57088) test DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx7b115f2b58464d2b95373-0068c57088) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: tx7b115f2b58464d2b95373-0068c57088) test ERROR: Account HEAD returning 503 for [503, 503] (txn: tx7b115f2b58464d2b95373-0068c57088) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Base server 10.0.0.0:1000/sda re: Trying to POST /: Timeout (Nones) (txn: tx25f646c788944a8a87f34-0068c57088) test ERROR: ERROR with Base server 10.0.0.1:1001/sdb re: Trying to POST /: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx25f646c788944a8a87f34-0068c57088) test ERROR: ERROR with Base server 10.0.0.2:1002/sdc re: Trying to POST /: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx25f646c788944a8a87f34-0068c57088) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmpemj0j68i/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpemj0j68i/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmpemj0j68i/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpemj0j68i/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a" 201 - "-" "test" "-" 0.0113 "-" 1824529 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a" 201 - "-" "test" "-" 0.0030 "-" 1824529 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0109 "-" 1824529 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0149 "-" 1824529 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6606114c43a846d6a145a-0068c57088" "proxy-server 1824529" 0.0011 "-" 1824529 - File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 471, in fire_timers timer() ~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ cb(*args, **kw) ~~^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1115, in get_response status, headers, app_iter = self.call_application(application) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1099, in call_application app_iter = application(self.environ, start_response) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_reconciler.py", line 87, in __call__ return self.storage_policy[policy_index].__call__( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ env, start_response) ^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/helpers.py", line 386, in __call__ resp = resp_class( req=req, headers=headers, body=body, conditional_response=req.method in ('GET', 'HEAD'), conditional_etag=conditional_etag) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_reconciler.py", line 1929, in blow_up raise Exception('kaboom!') Exception: kaboom! test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0007 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0006 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0006 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0128 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0006 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0005 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0005 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0087 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0003 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0003 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0005 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 82 "-" "-" "-" 0.0004 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0100 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 7 "-" "-" "-" 0.0091 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 7 "-" "-" "-" 0.0008 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 7 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 6 "-" "-" "-" 0.0088 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0086 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o2" 412 - "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 412 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 412 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 412 - "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0093 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0087 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 412 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 412 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0087 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0094 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0086 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o2" 201 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o2" 304 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o2" 404 70 "-" "-" "-" 0.0002 "-" 1824531 -test.unit.obj.test_server.TestObjectController.test_GET_if_none_match test.unit.obj.test_server.TestObjectController.test_GET_if_none_match ... ok test.unit.obj.test_server.TestObjectController.test_GET_if_unmodified_since test.unit.obj.test_server.TestObjectController.test_GET_if_unmodified_since ... ok test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_private_config_false test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_private_config_false ... ok test DEBUG: fetching '/AUTH_bob/c/o1' (1757769863.739680) from storage policy 1 test DEBUG: delete_attempt: '/AUTH_bob/c/o1' (1757769863.739680) in policy_index 1 will be deleted from policy_index 0 (1757769863.73968_0000000000000003) test INFO: delete_success: '/AUTH_bob/c/o1' (1757769863.739680) deleted from policy_index 0 (1757769863.73968_0000000000000003) test DEBUG: cleanup_attempt: '/AUTH_bob/c/o1' (1757769863.739680) from policy_index 1 (1757769863.73968_0000000000000001) will be deleted test DEBUG: cleanup_success: '/AUTH_bob/c/o1' (1757769863.739680) was successfully removed from policy_index 1 test INFO: success: '/AUTH_bob/c/o1' (1757769863.739680) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (1757769863.739680) from the queue (1757769863.73968_0000000000000002) test INFO: Reconciler Stats: {'misplaced_object': 1, 'delete_attempt': 1, 'delete_success': 1, 'cleanup_attempt': 1, 'cleanup_success': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 test DEBUG: noop_object: '/AUTH_bob/c/o1' (3618.841870) container policy_index 1 matches queue policy index 1 test INFO: success: '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (3618.841870) from the queue (0000003618.84187_0000000000000002) test INFO: Reconciler Stats: {'noop_object': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (3618.841870) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (3618.841870) from storage policy 1 test DEBUG: copy_attempt: '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 will be moved to policy_index 0 (0000003618.84187_0000000000000003) test DEBUG: copy_success: '/AUTH_bob/c/o1' (3618.841870) moved from policy_index 1 to policy_index 0 (0000003618.84187_0000000000000003) test DEBUG: cleanup_attempt: '/AUTH_bob/c/o1' (3618.841870) from policy_index 1 (0000003618.84187_0000000000000001) will be deleted test DEBUG: cleanup_success: '/AUTH_bob/c/o1' (3618.841870) was successfully removed from policy_index 1 test INFO: success: '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (3618.841870) from the queue (0000003618.84187_0000000000000002) test INFO: Reconciler Stats: {'misplaced_object': 1, 'copy_attempt': 1, 'copy_success': 1, 'cleanup_attempt': 1, 'cleanup_success': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3679.201900) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (3679.201900) in destination policy_index 0 test DEBUG: found_object: '/AUTH_bob/c/o1' (3679.201900) in policy_index 0 is newer than queue (3679.201900) test DEBUG: cleanup_attempt: '/AUTH_bob/c/o1' (3679.201900) from policy_index 1 (0000003679.20190_0000000000000001) will be deleted test DEBUG: cleanup_success: '/AUTH_bob/c/o1' (3679.201900) was successfully removed from policy_index 1 test INFO: success: '/AUTH_bob/c/o1' (3679.201900) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (3679.201900) from the queue (0000003679.20190_0000000000000002) test INFO: Reconciler Stats: {'found_object': 1, 'cleanup_attempt': 1, 'cleanup_success': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3679.201900) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (3679.201900) in destination policy_index 0 test DEBUG: found_object: '/AUTH_bob/c/o1' (3680.201900) in policy_index 0 is newer than queue (3679.201900) test DEBUG: cleanup_attempt: '/AUTH_bob/c/o1' (3679.201900) from policy_index 1 (0000003679.20190_0000000000000001) will be deleted test DEBUG: cleanup_success: '/AUTH_bob/c/o1' (3679.201900) was successfully removed from policy_index 1 test INFO: success: '/AUTH_bob/c/o1' (3679.201900) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (3679.201900) from the queue (0000003679.20190_0000000000000002) test INFO: Reconciler Stats: {'found_object': 1, 'cleanup_attempt': 1, 'cleanup_success': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 36000 test DEBUG: looking for objects in 36000 test DEBUG: checking placement for '/AUTH_bob/c/o1' (36123.383930) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (36123.383930) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (36123.383930) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (36123.383930) from storage policy 1 test DEBUG: copy_attempt: '/AUTH_bob/c/o1' (36123.383930) in policy_index 1 will be moved to policy_index 0 (0000036123.38393_0000000000000003) test DEBUG: copy_success: '/AUTH_bob/c/o1' (36123.383930) moved from policy_index 1 to policy_index 0 (0000036123.38393_0000000000000003) test DEBUG: cleanup_attempt: '/AUTH_bob/c/o1' (36123.383930) from policy_index 1 (0000036123.38393_0000000000000001) will be deleted test DEBUG: cleanup_success: '/AUTH_bob/c/o1' (36123.383930) was successfully removed from policy_index 1 test INFO: success: '/AUTH_bob/c/o1' (36123.383930) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/36000/1:/AUTH_bob/c/o1' (36123.383930) from the queue (0000036123.38393_0000000000000002) test INFO: Reconciler Stats: {'misplaced_object': 1, 'copy_attempt': 1, 'copy_success': 1, 'cleanup_attempt': 1, 'cleanup_success': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3600.123460) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (3600.123460) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (3600.123460) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (3600.123460) from storage policy 1 test DEBUG: copy_attempt: '/AUTH_bob/c/o1' (3600.123460) in policy_index 1 will be moved to policy_index 0 (0000003600.12346_0000000000000003) test DEBUG: copy_success: '/AUTH_bob/c/o1' (3600.123460) moved from policy_index 1 to policy_index 0 (0000003600.12346_0000000000000003) test DEBUG: cleanup_attempt: '/AUTH_bob/c/o1' (3600.123460) from policy_index 1 (0000003600.12346_0000000000000001) will be deleted test DEBUG: cleanup_failed: '/AUTH_bob/c/o1' (3600.123460) was not cleaned up in storage_policy 1 (Unexpected response: 503 Service Unavailable)test.unit.container.test_reconciler.TestReconciler.test_object_move_fails_cleanup test.unit.container.test_reconciler.TestReconciler.test_object_move_fails_cleanup ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_fails_preflight test.unit.container.test_reconciler.TestReconciler.test_object_move_fails_preflight ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_no_such_object_no_tombstone_ancient test.unit.container.test_reconciler.TestReconciler.test_object_move_no_such_object_no_tombstone_ancient ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_no_such_object_no_tombstone_recent test.unit.container.test_reconciler.TestReconciler.test_object_move_no_such_object_no_tombstone_recent ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_ranges_includes test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_ranges_includes ... ok test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_private_config_true test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_private_config_true ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_put_blows_up_crazy_town test.unit.container.test_reconciler.TestReconciler.test_object_move_put_blows_up_crazy_town ... ok test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_slo_manifest_config_false test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_slo_manifest_config_false ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_put_fails test.unit.container.test_reconciler.TestReconciler.test_object_move_put_fails ... ok test ERROR: Failed to unlink '/tmp/tmpebfqsyxo/containers/part/suffix/hash/container.db': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2235, in set_sharded_state os.unlink(retiring_file) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: 1 test DEBUG: Unlinked retiring db '/tmp/tmpebfqsyxo/containers/part/suffix/hash/container_1757769864.00000.db' test WARNING: Still have multiple db files after unlinking '/tmp/tmpebfqsyxo/containers/part/suffix/hash/container_1757769864.00000.db': ['/tmp/tmpebfqsyxo/containers/part/suffix/hash/container.db', '/tmp/tmpebfqsyxo/containers/part/suffix/hash/container_1757769865.00000.db'] test WARNING: Refusing to delete db file for 'a/c': no fresher db file found in ['/tmp/tmpebfqsyxo/containers/part/suffix/hash/container_1757769865.00000.db']. test ERROR: Failed to set the ROWID of the fresh database for a/c: test ERROR: Failed to sync the container_stat table/view with the fresh database for a/c: sharder-test WARNING: Reclaimable db stuck waiting for shrinking, path: a/c, db: /tmp/tmpirg90f38/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for shard: missing own shard range (skipping), path: bad_account/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test WARNING: Audit warnings for shard: account not in shards namespace '.shards_', path: bad_account/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test WARNING: Audit failed for shard: missing own shard range (skipping), path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Updated own shard range from ShardRange<'j' to 'k' as of 1757769865.00000, (0, 0) as of 1757769865.00000, active as of 1757769865.00000> to ShardRange<'k' to 't' as of 1757769866.00000, (0, 0) as of 1757769866.00000, active as of 1757769866.00000>, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test WARNING: Failed to get shard ranges from a/c: bad, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test WARNING: Audit warnings for shard: unable to get shard ranges from root, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769870.00000, (0, 0) as of 1757769870.00000, shrinking as of 1757769867.00000> to ShardRange<'k' to 't' as of 1757769870.00000, (0, 0) as of 1757769870.00000, sharding as of 1757769871.00000>, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Marked shard container as deleted, path: .shards_a/shard_c, db: /tmp/tmpp1m1irn7/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769865.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/1a4/fdc0ec5a8f71d3f6af984bc5096ff1a4/fdc0ec5a8f71d3f6af984bc5096ff1a4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769867.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/cab/edee8d197f5c57c39d3769ac79663cab/edee8d197f5c57c39d3769ac79663cab.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769866.00000, (0, 0) as of 1757769866.00000, found as of 1757769866.00000> to ShardRange<'k' to 't' as of 1757769867.00000, (0, 0) as of 1757769867.00000, created as of 1757769867.00000>, path: .shards_a/shard_c_1757769867.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/cab/edee8d197f5c57c39d3769ac79663cab/edee8d197f5c57c39d3769ac79663cab.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769869.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/5b6/42dbffbcf66f1b5d2d08cb7bfde755b6/42dbffbcf66f1b5d2d08cb7bfde755b6.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769868.00000, (0, 0) as of 1757769868.00000, found as of 1757769868.00000> to ShardRange<'k' to 't' as of 1757769869.00000, (0, 0) as of 1757769869.00000, cleaved as of 1757769869.00000>, path: .shards_a/shard_c_1757769869.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/5b6/42dbffbcf66f1b5d2d08cb7bfde755b6/42dbffbcf66f1b5d2d08cb7bfde755b6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769871.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/4f7/ea21579308786a53b2c41621562e44f7/ea21579308786a53b2c41621562e44f7.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769870.00000, (0, 0) as of 1757769870.00000, found as of 1757769870.00000> to ShardRange<'k' to 't' as of 1757769871.00000, (0, 0) as of 1757769871.00000, active as of 1757769871.00000>, path: .shards_a/shard_c_1757769871.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/4f7/ea21579308786a53b2c41621562e44f7/ea21579308786a53b2c41621562e44f7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769873.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/fae/a52fed4b400d2b79ef45db3dd7b96fae/a52fed4b400d2b79ef45db3dd7b96fae.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769872.00000, (0, 0) as of 1757769872.00000, found as of 1757769872.00000> to ShardRange<'k' to 't' as of 1757769873.00000, (0, 0) as of 1757769873.00000, shrinking as of 1757769873.00000>, path: .shards_a/shard_c_1757769873.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/fae/a52fed4b400d2b79ef45db3dd7b96fae/a52fed4b400d2b79ef45db3dd7b96fae.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769873.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/fae/a52fed4b400d2b79ef45db3dd7b96fae/a52fed4b400d2b79ef45db3dd7b96fae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769875.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/6af/4b1b9a3c6b1127eae2d996eddfee16af/4b1b9a3c6b1127eae2d996eddfee16af.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769874.00000, (0, 0) as of 1757769874.00000, found as of 1757769874.00000> to ShardRange<'k' to 't' as of 1757769875.00000, (0, 0) as of 1757769875.00000, sharding as of 1757769875.00000>, path: .shards_a/shard_c_1757769875.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/6af/4b1b9a3c6b1127eae2d996eddfee16af/4b1b9a3c6b1127eae2d996eddfee16af.dbtest.unit.obj.test_server.TestObjectController.test_GET_keep_cache_slo_manifest_config_true test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_slo_manifest_config_true ... ok test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_slo_manifest_no_config test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_slo_manifest_no_config ... ok test INFO: retry: '/AUTH_bob/c/o1' (3600.123460) in policy_index 1 must be retried test INFO: Reconciler Stats: {'misplaced_object': 1, 'copy_attempt': 1, 'copy_success': 1, 'cleanup_attempt': 1, 'cleanup_failed': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3600.123460) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (3600.123460) in destination policy_index 0 test DEBUG: unavailable_destination: '/AUTH_bob/c/o1' (3600.123460) unable to determine the destination timestamp, if any test INFO: retry: '/AUTH_bob/c/o1' (3600.123460) in policy_index 1 must be retried test INFO: Reconciler Stats: {'unavailable_destination': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 1757102400 test DEBUG: looking for objects in 1757102400 test DEBUG: checking placement for '/AUTH_jeb/c/o1' (1757104584.481090) in policy_index 1 test DEBUG: checking for '/AUTH_jeb/c/o1' (1757104584.481090) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_jeb/c/o1' (1757104584.481090) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_jeb/c/o1' (1757104584.481090) from storage policy 1 test CRITICAL: lost_source: '/AUTH_jeb/c/o1' (1757104584.48109) was not available in policy_index 1 and has expired test INFO: success: '/AUTH_jeb/c/o1' (1757104584.481090) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/1757102400/1:/AUTH_jeb/c/o1' (1757104584.481090) from the queue (1757104584.48109_0000000000000002) test INFO: Reconciler Stats: {'misplaced_object': 1, 'lost_source': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: checking placement for '/AUTH_jeb/c/o1' (1757769864.494460) in policy_index 1 test DEBUG: checking for '/AUTH_jeb/c/o1' (1757769864.494460) in destination policy_index 0 test DEBUG: looking for containers in .misplaced_objects test DEBUG: misplaced_object: '/AUTH_jeb/c/o1' (1757769864.494460) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_jeb/c/o1' (1757769864.494460) from storage policy 1 test WARNING: unavailable_source: '/AUTH_jeb/c/o1' (1757769864.49446) in policy_index 1 responded 404 (0000000000.00000) test INFO: retry: '/AUTH_jeb/c/o1' (1757769864.494460) in policy_index 1 must be retried test INFO: Reconciler Stats: {'misplaced_object': 1, 'unavailable_source': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 36000 test DEBUG: looking for objects in 36000 test DEBUG: checking placement for '/AUTH_bob/c/o1' (36123.383920) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (36123.383920) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (36123.383920) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (36123.383920) from storage policy 1 test DEBUG: copy_attempt: '/AUTH_bob/c/o1' (36123.383920) in policy_index 1 will be moved to policy_index 0 (0000036123.38392_0000000000000003) test ERROR: unhandled_error: unable to upload '/AUTH_bob/c/o1' (36123.383920) from policy_index 1 to policy_index 0 Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 630, in ensure_object_in_right_location self.swift.upload_object( ~~~~~~~~~~~~~~~~~~~~~~~~^ FileLikeIter(source_obj_iter), account, container, obj, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers) ^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/internal_client.py", line 836, in upload_object self.handle_request('PUT', path, headers, acceptable_statuses, fobj, ~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ params=params) ^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/internal_client.py", line 256, in handle_request resp = self.make_request(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/internal_client.py", line 253, in make_request raise err File "/build/reproducible-path/swift-2.36.0/swift/common/internal_client.py", line 224, in make_request resp = spawn(req.get_response, self.app).wait() File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 232, in wait return self._exit_event.wait() ~~~~~~~~~~~~~~~~~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/event.py", line 124, in wait result = hub.switch() File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 310, in switch return self.greenlet.switch() ~~~~~~~~~~~~~~~~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1115, in get_response status, headers, app_iter = self.call_application(application) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1099, in call_application app_iter = application(self.environ, start_response) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_reconciler.py", line 87, in __call__ return self.storage_policy[policy_index].__call__( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ env, start_response) ^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/helpers.py", line 386, in __call__ resp = resp_class( req=req, headers=headers, body=body, conditional_response=req.method in ('GET', 'HEAD'), conditional_etag=conditional_etag) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_reconciler.py", line 1929, in blow_up raise Exception('kaboom!') Exception: kaboom! test INFO: retry: '/AUTH_bob/c/o1' (36123.383920) in policy_index 1 must be retried test INFO: Reconciler Stats: {'misplaced_object': 1, 'copy_attempt': 1, 'unhandled_error': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 36000 test DEBUG: looking for objects in 36000 test DEBUG: checking placement for '/AUTH_bob/c/o1' (36123.383920) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (36123.383920) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (36123.383920) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (36123.383920) from storage policy 1 test DEBUG: copy_attempt: '/AUTH_bob/c/o1' (36123.383920) in policy_index 1 will be moved to policy_index 0 (0000036123.38392_0000000000000003) test WARNING: copy_failed: upload '/AUTH_bob/c/o1' (36123.383920) from policy_index 1 to policy_index 0 returned Unexpected response: 503 Service Unavailable test INFO: retry: '/AUTH_bob/c/o1' (36123.383920) in policy_index 1 must be retried test INFO: Reconciler Stats: {'misplaced_object': 1, 'copy_attempt': 1, 'copy_failed': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (1757163599.000000) in policy_index 1test.unit.container.test_reconciler.TestReconciler.test_object_move_src_object_is_forever_gone test.unit.container.test_reconciler.TestReconciler.test_object_move_src_object_is_forever_gone ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_src_object_newer_than_queue_entry test.unit.container.test_reconciler.TestReconciler.test_object_move_src_object_newer_than_queue_entry ... ok test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_slo_manifest_not_slo test.unit.obj.test_server.TestObjectController.test_GET_keep_cache_slo_manifest_not_slo ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_src_object_older_than_queue_entry test.unit.container.test_reconciler.TestReconciler.test_object_move_src_object_older_than_queue_entry ... ok test.unit.obj.test_server.TestObjectController.test_GET_metafile_unavailable test.unit.obj.test_server.TestObjectController.test_GET_metafile_unavailable ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_the_other_direction test.unit.container.test_reconciler.TestReconciler.test_object_move_the_other_direction ... ok test.unit.obj.test_server.TestObjectController.test_GET_no_etag_validation test.unit.obj.test_server.TestObjectController.test_GET_no_etag_validation ... ok test.unit.container.test_reconciler.TestReconciler.test_object_move_with_unicode_and_spaces test.unit.container.test_reconciler.TestReconciler.test_object_move_with_unicode_and_spaces ... ok test.unit.obj.test_server.TestObjectController.test_GET_quarantine test.unit.obj.test_server.TestObjectController.test_GET_quarantine ... ok test.unit.container.test_reconciler.TestReconciler.test_processes_config test.unit.container.test_reconciler.TestReconciler.test_processes_config ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_ranges_with_sharding_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_ranges_with_sharding_overlaps ... ok test.unit.container.test_reconciler.TestReconciler.test_queue_name_with_policy_index_delimiter_in_name test.unit.container.test_reconciler.TestReconciler.test_queue_name_with_policy_index_delimiter_in_name ... ok test.unit.obj.test_server.TestObjectController.test_GET_quarantine_range test.unit.obj.test_server.TestObjectController.test_GET_quarantine_range ... ok Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 471, in fire_timers timer() ~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ cb(*args, **kw) ~~^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1115, in get_response status, headers, app_iter = self.call_application(application) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1099, in call_application app_iter = application(self.environ, start_response) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_reconciler.py", line 87, in __call__ return self.storage_policy[policy_index].__call__( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ env, start_response) ^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/helpers.py", line 386, in __call__ resp = resp_class( req=req, headers=headers, body=body, conditional_response=req.method in ('GET', 'HEAD'), conditional_etag=conditional_etag) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_reconciler.py", line 2135, in blow_up raise Exception('kaboom!') Exception: kaboom! /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test DEBUG: checking for '/AUTH_bob/c/o1' (1757163599.000000) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (1757163599.000000) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (1757163599.000000) from storage policy 1 test CRITICAL: lost_source: '/AUTH_bob/c/o1' (1757163599.00000) was not available in policy_index 1 and has expired test INFO: success: '/AUTH_bob/c/o1' (1757163599.000000) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (1757163599.000000) from the queue (1757163599.00000_0000000000000002) test INFO: Reconciler Stats: {'misplaced_object': 1, 'lost_source': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3600.123460) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (3600.123460) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (3600.123460) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (3600.123460) from storage policy 1 test DEBUG: copy_attempt: '/AUTH_bob/c/o1' (3600.234570) in policy_index 1 will be moved to policy_index 0 (0000003600.23457_0000000000000003) test DEBUG: copy_success: '/AUTH_bob/c/o1' (3600.234570) moved from policy_index 1 to policy_index 0 (0000003600.23457_0000000000000003) test DEBUG: cleanup_attempt: '/AUTH_bob/c/o1' (3600.123460) from policy_index 1 (0000003600.12346_0000000000000001) will be deleted test DEBUG: cleanup_success: '/AUTH_bob/c/o1' (3600.123460) was successfully removed from policy_index 1 test INFO: success: '/AUTH_bob/c/o1' (3600.123460) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c/o1' (3600.123460) from the queue (0000003600.12346_0000000000000002) test INFO: Reconciler Stats: {'misplaced_object': 1, 'copy_attempt': 1, 'copy_success': 1, 'cleanup_attempt': 1, 'cleanup_success': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: checking placement for '/AUTH_bob/c/o1' (1757769864.614040) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (1757769864.614040) in destination policy_index 0 test DEBUG: looking for containers in .misplaced_objects test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (1757769864.614040) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (1757769864.614040) from storage policy 1 test WARNING: unavailable_source: '/AUTH_bob/c/o1' (1757769864.61404) in policy_index 1 responded 200 (1757769863.61404) test INFO: retry: '/AUTH_bob/c/o1' (1757769864.614040) in policy_index 1 must be retried test INFO: Reconciler Stats: {'misplaced_object': 1, 'unavailable_source': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3618.841870) in policy_index 0 test DEBUG: checking for '/AUTH_bob/c/o1' (3618.841870) in destination policy_index 1 test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (3618.841870) in policy_index 0 should be in policy_index 1 test DEBUG: fetching '/AUTH_bob/c/o1' (3618.841870) from storage policy 0 test DEBUG: copy_attempt: '/AUTH_bob/c/o1' (3618.841870) in policy_index 0 will be moved to policy_index 1 (0000003618.84187_0000000000000003) test DEBUG: copy_success: '/AUTH_bob/c/o1' (3618.841870) moved from policy_index 0 to policy_index 1 (0000003618.84187_0000000000000003) test DEBUG: cleanup_attempt: '/AUTH_bob/c/o1' (3618.841870) from policy_index 0 (0000003618.84187_0000000000000001) will be deleted test DEBUG: cleanup_success: '/AUTH_bob/c/o1' (3618.841870) was successfully removed from policy_index 0 test INFO: success: '/AUTH_bob/c/o1' (3618.841870) in policy_index 0 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/0:/AUTH_bob/c/o1' (3618.841870) from the queue (0000003618.84187_0000000000000002) test INFO: Reconciler Stats: {'misplaced_object': 1, 'copy_attempt': 1, 'copy_success': 1, 'cleanup_attempt': 1, 'cleanup_success': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c ت/o1 ت' (3618.841870) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c ت/o1 ت' (3618.841870) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c ت/o1 ت' (3618.841870) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c ت/o1 ت' (3618.841870) from storage policy 1 test DEBUG: copy_attempt: '/AUTH_bob/c ت/o1 ت' (3618.841870) in policy_index 1 will be moved to policy_index 0 (0000003618.84187_0000000000000003) test DEBUG: copy_success: '/AUTH_bob/c ت/o1 ت' (3618.841870) moved from policy_index 1 to policy_index 0 (0000003618.84187_0000000000000003) test DEBUG: cleanup_attempt: '/AUTH_bob/c ت/o1 ت' (3618.841870) from policy_index 1 (0000003618.84187_0000000000000001) will be deleted test DEBUG: cleanup_success: '/AUTH_bob/c ت/o1 ت' (3618.841870) was successfully removed from policy_index 1 test INFO: success: '/AUTH_bob/c ت/o1 ت' (3618.841870) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c ت/o1 ت' (3618.841870) from the queue (0000003618.84187_0000000000000002) test INFO: Reconciler Stats: {'misplaced_object': 1, 'copy_attempt': 1, 'copy_success': 1, 'cleanup_attempt': 1, 'cleanup_success': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) in destination policy_index 0 test DEBUG: misplaced_object: '/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) from storage policy 1 test DEBUG: copy_attempt: '/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) in policy_index 1 will be moved to policy_index 0 (0000003618.84187_0000000000000003) test DEBUG: copy_success: '/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) moved from policy_index 1 to policy_index 0 (0000003618.84187_0000000000000003) test DEBUG: cleanup_attempt: '/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) from policy_index 1 (0000003618.84187_0000000000000001) will be deleted test DEBUG: cleanup_success: '/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) was successfully removed from policy_index 1 test INFO: success: '/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) in policy_index 1 was handled successfully test DEBUG: pop_queue: remove '/.misplaced_objects/3600/1:/AUTH_bob/c:sneaky/o1:sneaky' (3618.841870) from the queue (0000003618.84187_0000000000000002) test INFO: Reconciler Stats: {'misplaced_object': 1, 'copy_attempt': 1, 'copy_success': 1, 'cleanup_attempt': 1, 'cleanup_success': 1, 'success': 1, 'pop_queue': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: checking placement for '/AUTH_bob/c/o1' (1757769864.697330) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (1757769864.697330) in destination policy_index 0test.unit.container.test_reconciler.TestReconciler.test_src_object_unavailable_server_error test.unit.container.test_reconciler.TestReconciler.test_src_object_unavailable_server_error ... ok test.unit.container.test_reconciler.TestReconciler.test_src_object_unavailable_with_slightly_newer_tombstone test.unit.container.test_reconciler.TestReconciler.test_src_object_unavailable_with_slightly_newer_tombstone ... ok test.unit.container.test_reconciler.TestReconciler.test_unable_to_direct_get_oldest_storage_policy test.unit.container.test_reconciler.TestReconciler.test_unable_to_direct_get_oldest_storage_policy ... ok test.unit.container.test_reconciler.TestReconciler.test_unhandled_exception_in_reconcile test.unit.container.test_reconciler.TestReconciler.test_unhandled_exception_in_reconcile ... ok test.unit.container.test_server.TestContainerController.test_DELETE test.unit.container.test_server.TestContainerController.test_DELETE ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_is_deleted ... ok test.unit.proxy.test_server.TestAccountController.test_DELETE test.unit.proxy.test_server.TestAccountController.test_DELETE ... ok test.unit.proxy.test_server.TestAccountController.test_DELETE_with_query_string test.unit.proxy.test_server.TestAccountController.test_DELETE_with_query_string ... ok test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0086 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 412 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0084 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0087 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0093 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0093 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0089 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0092 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 503 118 "-" "-" "-" 0.0017 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 - "-" "-" "-" 0.0084 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0093 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller WARNING: Quarantined object /tmp/tmpn77gydr7/tmp_test_object_server_ObjectController/sda1/objects/p/a43/615cd4810e0d969889af154f7b02ba43/1757769864.65033.data: metadata content-length 5 does not match actual object size 6 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller WARNING: Quarantined object /tmp/tmpviz23uqe/tmp_test_object_server_ObjectController/sda1/objects/p/a43/615cd4810e0d969889af154f7b02ba43/1757769864.67321.data: ETag 44531cbb8377fa80aa1530d63ed8369a and file's md5 0b4c12d7e0a73840c1c4f148fda3b037 do not match test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 5 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 5 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 206 6 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller WARNING: Quarantined object /tmp/tmp9m76j1fq/tmp_test_object_server_ObjectController/sda1/objects/p/a43/615cd4810e0d969889af154f7b02ba43/1757769864.69513.data: ETag 44531cbb8377fa80aa1530d63ed8369a and file's md5 0b4c12d7e0a73840c1c4f148fda3b037 do not match test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 -test.unit.obj.test_server.TestObjectController.test_GET_quarantine_zbyte test.unit.obj.test_server.TestObjectController.test_GET_quarantine_zbyte ... ok test.unit.obj.test_server.TestObjectController.test_GET_range_not_satisfiable test.unit.obj.test_server.TestObjectController.test_GET_range_not_satisfiable ... ok test.unit.obj.test_server.TestObjectController.test_GET_range_zero_byte_object test.unit.obj.test_server.TestObjectController.test_GET_range_zero_byte_object ... ok test.unit.obj.test_server.TestObjectController.test_HEAD test.unit.obj.test_server.TestObjectController.test_HEAD ... ok test.unit.obj.test_server.TestObjectController.test_HEAD_but_expired test.unit.obj.test_server.TestObjectController.test_HEAD_but_expired ... ok test.unit.container.test_server.TestContainerController.test_DELETE_PUT_recreate test.unit.container.test_server.TestContainerController.test_DELETE_PUT_recreate ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx7e6ab8ee5c4c48c4847d0-0068c57088" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx596c39be7a11460583904-0068c57088" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx277390eba3cc4ce898f7e-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx61449236a1f644d8ad0f4-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 412 - "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx3255418e6bb742b1903b5-0068c57088" "proxy-server 1824514" 0.0008 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 412 - "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx3255418e6bb742b1903b5-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc5b33866b967431480687-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txfd26744fdd22422da2cb4-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 304 - "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx9620f3662dc94c44b5d26-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx336eef984e6e4677ba244-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx5e50f794b08d4adcb8087-0068c57088" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 304 - "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txb612014df70e4d5c84b9c-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx87127b8626a7472cb7f9e-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx0603f865ea304d02aee11-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx0db9842a58c540dda4769-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txdc01d45962c04e01af1d3-0068c57088" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txbbe76e97a4244f40b640c-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txbc4811ef5d0f4720a7be2-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx19ac8c25b0f24f938579d-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx21e4b8ae085c4be69852d-0068c57088" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txf382decfc02a4b1dbdc2f-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2fb1bb881f5c4ccca34b6-0068c57088" "proxy-server 1824514" 0.0169 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx134d64f915cc4dbd8155c-0068c57088" "proxy-server 1824514" 0.0015 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 412 - "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txb92236b101de45e984b42-0068c57088" "proxy-server 1824514" 0.0008 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 412 - "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txb92236b101de45e984b42-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx28d19277dd8540af9f18f-0068c57088" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx16beb81c67594f199b4ce-0068c57088" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 304 - "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txa8c78ef04650423bb0382-0068c57088" "proxy-server 1824514" 0.0008 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx46dd91af2ede46bfa98f7-0068c57088" "proxy-server 1824514" 0.0014 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx2968f982208b4c179a530-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 304 - "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx19e7191717004507a20db-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3334f233333742ceab535-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx10bf2d05691f46bbb4b22-0068c57088" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txa444d0d3e45d4eac9af2d-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3fea8e796cce4df48ee6a-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 -test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_ranges_with_shrinking_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_ranges_with_shrinking_overlaps ... ok test.unit.container.test_server.TestContainerController.test_DELETE_PUT_recreate_replication_race test.unit.container.test_server.TestContainerController.test_DELETE_PUT_recreate_replication_race ... ok test.unit.obj.test_server.TestObjectController.test_HEAD_if_match test.unit.obj.test_server.TestObjectController.test_HEAD_if_match ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5c07aaa3453940c7be1e7-0068c57088" "proxy-server 1824509" 0.0013 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 201 - "PUT http://127.0.0.1:41753/sdb1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" "tx5c07aaa3453940c7be1e7-0068c57088" "container-server 1824509" 0.0010 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 201 - "PUT http://127.0.0.1:36297/sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" "tx5c07aaa3453940c7be1e7-0068c57088" "container-server 1824509" 0.0011 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "tx5c07aaa3453940c7be1e7-0068c57088" "proxy-server 1824509" 0.0572 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "tx5c07aaa3453940c7be1e7-0068c57088" "proxy-server 1824509" 0.0863 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx56565e7ad4384242a005e-0068c57088" "proxy-server 1824509" 0.0102 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 204 - "HEAD http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "txbdb65c6f67cd4c4798351-0068c57088" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdh1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx80cac8d2af694329a3d60-0068c57088" "proxy-server 1824509" 0.0222 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx80cac8d2af694329a3d60-0068c57088" "object-server 1824509" 0.0005 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/sdg1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx80cac8d2af694329a3d60-0068c57088" "object-server 1824509" 0.0005 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdg1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx80cac8d2af694329a3d60-0068c57088" "proxy-server 1824509" 0.0329 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx80cac8d2af694329a3d60-0068c57088" "proxy-server 1824509" 0.0327 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa9c41b0da07a4108acb84-0068c57088" "proxy-server 1824509" 0.0062 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 204 - "HEAD http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "txcfc2f3be22974d74bb3f9-0068c57088" "proxy-server 1824509" 0.0076 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdh1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txbf222455ccf4411382d0b-0068c57088" "proxy-server 1824509" 0.0049 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txbf222455ccf4411382d0b-0068c57088" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txafd46e367ed3489b9f6aa-0068c57088" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 204 - "HEAD http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "txfb61411285cb44d58fba9-0068c57088" "proxy-server 1824509" 0.0012 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdg1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txe56d8d2b604145ddbb519-0068c57088" "proxy-server 1824509" 0.0225 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txe56d8d2b604145ddbb519-0068c57088" "object-server 1824509" 0.0004 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/sdh1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txe56d8d2b604145ddbb519-0068c57088" "object-server 1824509" 0.0004 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txe56d8d2b604145ddbb519-0068c57088" "proxy-server 1824509" 0.0306 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdh1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txe56d8d2b604145ddbb519-0068c57088" "proxy-server 1824509" 0.0348 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx63cfe3eff96c48038d149-0068c57088" "proxy-server 1824509" 0.0054 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 204 - "HEAD http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "txe85176b49edb433e8807d-0068c57088" "proxy-server 1824509" 0.0055 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txabd009f781484bb19e168-0068c57088" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdg1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txabd009f781484bb19e168-0068c57088" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1b56352cb2c947bbab219-0068c57088" "proxy-server 1824509" 0.0014 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 204 - "HEAD http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "txa535cd08f0be4ad4908e7-0068c57088" "proxy-server 1824509" 0.0065 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdg1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txa4c762ff0eda4a36b6171-0068c57088" "proxy-server 1824509" 0.0224 "-" 1824509 3test.unit.obj.test_server.TestObjectController.test_HEAD_if_modified_since test.unit.obj.test_server.TestObjectController.test_HEAD_if_modified_since ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_is_old_enough_to_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_is_old_enough_to_reclaim ... ok test.unit.container.test_server.TestContainerController.test_DELETE_account_update test.unit.container.test_server.TestContainerController.test_DELETE_account_update ... ok test.unit.obj.test_server.TestObjectController.test_HEAD_if_none_match test.unit.obj.test_server.TestObjectController.test_HEAD_if_none_match ... ok test.unit.obj.test_server.TestObjectController.test_HEAD_if_unmodified_since test.unit.obj.test_server.TestObjectController.test_HEAD_if_unmodified_since ... ok sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769875.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/6af/4b1b9a3c6b1127eae2d996eddfee16af/4b1b9a3c6b1127eae2d996eddfee16af.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769877.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/6a9/171a1e531a8685c90fa129e7749d26a9/171a1e531a8685c90fa129e7749d26a9.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769876.00000, (0, 0) as of 1757769876.00000, found as of 1757769876.00000> to ShardRange<'k' to 't' as of 1757769877.00000, (0, 0) as of 1757769877.00000, sharded as of 1757769877.00000>, path: .shards_a/shard_c_1757769877.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/6a9/171a1e531a8685c90fa129e7749d26a9/171a1e531a8685c90fa129e7749d26a9.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769877.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/6a9/171a1e531a8685c90fa129e7749d26a9/171a1e531a8685c90fa129e7749d26a9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769879.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/2a4/4c18a0a351a33501e8b0e101892352a4/4c18a0a351a33501e8b0e101892352a4.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769878.00000, (0, 0) as of 1757769878.00000, found as of 1757769878.00000> to ShardRange<'k' to 't' as of 1757769879.00000, (0, 0) as of 1757769879.00000, shrunk as of 1757769879.00000>, path: .shards_a/shard_c_1757769879.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/2a4/4c18a0a351a33501e8b0e101892352a4/4c18a0a351a33501e8b0e101892352a4.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769879.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/2a4/4c18a0a351a33501e8b0e101892352a4/4c18a0a351a33501e8b0e101892352a4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769881.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769880.00000, (0, 0) as of 1757769880.00000, created as of 1757769880.00000> to ShardRange<'k' to 't' as of 1757769881.00000, (0, 0) as of 1757769881.00000, found as of 1757769881.00000>, path: .shards_a/shard_c_1757769881.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769883.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/21f/2d232698690ed0b3c3a15ec552b8821f/2d232698690ed0b3c3a15ec552b8821f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769885.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/a85/aa4389525f92add7afdf896686e6ea85/aa4389525f92add7afdf896686e6ea85.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769884.00000, (0, 0) as of 1757769884.00000, created as of 1757769884.00000> to ShardRange<'k' to 't' as of 1757769885.00000, (0, 0) as of 1757769885.00000, cleaved as of 1757769885.00000>, path: .shards_a/shard_c_1757769885.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/a85/aa4389525f92add7afdf896686e6ea85/aa4389525f92add7afdf896686e6ea85.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769887.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/966/eb35fe62f3504ede7cf738f7a74ae966/eb35fe62f3504ede7cf738f7a74ae966.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769886.00000, (0, 0) as of 1757769886.00000, created as of 1757769886.00000> to ShardRange<'k' to 't' as of 1757769887.00000, (0, 0) as of 1757769887.00000, active as of 1757769887.00000>, path: .shards_a/shard_c_1757769887.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/966/eb35fe62f3504ede7cf738f7a74ae966/eb35fe62f3504ede7cf738f7a74ae966.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769889.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/873/9b2962a7350720474ea832c741eff873/9b2962a7350720474ea832c741eff873.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769888.00000, (0, 0) as of 1757769888.00000, created as of 1757769888.00000> to ShardRange<'k' to 't' as of 1757769889.00000, (0, 0) as of 1757769889.00000, shrinking as of 1757769889.00000>, path: .shards_a/shard_c_1757769889.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/873/9b2962a7350720474ea832c741eff873/9b2962a7350720474ea832c741eff873.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769889.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/873/9b2962a7350720474ea832c741eff873/9b2962a7350720474ea832c741eff873.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769891.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/cf2/3deb9d98214ccdbed5ecb44ad1883cf2/3deb9d98214ccdbed5ecb44ad1883cf2.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769890.00000, (0, 0) as of 1757769890.00000, created as of 1757769890.00000> to ShardRange<'k' to 't' as of 1757769891.00000, (0, 0) as of 1757769891.00000, sharding as of 1757769891.00000>, path: .shards_a/shard_c_1757769891.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/cf2/3deb9d98214ccdbed5ecb44ad1883cf2/3deb9d98214ccdbed5ecb44ad1883cf2.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769891.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/cf2/3deb9d98214ccdbed5ecb44ad1883cf2/3deb9d98214ccdbed5ecb44ad1883cf2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769893.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d4c/2423b061c759b966fa726b8c67ea5d4c/2423b061c759b966fa726b8c67ea5d4c.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769892.00000, (0, 0) as of 1757769892.00000, created as of 1757769892.00000> to ShardRange<'k' to 't' as of 1757769893.00000, (0, 0) as of 1757769893.00000, sharded as of 1757769893.00000>, path: .shards_a/shard_c_1757769893.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d4c/2423b061c759b966fa726b8c67ea5d4c/2423b061c759b966fa726b8c67ea5d4c.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769893.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d4c/2423b061c759b966fa726b8c67ea5d4c/2423b061c759b966fa726b8c67ea5d4c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769895.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/dd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769894.00000, (0, 0) as of 1757769894.00000, created as of 1757769894.00000> to ShardRange<'k' to 't' as of 1757769895.00000, (0, 0) as of 1757769895.00000, shrunk as of 1757769895.00000>, path: .shards_a/shard_c_1757769895.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/dd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769895.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/dd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769897.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/183/8ee9f1814cd40c01464241bee0f60183/8ee9f1814cd40c01464241bee0f60183.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769896.00000, (0, 0) as of 1757769896.00000, cleaved as of 1757769896.00000> to ShardRange<'k' to 't' as of 1757769897.00000, (0, 0) as of 1757769897.00000, found as of 1757769897.00000>, path: .shards_a/shard_c_1757769897.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/183/8ee9f1814cd40c01464241bee0f60183/8ee9f1814cd40c01464241bee0f60183.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769899.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d2f/e2488a16152542fad2e9de030084fd2f/e2488a16152542fad2e9de030084fd2f.db test DEBUG: looking for containers in .misplaced_objects test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (1757769864.697330) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (1757769864.697330) from storage policy 1 test WARNING: unavailable_source: '/AUTH_bob/c/o1' (1757769864.69733) in policy_index 1 responded 503 (0000000000.00000) test INFO: retry: '/AUTH_bob/c/o1' (1757769864.697330) in policy_index 1 must be retried test INFO: Reconciler Stats: {'misplaced_object': 1, 'unavailable_source': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: checking placement for '/AUTH_bob/c/o1' (1757769864.706050) in policy_index 1 test DEBUG: checking for '/AUTH_bob/c/o1' (1757769864.706050) in destination policy_index 0 test DEBUG: looking for containers in .misplaced_objects test DEBUG: misplaced_object: '/AUTH_bob/c/o1' (1757769864.706050) in policy_index 1 should be in policy_index 0 test DEBUG: fetching '/AUTH_bob/c/o1' (1757769864.706050) from storage policy 1 test WARNING: unavailable_source: '/AUTH_bob/c/o1' (1757769864.70605) in policy_index 1 responded 404 (1757769864.70605_0000000000000003) test INFO: retry: '/AUTH_bob/c/o1' (1757769864.706050) in policy_index 1 must be retried test INFO: Reconciler Stats: {'misplaced_object': 1, 'unavailable_source': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test DEBUG: checking container 3600 test DEBUG: looking for objects in 3600 test DEBUG: checking placement for '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 test DEBUG: unavailable_container: '/AUTH_bob/c/o1' (3618.841870) unable to determine the destination policy_index test INFO: retry: '/AUTH_bob/c/o1' (3618.841870) in policy_index 1 must be retried test INFO: Reconciler Stats: {'unavailable_container': 1, 'retry': 1} test DEBUG: pulling items from the queue test DEBUG: checking container 1757768400 test DEBUG: looking for objects in 1757768400 test DEBUG: looking for containers in .misplaced_objects test ERROR: Unhandled Exception trying to reconcile: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 844, in run_once self.reconcile() ~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 823, in reconcile for container in self._iter_containers(): ~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/container/reconciler.py", line 743, in _iter_containers one_page = list(itertools.islice( container_gen, constraints.CONTAINER_LISTING_LIMIT)) File "/build/reproducible-path/swift-2.36.0/swift/common/internal_client.py", line 323, in _iter_items resp = self.make_request( 'GET', '%s?format=json&marker=%s&end_marker=%s&prefix=%s' % ...<2 lines>... bytes_to_wsgi(quote(prefix))), {}, acceptable_statuses) File "/build/reproducible-path/swift-2.36.0/swift/common/internal_client.py", line 253, in make_request raise err File "/build/reproducible-path/swift-2.36.0/swift/common/internal_client.py", line 224, in make_request resp = spawn(req.get_response, self.app).wait() File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 232, in wait return self._exit_event.wait() ~~~~~~~~~~~~~~~~~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/event.py", line 124, in wait result = hub.switch() File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 310, in switch return self.greenlet.switch() ~~~~~~~~~~~~~~~~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1115, in get_response status, headers, app_iter = self.call_application(application) ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/swob.py", line 1099, in call_application app_iter = application(self.environ, start_response) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_reconciler.py", line 87, in __call__ return self.storage_policy[policy_index].__call__( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ env, start_response) ^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/middleware/helpers.py", line 386, in __call__ resp = resp_class( req=req, headers=headers, body=body, conditional_response=req.method in ('GET', 'HEAD'), conditional_etag=conditional_etag) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_reconciler.py", line 2135, in blow_up raise Exception('kaboom!') Exception: kaboom! test INFO: Reconciler Stats: {} test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0041 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0145 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0061 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0029 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0105 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0048 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0023 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0002 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0050 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0123 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0060 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 404 - "-" "-" "-" 0.0035 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0018 "-" 1824512 0 test ERROR: ERROR Account update failed with 127.0.0.1:46101/sda1 (will retry later): Response 503 OK test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0033 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf'test.unit.container.test_server.TestContainerController.test_DELETE_container_not_found test.unit.container.test_server.TestContainerController.test_DELETE_container_not_found ... ok test.unit.container.test_server.TestContainerController.test_DELETE_invalid_partition test.unit.container.test_server.TestContainerController.test_DELETE_invalid_partition ... ok test.unit.container.test_server.TestContainerController.test_DELETE_not_found test.unit.container.test_server.TestContainerController.test_DELETE_not_found ... ok test.unit.container.test_server.TestContainerController.test_DELETE_obj_not_found test.unit.container.test_server.TestContainerController.test_DELETE_obj_not_found ... ok test.unit.obj.test_server.TestObjectController.test_HEAD_metafile_unavailable test.unit.obj.test_server.TestObjectController.test_HEAD_metafile_unavailable ... ok test.unit.proxy.test_server.TestAccountController.test_GET test.unit.proxy.test_server.TestAccountController.test_GET ... ok test.unit.obj.test_server.TestObjectController.test_HEAD_quarantine_zbyte test.unit.obj.test_server.TestObjectController.test_HEAD_quarantine_zbyte ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_usage test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_get_shard_usage ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_is_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_is_reclaimable ... ok test-object-controller WARNING: Quarantined object /tmp/tmpww1ml1kd/tmp_test_object_server_ObjectController/sda1/objects/p/a43/615cd4810e0d969889af154f7b02ba43/1757769864.71989.data: metadata content-length 6 does not match actual object size 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/zero-byte" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/zero-byte" 206 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/zero-byte" 416 97 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/zero-byte" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c/zero-byte" 200 - "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c" 400 25 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0085 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0101 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0086 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o2" 412 - "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 412 - "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 412 - "-" "-" "-" 0.0086 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0091 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o2" 201 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o2" 304 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o2" 404 - "-" "-" "-" 0.0083 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 304 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 412 - "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0093 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 503 - "-" "-" "-" 0.0018 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 - "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0083 "-" 1824531 - test-object-controller WARNING: Quarantined object /tmp/tmprzb4862o/tmp_test_object_server_ObjectController/sda1/objects/p/a43/615cd4810e0d969889af154f7b02ba43/1757769864.93814.data: metadata content-length 6 does not match actual object size 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test DEBUG: Labeled statsd mode: disabled (test)test.unit.obj.test_server.TestObjectController.test_OPTIONS test.unit.obj.test_server.TestObjectController.test_OPTIONS ... ok test.unit.obj.test_server.TestObjectController.test_POST_bad_timestamp test.unit.obj.test_server.TestObjectController.test_POST_bad_timestamp ... ok test.unit.container.test_server.TestContainerController.test_DELETE_object test.unit.container.test_server.TestContainerController.test_DELETE_object ... ok test.unit.obj.test_server.TestObjectController.test_POST_but_expired test.unit.obj.test_server.TestObjectController.test_POST_but_expired ... ok test.unit.proxy.test_server.TestAccountController.test_GET_autocreate test.unit.proxy.test_server.TestAccountController.test_GET_autocreate ... ok test.unit.obj.test_server.TestObjectController.test_POST_calls_delete_at test.unit.obj.test_server.TestObjectController.test_POST_calls_delete_at ... ok test.unit.obj.test_server.TestObjectController.test_POST_can_skip_updating_expirer_queue test.unit.obj.test_server.TestObjectController.test_POST_can_skip_updating_expirer_queue ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_last_modified_time test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_last_modified_time ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_has_multiple_policies test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_has_multiple_policies ... ok test.unit.obj.test_server.TestObjectController.test_POST_conflicts_with_later_POST test.unit.obj.test_server.TestObjectController.test_POST_conflicts_with_later_POST ... ok test.unit.obj.test_server.TestObjectController.test_POST_container_connection test.unit.obj.test_server.TestObjectController.test_POST_container_connection ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_legacy_pending_files test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_legacy_pending_files ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/sdh1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txa4c762ff0eda4a36b6171-0068c57088" "object-server 1824509" 0.0004 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txa4c762ff0eda4a36b6171-0068c57088" "object-server 1824509" 0.0004 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdh1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txa4c762ff0eda4a36b6171-0068c57088" "proxy-server 1824509" 0.0394 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 201 - "PUT http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "txa4c762ff0eda4a36b6171-0068c57088" "proxy-server 1824509" 0.0407 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6d47db03e261400b8f436-0068c57088" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 204 - "HEAD http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "tx89dff323089c4bea8c1c7-0068c57088" "proxy-server 1824509" 0.0070 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdh1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx86d70943942540e2b9432-0068c57088" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx86d70943942540e2b9432-0068c57088" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx71973abad6d94411998a4-0068c57088" "proxy-server 1824509" 0.0014 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 204 - "HEAD http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "tx4d424c5f4c884b178e57f-0068c57088" "proxy-server 1824509" 0.0074 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 404 70 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx327bd0a83bda41d7ac94f-0068c57088" "proxy-server 1824509" 0.0004 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdg1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 404 70 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx327bd0a83bda41d7ac94f-0068c57088" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx327bd0a83bda41d7ac94f-0068c57088) proxy DEBUG: Ignoring 404 from primary (txn: tx327bd0a83bda41d7ac94f-0068c57088) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdh1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 404 70 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx327bd0a83bda41d7ac94f-0068c57088" "proxy-server 1824509" 0.0004 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx327bd0a83bda41d7ac94f-0068c57088) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0841c9ea822f495cb288a-0068c57088" "proxy-server 1824509" 0.0013 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a/0da59b8b499b4a2f919fdae1b21a2fa0" 204 - "HEAD http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0" "tx63753f1acbb2482c81289-0068c57088" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdg1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx515bbfbfd45c4c608831d-0068c57088" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx515bbfbfd45c4c608831d-0068c57088" "proxy-server 1824509" 0.0071 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdg1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx515bbfbfd45c4c608831d-0068c57088" "proxy-server 1824509" 0.0064 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "GET /sdi1/2/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" 200 84 "GET http://localhost/v1/a/0da59b8b499b4a2f919fdae1b21a2fa0/7034b52193174d1caefee1ae325dd53f" "tx515bbfbfd45c4c608831d-0068c57088" "proxy-server 1824509" 0.0008 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa79c57f52dad496b93e94-0068c57088" "proxy-server 1824509" 0.0012 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/fdca0b7f072a42b59012b7619bb94dc7" 201 - "PUT http://127.0.0.1:36297/sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7" "txa79c57f52dad496b93e94-0068c57088" "container-server 1824509" 0.0011 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/fdca0b7f072a42b59012b7619bb94dc7" 201 - "PUT http://127.0.0.1:41753/sdb1/2/a/fdca0b7f072a42b59012b7619bb94dc7" "txa79c57f52dad496b93e94-0068c57088" "container-server 1824509" 0.0010 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "txa79c57f52dad496b93e94-0068c57088" "proxy-server 1824509" 0.0288 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "txa79c57f52dad496b93e94-0068c57088" "proxy-server 1824509" 0.0253 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx429e959064d840c9932fc-0068c57088" "proxy-server 1824509" 0.0060 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 204 - "HEAD http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "txe085bb6f425c4e1aa5365-0068c57088" "proxy-server 1824509" 0.0011 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txef30849e48274e8185b30-0068c57089" "proxy-server 1824509" 0.0357 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/2/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/sdg1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txef30849e48274e8185b30-0068c57089" "object-server 1824509" 0.0005 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/sdi1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txef30849e48274e8185b30-0068c57089" "object-server 1824509" 0.0005 "-" 1824509 3test.unit.obj.test_server.TestObjectController.test_POST_container_updates_precedence test.unit.obj.test_server.TestObjectController.test_POST_container_updates_precedence ... ok test.unit.proxy.test_server.TestAccountController.test_HEAD test.unit.proxy.test_server.TestAccountController.test_HEAD ... ok test.unit.obj.test_server.TestObjectController.test_POST_container_updates_with_EC_policy test.unit.obj.test_server.TestObjectController.test_POST_container_updates_with_EC_policy ... ok sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769898.00000, (0, 0) as of 1757769898.00000, cleaved as of 1757769898.00000> to ShardRange<'k' to 't' as of 1757769899.00000, (0, 0) as of 1757769899.00000, created as of 1757769899.00000>, path: .shards_a/shard_c_1757769899.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d2f/e2488a16152542fad2e9de030084fd2f/e2488a16152542fad2e9de030084fd2f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769901.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/959/33940f310031c7b4fe655f10a32da959/33940f310031c7b4fe655f10a32da959.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769903.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f9d/bb78a69059b5bd01c1a46978bdd38f9d/bb78a69059b5bd01c1a46978bdd38f9d.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769902.00000, (0, 0) as of 1757769902.00000, cleaved as of 1757769902.00000> to ShardRange<'k' to 't' as of 1757769903.00000, (0, 0) as of 1757769903.00000, active as of 1757769903.00000>, path: .shards_a/shard_c_1757769903.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f9d/bb78a69059b5bd01c1a46978bdd38f9d/bb78a69059b5bd01c1a46978bdd38f9d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769905.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f02/a8b1afe462b78d02629d333b1839ff02/a8b1afe462b78d02629d333b1839ff02.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769904.00000, (0, 0) as of 1757769904.00000, cleaved as of 1757769904.00000> to ShardRange<'k' to 't' as of 1757769905.00000, (0, 0) as of 1757769905.00000, shrinking as of 1757769905.00000>, path: .shards_a/shard_c_1757769905.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f02/a8b1afe462b78d02629d333b1839ff02/a8b1afe462b78d02629d333b1839ff02.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769905.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f02/a8b1afe462b78d02629d333b1839ff02/a8b1afe462b78d02629d333b1839ff02.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769907.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ad9/5e170677330de9080c7e57b95bdb4ad9/5e170677330de9080c7e57b95bdb4ad9.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769906.00000, (0, 0) as of 1757769906.00000, cleaved as of 1757769906.00000> to ShardRange<'k' to 't' as of 1757769907.00000, (0, 0) as of 1757769907.00000, sharding as of 1757769907.00000>, path: .shards_a/shard_c_1757769907.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ad9/5e170677330de9080c7e57b95bdb4ad9/5e170677330de9080c7e57b95bdb4ad9.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769907.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ad9/5e170677330de9080c7e57b95bdb4ad9/5e170677330de9080c7e57b95bdb4ad9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769909.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/a73/35e717d22237d428402bf822b7ad1a73/35e717d22237d428402bf822b7ad1a73.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769908.00000, (0, 0) as of 1757769908.00000, cleaved as of 1757769908.00000> to ShardRange<'k' to 't' as of 1757769909.00000, (0, 0) as of 1757769909.00000, sharded as of 1757769909.00000>, path: .shards_a/shard_c_1757769909.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/a73/35e717d22237d428402bf822b7ad1a73/35e717d22237d428402bf822b7ad1a73.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769909.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/a73/35e717d22237d428402bf822b7ad1a73/35e717d22237d428402bf822b7ad1a73.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769911.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/c53/c8ea902322a73cedcd940ca647e41c53/c8ea902322a73cedcd940ca647e41c53.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769910.00000, (0, 0) as of 1757769910.00000, cleaved as of 1757769910.00000> to ShardRange<'k' to 't' as of 1757769911.00000, (0, 0) as of 1757769911.00000, shrunk as of 1757769911.00000>, path: .shards_a/shard_c_1757769911.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/c53/c8ea902322a73cedcd940ca647e41c53/c8ea902322a73cedcd940ca647e41c53.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769911.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/c53/c8ea902322a73cedcd940ca647e41c53/c8ea902322a73cedcd940ca647e41c53.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769913.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/bac/25cfc95ac015d6283eda321f6f42fbac/25cfc95ac015d6283eda321f6f42fbac.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769912.00000, (0, 0) as of 1757769912.00000, active as of 1757769912.00000> to ShardRange<'k' to 't' as of 1757769913.00000, (0, 0) as of 1757769913.00000, found as of 1757769913.00000>, path: .shards_a/shard_c_1757769913.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/bac/25cfc95ac015d6283eda321f6f42fbac/25cfc95ac015d6283eda321f6f42fbac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769915.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/838/d1720079edbfbfa62e0382f6ffcca838/d1720079edbfbfa62e0382f6ffcca838.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769914.00000, (0, 0) as of 1757769914.00000, active as of 1757769914.00000> to ShardRange<'k' to 't' as of 1757769915.00000, (0, 0) as of 1757769915.00000, created as of 1757769915.00000>, path: .shards_a/shard_c_1757769915.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/838/d1720079edbfbfa62e0382f6ffcca838/d1720079edbfbfa62e0382f6ffcca838.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769917.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/24f/846cf025ce1eb9fe72f29c394eb2724f/846cf025ce1eb9fe72f29c394eb2724f.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769916.00000, (0, 0) as of 1757769916.00000, active as of 1757769916.00000> to ShardRange<'k' to 't' as of 1757769917.00000, (0, 0) as of 1757769917.00000, cleaved as of 1757769917.00000>, path: .shards_a/shard_c_1757769917.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/24f/846cf025ce1eb9fe72f29c394eb2724f/846cf025ce1eb9fe72f29c394eb2724f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769919.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/9c2/1c328d811a117db798490c14fc4169c2/1c328d811a117db798490c14fc4169c2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769921.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769920.00000, (0, 0) as of 1757769920.00000, active as of 1757769920.00000> to ShardRange<'k' to 't' as of 1757769921.00000, (0, 0) as of 1757769921.00000, shrinking as of 1757769921.00000>, path: .shards_a/shard_c_1757769921.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769921.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769923.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f08/8901cd65118f345943a36ccc8969bf08/8901cd65118f345943a36ccc8969bf08.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769922.00000, (0, 0) as of 1757769922.00000, active as of 1757769922.00000> to ShardRange<'k' to 't' as of 1757769923.00000, (0, 0) as of 1757769923.00000, sharding as of 1757769923.00000>, path: .shards_a/shard_c_1757769923.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f08/8901cd65118f345943a36ccc8969bf08/8901cd65118f345943a36ccc8969bf08.dbtest.unit.proxy.test_server.TestAccountController.test_HEAD_autocreate test.unit.proxy.test_server.TestAccountController.test_HEAD_autocreate ... ok test.unit.obj.test_server.TestObjectController.test_POST_container_updates_with_replication_policy test.unit.obj.test_server.TestObjectController.test_POST_container_updates_with_replication_policy ... ok test.unit.proxy.test_server.TestAccountController.test_OPTIONS test.unit.proxy.test_server.TestAccountController.test_OPTIONS ... ok test.unit.obj.test_server.TestObjectController.test_POST_delete_at_in_past test.unit.obj.test_server.TestObjectController.test_POST_delete_at_in_past ... ok test.unit.obj.test_server.TestObjectController.test_POST_delete_at_in_past_with_skewed_clock test.unit.obj.test_server.TestObjectController.test_POST_delete_at_in_past_with_skewed_clock ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_has_other_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_has_other_shard_ranges ... ok test.unit.proxy.test_server.TestAccountController.test_POST_autocreate test.unit.proxy.test_server.TestAccountController.test_POST_autocreate ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx220b725960164e4392045-0068c57088" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txec0be2d1fda846b1bf91f-0068c57088" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9ffdc9453ea04332918f5-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txe8a1f880b3c54f7391aef-0068c57088" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx2acf7a41a383421385d37-0068c57088" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx711d357d68f1493999040-0068c57088" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txcdeb4d29da8942b98fabf-0068c57088" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 412 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx498a276eb9494dc092202-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 412 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx498a276eb9494dc092202-0068c57088" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6e23d8d83bcc419d98fbd-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txd9f3dc20543e420dad456-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 304 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txff2e78e6e87246a8bfac0-0068c57088" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx93a60dc859314ac88adc1-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txc3256160334d47eca0397-0068c57088" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 304 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx449470d9292043e69cf85-0068c57088" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7a5255bfb2ee483487c94-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx606d71c1ff364e9bb07ba-0068c57088" "proxy-server 1824514" 0.0014 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx524902d33732497f91100-0068c57088" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4551131f0e4b4ed485f6a-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txcd103c46d3dd4af98d5c6-0068c57088" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx7fd0debb929f4f32884c1-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx1a444aa75c434f1994285-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txa97d3074de09452ab76f0-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx81895ff865fd4ce480071-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txacc5e636843e426aa9970-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "txcdb1982b3f9143df86b7f-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 412 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx1c93e1c31f9a4145afaee-0068c57089" "proxy-server 1824514" 0.0006 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 412 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx1c93e1c31f9a4145afaee-0068c57089" "proxy-server 1824514" 0.0006 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc2e5e15248754623be8da-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx88fb6998ba3242ef9bf5d-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 304 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx9983bb7c50dc404b8a5d9-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx6342c5259ee24c7eaa72f-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx2a4796c63bef4c14808ec-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdc1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 304 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "tx84256faa8b00427c9715c-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4587f35b9e794d6488009-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 -test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_without_crypto_read_with_crypto test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_without_crypto_read_with_crypto ... ok test.unit.proxy.test_server.TestAccountController.test_POST_autocreate_with_sysmeta test.unit.proxy.test_server.TestAccountController.test_POST_autocreate_with_sysmeta ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_initialize_container_broker_in_default test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_initialize_container_broker_in_default ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter ... ok test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "POST /sda1/p/a/c/o" 400 26 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0019 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0092 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "POST /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0013 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0012 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0101 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0086 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0091 "-" 1824531 - test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('1.2.3.4:0', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller ERROR: ERROR container update failed with 1.2.3.4:0/sda1 (saving for async update later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 323, in async_update response = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 1103, in getresponse raise Exception('test') Exception: test test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('1.2.3.4:0', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0122 "-" 1824531 - test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from 1.2.3.4:0/sda1 test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('1.2.3.4:0', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0100 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0094 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0095 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0009 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0091 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0089 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0093 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0005 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0005 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0093 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0011 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0005 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0012 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0004 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0006 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0006 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 400 19 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [01/Jan/1970:00:18:20 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" - "-" 1824531 - test-object-controller INFO: - - - [01/Jan/1970:00:18:21 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0101 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 400 19 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0004 "-" 1824531 -test.unit.obj.test_server.TestObjectController.test_POST_invalid_headers test.unit.obj.test_server.TestObjectController.test_POST_invalid_headers ... ok test.unit.obj.test_server.TestObjectController.test_POST_invalid_path test.unit.obj.test_server.TestObjectController.test_POST_invalid_path ... ok test.unit.obj.test_server.TestObjectController.test_POST_metafile_unavailable test.unit.obj.test_server.TestObjectController.test_POST_metafile_unavailable ... ok test.unit.obj.test_server.TestObjectController.test_POST_no_timestamp test.unit.obj.test_server.TestObjectController.test_POST_no_timestamp ... ok test.unit.obj.test_server.TestObjectController.test_POST_not_exist test.unit.obj.test_server.TestObjectController.test_POST_not_exist ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txef30849e48274e8185b30-0068c57089" "proxy-server 1824509" 0.0318 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txef30849e48274e8185b30-0068c57089" "proxy-server 1824509" 0.0448 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx61ae01eb43a54f0c84444-0068c57089" "proxy-server 1824509" 0.0014 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 204 - "HEAD http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "tx9c54925a5f2e41a082d7a-0068c57089" "proxy-server 1824509" 0.0106 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 200 84 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txdcf80211c66b45bb812c6-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 200 84 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txdcf80211c66b45bb812c6-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa80b8841f81d415296964-0068c57089" "proxy-server 1824509" 0.0101 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 204 - "HEAD http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "tx4a833b96bcb04cddb99ae-0068c57089" "proxy-server 1824509" 0.0054 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txf969f362b7704f1589525-0068c57089" "proxy-server 1824509" 0.0223 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/2/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/sdi1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txf969f362b7704f1589525-0068c57089" "object-server 1824509" 0.0004 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txf969f362b7704f1589525-0068c57089" "object-server 1824509" 0.0086 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txf969f362b7704f1589525-0068c57089" "proxy-server 1824509" 0.0346 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txf969f362b7704f1589525-0068c57089" "proxy-server 1824509" 0.0368 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdab9fc0009424485ab7d2-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 204 - "HEAD http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "tx283a5af3af62412e99dd1-0068c57089" "proxy-server 1824509" 0.0078 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 200 84 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "tx7fe4c4b3f88d465e9cefb-0068c57089" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 200 84 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "tx7fe4c4b3f88d465e9cefb-0068c57089" "proxy-server 1824509" 0.0006 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3838ae234ba349fd80648-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 204 - "HEAD http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "tx77a9b30a017543d99b10d-0068c57089" "proxy-server 1824509" 0.0040 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "tx6fbc26d3291c453b90ff3-0068c57089" "proxy-server 1824509" 0.0122 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/sdg1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "tx6fbc26d3291c453b90ff3-0068c57089" "object-server 1824509" 0.0004 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/2/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "tx6fbc26d3291c453b90ff3-0068c57089" "object-server 1824509" 0.0004 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "tx6fbc26d3291c453b90ff3-0068c57089" "proxy-server 1824509" 0.0178 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 201 - "PUT http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "tx6fbc26d3291c453b90ff3-0068c57089" "proxy-server 1824509" 0.0170 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txddc1d703d1774e0785ab8-0068c57089" "proxy-server 1824509" 0.0014 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 204 - "HEAD http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "tx16dfd85fa3b740f2b5c64-0068c57089" "proxy-server 1824509" 0.0025 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 200 84 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "tx0285408688cc433f87223-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 200 84 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "tx0285408688cc433f87223-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx62638340c2c043e1ad1c6-0068c57089" "proxy-server 1824509" 0.0012 "-" 1824509 -test.unit.obj.test_server.TestObjectController.test_POST_old_timestamp test.unit.obj.test_server.TestObjectController.test_POST_old_timestamp ... ok test.unit.proxy.test_server.TestAccountController.test_POST_bad_metadata test.unit.proxy.test_server.TestAccountController.test_POST_bad_metadata ... ok test.unit.proxy.test_server.TestECGets.test_GET_with_multiple_timestamps_on_nodes test.unit.proxy.test_server.TestECGets.test_GET_with_multiple_timestamps_on_nodes ... ok test.unit.obj.test_server.TestObjectController.test_POST_quarantine_zbyte test.unit.obj.test_server.TestObjectController.test_POST_quarantine_zbyte ... ok test.unit.proxy.test_server.TestAccountController.test_POST_metadata test.unit.proxy.test_server.TestAccountController.test_POST_metadata ... ok test.unit.obj.test_server.TestObjectController.test_POST_system_metadata test.unit.obj.test_server.TestObjectController.test_POST_system_metadata ... ok test.unit.obj.test_server.TestObjectController.test_POST_then_fetch_content_type test.unit.obj.test_server.TestObjectController.test_POST_then_fetch_content_type ... ok test.unit.proxy.test_server.TestAccountController.test_PUT test.unit.proxy.test_server.TestAccountController.test_PUT ... ok test.unit.obj.test_server.TestObjectController.test_POST_transient_sysmeta test.unit.obj.test_server.TestObjectController.test_POST_transient_sysmeta ... ok test.unit.proxy.test_server.TestAccountController.test_PUT_bad_metadata test.unit.proxy.test_server.TestAccountController.test_PUT_bad_metadata ... ok test.unit.obj.test_server.TestObjectController.test_POST_update_meta test.unit.obj.test_server.TestObjectController.test_POST_update_meta ... ok test.unit.obj.test_server.TestObjectController.test_POST_with_full_drive test.unit.obj.test_server.TestObjectController.test_POST_with_full_drive ... ok test.unit.proxy.test_server.TestAccountController.test_PUT_connect_exceptions test.unit.proxy.test_server.TestAccountController.test_PUT_connect_exceptions ... ok test.unit.obj.test_server.TestObjectController.test_POST_with_x_backend_open_expired test.unit.obj.test_server.TestObjectController.test_POST_with_x_backend_open_expired ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 204 - "HEAD http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "txf2374ea3322c4a80b480c-0068c57089" "proxy-server 1824509" 0.0098 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 404 70 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txe5d5080090b148219b085-0068c57089" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 404 70 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txe5d5080090b148219b085-0068c57089" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txe5d5080090b148219b085-0068c57089) proxy DEBUG: Ignoring 404 from primary (txn: txe5d5080090b148219b085-0068c57089) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 404 70 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txe5d5080090b148219b085-0068c57089" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txe5d5080090b148219b085-0068c57089) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx274ff504b6a345f4bf051-0068c57089" "proxy-server 1824509" 0.0020 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/fdca0b7f072a42b59012b7619bb94dc7" 204 - "HEAD http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7" "tx70cf363a4fb241b58f055-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 200 84 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txaeeee17a21e24c67a9ab7-0068c57089" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 200 84 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txaeeee17a21e24c67a9ab7-0068c57089" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" 200 84 "GET http://localhost/v1/a/fdca0b7f072a42b59012b7619bb94dc7/3a2d107b1eee442ea6296c47a4ef6e2b" "txaeeee17a21e24c67a9ab7-0068c57089" "proxy-server 1824509" 0.0009 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe78eb1ac0b5e4ade83327-0068c57089" "proxy-server 1824509" 0.0015 "-" 1824509 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/d47203f1c32745ed97ba5de9887d58c4" 201 - "PUT http://127.0.0.1:36297/sda1/3/a/d47203f1c32745ed97ba5de9887d58c4" "txe78eb1ac0b5e4ade83327-0068c57089" "container-server 1824509" 0.0009 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/0/a/d47203f1c32745ed97ba5de9887d58c4" 201 - "PUT http://127.0.0.1:41753/sdb1/3/a/d47203f1c32745ed97ba5de9887d58c4" "txe78eb1ac0b5e4ade83327-0068c57089" "container-server 1824509" 0.0009 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/3/a/d47203f1c32745ed97ba5de9887d58c4" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "txe78eb1ac0b5e4ade83327-0068c57089" "proxy-server 1824509" 0.0120 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/3/a/d47203f1c32745ed97ba5de9887d58c4" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "txe78eb1ac0b5e4ade83327-0068c57089" "proxy-server 1824509" 0.0085 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1921d59ed68f41269f883-0068c57089" "proxy-server 1824509" 0.0019 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/3/a/d47203f1c32745ed97ba5de9887d58c4" 204 - "HEAD http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "tx8b964e54bf83489d813a5-0068c57089" "proxy-server 1824509" 0.0011 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx097d2d6ff022428fb4b48-0068c57089" "proxy-server 1824509" 0.0137 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/3/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx097d2d6ff022428fb4b48-0068c57089" "object-server 1824509" 0.0005 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/3/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/sdh1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx097d2d6ff022428fb4b48-0068c57089" "object-server 1824509" 0.0005 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx097d2d6ff022428fb4b48-0068c57089" "proxy-server 1824509" 0.0148 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx097d2d6ff022428fb4b48-0068c57089" "proxy-server 1824509" 0.0147 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx10f909c1647f4d11a3cbb-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/3/a/d47203f1c32745ed97ba5de9887d58c4" 204 - "HEAD http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "txcc7d72c8c2a44b29b6cba-0068c57089" "proxy-server 1824509" 0.0023 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 200 82 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txf1ce2a7c3a24425eb468e-0068c57089" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 200 82 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txf1ce2a7c3a24425eb468e-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx075b91ae9d044486a2a02-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/3/a/d47203f1c32745ed97ba5de9887d58c4" 204 - "HEAD http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "tx9568ca60d41b4fdd9caf7-0068c57089" "proxy-server 1824509" 0.0012 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txe4a674c1f5e74d2694bef-0068c57089" "proxy-server 1824509" 0.0090 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/3/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/sdg1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txe4a674c1f5e74d2694bef-0068c57089" "object-server 1824509" 0.0004 "-" 1824509 3test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter_non_slash ... ok test.unit.obj.test_server.TestObjectController.test_POST_with_x_backend_replication test.unit.obj.test_server.TestObjectController.test_POST_with_x_backend_replication ... ok test.unit.obj.test_server.TestObjectController.test_PUT_bad_footer_checksum test.unit.obj.test_server.TestObjectController.test_PUT_bad_footer_checksum ... ok test.unit.proxy.test_server.TestAccountController.test_PUT_max_account_name_length test.unit.proxy.test_server.TestAccountController.test_PUT_max_account_name_length ... ok test.unit.obj.test_server.TestObjectController.test_PUT_bad_footer_json test.unit.obj.test_server.TestObjectController.test_PUT_bad_footer_json ... ok test.unit.obj.test_server.TestObjectController.test_PUT_bad_timestamp test.unit.obj.test_server.TestObjectController.test_PUT_bad_timestamp ... ok test.unit.obj.test_server.TestObjectController.test_PUT_bad_transfer_encoding test.unit.obj.test_server.TestObjectController.test_PUT_bad_transfer_encoding ... ok test.unit.proxy.test_server.TestAccountController.test_PUT_metadata test.unit.proxy.test_server.TestAccountController.test_PUT_metadata ... ok test.unit.proxy.test_server.TestAccountController.test_PUT_status test.unit.proxy.test_server.TestAccountController.test_PUT_status ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter_order_and_reverse test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter_order_and_reverse ... ok sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769923.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f08/8901cd65118f345943a36ccc8969bf08/8901cd65118f345943a36ccc8969bf08.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769925.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b1d/4c68ce376413d69ed951996fb9809b1d/4c68ce376413d69ed951996fb9809b1d.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769924.00000, (0, 0) as of 1757769924.00000, active as of 1757769924.00000> to ShardRange<'k' to 't' as of 1757769925.00000, (0, 0) as of 1757769925.00000, sharded as of 1757769925.00000>, path: .shards_a/shard_c_1757769925.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b1d/4c68ce376413d69ed951996fb9809b1d/4c68ce376413d69ed951996fb9809b1d.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769925.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b1d/4c68ce376413d69ed951996fb9809b1d/4c68ce376413d69ed951996fb9809b1d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769927.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/001/c29174a1b99ed1ec61c121a00ea98001/c29174a1b99ed1ec61c121a00ea98001.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769926.00000, (0, 0) as of 1757769926.00000, active as of 1757769926.00000> to ShardRange<'k' to 't' as of 1757769927.00000, (0, 0) as of 1757769927.00000, shrunk as of 1757769927.00000>, path: .shards_a/shard_c_1757769927.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/001/c29174a1b99ed1ec61c121a00ea98001/c29174a1b99ed1ec61c121a00ea98001.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769927.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/001/c29174a1b99ed1ec61c121a00ea98001/c29174a1b99ed1ec61c121a00ea98001.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769929.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769928.00000, (0, 0) as of 1757769928.00000, shrinking as of 1757769928.00000> to ShardRange<'k' to 't' as of 1757769929.00000, (0, 0) as of 1757769929.00000, found as of 1757769929.00000>, path: .shards_a/shard_c_1757769929.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769931.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/2c5/4f55d8279a32c43d78554b52b4a812c5/4f55d8279a32c43d78554b52b4a812c5.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769930.00000, (0, 0) as of 1757769930.00000, shrinking as of 1757769930.00000> to ShardRange<'k' to 't' as of 1757769931.00000, (0, 0) as of 1757769931.00000, created as of 1757769931.00000>, path: .shards_a/shard_c_1757769931.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/2c5/4f55d8279a32c43d78554b52b4a812c5/4f55d8279a32c43d78554b52b4a812c5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769933.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b30/e53cd26c4555d6f33da71fc70de40b30/e53cd26c4555d6f33da71fc70de40b30.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769932.00000, (0, 0) as of 1757769932.00000, shrinking as of 1757769932.00000> to ShardRange<'k' to 't' as of 1757769933.00000, (0, 0) as of 1757769933.00000, cleaved as of 1757769933.00000>, path: .shards_a/shard_c_1757769933.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b30/e53cd26c4555d6f33da71fc70de40b30/e53cd26c4555d6f33da71fc70de40b30.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769935.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/2d2/ebbef58771b789d75f0a35856d0742d2/ebbef58771b789d75f0a35856d0742d2.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769934.00000, (0, 0) as of 1757769934.00000, shrinking as of 1757769934.00000> to ShardRange<'k' to 't' as of 1757769935.00000, (0, 0) as of 1757769935.00000, active as of 1757769935.00000>, path: .shards_a/shard_c_1757769935.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/2d2/ebbef58771b789d75f0a35856d0742d2/ebbef58771b789d75f0a35856d0742d2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769937.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/68d/388f825274c49e60c829a527fe0c868d/388f825274c49e60c829a527fe0c868d.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769937.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/68d/388f825274c49e60c829a527fe0c868d/388f825274c49e60c829a527fe0c868d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769939.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f9b/450c6f57470a7424ee76ae4977a9df9b/450c6f57470a7424ee76ae4977a9df9b.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769938.00000, (0, 0) as of 1757769938.00000, shrinking as of 1757769938.00000> to ShardRange<'k' to 't' as of 1757769939.00000, (0, 0) as of 1757769939.00000, sharding as of 1757769939.00000>, path: .shards_a/shard_c_1757769939.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f9b/450c6f57470a7424ee76ae4977a9df9b/450c6f57470a7424ee76ae4977a9df9b.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769939.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f9b/450c6f57470a7424ee76ae4977a9df9b/450c6f57470a7424ee76ae4977a9df9b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769941.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/529/a972b5fe426b4af4b4603423a8bbe529/a972b5fe426b4af4b4603423a8bbe529.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769940.00000, (0, 0) as of 1757769940.00000, shrinking as of 1757769940.00000> to ShardRange<'k' to 't' as of 1757769941.00000, (0, 0) as of 1757769941.00000, sharded as of 1757769941.00000>, path: .shards_a/shard_c_1757769941.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/529/a972b5fe426b4af4b4603423a8bbe529/a972b5fe426b4af4b4603423a8bbe529.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769941.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/529/a972b5fe426b4af4b4603423a8bbe529/a972b5fe426b4af4b4603423a8bbe529.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769943.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/644/473d3480816af0f3a01d153174862644/473d3480816af0f3a01d153174862644.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769942.00000, (0, 0) as of 1757769942.00000, shrinking as of 1757769942.00000> to ShardRange<'k' to 't' as of 1757769943.00000, (0, 0) as of 1757769943.00000, shrunk as of 1757769943.00000>, path: .shards_a/shard_c_1757769943.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/644/473d3480816af0f3a01d153174862644/473d3480816af0f3a01d153174862644.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769943.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/644/473d3480816af0f3a01d153174862644/473d3480816af0f3a01d153174862644.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769945.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/e99/a1663205739c0ae6ceb582a66629be99/a1663205739c0ae6ceb582a66629be99.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769944.00000, (0, 0) as of 1757769944.00000, sharding as of 1757769944.00000> to ShardRange<'k' to 't' as of 1757769945.00000, (0, 0) as of 1757769945.00000, found as of 1757769945.00000>, path: .shards_a/shard_c_1757769945.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/e99/a1663205739c0ae6ceb582a66629be99/a1663205739c0ae6ceb582a66629be99.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769947.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/47c/c53a22dc05c539a8733754cd3527a47c/c53a22dc05c539a8733754cd3527a47c.dbtest.unit.proxy.test_server.TestAccountController.test_auto_create_account_listing_response_is_json test.unit.proxy.test_server.TestAccountController.test_auto_create_account_listing_response_is_json ... ok test.unit.proxy.test_server.TestAccountController.test_connection_refused test.unit.proxy.test_server.TestAccountController.test_connection_refused ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter_prefix_delim ... ok test.unit.proxy.test_server.TestAccountController.test_other_socket_error test.unit.proxy.test_server.TestAccountController.test_other_socket_error ... ok test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 404 - "-" "-" "-" 0.0081 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/./a/c" 400 20 "-" "-" "-" 0.0002 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 404 - "-" "-" "-" 0.0003 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0003 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 409 - "-" "-" "-" 0.0610 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:24 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0037 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:24 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0091 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0116 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/bashful" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0138 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy10" 204 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy10_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy20" 301 - "-" "-" "-" 0.0212 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy20_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy30" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy30_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy40" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy40_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy50" 204 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy50_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy60" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy60_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy70" 204 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy70_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy80" 204 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpy80_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier10" 204 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier10_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier20" 301 - "-" "-" "-" 0.0091 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier20_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0145 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier30" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier30_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier40" 301 - "-" "-" "-" 0.0092 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier40_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier50" 204 - "-" "-" "-" 0.0093 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier50_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier60" 301 - "-" "-" "-" 0.0091 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier60_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier70" 204 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier70_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier80" 204 - "-" "-" "-" 0.0131 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpier80_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0096 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey10" 204 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey10_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c" 400 25 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0091 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 503 118 "-" "-" "-" 0.0017 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/p/a/c/o" 200 - "-" "-" "-" 0.0078 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 400 26 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/fail" 404 70 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0093 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller WARNING: Quarantined object /tmp/tmpn8gughru/tmp_test_object_server_ObjectController/sda1/objects/p/a43/615cd4810e0d969889af154f7b02ba43/1757769865.35102.data: metadata content-length 6 does not match actual object size 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0091 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0053 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/p/a/c/o" 200 14 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c/o" 200 14 "-" "-" "-" 0.0087 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0132 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0092 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0088 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0052 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 507 109 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0020 "-" 1824531 - test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0070 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0047 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0061 "-" 1824531 - test-object-controller DEBUG: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0062 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 422 19 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 27 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 26 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 38 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0057 "-" 1824531 0test.unit.obj.test_server.TestObjectController.test_PUT_calls_delete_at test.unit.obj.test_server.TestObjectController.test_PUT_calls_delete_at ... ok test.unit.obj.test_server.TestObjectController.test_PUT_can_skip_deleting_expirer_queue_but_still_inserts test.unit.obj.test_server.TestObjectController.test_PUT_can_skip_deleting_expirer_queue_but_still_inserts ... ok test.unit.obj.test_server.TestObjectController.test_PUT_can_skip_updating_expirer_queue test.unit.obj.test_server.TestObjectController.test_PUT_can_skip_updating_expirer_queue ... ok test.unit.obj.test_server.TestObjectController.test_PUT_client_closed_connection test.unit.obj.test_server.TestObjectController.test_PUT_client_closed_connection ... ok test.unit.obj.test_server.TestObjectController.test_PUT_client_timeout test.unit.obj.test_server.TestObjectController.test_PUT_client_timeout ... ok test.unit.proxy.test_server.TestAccountController.test_response_get_accept_ranges_header test.unit.proxy.test_server.TestAccountController.test_response_get_accept_ranges_header ... ok test.unit.obj.test_server.TestObjectController.test_PUT_commits_data test.unit.obj.test_server.TestObjectController.test_PUT_commits_data ... ok test.unit.obj.test_server.TestObjectController.test_PUT_common test.unit.obj.test_server.TestObjectController.test_PUT_common ... ok test.unit.obj.test_server.TestObjectController.test_PUT_container_connection test.unit.obj.test_server.TestObjectController.test_PUT_container_connection ... ok test.unit.obj.test_server.TestObjectController.test_PUT_container_update_overrides test.unit.obj.test_server.TestObjectController.test_PUT_container_update_overrides ... ok test.unit.proxy.test_server.TestAccountController.test_response_head_accept_ranges_header test.unit.proxy.test_server.TestAccountController.test_response_head_accept_ranges_header ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter_with_reserved_name test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_list_objects_iter_with_reserved_name ... ok test.unit.proxy.test_server.TestController.test_account_info_200 test.unit.proxy.test_server.TestController.test_account_info_200 ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/3/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txe4a674c1f5e74d2694bef-0068c57089" "object-server 1824509" 0.0004 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txe4a674c1f5e74d2694bef-0068c57089" "proxy-server 1824509" 0.0145 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txe4a674c1f5e74d2694bef-0068c57089" "proxy-server 1824509" 0.0179 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa3d9bb448fdf4f2a9da03-0068c57089" "proxy-server 1824509" 0.0054 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/3/a/d47203f1c32745ed97ba5de9887d58c4" 204 - "HEAD http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "tx4f20f2905b1c44dcb60f7-0068c57089" "proxy-server 1824509" 0.0056 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 200 82 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txf9645d185759472192757-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 200 82 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txf9645d185759472192757-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb3155c45da8c4ddf98333-0068c57089" "proxy-server 1824509" 0.0052 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/3/a/d47203f1c32745ed97ba5de9887d58c4" 204 - "HEAD http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "txdc5b373557d74951adeff-0068c57089" "proxy-server 1824509" 0.0020 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txff654c648dda40d88b2ea-0068c57089" "proxy-server 1824509" 0.0112 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/3/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/sdh1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txff654c648dda40d88b2ea-0068c57089" "object-server 1824509" 0.0005 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/3/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txff654c648dda40d88b2ea-0068c57089" "object-server 1824509" 0.0004 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txff654c648dda40d88b2ea-0068c57089" "proxy-server 1824509" 0.0177 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 201 - "PUT http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txff654c648dda40d88b2ea-0068c57089" "proxy-server 1824509" 0.0176 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6eaa6fa1a0af43b58afc6-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/3/a/d47203f1c32745ed97ba5de9887d58c4" 204 - "HEAD http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "txdbcb0b8308de435c963dc-0068c57089" "proxy-server 1824509" 0.0020 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 200 82 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txd2f79c80b98a493998e95-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 200 82 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "txd2f79c80b98a493998e95-0068c57089" "proxy-server 1824509" 0.0006 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txecf9e7a087914cc095f44-0068c57089" "proxy-server 1824509" 0.0012 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/3/a/d47203f1c32745ed97ba5de9887d58c4" 204 - "HEAD http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "tx2ca9d412ecc34cc7a1ab1-0068c57089" "proxy-server 1824509" 0.0020 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 404 70 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx47e0a908a213484cb93d3-0068c57089" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 404 70 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx47e0a908a213484cb93d3-0068c57089" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx47e0a908a213484cb93d3-0068c57089) proxy DEBUG: Ignoring 404 from primary (txn: tx47e0a908a213484cb93d3-0068c57089) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 404 70 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx47e0a908a213484cb93d3-0068c57089" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx47e0a908a213484cb93d3-0068c57089) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe5963a1e2ab24d8cbd6c8-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/3/a/d47203f1c32745ed97ba5de9887d58c4" 204 - "HEAD http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4" "txe61c76da6c3e4214aae9c-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 200 82 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx9fca63ceb71d4cb29f8e7-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 200 82 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx9fca63ceb71d4cb29f8e7-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" 200 82 "GET http://localhost/v1/a/d47203f1c32745ed97ba5de9887d58c4/86b4be8ae4ac4db8a0cca331bbb17566" "tx9fca63ceb71d4cb29f8e7-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3test.unit.proxy.test_server.TestController.test_account_info_404 test.unit.proxy.test_server.TestController.test_account_info_404 ... ok test.unit.proxy.test_server.TestController.test_account_info_container_count test.unit.proxy.test_server.TestController.test_account_info_container_count ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_load_old_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_load_old_record_from_pending_file ... ok test.unit.proxy.test_server.TestController.test_account_info_no_account test.unit.proxy.test_server.TestController.test_account_info_no_account ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_make_tuple_for_pickle test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_make_tuple_for_pickle ... ok test.unit.proxy.test_server.TestController.test_account_info_no_cache test.unit.proxy.test_server.TestController.test_account_info_no_cache ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 204 - "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e" "tx8b67efbd48b3495387316-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdd1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" 200 24 "HEAD http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e/o" "txc9a762de29584ad7888c3-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txd4e5267980c744dab8b59-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/1/a/9be520b60e1c4b6bb01943b6d4f9a46e" 200 155 "GET http://foo:8080/v1/a/9be520b60e1c4b6bb01943b6d4f9a46e?format=json&states=listing" "txd4e5267980c744dab8b59-0068c57089" "proxy-server 1824514" 0.0139 "-" 1824514 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx2978a83f4ca74b4c91f2e-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/1/a/bd2ed06c2d8848318db977405770d75c" 201 - "PUT http://127.0.0.1:40941/sda1/2/a/bd2ed06c2d8848318db977405770d75c" "tx2978a83f4ca74b4c91f2e-0068c57089" "container-server 1824514" 0.0010 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/1/a/bd2ed06c2d8848318db977405770d75c" 201 - "PUT http://127.0.0.1:60751/sdb1/2/a/bd2ed06c2d8848318db977405770d75c" "tx2978a83f4ca74b4c91f2e-0068c57089" "container-server 1824514" 0.0011 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 201 - "PUT http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx2978a83f4ca74b4c91f2e-0068c57089" "proxy-server 1824514" 0.0451 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 201 - "PUT http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx2978a83f4ca74b4c91f2e-0068c57089" "proxy-server 1824514" 0.0333 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3bcbe30ddf704d6fbc0b0-0068c57089" "proxy-server 1824514" 0.0102 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx3bcbe30ddf704d6fbc0b0-0068c57089" "proxy-server 1824514" 0.0094 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx1cfa12be05a14c53bb6e8-0068c57089" "proxy-server 1824514" 0.0180 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "txadec3ad1fc224ace9bfd8-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 201 - "PUT http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txab55914ba7ab401697f9e-0068c57089" "proxy-server 1824514" 0.0472 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/2/a/bd2ed06c2d8848318db977405770d75c/o" 201 - "PUT http://foo:8080/sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" "txab55914ba7ab401697f9e-0068c57089" "object-server 1824514" 0.0046 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/2/a/bd2ed06c2d8848318db977405770d75c/o" 201 - "PUT http://foo:8080/sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" "txab55914ba7ab401697f9e-0068c57089" "object-server 1824514" 0.0005 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 201 - "PUT http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txab55914ba7ab401697f9e-0068c57089" "proxy-server 1824514" 0.0553 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 201 - "PUT http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txab55914ba7ab401697f9e-0068c57089" "proxy-server 1824514" 0.0573 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx3ec8606d2f3647daaff4d-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx7e51107967a74c48a80c9-0068c57089" "proxy-server 1824514" 0.0071 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "POST /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 202 76 "POST http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx6c18f69815914e5fa7121-0068c57089" "proxy-server 1824514" 0.0072 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/2/a/bd2ed06c2d8848318db977405770d75c/o" 201 - "POST http://foo:8080/sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" "tx6c18f69815914e5fa7121-0068c57089" "object-server 1824514" 0.0004 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/2/a/bd2ed06c2d8848318db977405770d75c/o" 201 - "POST http://foo:8080/sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" "tx6c18f69815914e5fa7121-0068c57089" "object-server 1824514" 0.0004 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "POST /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 202 76 "POST http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx6c18f69815914e5fa7121-0068c57089" "proxy-server 1824514" 0.0226 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "POST /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 202 76 "POST http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx6c18f69815914e5fa7121-0068c57089" "proxy-server 1824514" 0.0214 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx0527d01a0ee047ada2e8a-0068c57089" "proxy-server 1824514" 0.0054 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx7fbb65c5b169453eab78f-0068c57089" "proxy-server 1824514" 0.0097 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx957a5e2cae34444bbf41d-0068c57089" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx957a5e2cae34444bbf41d-0068c57089" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7fe305dfd8564db8803b8-0068c57089" "proxy-server 1824514" 0.0056 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx6696dd42057949dbbdc36-0068c57089" "proxy-server 1824514" 0.0099 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx4136576e6fdb4e84aa2d0-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txaff4f81d915b4178b3b7f-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "txcc101880e7ec40cc890c4-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 3 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0018 "-" 1824531 - test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0096 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0097 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 499 89 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 408 116 "-" "-" "-" 0.0008 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0023 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('1.2.3.4:0', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0016 "-" 1824531 - test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from 1.2.3.4:0/sda1 test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('1.2.3.4:0', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0063 "-" 1824531 - test-object-controller ERROR: ERROR container update failed with 1.2.3.4:0/sda1 (saving for async update later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 323, in async_update response = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 3114, in getresponse raise Exception('test') Exception: test test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('1.2.3.4:0', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0079 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0017 "-" 1824531 - test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0024 "-" 1824531 - test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0017 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0030 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0029 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0020 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got 'garbage'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0018 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got '/'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0016 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got '/no-acct'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0018 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got 'no-cont/'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0017 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got 'too/many/parts'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0017 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got '/leading/slash'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123)test.unit.obj.test_server.TestObjectController.test_PUT_container_update_to_old_style_shard test.unit.obj.test_server.TestObjectController.test_PUT_container_update_to_old_style_shard ... ok test.unit.obj.test_server.TestObjectController.test_PUT_container_update_to_shard test.unit.obj.test_server.TestObjectController.test_PUT_container_update_to_shard ... ok sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769946.00000, (0, 0) as of 1757769946.00000, sharding as of 1757769946.00000> to ShardRange<'k' to 't' as of 1757769947.00000, (0, 0) as of 1757769947.00000, created as of 1757769947.00000>, path: .shards_a/shard_c_1757769947.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/47c/c53a22dc05c539a8733754cd3527a47c/c53a22dc05c539a8733754cd3527a47c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769949.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/aff/c5a4f4205b55c149906e29c56f6a4aff/c5a4f4205b55c149906e29c56f6a4aff.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769948.00000, (0, 0) as of 1757769948.00000, sharding as of 1757769948.00000> to ShardRange<'k' to 't' as of 1757769949.00000, (0, 0) as of 1757769949.00000, cleaved as of 1757769949.00000>, path: .shards_a/shard_c_1757769949.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/aff/c5a4f4205b55c149906e29c56f6a4aff/c5a4f4205b55c149906e29c56f6a4aff.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769951.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/359/21c3f6abca1214e1a52995d2f81ae359/21c3f6abca1214e1a52995d2f81ae359.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769950.00000, (0, 0) as of 1757769950.00000, sharding as of 1757769950.00000> to ShardRange<'k' to 't' as of 1757769951.00000, (0, 0) as of 1757769951.00000, active as of 1757769951.00000>, path: .shards_a/shard_c_1757769951.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/359/21c3f6abca1214e1a52995d2f81ae359/21c3f6abca1214e1a52995d2f81ae359.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769953.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8cc/2489c158f88285ded27fa68bffb8f8cc/2489c158f88285ded27fa68bffb8f8cc.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769952.00000, (0, 0) as of 1757769952.00000, sharding as of 1757769952.00000> to ShardRange<'k' to 't' as of 1757769953.00000, (0, 0) as of 1757769953.00000, shrinking as of 1757769953.00000>, path: .shards_a/shard_c_1757769953.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8cc/2489c158f88285ded27fa68bffb8f8cc/2489c158f88285ded27fa68bffb8f8cc.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769953.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8cc/2489c158f88285ded27fa68bffb8f8cc/2489c158f88285ded27fa68bffb8f8cc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769955.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d2e/7857ea434996e656ea554796972fed2e/7857ea434996e656ea554796972fed2e.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769955.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d2e/7857ea434996e656ea554796972fed2e/7857ea434996e656ea554796972fed2e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769957.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/63d/3ab2c4fdfac325c8b53d8ec3c08b063d/3ab2c4fdfac325c8b53d8ec3c08b063d.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769956.00000, (0, 0) as of 1757769956.00000, sharding as of 1757769956.00000> to ShardRange<'k' to 't' as of 1757769957.00000, (0, 0) as of 1757769957.00000, sharded as of 1757769957.00000>, path: .shards_a/shard_c_1757769957.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/63d/3ab2c4fdfac325c8b53d8ec3c08b063d/3ab2c4fdfac325c8b53d8ec3c08b063d.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769957.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/63d/3ab2c4fdfac325c8b53d8ec3c08b063d/3ab2c4fdfac325c8b53d8ec3c08b063d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769959.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/5f7/3605ae3bc8ce18beb49cc732f9fcb5f7/3605ae3bc8ce18beb49cc732f9fcb5f7.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769958.00000, (0, 0) as of 1757769958.00000, sharding as of 1757769958.00000> to ShardRange<'k' to 't' as of 1757769959.00000, (0, 0) as of 1757769959.00000, shrunk as of 1757769959.00000>, path: .shards_a/shard_c_1757769959.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/5f7/3605ae3bc8ce18beb49cc732f9fcb5f7/3605ae3bc8ce18beb49cc732f9fcb5f7.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769959.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/5f7/3605ae3bc8ce18beb49cc732f9fcb5f7/3605ae3bc8ce18beb49cc732f9fcb5f7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769961.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/5f9/25d5d55ffd1dd3da981779bbad3825f9/25d5d55ffd1dd3da981779bbad3825f9.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769960.00000, (0, 0) as of 1757769960.00000, sharded as of 1757769960.00000> to ShardRange<'k' to 't' as of 1757769961.00000, (0, 0) as of 1757769961.00000, found as of 1757769961.00000>, path: .shards_a/shard_c_1757769961.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/5f9/25d5d55ffd1dd3da981779bbad3825f9/25d5d55ffd1dd3da981779bbad3825f9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769963.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/6dd/43239cdd812864922f999610ba4b06dd/43239cdd812864922f999610ba4b06dd.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769962.00000, (0, 0) as of 1757769962.00000, sharded as of 1757769962.00000> to ShardRange<'k' to 't' as of 1757769963.00000, (0, 0) as of 1757769963.00000, created as of 1757769963.00000>, path: .shards_a/shard_c_1757769963.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/6dd/43239cdd812864922f999610ba4b06dd/43239cdd812864922f999610ba4b06dd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769965.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/0ec/96d58672111b8bb6b6c89da8e62af0ec/96d58672111b8bb6b6c89da8e62af0ec.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769964.00000, (0, 0) as of 1757769964.00000, sharded as of 1757769964.00000> to ShardRange<'k' to 't' as of 1757769965.00000, (0, 0) as of 1757769965.00000, cleaved as of 1757769965.00000>, path: .shards_a/shard_c_1757769965.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/0ec/96d58672111b8bb6b6c89da8e62af0ec/96d58672111b8bb6b6c89da8e62af0ec.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769967.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/75e/9c500d0ec9e120201f482f094431a75e/9c500d0ec9e120201f482f094431a75e.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769966.00000, (0, 0) as of 1757769966.00000, sharded as of 1757769966.00000> to ShardRange<'k' to 't' as of 1757769967.00000, (0, 0) as of 1757769967.00000, active as of 1757769967.00000>, path: .shards_a/shard_c_1757769967.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/75e/9c500d0ec9e120201f482f094431a75e/9c500d0ec9e120201f482f094431a75e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769969.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/4a0/a5f98d9b92353f93b43aae303cefe4a0/a5f98d9b92353f93b43aae303cefe4a0.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769968.00000, (0, 0) as of 1757769968.00000, sharded as of 1757769968.00000> to ShardRange<'k' to 't' as of 1757769969.00000, (0, 0) as of 1757769969.00000, shrinking as of 1757769969.00000>, path: .shards_a/shard_c_1757769969.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/4a0/a5f98d9b92353f93b43aae303cefe4a0/a5f98d9b92353f93b43aae303cefe4a0.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769969.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/4a0/a5f98d9b92353f93b43aae303cefe4a0/a5f98d9b92353f93b43aae303cefe4a0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769971.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/806/7199c93ccfddc75301c516ffe5745806/7199c93ccfddc75301c516ffe5745806.dbtest.unit.obj.test_server.TestObjectController.test_PUT_cooperative_period_config test.unit.obj.test_server.TestObjectController.test_PUT_cooperative_period_config ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://127.0.0.1:53717/sdb1/3/a/c" "tx6606114c43a846d6a145a-0068c57088" "container-server 1824529" 0.0011 "-" 1824529 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://127.0.0.1:55533/sda1/3/a/c" "tx6606114c43a846d6a145a-0068c57088" "container-server 1824529" 0.0010 "-" 1824529 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "tx6606114c43a846d6a145a-0068c57088" "proxy-server 1824529" 0.0411 "-" 1824529 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "tx6606114c43a846d6a145a-0068c57088" "proxy-server 1824529" 0.0335 "-" 1824529 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/24 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx6606114c43a846d6a145a-0068c57088 - 0.0599 - - 1757769864.476806402 1757769864.536657333 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx47104b8615c545d184eaa-0068c57088" "proxy-server 1824529" 0.0011 "-" 1824529 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:53717/sdb1/0/a1/c1" "tx47104b8615c545d184eaa-0068c57088" "container-server 1824529" 0.0010 "-" 1824529 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:55533/sda1/0/a1/c1" "tx47104b8615c545d184eaa-0068c57088" "container-server 1824529" 0.0010 "-" 1824529 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx47104b8615c545d184eaa-0068c57088" "proxy-server 1824529" 0.0289 "-" 1824529 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx47104b8615c545d184eaa-0068c57088" "proxy-server 1824529" 0.0478 "-" 1824529 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/24 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx47104b8615c545d184eaa-0068c57088 - 0.0673 - - 1757769864.538066149 1757769864.605358362 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcc5cacf4de8947eb8e09c-0068c57088" "proxy-server 1824529" 0.0019 "-" 1824529 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://127.0.0.1:53717/sdb1/3/a/c1" "txcc5cacf4de8947eb8e09c-0068c57088" "container-server 1824529" 0.0010 "-" 1824529 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://127.0.0.1:55533/sda1/3/a/c1" "txcc5cacf4de8947eb8e09c-0068c57088" "container-server 1824529" 0.0016 "-" 1824529 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txcc5cacf4de8947eb8e09c-0068c57088" "proxy-server 1824529" 0.0372 "-" 1824529 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txcc5cacf4de8947eb8e09c-0068c57088" "proxy-server 1824529" 0.0254 "-" 1824529 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/24 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - txcc5cacf4de8947eb8e09c-0068c57088 - 0.0648 - - 1757769864.614835262 1757769864.679658890 1 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd959b6c38b56493a8f454-0068c57088" "proxy-server 1824529" 0.0019 "-" 1824529 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://127.0.0.1:53717/sdb1/0/a/c2" "txd959b6c38b56493a8f454-0068c57088" "container-server 1824529" 0.0010 "-" 1824529 2 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://127.0.0.1:55533/sda1/0/a/c2" "txd959b6c38b56493a8f454-0068c57088" "container-server 1824529" 0.0015 "-" 1824529 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txd959b6c38b56493a8f454-0068c57088" "proxy-server 1824529" 0.0431 "-" 1824529 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:24 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txd959b6c38b56493a8f454-0068c57088" "proxy-server 1824529" 0.0317 "-" 1824529 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/24 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txd959b6c38b56493a8f454-0068c57088 - 0.0680 - - 1757769864.681052923 1757769864.749063492 2 - test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.1:1001/sdb (txn: txf99ed7d9b336412696a78-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: txf99ed7d9b336412696a78-0068c57089) test ERROR: Account HEAD returning 503 for [503, 503] (txn: txf99ed7d9b336412696a78-0068c57089) test ERROR: ERROR 504 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: txa4373e5908ad4cb18bb19-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.1:1001/sdb (txn: txa4373e5908ad4cb18bb19-0068c57089) test ERROR: Account HEAD returning 503 for [504, 503] (txn: txa4373e5908ad4cb18bb19-0068c57089) test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: tx29314ec652514695aa121-0068c57089) test DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx29314ec652514695aa121-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: tx29314ec652514695aa121-0068c57089) test ERROR: Account HEAD returning 503 for [507, 503] (txn: tx29314ec652514695aa121-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: tx9cd7808657f74ade8e2e5-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.1:1001/sdb (txn: tx9cd7808657f74ade8e2e5-0068c57089) test DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx9cd7808657f74ade8e2e5-0068c57089) test ERROR: Account HEAD returning 503 for [503, 503] (txn: tx9cd7808657f74ade8e2e5-0068c57089) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestController.test_container_info_200 test.unit.proxy.test_server.TestController.test_container_info_200 ... ok test.unit.proxy.test_server.TestController.test_container_info_404 test.unit.proxy.test_server.TestController.test_container_info_404 ... ok test.unit.obj.test_server.TestObjectController.test_PUT_delete_at_in_past test.unit.obj.test_server.TestObjectController.test_PUT_delete_at_in_past ... ok test.unit.obj.test_server.TestObjectController.test_PUT_etag_in_footer test.unit.obj.test_server.TestObjectController.test_PUT_etag_in_footer ... ok test.unit.obj.test_server.TestObjectController.test_PUT_etag_in_footer_mismatch test.unit.obj.test_server.TestObjectController.test_PUT_etag_in_footer_mismatch ... ok test.unit.obj.test_server.TestObjectController.test_PUT_extra_mime_docs_ignored test.unit.obj.test_server.TestObjectController.test_PUT_extra_mime_docs_ignored ... ok test.unit.proxy.test_server.TestController.test_container_info_invalid_account test.unit.proxy.test_server.TestController.test_container_info_invalid_account ... ok test.unit.obj.test_server.TestObjectController.test_PUT_if_none_match test.unit.obj.test_server.TestObjectController.test_PUT_if_none_match ... ok test.unit.obj.test_server.TestObjectController.test_PUT_if_none_match_but_expired test.unit.obj.test_server.TestObjectController.test_PUT_if_none_match_but_expired ... ok test.unit.obj.test_server.TestObjectController.test_PUT_if_none_match_star test.unit.obj.test_server.TestObjectController.test_PUT_if_none_match_star ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items ... ok test.unit.proxy.test_server.TestController.test_container_info_no_cache test.unit.proxy.test_server.TestController.test_container_info_no_cache ... ok test.unit.proxy.test_server.TestController.test_get_account_info_returns_values_as_strings test.unit.proxy.test_server.TestController.test_get_account_info_returns_values_as_strings ... ok test.unit.proxy.test_server.TestController.test_get_container_info_returns_values_as_strings test.unit.proxy.test_server.TestController.test_get_container_info_returns_values_as_strings ... ok test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0017 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0018 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0014 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0018 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got 'garbage'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0017 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got '/'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0017 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got '/no-acct'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0056 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got 'no-cont/'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0016 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got 'too/many/parts'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0016 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller ERROR: Invalid X-Backend-Container-Path, should be of the form 'account/container' but got '/leading/slash'. (txn: 123) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0157 "-" 1824531 1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0015 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0097 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0017 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0014 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 19 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0015 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 422 93 "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0015 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 412 92 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0020 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 412 92 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 412 92 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 20 "-" "-" "-" 0.0003 "-" 1824531 -test.unit.obj.test_server.TestObjectController.test_PUT_invalid_content_type test.unit.obj.test_server.TestObjectController.test_PUT_invalid_content_type ... ok test.unit.obj.test_server.TestObjectController.test_PUT_invalid_etag test.unit.obj.test_server.TestObjectController.test_PUT_invalid_etag ... ok test.unit.obj.test_server.TestObjectController.test_PUT_invalid_path test.unit.obj.test_server.TestObjectController.test_PUT_invalid_path ... ok test.unit.obj.test_server.TestObjectController.test_PUT_meta_in_footer test.unit.obj.test_server.TestObjectController.test_PUT_meta_in_footer ... ok test.unit.obj.test_server.TestObjectController.test_PUT_metafile_unavailable test.unit.obj.test_server.TestObjectController.test_PUT_metafile_unavailable ... ok test.unit.obj.test_server.TestObjectController.test_PUT_missing_footer_checksum test.unit.obj.test_server.TestObjectController.test_PUT_missing_footer_checksum ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items_is_green test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items_is_green ... ok test.unit.proxy.test_server.TestController.test_make_requests test.unit.proxy.test_server.TestController.test_make_requests ... ok test.unit.container.test_server.TestContainerController.test_DELETE_object_update_redirected_to_shard test.unit.container.test_server.TestContainerController.test_DELETE_object_update_redirected_to_shard ... ok test.unit.obj.test_server.TestObjectController.test_PUT_new_object_really_old_timestamp test.unit.obj.test_server.TestObjectController.test_PUT_new_object_really_old_timestamp ... ok test.unit.proxy.test_server.TestController.test_transfer_headers test.unit.proxy.test_server.TestController.test_transfer_headers ... ok test.unit.container.test_server.TestContainerController.test_DELETE_timestamp_not_float test.unit.container.test_server.TestContainerController.test_DELETE_timestamp_not_float ... ok test.unit.obj.test_server.TestObjectController.test_PUT_next_part_power test.unit.obj.test_server.TestObjectController.test_PUT_next_part_power ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc690c2071ddd42e1a195d-0068c57089" "proxy-server 1824509" 0.0053 "-" 1824509 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 201 - "PUT http://127.0.0.1:36297/sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "txc690c2071ddd42e1a195d-0068c57089" "container-server 1824509" 0.0010 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 201 - "PUT http://127.0.0.1:41753/sdb1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "txc690c2071ddd42e1a195d-0068c57089" "container-server 1824509" 0.0010 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "txc690c2071ddd42e1a195d-0068c57089" "proxy-server 1824509" 0.0311 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "txc690c2071ddd42e1a195d-0068c57089" "proxy-server 1824509" 0.0127 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf66f2b9baec040549d789-0068c57089" "proxy-server 1824509" 0.0019 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 204 - "HEAD http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "tx66e37f746ecf4236afcd2-0068c57089" "proxy-server 1824509" 0.0067 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx5cbcf2f9467144159728f-0068c57089" "object-server 1824509" 0.0005 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/sdh1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx5cbcf2f9467144159728f-0068c57089" "object-server 1824509" 0.0005 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx5cbcf2f9467144159728f-0068c57089" "proxy-server 1824509" 0.0296 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx5cbcf2f9467144159728f-0068c57089" "proxy-server 1824509" 0.0335 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx5cbcf2f9467144159728f-0068c57089" "proxy-server 1824509" 0.0474 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2c5727f554794f0fb6e0a-0068c57089" "proxy-server 1824509" 0.0062 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 204 - "HEAD http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "tx4d0d97fe5e5c4ed8a3159-0068c57089" "proxy-server 1824509" 0.0023 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 200 82 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txae742378d2fd48bba4dad-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 200 82 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txae742378d2fd48bba4dad-0068c57089" "proxy-server 1824509" 0.0008 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc5d22c8d5a1345a8b8685-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 204 - "HEAD http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "tx106d5e843b4e48839433b-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx6f4c7e7df09d4c239fe9d-0068c57089" "proxy-server 1824509" 0.0201 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/sdh1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx6f4c7e7df09d4c239fe9d-0068c57089" "object-server 1824509" 0.0004 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/sdi1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx6f4c7e7df09d4c239fe9d-0068c57089" "object-server 1824509" 0.0005 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx6f4c7e7df09d4c239fe9d-0068c57089" "proxy-server 1824509" 0.0300 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx6f4c7e7df09d4c239fe9d-0068c57089" "proxy-server 1824509" 0.0354 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0777a69796054887bf8cb-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 204 - "HEAD http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "tx3e2c0f4924eb49f4a2db1-0068c57089" "proxy-server 1824509" 0.0062 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 200 82 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txf78f3fb757564d2f8e7a6-0068c57089" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 200 82 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txf78f3fb757564d2f8e7a6-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0c569cfa253b466c91e0b-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 204 - "HEAD http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "txb71781c7fca3411a91fb7-0068c57089" "proxy-server 1824509" 0.0054 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdi1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx85e55c0028f943d183105-0068c57089" "proxy-server 1824509" 0.0258 "-" 1824509 3test.unit.container.test_server.TestContainerController.test_GET_accept_not_valid test.unit.container.test_server.TestContainerController.test_GET_accept_not_valid ... ok test.unit.obj.test_server.TestObjectController.test_PUT_next_part_power_eexist test.unit.obj.test_server.TestObjectController.test_PUT_next_part_power_eexist ... ok test.unit.obj.test_server.TestObjectController.test_PUT_next_part_power_races_around_makedirs_eexist test.unit.obj.test_server.TestObjectController.test_PUT_next_part_power_races_around_makedirs_eexist ... ok test.unit.obj.test_server.TestObjectController.test_PUT_next_part_power_races_around_makedirs_enoent test.unit.obj.test_server.TestObjectController.test_PUT_next_part_power_races_around_makedirs_enoent ... ok test.unit.obj.test_server.TestObjectController.test_PUT_no_content_length test.unit.obj.test_server.TestObjectController.test_PUT_no_content_length ... ok test.unit.obj.test_server.TestObjectController.test_PUT_no_content_type test.unit.obj.test_server.TestObjectController.test_PUT_no_content_type ... ok test.unit.obj.test_server.TestObjectController.test_PUT_no_etag test.unit.obj.test_server.TestObjectController.test_PUT_no_etag ... ok test.unit.obj.test_server.TestObjectController.test_PUT_no_timestamp test.unit.obj.test_server.TestObjectController.test_PUT_no_timestamp ... ok test.unit.obj.test_server.TestObjectController.test_PUT_object_really_new_timestamp test.unit.obj.test_server.TestObjectController.test_PUT_object_really_new_timestamp ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items_overwrite test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items_overwrite ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txa3ae48c0359144459f72e-0068c57089" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txa3ae48c0359144459f72e-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txe42f57566795450c822a4-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx84109c041ce3417abed22-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txb24976df0fea40d48b6d3-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx24def694bbec4fdcabf5f-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx999378dd4371449fb8fd6-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx9661765f517f4544a5cde-0068c57089" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx9661765f517f4544a5cde-0068c57089" "proxy-server 1824514" 0.0049 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx07b0200ed2b64dc5b423f-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx4715e00efc0e426589757-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txb42634986dd7475c85e59-0068c57089" "proxy-server 1824514" 0.0009 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txb42634986dd7475c85e59-0068c57089" "proxy-server 1824514" 0.0050 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4f4d4338587c4fd5aaa15-0068c57089" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "txe29c06b4bef245bdb370a-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txbfe6aeb90422420d971f0-0068c57089" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txbfe6aeb90422420d971f0-0068c57089" "proxy-server 1824514" 0.0008 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: txbfe6aeb90422420d971f0-0068c57089) proxy DEBUG: Ignoring 412 from primary (txn: txbfe6aeb90422420d971f0-0068c57089) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txbfe6aeb90422420d971f0-0068c57089" "proxy-server 1824514" 0.0008 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: txbfe6aeb90422420d971f0-0068c57089) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx21d0288d29734f0baa23a-0068c57089" "proxy-server 1824514" 0.0053 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx380f6040617f456b91b53-0068c57089" "proxy-server 1824514" 0.0054 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx5473c6709391495b9860f-0068c57089" "proxy-server 1824514" 0.0049 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx5473c6709391495b9860f-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx5473c6709391495b9860f-0068c57089" "proxy-server 1824514" 0.0089 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9555b22f616d4a26895ac-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "txe8ea2b1ca9114ea5a69ad-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx962e8da4d29c4c1dac5b7-0068c57089" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx962e8da4d29c4c1dac5b7-0068c57089" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx962e8da4d29c4c1dac5b7-0068c57089" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx950656111cfa4e3f8ee39-0068c57089" "proxy-server 1824514" 0.0054 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx2fa3649defe54309876f1-0068c57089" "proxy-server 1824514" 0.0094 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx01c6ffb115944bd898152-0068c57089" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx01c6ffb115944bd898152-0068c57089" "proxy-server 1824514" 0.0009 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx99016c1c682f4402a552c-0068c57089" "proxy-server 1824514" 0.0053 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx0ec0827893404696bb775-0068c57089" "proxy-server 1824514" 0.0093 "-" 1824514 3 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 422 93 "-" "-" "-" 0.0008 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 400 25 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0015 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/p/a/c/o" 200 17 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0049 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0142 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/p/a/c/o" 200 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 24 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 26 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0127 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Relinking /tmp/tmp11dvyuwz/tmp_test_object_server_ObjectController/sda1/objects/389/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data to /tmp/tmp11dvyuwz/tmp_test_object_server_ObjectController/sda1/objects/778/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data due to next_part_power set test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/389/a/c/o" 201 - "-" "-" "-" 0.0068 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/778/a/c/o" 201 - "-" "txn1" "-" 0.0018 "-" 1824531 0 test-object-controller DEBUG: Relinking /tmp/tmpa6h904ei/tmp_test_object_server_ObjectController/sda1/objects/389/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data to /tmp/tmpa6h904ei/tmp_test_object_server_ObjectController/sda1/objects/778/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data due to next_part_power set (txn: txn2) test-object-controller ERROR: Relinking /tmp/tmpa6h904ei/tmp_test_object_server_ObjectController/sda1/objects/389/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data to /tmp/tmpa6h904ei/tmp_test_object_server_ObjectController/sda1/objects/778/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data failed: [Errno 17] File exists: '/tmp/tmpa6h904ei/tmp_test_object_server_ObjectController/sda1/objects/389/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data' -> '/tmp/tmpa6h904ei/tmp_test_object_server_ObjectController/sda1/objects/778/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1993, in _finalize_put relink_paths(target_path, new_target_path) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 539, in relink_paths raise err File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 515, in relink_paths os.link(target_path, new_target_path) ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ FileExistsError: [Errno 17] File exists: '/tmp/tmpa6h904ei/tmp_test_object_server_ObjectController/sda1/objects/389/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data' -> '/tmp/tmpa6h904ei/tmp_test_object_server_ObjectController/sda1/objects/778/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data' (txn: txn2) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/389/a/c/o" 201 - "-" "txn2" "-" 0.0038 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Relinking /tmp/tmp7smg8nuf/tmp_test_object_server_ObjectController/sda1/objects/389/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data to /tmp/tmp7smg8nuf/tmp_test_object_server_ObjectController/sda1/objects/778/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data due to next_part_power set test-object-controller DEBUG: Relinking /tmp/tmp7smg8nuf/tmp_test_object_server_ObjectController/sda1/objects/389/a43/615cd4810e0d969889af154f7b02ba43/1757769866.00000.data to /tmp/tmp7smg8nuf/tmp_test_object_server_ObjectController/sda1/objects/778/a43/615cd4810e0d969889af154f7b02ba43/1757769866.00000.data due to next_part_power set test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/389/a/c/o" 201 - "-" "-" "-" 0.0014 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/389/a/c/o" 201 - "-" "-" "-" 0.0032 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Relinking /tmp/tmpfdltctiw/tmp_test_object_server_ObjectController/sda1/objects/389/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data to /tmp/tmpfdltctiw/tmp_test_object_server_ObjectController/sda1/objects/778/a43/615cd4810e0d969889af154f7b02ba43/1757769865.00000.data due to next_part_power set test-object-controller DEBUG: Relinking /tmp/tmpfdltctiw/tmp_test_object_server_ObjectController/sda1/objects/389/a43/615cd4810e0d969889af154f7b02ba43/1757769866.00000.data to /tmp/tmpfdltctiw/tmp_test_object_server_ObjectController/sda1/objects/778/a43/615cd4810e0d969889af154f7b02ba43/1757769866.00000.data due to next_part_power set test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/389/a/c/o" 201 - "-" "-" "-" 0.0014 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/389/a/c/o" 201 - "-" "-" "-" 0.0031 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 411 30 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 15 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 26 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 400 26 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0005 "-" 1824531 -test.unit.obj.test_server.TestObjectController.test_PUT_old_timestamp test.unit.obj.test_server.TestObjectController.test_PUT_old_timestamp ... ok test.unit.obj.test_server.TestObjectController.test_PUT_overwrite test.unit.obj.test_server.TestObjectController.test_PUT_overwrite ... ok test.unit.obj.test_server.TestObjectController.test_PUT_overwrite_to_newer_ts_failed test.unit.obj.test_server.TestObjectController.test_PUT_overwrite_to_newer_ts_failed ... ok test.unit.obj.test_server.TestObjectController.test_PUT_overwrite_to_older_ts_success test.unit.obj.test_server.TestObjectController.test_PUT_overwrite_to_older_ts_success ... ok test.unit.obj.test_server.TestObjectController.test_PUT_overwrite_w_delete_at test.unit.obj.test_server.TestObjectController.test_PUT_overwrite_w_delete_at ... ok sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769970.00000, (0, 0) as of 1757769970.00000, sharded as of 1757769970.00000> to ShardRange<'k' to 't' as of 1757769971.00000, (0, 0) as of 1757769971.00000, sharding as of 1757769971.00000>, path: .shards_a/shard_c_1757769971.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/806/7199c93ccfddc75301c516ffe5745806/7199c93ccfddc75301c516ffe5745806.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769971.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/806/7199c93ccfddc75301c516ffe5745806/7199c93ccfddc75301c516ffe5745806.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769973.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b2f/4fc33dca908b12e11b52bb32e542ab2f/4fc33dca908b12e11b52bb32e542ab2f.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769973.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b2f/4fc33dca908b12e11b52bb32e542ab2f/4fc33dca908b12e11b52bb32e542ab2f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769975.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8f6/6b89862619852170b663c913582f98f6/6b89862619852170b663c913582f98f6.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769974.00000, (0, 0) as of 1757769974.00000, sharded as of 1757769974.00000> to ShardRange<'k' to 't' as of 1757769975.00000, (0, 0) as of 1757769975.00000, shrunk as of 1757769975.00000>, path: .shards_a/shard_c_1757769975.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8f6/6b89862619852170b663c913582f98f6/6b89862619852170b663c913582f98f6.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769975.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8f6/6b89862619852170b663c913582f98f6/6b89862619852170b663c913582f98f6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769977.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/3d8/2eb68ae9504b8297e9c879dd66fdb3d8/2eb68ae9504b8297e9c879dd66fdb3d8.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769976.00000, (0, 0) as of 1757769976.00000, shrunk as of 1757769976.00000> to ShardRange<'k' to 't' as of 1757769977.00000, (0, 0) as of 1757769977.00000, found as of 1757769977.00000>, path: .shards_a/shard_c_1757769977.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/3d8/2eb68ae9504b8297e9c879dd66fdb3d8/2eb68ae9504b8297e9c879dd66fdb3d8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769979.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/fbb/29a5937be533dad006377cfa32229fbb/29a5937be533dad006377cfa32229fbb.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769978.00000, (0, 0) as of 1757769978.00000, shrunk as of 1757769978.00000> to ShardRange<'k' to 't' as of 1757769979.00000, (0, 0) as of 1757769979.00000, created as of 1757769979.00000>, path: .shards_a/shard_c_1757769979.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/fbb/29a5937be533dad006377cfa32229fbb/29a5937be533dad006377cfa32229fbb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769981.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/96f/918274de5441d0ab35ddad801d48396f/918274de5441d0ab35ddad801d48396f.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769980.00000, (0, 0) as of 1757769980.00000, shrunk as of 1757769980.00000> to ShardRange<'k' to 't' as of 1757769981.00000, (0, 0) as of 1757769981.00000, cleaved as of 1757769981.00000>, path: .shards_a/shard_c_1757769981.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/96f/918274de5441d0ab35ddad801d48396f/918274de5441d0ab35ddad801d48396f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769983.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/193/02349bc76b94567efcb729049bf9d193/02349bc76b94567efcb729049bf9d193.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769982.00000, (0, 0) as of 1757769982.00000, shrunk as of 1757769982.00000> to ShardRange<'k' to 't' as of 1757769983.00000, (0, 0) as of 1757769983.00000, active as of 1757769983.00000>, path: .shards_a/shard_c_1757769983.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/193/02349bc76b94567efcb729049bf9d193/02349bc76b94567efcb729049bf9d193.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769985.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/48f/cc7e89ca95f0a0a33de14dcbff90748f/cc7e89ca95f0a0a33de14dcbff90748f.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769984.00000, (0, 0) as of 1757769984.00000, shrunk as of 1757769984.00000> to ShardRange<'k' to 't' as of 1757769985.00000, (0, 0) as of 1757769985.00000, shrinking as of 1757769985.00000>, path: .shards_a/shard_c_1757769985.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/48f/cc7e89ca95f0a0a33de14dcbff90748f/cc7e89ca95f0a0a33de14dcbff90748f.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769985.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/48f/cc7e89ca95f0a0a33de14dcbff90748f/cc7e89ca95f0a0a33de14dcbff90748f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769987.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/7f9/6ea77b52e91069e93e5f7accc57907f9/6ea77b52e91069e93e5f7accc57907f9.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769986.00000, (0, 0) as of 1757769986.00000, shrunk as of 1757769986.00000> to ShardRange<'k' to 't' as of 1757769987.00000, (0, 0) as of 1757769987.00000, sharding as of 1757769987.00000>, path: .shards_a/shard_c_1757769987.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/7f9/6ea77b52e91069e93e5f7accc57907f9/6ea77b52e91069e93e5f7accc57907f9.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769987.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/7f9/6ea77b52e91069e93e5f7accc57907f9/6ea77b52e91069e93e5f7accc57907f9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769989.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/e02/2ecb6bd53e7f7e8daa0d29fa7b25ae02/2ecb6bd53e7f7e8daa0d29fa7b25ae02.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769988.00000, (0, 0) as of 1757769988.00000, shrunk as of 1757769988.00000> to ShardRange<'k' to 't' as of 1757769989.00000, (0, 0) as of 1757769989.00000, sharded as of 1757769989.00000>, path: .shards_a/shard_c_1757769989.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/e02/2ecb6bd53e7f7e8daa0d29fa7b25ae02/2ecb6bd53e7f7e8daa0d29fa7b25ae02.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769989.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/e02/2ecb6bd53e7f7e8daa0d29fa7b25ae02/2ecb6bd53e7f7e8daa0d29fa7b25ae02.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769991.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/260/ce6ba856ee776d108fe6d1f81e25a260/ce6ba856ee776d108fe6d1f81e25a260.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769991.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/260/ce6ba856ee776d108fe6d1f81e25a260/ce6ba856ee776d108fe6d1f81e25a260.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769992.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/366/2ccd553b80b3c028fbe0a0d0f9992366/2ccd553b80b3c028fbe0a0d0f9992366.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769994.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8ae/96d45ef283be32e1a33351d57504b8ae/96d45ef283be32e1a33351d57504b8ae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769996.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/19c/3b20aea87ffe4ec5c710108213d2919c/3b20aea87ffe4ec5c710108213d2919c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769998.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/753/3026bf7107d8309d9feae2d6d4a46753/3026bf7107d8309d9feae2d6d4a46753.dbtest.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items_overwrite_unicode test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items_overwrite_unicode ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_marker_beyond_end_marker_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_marker_beyond_end_marker_memcache ... ok test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey20" 301 - "-" "-" "-" 0.0131 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey20_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey30" 301 - "-" "-" "-" 0.0191 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey30_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey40" 301 - "-" "-" "-" 0.0051 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey40_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey50" 204 - "-" "-" "-" 0.0052 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey50_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey60" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey60_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey70" 204 - "-" "-" "-" 0.0052 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey70_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey80" 204 - "-" "-" "-" 0.0052 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey80_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/bashful" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/dopey" 301 - "-" "-" "-" 0.0051 "-" 1824512 - test DEBUG: Unlinked retiring db '/tmp/tmpn97vno5x/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest10" 204 - "-" "-" "-" 0.0012 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest10_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest20" 301 - "-" "-" "-" 0.0051 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest20_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest30" 301 - "-" "-" "-" 0.0051 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest30_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest40" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest40_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest50" 204 - "-" "-" "-" 0.0052 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest50_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest60" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest60_no_header" 204 - "-" "-" "-" 0.0045 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest70" 204 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest70_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest80" 204 - "-" "-" "-" 0.0053 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c/grumpiest80_no_header" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0115 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "DELETE /sda1/p/a/c" 400 26 "-" "-" "-" 0.0001 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0076 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c" 406 - "-" "-" "-" 0.0055 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0074 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/obj_0" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/obj_1" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0066 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0062 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0058 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:25 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0101 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0024 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0024 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0069 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0109 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0065 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0022 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 126 "-" "-" "-" 0.0025 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 126 "-" "-" "-" 0.0068 "-" 1824512 0test.unit.container.test_server.TestContainerController.test_GET_auto_record_type test.unit.container.test_server.TestContainerController.test_GET_auto_record_type ... ok test.unit.container.test_server.TestContainerController.test_GET_delimiter test.unit.container.test_server.TestContainerController.test_GET_delimiter ... ok test.unit.container.test_server.TestContainerController.test_GET_delimiter_non_ascii test.unit.container.test_server.TestContainerController.test_GET_delimiter_non_ascii ... ok test.unit.container.test_server.TestContainerController.test_GET_delimiter_xml test.unit.container.test_server.TestContainerController.test_GET_delimiter_xml ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items_post_overwrite_out_of_order test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_items_post_overwrite_out_of_order ... ok test.unit.container.test_server.TestContainerController.test_GET_delimiter_xml_with_quotes test.unit.container.test_server.TestContainerController.test_GET_delimiter_xml_with_quotes ... ok test.unit.container.test_server.TestContainerController.test_GET_invalid_accept test.unit.container.test_server.TestContainerController.test_GET_invalid_accept ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/sdh1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx85e55c0028f943d183105-0068c57089" "object-server 1824509" 0.0005 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdb1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx85e55c0028f943d183105-0068c57089" "object-server 1824509" 0.0004 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdh1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx85e55c0028f943d183105-0068c57089" "proxy-server 1824509" 0.0377 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "PUT /sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 201 - "PUT http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx85e55c0028f943d183105-0068c57089" "proxy-server 1824509" 0.0399 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7d027f9a5f274771a4fdc-0068c57089" "proxy-server 1824509" 0.0014 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sdb1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 204 - "HEAD http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "tx6812107682f54810a492c-0068c57089" "proxy-server 1824509" 0.0031 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 200 82 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx5bf91179192743f8a1882-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 200 82 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "tx5bf91179192743f8a1882-0068c57089" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb4fb9475c31b441ca6df3-0068c57089" "proxy-server 1824509" 0.0013 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 204 - "HEAD http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "tx9f001c3f2e9a480aa4c41-0068c57089" "proxy-server 1824509" 0.0073 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 404 70 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txa1157d33ea884a3eb9483-0068c57089" "proxy-server 1824509" 0.0003 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 404 70 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txa1157d33ea884a3eb9483-0068c57089" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txa1157d33ea884a3eb9483-0068c57089) proxy DEBUG: Ignoring 404 from primary (txn: txa1157d33ea884a3eb9483-0068c57089) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 404 70 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txa1157d33ea884a3eb9483-0068c57089" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txa1157d33ea884a3eb9483-0068c57089) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txefd4be6e02dc413784c27-0068c57089" "proxy-server 1824509" 0.0012 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/0/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" 204 - "HEAD http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a" "txe8594b94420d4c2991dc6-0068c5708a" "proxy-server 1824509" 0.0031 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 200 82 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txefdf9ee93e8b496da0b8a-0068c5708a" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 200 82 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txefdf9ee93e8b496da0b8a-0068c5708a" "proxy-server 1824509" 0.0006 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdi1/2/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" 404 70 "GET http://localhost/v1/a/9fd0cd34b6ca47a4bd1e1ca77edae14a/3644e933b6bf49af8b0e6642ef6dffdf" "txefdf9ee93e8b496da0b8a-0068c5708a" "proxy-server 1824509" 0.0004 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txefdf9ee93e8b496da0b8a-0068c5708a) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx43f89641a7d642bc82fa3-0068c5708a" "proxy-server 1824509" 0.0053 "-" 1824509 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/0/a/af2bce6a16a54a95bff6cf5ab9a4908c" 201 - "PUT http://127.0.0.1:36297/sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" "tx43f89641a7d642bc82fa3-0068c5708a" "container-server 1824509" 0.0010 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdb1/0/a/af2bce6a16a54a95bff6cf5ab9a4908c" 201 - "PUT http://127.0.0.1:41753/sdb1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" "tx43f89641a7d642bc82fa3-0068c5708a" "container-server 1824509" 0.0010 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdb1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "tx43f89641a7d642bc82fa3-0068c5708a" "proxy-server 1824509" 0.0266 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "tx43f89641a7d642bc82fa3-0068c5708a" "proxy-server 1824509" 0.0189 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx24fa0d26afd5468fa5686-0068c5708a" "proxy-server 1824509" 0.0018 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 204 - "HEAD http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "txc53b1525ae1449b99c6ca-0068c5708a" "proxy-server 1824509" 0.0053 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdg1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txc4529850b6f44c22923cc-0068c5708a" "proxy-server 1824509" 0.0184 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/sdi1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txc4529850b6f44c22923cc-0068c5708a" "object-server 1824509" 0.0004 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdb1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txc4529850b6f44c22923cc-0068c5708a" "object-server 1824509" 0.0005 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdi1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txc4529850b6f44c22923cc-0068c5708a" "proxy-server 1824509" 0.0373 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx77a4613656554873b0686-0068c57089" "proxy-server 1824514" 0.0049 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx77a4613656554873b0686-0068c57089" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc3eec7baed8a46ccb0e51-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:25 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx5d7dc38d7c3143898bf56-0068c57089" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txd2c030cdd985498baec12-0068c5708a" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txd2c030cdd985498baec12-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx7642ea9bee834761b04a2-0068c5708a" "proxy-server 1824514" 0.0094 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx6c4421f64f1643c3b8054-0068c5708a" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx4c63c513d9e44600b32cb-0068c5708a" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx4c63c513d9e44600b32cb-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx4c63c513d9e44600b32cb-0068c5708a) proxy DEBUG: Ignoring 412 from primary (txn: tx4c63c513d9e44600b32cb-0068c5708a) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx4c63c513d9e44600b32cb-0068c5708a" "proxy-server 1824514" 0.0008 "-" 1824514 3 proxy DEBUG: Ignoring 412 from primary (txn: tx4c63c513d9e44600b32cb-0068c5708a) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx947ade53c923480ca0776-0068c5708a" "proxy-server 1824514" 0.0055 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx1c729efe619b408c9bb74-0068c5708a" "proxy-server 1824514" 0.0054 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx14378d950af64db6bf784-0068c5708a" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx14378d950af64db6bf784-0068c5708a" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx14378d950af64db6bf784-0068c5708a" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx4e55a575d66d47b8b90d8-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx77e2662be3454134bdedc-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx8e07b41d64884532889cc-0068c5708a" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx8e07b41d64884532889cc-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx8e07b41d64884532889cc-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txc6afe625c44a498b9f7cd-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx4a6aafa617724c478d28b-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txb2645e72dccb495db58bc-0068c5708a" "proxy-server 1824514" 0.0008 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txb2645e72dccb495db58bc-0068c5708a" "proxy-server 1824514" 0.0008 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx02300fb6fec74c57bd8dd-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx078ddc760e9e460690b43-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx8bc9870f413d486488739-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txee4c0eafb46e46e89fac0-0068c5708a" "proxy-server 1824514" 0.0013 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx5632fb95a2484f678f2af-0068c5708a" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx8282d2f1560b4cfab3906-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb0228678545f440cbb27a-0068c5708a" "proxy-server 1824514" 0.0069 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx65ebcc3c8d7a4df085c80-0068c5708a" "proxy-server 1824514" 0.0054 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txaf5a9e2a13f840be8c42f-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3test.unit.container.test_server.TestContainerController.test_GET_json test.unit.container.test_server.TestContainerController.test_GET_json ... ok test.unit.container.test_server.TestContainerController.test_GET_json_last_modified test.unit.container.test_server.TestContainerController.test_GET_json_last_modified ... ok test.unit.container.test_server.TestContainerController.test_GET_leading_delimiter test.unit.container.test_server.TestContainerController.test_GET_leading_delimiter ... ok test.unit.container.test_server.TestContainerController.test_GET_limit test.unit.container.test_server.TestContainerController.test_GET_limit ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_empty test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_empty ... ok test.unit.container.test_server.TestContainerController.test_GET_log_requests_false test.unit.container.test_server.TestContainerController.test_GET_log_requests_false ... ok test DEBUG: Unlinked retiring db '/tmp/tmplb37acni/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 648 "-" "-" "-" 0.0101 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0146 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0024 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0075 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-TX-A" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-TX-B" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-OK-A" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-OK-B" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-UT-A" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 66 "-" "-" "-" 0.0106 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/a/%E2%9D%A5/1" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/a/%E2%9D%A5/2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/a/%EA%99%AE/1" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/a/%EA%99%AE/2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 50 "-" "-" "-" 0.0031 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 14 "-" "-" "-" 0.0020 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-TX-A" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-TX-B" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-OK-A" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-OK-B" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-UT-A" 201 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 221 "-" "-" "-" 0.0032 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0043 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/%3C%27sub%27%20%22dir%22%3E/object" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 159 "-" "-" "-" 0.0030 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 400 21 "-" "-" "-" 0.0002 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc" 201 - "-" "-" "-" 0.0117 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/jsonc" 200 2 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc/0" 201 - "-" "-" "-" 0.0045 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc/1" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc/2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0086 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0087 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0012 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0012 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/jsonc" 200 351 "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/p/a/jsonc" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc/0" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc/1" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/jsonc" 200 234 "-" "-" "-" 0.0032 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-TX-A" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US-TX-B" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/-UK" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/-CH" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 36 "-" "-" "-" 0.0031 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0043 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/0" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/1" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 4 "-" "-" "-" 0.0030 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0004 "-" 1824512 0test.unit.container.test_server.TestContainerController.test_GET_log_requests_true test.unit.container.test_server.TestContainerController.test_GET_log_requests_true ... ok test.unit.container.test_server.TestContainerController.test_GET_marker test.unit.container.test_server.TestContainerController.test_GET_marker ... ok test.unit.container.test_server.TestContainerController.test_GET_multichar_delimiter test.unit.container.test_server.TestContainerController.test_GET_multichar_delimiter ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_is_deleted ... ok test.unit.container.test_server.TestContainerController.test_GET_namespaces_errors test.unit.container.test_server.TestContainerController.test_GET_namespaces_errors ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_is_old_enough_to_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_is_old_enough_to_reclaim ... ok test.unit.container.test_server.TestContainerController.test_GET_namespaces_not_supported test.unit.container.test_server.TestContainerController.test_GET_namespaces_not_supported ... ok test DEBUG: GET listing from 1 shards for: /v1/a/c?marker=%E2%98%8A&end_marker=%E2%98%86&limit=2&reverse=true&format=json&states=listing (txn: tx37b4b47f39c3449ab78fe-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx37b4b47f39c3449ab78fe-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%8A&end_marker=%E2%98%86&limit=2&reverse=true&format=json {'X-Backend-Record-Type': 'auto'} (txn: tx37b4b47f39c3449ab78fe-0068c57081) test DEBUG: Found 4 objects in shard (state=unsharded), total = 4 (txn: tx37b4b47f39c3449ab78fe-0068c57081) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='lemon', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Found 1020 objects in shard (state=unsharded), total = 1068 (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: Setting object count to 1068 (txn: txa9987e4fee9640adb92eb-0068c57084) test DEBUG: GET listing from 3 shards for: /v1/a/c?reverse=true&format=json&states=listing (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='lemon', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Get listing from /v1/.shards_a/c_?reverse=true&format=json&limit=10000&marker=&end_marker=lemon {'X-Backend-Record-Type': 'auto'} (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1024 (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Get listing from /v1/.shards_a/c_pie?reverse=true&format=json&limit=8976&marker=m&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Found 44 objects in shard (state=unsharded), total = 1068 (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Get listing from /v1/.shards_a/c_ham?reverse=true&format=json&limit=8932&marker=A&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Found 0 objects in shard (state=unsharded), total = 1068 (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Setting object count to 1068 (txn: txfd39cc440f804290b5ddc-0068c57084) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx42d4e6407e744bbc9549b-0068c57087) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx42d4e6407e744bbc9549b-0068c57087) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx42d4e6407e744bbc9549b-0068c57087) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx42d4e6407e744bbc9549b-0068c57087) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx42d4e6407e744bbc9549b-0068c57087) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx42d4e6407e744bbc9549b-0068c57087) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing: 404 (txn: tx42d4e6407e744bbc9549b-0068c57087) test ERROR: Aborting listing from shards due to bad response: [200, 404] (txn: tx42d4e6407e744bbc9549b-0068c57087) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txf96078d81cfc4ae5925c4-0068c5708a) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txf96078d81cfc4ae5925c4-0068c5708a) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txf96078d81cfc4ae5925c4-0068c5708a) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txf96078d81cfc4ae5925c4-0068c5708a) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txf96078d81cfc4ae5925c4-0068c5708a) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txf96078d81cfc4ae5925c4-0068c5708a) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.1:1001/sdb (txn: txf96078d81cfc4ae5925c4-0068c5708a) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.2:1002/sdc (txn: txf96078d81cfc4ae5925c4-0068c5708a) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.0:1000/sda (txn: txf96078d81cfc4ae5925c4-0068c5708a) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.3:1003/sda (txn: txf96078d81cfc4ae5925c4-0068c5708a) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.4:1004/sda (txn: txf96078d81cfc4ae5925c4-0068c5708a) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.5:1005/sda (txn: txf96078d81cfc4ae5925c4-0068c5708a) test ERROR: Container GET returning 503 for [500, 500, 500, 500, 500, 500] (txn: txf96078d81cfc4ae5925c4-0068c5708a) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing: 503 (txn: txf96078d81cfc4ae5925c4-0068c5708a)test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_shard_errors_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_shard_errors_no_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_shard_range_single_record test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_shard_range_single_record ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txc4529850b6f44c22923cc-0068c5708a" "proxy-server 1824509" 0.0371 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx644483517f3b4eb3804b6-0068c5708a" "proxy-server 1824509" 0.0078 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 204 - "HEAD http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "tx39b4b9fd3b594c8982582-0068c5708a" "proxy-server 1824509" 0.0076 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 200 82 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txa35d0a221e6544daadfa2-0068c5708a" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 200 82 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txa35d0a221e6544daadfa2-0068c5708a" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd9be6df5a15f487d9c9ae-0068c5708a" "proxy-server 1824509" 0.0054 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 204 - "HEAD http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "txddba04a5c5ed4594a064e-0068c5708a" "proxy-server 1824509" 0.0054 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txe49c479e88f34d038c352-0068c5708a" "proxy-server 1824509" 0.0225 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdb1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/sdg1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txe49c479e88f34d038c352-0068c5708a" "object-server 1824509" 0.0046 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/sdi1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txe49c479e88f34d038c352-0068c5708a" "object-server 1824509" 0.0004 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdg1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txe49c479e88f34d038c352-0068c5708a" "proxy-server 1824509" 0.0321 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdi1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txe49c479e88f34d038c352-0068c5708a" "proxy-server 1824509" 0.0335 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4f6497b8814143ceaac67-0068c5708a" "proxy-server 1824509" 0.0012 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 204 - "HEAD http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "txba7514b1f3e948ef9c6b8-0068c5708a" "proxy-server 1824509" 0.0068 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 200 82 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txb194098da5724f5bb2d7d-0068c5708a" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 200 82 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txb194098da5724f5bb2d7d-0068c5708a" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1b42a2d40a124fefa4058-0068c5708a" "proxy-server 1824509" 0.0054 "-" 1824509 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 204 - "HEAD http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "tx56a6387676744f429a555-0068c5708a" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdg1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txff6ee61805c8427ea91a5-0068c5708a" "proxy-server 1824509" 0.0306 "-" 1824509 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/sdi1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txff6ee61805c8427ea91a5-0068c5708a" "object-server 1824509" 0.0005 "-" 1824509 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdb1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txff6ee61805c8427ea91a5-0068c5708a" "object-server 1824509" 0.0004 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdi1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txff6ee61805c8427ea91a5-0068c5708a" "proxy-server 1824509" 0.0368 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "PUT /sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 201 - "PUT http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txff6ee61805c8427ea91a5-0068c5708a" "proxy-server 1824509" 0.0366 "-" 1824509 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc8dc6336547b4fc38271d-0068c5708a" "proxy-server 1824509" 0.0014 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 204 - "HEAD http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "tx4e3b159a075d494bab9e9-0068c5708a" "proxy-server 1824509" 0.0065 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 200 82 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "tx6905bafdb94e454380f09-0068c5708a" "proxy-server 1824509" 0.0008 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 200 82 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "tx6905bafdb94e454380f09-0068c5708a" "proxy-server 1824509" 0.0007 "-" 1824509 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0cf18d4c64e94d299bf60-0068c5708a" "proxy-server 1824509" 0.0022 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 204 - "HEAD http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "txdd2686e64b614f6bafce8-0068c5708a" "proxy-server 1824509" 0.0013 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdi1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 404 70 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txbf2b683af1f44a348b4bc-0068c5708a" "proxy-server 1824509" 0.0003 "-" 1824509 3test.unit.proxy.test_server.TestECGets.test_GET_with_same_frag_index_on_multiple_nodes test.unit.proxy.test_server.TestECGets.test_GET_with_same_frag_index_on_multiple_nodes ... ok test.unit.container.test_server.TestContainerController.test_GET_namespaces_other_params test.unit.container.test_server.TestContainerController.test_GET_namespaces_other_params ... ok test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_without_crypto_read_with_crypto_ec test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_write_without_crypto_read_with_crypto_ec ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_is_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_is_reclaimable ... ok test.unit.container.test_server.TestContainerController.test_GET_namespaces_sharded_subshard_state_listing test.unit.container.test_server.TestContainerController.test_GET_namespaces_sharded_subshard_state_listing ... ok test.unit.common.middleware.s3api.test_acl_handlers.TestAclHandlers.test_get_acl_handler test.unit.common.middleware.s3api.test_acl_handlers.TestAclHandlers.test_get_acl_handler ... ok test.unit.common.middleware.s3api.test_acl_handlers.TestAclHandlers.test_handle_acl test.unit.common.middleware.s3api.test_acl_handlers.TestAclHandlers.test_handle_acl ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_GET_last_version test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_GET_last_version ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_last_modified_time test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_last_modified_time ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_GET_last_version_part_num test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_GET_last_version_part_num ... ok test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0074 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/0" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/1" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0078 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0059 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0075 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US~~TX~~A" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US~~TX~~B" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US~~OK~~A" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US~~OK~~B" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US~~OK~Tulsa~~A" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US~~OK~Tulsa~~B" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US~~UT~~A" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US~~UT~~~B" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 102 "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 102 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 24 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 24 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 150 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 150 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 251 "-" "-" "-" 0.0069 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 251 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 126 "-" "-" "-" 0.0022 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0053 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0013 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 400 9 "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 507 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0023 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0139 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0013 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0054 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0135 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 400 36 "-" "-" "-" 0.0035 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 400 35 "-" "-" "-" 0.0010 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0013 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0013 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0013 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 192 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 192 "-" "-" "-" 0.0060 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 202 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 202 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 63 "-" "-" "-" 0.0013 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 63 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 323 "-" "-" "-" 0.0014 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0022 "-" 1824512 0 test DEBUG: Unlinked retiring db '/tmp/tmp2lmvxa3y/tmp_test_container_server_ContainerController/sda1/containers/p/61c/b6a56f59d3a8b4d57e122a32d715b61c/b6a56f59d3a8b4d57e122a32d715b61c.db' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 285 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 1672 "-" "-" "-" 0.0027 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0021 "-" 1824512 0 test DEBUG: Unlinked retiring db '/tmp/tmph8bf3vbn/tmp_test_container_server_ContainerController/sda1/containers/p/61c/b6a56f59d3a8b4d57e122a32d715b61c/b6a56f59d3a8b4d57e122a32d715b61c.db' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 285 "-" "-" "-" 0.0030 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 1672 "-" "-" "-" 0.0020 "-" 1824512 0test.unit.container.test_server.TestContainerController.test_GET_namespaces_sharded_subshard_state_updating test.unit.container.test_server.TestContainerController.test_GET_namespaces_sharded_subshard_state_updating ... ok test.unit.container.test_server.TestContainerController.test_GET_namespaces_unsharded_root_state_listing test.unit.container.test_server.TestContainerController.test_GET_namespaces_unsharded_root_state_listing ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_GET_version test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_GET_version ... ok test.unit.container.test_server.TestContainerController.test_GET_namespaces_unsharded_root_state_updating test.unit.container.test_server.TestContainerController.test_GET_namespaces_unsharded_root_state_updating ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_GET_version_part_num test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_GET_version_part_num ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_legacy_pending_files test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_legacy_pending_files ... ok test.unit.container.test_server.TestContainerController.test_GET_namespaces_unsharded_subshard_state_listing test.unit.container.test_server.TestContainerController.test_GET_namespaces_unsharded_subshard_state_listing ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_HEAD_last_version test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_HEAD_last_version ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770000.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/030/9f9d9a4402d2087bcb85c6dde6987030/9f9d9a4402d2087bcb85c6dde6987030.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770002.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/12c/cab9aad1fb93ad2b60bb00b87665412c/cab9aad1fb93ad2b60bb00b87665412c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770004.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ee5/edacc2f29f93f5f9a49e9ac919b6bee5/edacc2f29f93f5f9a49e9ac919b6bee5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770006.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/178/53faf6b8f3cd4bb1aaca63bcc77e4178/53faf6b8f3cd4bb1aaca63bcc77e4178.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770008.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/3a3/469edde635f0aeb5001b66826d4ff3a3/469edde635f0aeb5001b66826d4ff3a3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770010.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/144/72524d79efe3281e32a881e4fbf15144/72524d79efe3281e32a881e4fbf15144.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770012.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/e0e/b94b3e3a73713a851267ccec21895e0e/b94b3e3a73713a851267ccec21895e0e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770014.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/61b/18124be94268e50e1d3ca9c8294b661b/18124be94268e50e1d3ca9c8294b661b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770016.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/6b8/a9b1d8db31f3a3915734521a66c836b8/a9b1d8db31f3a3915734521a66c836b8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770018.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/dad/290095d6215545c9267509d74adbedad/290095d6215545c9267509d74adbedad.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770020.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/df3/8e40a487530e2eafce8be27a1eb3ddf3/8e40a487530e2eafce8be27a1eb3ddf3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770022.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/405/a8473bc9beb692a63248ad788ec81405/a8473bc9beb692a63248ad788ec81405.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770024.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/690/f06bc96d6b335668546729f04962f690/f06bc96d6b335668546729f04962f690.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770026.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/922/557f1d1694723b5a232ff883c84f3922/557f1d1694723b5a232ff883c84f3922.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770028.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/cc0/e46754d75003021046cd313bf847acc0/e46754d75003021046cd313bf847acc0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770030.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b50/bcf2ceff0406b0b6241146f1e38f1b50/bcf2ceff0406b0b6241146f1e38f1b50.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770032.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/370/5c14e7af1dd0bf19c2794326df018370/5c14e7af1dd0bf19c2794326df018370.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770034.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/c68/fffc86fcd89740f0977ba82660b8bc68/fffc86fcd89740f0977ba82660b8bc68.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770036.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/58b/4979c91969c180a1fd5590afdc7e758b/4979c91969c180a1fd5590afdc7e758b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770038.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/7d4/32bda3c620aef1a35edafa59390e27d4/32bda3c620aef1a35edafa59390e27d4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770040.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/400/b446dbb10e8b362542824c9087a26400/b446dbb10e8b362542824c9087a26400.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770042.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/af0/f6cd7c1ceeaa4fc306060f78f866daf0/f6cd7c1ceeaa4fc306060f78f866daf0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770044.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/48c/2abdf695962730b97b47c96feb5db48c/2abdf695962730b97b47c96feb5db48c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770046.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/cfd/d1cc2e53ee1fbf4f7d721b6f83653cfd/d1cc2e53ee1fbf4f7d721b6f83653cfd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770048.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b09/d5c8be75b55be4aef442e12175bbab09/d5c8be75b55be4aef442e12175bbab09.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770050.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/c23/06999da89cf056210dc67079982d5c23/06999da89cf056210dc67079982d5c23.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770052.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/e64/b92739c4d4ac61dbd2bcadb05e912e64/b92739c4d4ac61dbd2bcadb05e912e64.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770054.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f9c/23754b899af243ca96ec1c2e6303ff9c/23754b899af243ca96ec1c2e6303ff9c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770056.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8a3/9496a3039328c2ae02d71b2e44a058a3/9496a3039328c2ae02d71b2e44a058a3.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770056.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8a3/9496a3039328c2ae02d71b2e44a058a3/9496a3039328c2ae02d71b2e44a058a3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770058.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b71/629275bf537e214c07eac19b09166b71/629275bf537e214c07eac19b09166b71.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770058.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/b71/629275bf537e214c07eac19b09166b71/629275bf537e214c07eac19b09166b71.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770060.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/afa/1a3c5cb0f84dd07153c9d2f50d99fafa/1a3c5cb0f84dd07153c9d2f50d99fafa.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770060.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/afa/1a3c5cb0f84dd07153c9d2f50d99fafa/1a3c5cb0f84dd07153c9d2f50d99fafa.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770062.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/87d/08ab99a1679fb11f2203f1b486aa487d/08ab99a1679fb11f2203f1b486aa487d.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770062.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/87d/08ab99a1679fb11f2203f1b486aa487d/08ab99a1679fb11f2203f1b486aa487d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770064.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/432/506797ab0d49f11bb0fc1f65963f4432/506797ab0d49f11bb0fc1f65963f4432.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770064.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/432/506797ab0d49f11bb0fc1f65963f4432/506797ab0d49f11bb0fc1f65963f4432.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770066.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/c38/cab07a7980f0e6e235f7d9faa2233c38/cab07a7980f0e6e235f7d9faa2233c38.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770066.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/c38/cab07a7980f0e6e235f7d9faa2233c38/cab07a7980f0e6e235f7d9faa2233c38.dbtest.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_HEAD_last_version_part_num test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_HEAD_last_version_part_num ... ok test.unit.container.test_server.TestContainerController.test_GET_namespaces_unsharded_subshard_state_updating test.unit.container.test_server.TestContainerController.test_GET_namespaces_unsharded_subshard_state_updating ... ok test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_HEAD_version test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_HEAD_version ... ok test.unit.container.test_server.TestContainerController.test_GET_non_ascii test.unit.container.test_server.TestContainerController.test_GET_non_ascii ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txaf5a9e2a13f840be8c42f-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txaf5a9e2a13f840be8c42f-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx694b2c3c1b04405daf034-0068c5708a" "proxy-server 1824514" 0.0078 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx23627b87b6324315b91d0-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txcd73e1230a4b45ebbeedc-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx866c67d7ccd24606a46ef-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "txc99e62d5cb3646229c437-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txcb1e0c6841644fb4945f1-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx48136eaab33e4accb48e4-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx874d5cc26e2e4d62bc556-0068c5708a" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx16fd6f4db95b49b1b2140-0068c5708a" "proxy-server 1824514" 0.0088 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx8905760c4f294e5a94b6c-0068c5708a" "proxy-server 1824514" 0.0054 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx9cbacd194a624d50a2c6c-0068c5708a" "proxy-server 1824514" 0.0093 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx45b38bb1b1e74bfbb0b88-0068c5708a" "proxy-server 1824514" 0.0033 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb011fbbd7a3b44b68359c-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx53ad05bc1d814339b1c17-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "txb4e401dd7135419bb52a9-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txa6e0a0561d3746fe95fca-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx81c7d22583e04c2c99473-0068c5708a" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdg1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx563123d7222a4604b9796-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx563123d7222a4604b9796-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 412 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx563123d7222a4604b9796-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx9909dbeeb3534827b63bc-0068c5708a" "proxy-server 1824514" 0.0014 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdb1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "txdb0c7e668cd54029aeed7-0068c5708a" "proxy-server 1824514" 0.0014 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdh1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx4857418a8ab04eddbc73a-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "tx81270f268e3944adb3497-0068c5708a" "proxy-server 1824514" 0.0093 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx09b430337e3841f7b44d9-0068c5708a" "proxy-server 1824514" 0.0013 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 304 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx65277a86aba94680b918d-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txd4affcce1c30483c8bc82-0068c5708a" "proxy-server 1824514" 0.0012 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 204 - "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c" "tx06fbbbefd7d64fc790676-0068c5708a" "proxy-server 1824514" 0.0054 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sdi1/2/a/bd2ed06c2d8848318db977405770d75c/o" 200 92 "HEAD http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c/o" "tx459249930a0746b89af1e-0068c5708a" "proxy-server 1824514" 0.0007 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://foo:8080/v1/a?format=json" "txb56a0d1f56ac4da99ab5b-0068c5708a" "proxy-server 1824514" 0.0094 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/2/a/bd2ed06c2d8848318db977405770d75c" 200 155 "GET http://foo:8080/v1/a/bd2ed06c2d8848318db977405770d75c?format=json&states=listing" "txb56a0d1f56ac4da99ab5b-0068c5708a" "proxy-server 1824514" 0.0048 "-" 1824514 3 fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middlewaretest.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_HEAD_version_part_num test.unit.common.middleware.s3api.test_multi_get.TestVersionedMpuGETorHEAD.test_mpu_HEAD_version_part_num ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_access_user_id_logging test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_access_user_id_logging ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_bad_format_authorization test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_bad_format_authorization ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_bad_method test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_bad_method ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_bad_method_but_method_exists_in_controller test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_bad_method_but_method_exists_in_controller ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_bucket_virtual_hosted_style test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_bucket_virtual_hosted_style ... ok test.unit.container.test_server.TestContainerController.test_GET_objects_of_different_policies test.unit.container.test_server.TestContainerController.test_GET_objects_of_different_policies ... ok test.unit.container.test_server.TestContainerController.test_GET_over_limit test.unit.container.test_server.TestContainerController.test_GET_over_limit ... ok test.unit.container.test_server.TestContainerController.test_GET_path test.unit.container.test_server.TestContainerController.test_GET_path ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_canonical_string_v2 test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_canonical_string_v2 ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_canonical_string_v4 test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_canonical_string_v4 ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_check_pipeline test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_check_pipeline ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770068.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/a68/1b56c88cae07d689c4ee5c01b6f76a68/1b56c88cae07d689c4ee5c01b6f76a68.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770068.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/a68/1b56c88cae07d689c4ee5c01b6f76a68/1b56c88cae07d689c4ee5c01b6f76a68.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770070.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/573/c22d33b03313f95efb4c3d81f28b4573/c22d33b03313f95efb4c3d81f28b4573.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770070.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/573/c22d33b03313f95efb4c3d81f28b4573/c22d33b03313f95efb4c3d81f28b4573.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770072.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ff0/ba3d83dafe7d4b4c5bbfc6c8d6cbeff0/ba3d83dafe7d4b4c5bbfc6c8d6cbeff0.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770072.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ff0/ba3d83dafe7d4b4c5bbfc6c8d6cbeff0/ba3d83dafe7d4b4c5bbfc6c8d6cbeff0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770074.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f57/62bf4fa826d239b3edd69dad639c9f57/62bf4fa826d239b3edd69dad639c9f57.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770074.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/f57/62bf4fa826d239b3edd69dad639c9f57/62bf4fa826d239b3edd69dad639c9f57.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770076.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8ec/a5f321ae5cf1c4feab98d2b50cc568ec/a5f321ae5cf1c4feab98d2b50cc568ec.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770076.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8ec/a5f321ae5cf1c4feab98d2b50cc568ec/a5f321ae5cf1c4feab98d2b50cc568ec.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770078.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/dd4/656a58509af1b0f777e5b53184915dd4/656a58509af1b0f777e5b53184915dd4.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770078.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/dd4/656a58509af1b0f777e5b53184915dd4/656a58509af1b0f777e5b53184915dd4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770080.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/83c/a18c46b3bb4598e19085256dd902b83c/a18c46b3bb4598e19085256dd902b83c.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770080.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/83c/a18c46b3bb4598e19085256dd902b83c/a18c46b3bb4598e19085256dd902b83c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770082.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/1fc/519ab3e36f88d01e724fb561b8eb51fc/519ab3e36f88d01e724fb561b8eb51fc.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770082.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/1fc/519ab3e36f88d01e724fb561b8eb51fc/519ab3e36f88d01e724fb561b8eb51fc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770084.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/cb2/3b773fd64d693463068ea0805bb2dcb2/3b773fd64d693463068ea0805bb2dcb2.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770084.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/cb2/3b773fd64d693463068ea0805bb2dcb2/3b773fd64d693463068ea0805bb2dcb2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770086.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/337/f78ff13f7541c07b6ce4b976fdd53337/f78ff13f7541c07b6ce4b976fdd53337.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770086.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/337/f78ff13f7541c07b6ce4b976fdd53337/f78ff13f7541c07b6ce4b976fdd53337.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770088.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/a90/48bb5f5379c17646a148aa2005877a90/48bb5f5379c17646a148aa2005877a90.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770088.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/a90/48bb5f5379c17646a148aa2005877a90/48bb5f5379c17646a148aa2005877a90.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770090.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8fa/57168db851cd5cea0df237301dd408fa/57168db851cd5cea0df237301dd408fa.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770090.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/8fa/57168db851cd5cea0df237301dd408fa/57168db851cd5cea0df237301dd408fa.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770092.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/34c/e40110c572ab9ecda6ddd1ac63a9834c/e40110c572ab9ecda6ddd1ac63a9834c.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770092.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/34c/e40110c572ab9ecda6ddd1ac63a9834c/e40110c572ab9ecda6ddd1ac63a9834c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770094.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/900/57d5e34d5bcd7313b9606ae8ede83900/57d5e34d5bcd7313b9606ae8ede83900.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770094.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/900/57d5e34d5bcd7313b9606ae8ede83900/57d5e34d5bcd7313b9606ae8ede83900.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770096.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/9ae/d87365f50b2b6b352c9e567dcd2279ae/d87365f50b2b6b352c9e567dcd2279ae.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770096.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/9ae/d87365f50b2b6b352c9e567dcd2279ae/d87365f50b2b6b352c9e567dcd2279ae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770098.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/468/0f3c1c3ffd1f6e232b08fb01aabdc468/0f3c1c3ffd1f6e232b08fb01aabdc468.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770098.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/468/0f3c1c3ffd1f6e232b08fb01aabdc468/0f3c1c3ffd1f6e232b08fb01aabdc468.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770100.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/c0d/7d3ce109b68ae112e0900499311cec0d/7d3ce109b68ae112e0900499311cec0d.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770100.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/c0d/7d3ce109b68ae112e0900499311cec0d/7d3ce109b68ae112e0900499311cec0d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770102.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ecb/25569328a6b79e33bf4151d852000ecb/25569328a6b79e33bf4151d852000ecb.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770102.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/ecb/25569328a6b79e33bf4151d852000ecb/25569328a6b79e33bf4151d852000ecb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770104.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/aad/f384c412c199d98c8821ed0fe298eaad/f384c412c199d98c8821ed0fe298eaad.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770104.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/aad/f384c412c199d98c8821ed0fe298eaad/f384c412c199d98c8821ed0fe298eaad.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770106.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d45/cc61b0b9dc88725c0d37418947dc4d45/cc61b0b9dc88725c0d37418947dc4d45.dbtest.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_cors test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_cors ... ok test.unit.container.test_sharder.TestSharder.test_audit_old_style_shard_container_merge_other_ranges test.unit.container.test_sharder.TestSharder.test_audit_old_style_shard_container_merge_other_ranges ... ok test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0075 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 277 "-" "-" "-" 0.0061 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0098 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0017 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 277 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0019 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0022 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 285 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0034 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 285 "-" "-" "-" 0.0023 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0026 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc" 201 - "-" "-" "-" 0.0042 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc/Sp%C3%A4tzle" 201 - "-" "-" "-" 0.0014 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/jsonc/%E3%83%A9%E3%83%BC%E3%83%A1%E3%83%B3" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/jsonc" 200 268 "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/jsonc" 200 22 "-" "-" "-" 0.0019 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0099 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_0" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_1" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_3" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_4" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_5" 201 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_6" 201 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_7" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_8" 201 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_9" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_default_10" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_0" 201 - "-" "-" "-" 0.0004 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_1" 201 - "-" "-" "-" 0.0003 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_2" 201 - "-" "-" "-" 0.0003 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_3" 201 - "-" "-" "-" 0.0003 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_4" 201 - "-" "-" "-" 0.0003 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_5" 201 - "-" "-" "-" 0.0003 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_6" 201 - "-" "-" "-" 0.0003 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_7" 201 - "-" "-" "-" 0.0004 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_8" 201 - "-" "-" "-" 0.0003 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/obj_1_9" 201 - "-" "-" "-" 0.0003 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 155 "-" "-" "-" 0.0089 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 155 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 80 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0048 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 400 40 "-" "-" "-" 0.0009 "-" 1824512 3 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 412 22 "-" "-" "-" 0.0002 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US/TX" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US/TX/B" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US/OK" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US/OK/B" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/US/UT/A" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 242 "-" "-" "-" 0.0033 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/plainc" 201 - "-" "-" "-" 0.0044 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/plainc/0" 201 - "-" "-" "-" 0.0004 "-" 1824512 -test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_error_response_reason_logging test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_error_response_reason_logging ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_init_config test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_init_config ... ok test.unit.container.test_server.TestContainerController.test_GET_plain test.unit.container.test_server.TestContainerController.test_GET_plain ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_init_logger test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_init_logger ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_init_logs_checksum_implementation test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_init_logs_checksum_implementation ... ok test.unit.container.test_server.TestContainerController.test_GET_prefix test.unit.container.test_server.TestContainerController.test_GET_prefix ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_init_passes_wsgi_conf_file_to_check_pipeline test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_init_passes_wsgi_conf_file_to_check_pipeline ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_invalid_metadata_directive test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_invalid_metadata_directive ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_invalid_ssc test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_invalid_ssc ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_invalid_storage_class test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_invalid_storage_class ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: txe2ee86058d304e36ba8b7-0068c57089) test ERROR: ERROR 504 b'' Trying to HEAD /some_account/some_container From Container Server 10.0.0.2:1002/sdc (txn: txc7bc0750e2ba4084930ae-0068c57089) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/some_account: Network unreachable (txn: tx26e957e40d2a4739a4d87-0068c57089) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/some_account: Network unreachable (txn: tx26e957e40d2a4739a4d87-0068c57089) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/some_account: Network unreachable (txn: tx26e957e40d2a4739a4d87-0068c57089) test ERROR: Account HEAD returning 503 for [] (txn: tx26e957e40d2a4739a4d87-0068c57089) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.1:1001/sdb (txn: tx56f9407aca034680be3b7-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: tx56f9407aca034680be3b7-0068c57089) test ERROR: Account HEAD returning 503 for [503, 503] (txn: tx56f9407aca034680be3b7-0068c57089) test ERROR: ERROR 504 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: txf0d0a8067d9847bf95448-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: txf0d0a8067d9847bf95448-0068c57089) test ERROR: Account HEAD returning 503 for [504, 503] (txn: txf0d0a8067d9847bf95448-0068c57089) test ERROR: Node will be error limited for 60.00s: 10.0.0.1:1001/sdb, error: ERROR Insufficient Storage (txn: tx466cd29d996440cb80cca-0068c57089) test DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx466cd29d996440cb80cca-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: tx466cd29d996440cb80cca-0068c57089) test ERROR: Account HEAD returning 503 for [507, 503] (txn: tx466cd29d996440cb80cca-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.0:1000/sda (txn: tx1f191e0d318648cfafb62-0068c57089) test DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx1f191e0d318648cfafb62-0068c57089) test ERROR: ERROR 503 b'' Trying to HEAD /some_account From Account Server 10.0.0.2:1002/sdc (txn: tx1f191e0d318648cfafb62-0068c57089) test ERROR: Account HEAD returning 503 for [503, 503] (txn: tx1f191e0d318648cfafb62-0068c57089) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Base server 10.0.0.0:1000/sda re: Trying to POST /: Timeout (Nones) (txn: tx89e5b9e729574339bb8fa-0068c57089) test ERROR: ERROR with Base server 10.0.0.1:1001/sdb re: Trying to POST /: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx89e5b9e729574339bb8fa-0068c57089) test ERROR: ERROR with Base server 10.0.0.2:1002/sdc re: Trying to POST /: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx89e5b9e729574339bb8fa-0068c57089) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_invalid_uri test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_invalid_uri ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_mfa test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_mfa ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_mixture_param_v4 test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_mixture_param_v4 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_shard_ranges ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_non_ascii_user test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_non_ascii_user ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_non_s3_request_passthrough test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_non_s3_request_passthrough ... ok test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_auditing test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_auditing ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_notification test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_notification ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_create_bad_md5_bad_padding test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_create_bad_md5_bad_padding ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_create_bad_md5_too_long test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_create_bad_md5_too_long ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_create_bad_md5_too_short test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_create_bad_md5_too_short ... ok test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_errors test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_errors ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_create_bad_md5_unreadable test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_create_bad_md5_unreadable ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_tagging test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_tagging ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_virtual_hosted_style test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_object_virtual_hosted_style ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_path_info_encode test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_path_info_encode ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_policy test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_policy ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_registered_defaults test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_registered_defaults ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_registered_sensitive_info test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_registered_sensitive_info ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_request_payment test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_request_payment ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_shard_ranges_deleted test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_shard_ranges_deleted ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_restore test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_restore ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_error_metric test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_error_metric ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_initialization_with_disabled_pipeline_check test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_initialization_with_disabled_pipeline_check ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_only_s3_token test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_only_s3_token ... ok 1 RLock(s) were not greened, to fix this error make sure you run eventlet.monkey_patch() before importing any other modules. test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_only_s3_token_in_s3acl test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_only_s3_token_in_s3acl ... ok test.unit.obj.test_server.TestObjectController.test_PUT_redirected_async_pending test.unit.obj.test_server.TestObjectController.test_PUT_redirected_async_pending ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_only_s3_token_v3 test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_only_s3_token_v3 ... ok test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_from_compacted_shard test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_from_compacted_shard ... ok test.unit.obj.test_server.TestObjectController.test_PUT_redirected_async_pending_with_container_path test.unit.obj.test_server.TestObjectController.test_PUT_redirected_async_pending_with_container_path ... ok test.unit.obj.test_server.TestObjectController.test_PUT_redirected_async_pending_with_old_style_container_path test.unit.obj.test_server.TestObjectController.test_PUT_redirected_async_pending_with_old_style_container_path ... ok test.unit.obj.test_server.TestObjectController.test_PUT_slow test.unit.obj.test_server.TestObjectController.test_PUT_slow ... ok test.unit.obj.test_server.TestObjectController.test_PUT_ssync_multi_frag test.unit.obj.test_server.TestObjectController.test_PUT_ssync_multi_frag ... ok test.unit.obj.test_server.TestObjectController.test_PUT_succeeds_with_later_POST test.unit.obj.test_server.TestObjectController.test_PUT_succeeds_with_later_POST ... ok fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift DEBUG: Calling S3Api Middleware fake-swift INFO: GET /bucket/object AUTH_test bucket object 200 test:tester fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift WARNING: s3api middleware requires SLO middleware to support multi-part upload, please add it in pipeline fake-swift DEBUG: Use tempauth middleware. fake-swift DEBUG: Use keystone middleware. fake-swift DEBUG: Use keystone middleware. fake-swift DEBUG: Use keystone middleware. fake-swift DEBUG: 's3api' is not in list fake-swift DEBUG: Calling S3Api Middleware fake-swift WARNING: multipart: No SLO middleware in pipeline fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift INFO: HEAD /bucket/object s3:err:AccessDenied.invalid_credential fake-swift INFO: Using crc32c_isal implementation for CRC32C. fake-swift INFO: Using crc64nvme_isal implementation for CRC64NVME. fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift WARNING: multipart: No SLO middleware in pipeline fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift WARNING: multipart: No SLO middleware in pipeline fake-swift DEBUG: Calling S3Api Middleware fake-swift WARNING: multipart: No SLO middleware in pipeline fake-swift DEBUG: Calling S3Api Middleware fake-swift WARNING: multipart: No SLO middleware in pipeline fake-swift WARNING: s3api middleware requires SLO middleware to support multi-part upload, please add it in pipeline fake-swift DEBUG: Skip pipeline auth check. fake-swift DEBUG: Skip pipeline auth check. fake-swift DEBUG: Skip pipeline auth check. fake-swift DEBUG: Skip pipeline auth check. fake-swift DEBUG: 's3api' is not in list test DEBUG: Calling S3Api Middleware test DEBUG: Calling S3Api Middleware test DEBUG: Calling S3Api Middleware AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Use of the auth_admin_prefix, auth_host, auth_port, auth_protocol, identity_uri, admin_token, admin_user, admin_password, and admin_tenant_name configuration options was deprecated in the Mitaka release in favor of an auth_plugin and its related options. This class may be removed in a future release. Configuring admin URI using auth fragments was deprecated in the Kilo release, and will be removed in the Newton release, use 'identity_uri' instead. Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint test DEBUG: Calling S3Api Middleware Using the in-process token cache is deprecated as of the 4.2.0 release and may be removed in the 5.0.0 release or the 'O' development cycle. The in-process cache causes inconsistent results and high memory usage. When the feature is removed the auth_token middleware will not cache tokens by default which may result in performance issues. It is recommended to use memcache for the auth_token token cache by setting the memcached_servers option. test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_s3_token_and_auth_token test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_s3_token_and_auth_token ... ok test.unit.obj.test_server.TestObjectController.test_PUT_system_metadata test.unit.obj.test_server.TestObjectController.test_PUT_system_metadata ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_time_skew test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_s3api_with_time_skew ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 404 70 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txbf2b683af1f44a348b4bc-0068c5708a" "proxy-server 1824509" 0.0044 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txbf2b683af1f44a348b4bc-0068c5708a) proxy DEBUG: Ignoring 404 from primary (txn: txbf2b683af1f44a348b4bc-0068c5708a) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 404 70 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "txbf2b683af1f44a348b4bc-0068c5708a" "proxy-server 1824509" 0.0003 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: txbf2b683af1f44a348b4bc-0068c5708a) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx41d71da8207a42da8011b-0068c5708a" "proxy-server 1824509" 0.0059 "-" 1824509 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c" 204 - "HEAD http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c" "tx930b9778239f4895a4370-0068c5708a" "proxy-server 1824509" 0.0054 "-" 1824509 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdi1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 200 82 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "tx33af74694ac344dfa7822-0068c5708a" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdg1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 200 82 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "tx33af74694ac344dfa7822-0068c5708a" "proxy-server 1824509" 0.0007 "-" 1824509 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:26 +0000] "GET /sdh1/2/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" 404 70 "GET http://localhost/v1/a/af2bce6a16a54a95bff6cf5ab9a4908c/7464ca9a11404762b126918ccd47d82d" "tx33af74694ac344dfa7822-0068c5708a" "proxy-server 1824509" 0.0004 "-" 1824509 3 proxy DEBUG: Ignoring 404 from primary (txn: tx33af74694ac344dfa7822-0068c5708a) proxy ERROR: Object returning 503 for [] (txn: tx33af74694ac344dfa7822-0068c5708a) test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_server_side_encryption test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_server_side_encryption ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signature_v4 test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signature_v4 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter_non_slash ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signature_v4_bad_authorization_string test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signature_v4_bad_authorization_string ... ok sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770106.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/d45/cc61b0b9dc88725c0d37418947dc4d45/cc61b0b9dc88725c0d37418947dc4d45.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770108.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/1c9/1a854628b19268607951b33186d8b1c9/1a854628b19268607951b33186d8b1c9.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770108.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/1c9/1a854628b19268607951b33186d8b1c9/1a854628b19268607951b33186d8b1c9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770110.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/7c3/e2cc1dfa99509d814501c9d589a017c3/e2cc1dfa99509d814501c9d589a017c3.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770110.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/7c3/e2cc1dfa99509d814501c9d589a017c3/e2cc1dfa99509d814501c9d589a017c3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770112.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/fd5/af55656917432cc6caec5d66613d7fd5/af55656917432cc6caec5d66613d7fd5.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770112.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/fd5/af55656917432cc6caec5d66613d7fd5/af55656917432cc6caec5d66613d7fd5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770114.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/1ba/415ac11404ed6e59cc20fc9813c6f1ba/415ac11404ed6e59cc20fc9813c6f1ba.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770114.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/1ba/415ac11404ed6e59cc20fc9813c6f1ba/415ac11404ed6e59cc20fc9813c6f1ba.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770116.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/0e3/53d6efa1f81445fd945c4276f1b550e3/53d6efa1f81445fd945c4276f1b550e3.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770116.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/0e3/53d6efa1f81445fd945c4276f1b550e3/53d6efa1f81445fd945c4276f1b550e3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770118.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/14f/9da7388ef6eedc1b0f0b2503d2f3d14f/9da7388ef6eedc1b0f0b2503d2f3d14f.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770118.00000, db: /tmp/tmpp3k32sm3/sda/containers/0/14f/9da7388ef6eedc1b0f0b2503d2f3d14f/9da7388ef6eedc1b0f0b2503d2f3d14f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769871.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/66c/15fb98d7484e543aee2d42b3dcd9166c/15fb98d7484e543aee2d42b3dcd9166c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769876.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f75/0267ffe67847f132b8c030aede97df75/0267ffe67847f132b8c030aede97df75.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769881.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/5c1/2b14bcd474713767021ae671da4815c1/2b14bcd474713767021ae671da4815c1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769896.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/2e2/37c67cb6218d509e6fe1642f40a122e2/37c67cb6218d509e6fe1642f40a122e2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769901.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/774/7747f025f0720db7ac5c8ba9faa84774/7747f025f0720db7ac5c8ba9faa84774.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769906.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/41c/036de6688bc7eeac874c629324f6041c/036de6688bc7eeac874c629324f6041c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769911.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/051/ae88c7797d05d3f4dd6e94ada1621051/ae88c7797d05d3f4dd6e94ada1621051.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769916.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7be/53bd02c37d4dca9b69bcc559deec27be/53bd02c37d4dca9b69bcc559deec27be.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769921.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/361/bdd6e4a3be9c6dc778bf7947fd938361/bdd6e4a3be9c6dc778bf7947fd938361.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769926.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/760/47f397e2962e064a251785aaf2e85760/47f397e2962e064a251785aaf2e85760.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769931.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/14c/4047d06a80ae92b9efae76c95e23914c/4047d06a80ae92b9efae76c95e23914c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769936.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/64e/ea2272f9efe4db328c8f0e6eeaa3964e/ea2272f9efe4db328c8f0e6eeaa3964e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769941.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/0ff/9d781db5dd9ad7deaddd5669e86900ff/9d781db5dd9ad7deaddd5669e86900ff.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769951.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a52/d6352d444eab28d775b0f8d6673f0a52/d6352d444eab28d775b0f8d6673f0a52.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769956.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/830/3b05aa4eaca7c6eaab6c677b2c213830/3b05aa4eaca7c6eaab6c677b2c213830.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769961.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/cc2/414f8a41641642191e055adb2dd3ecc2/414f8a41641642191e055adb2dd3ecc2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769966.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a84/972206c5ddfbe3104eb36c180e751a84/972206c5ddfbe3104eb36c180e751a84.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769971.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/cb9/5902f68abce1d85074c866fa560cacb9/5902f68abce1d85074c866fa560cacb9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769976.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/171/3440bebe2d880ff654d5218a4faf5171/3440bebe2d880ff654d5218a4faf5171.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769981.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/17b/e345d51761e471dfb00d5a8edc2c617b/e345d51761e471dfb00d5a8edc2c617b.dbtest.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signature_v4_no_date test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signature_v4_no_date ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signature_v4_no_payload test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signature_v4_no_payload ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_expired test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_expired ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_invalid_expire test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_invalid_expire ... ok test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:25 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:26 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:26 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0096 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0016 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:3200', 'cdevice')] (txn: put_trans_id) test-object-controller INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "put_trans_id" "-" 0.0017 "-" 1824531 0 test-object-controller DEBUG: Update to /a/c/o redirected to .sharded_a/c_shard_1 (txn: put_trans_id) test INFO: Object update sweep starting on /tmp/tmppfv_zuso/tmp_test_object_server_ObjectController/sda1 (pid: 1824531) test DEBUG: Update sent for /.sharded_a/c_shard_1/o /tmp/tmppfv_zuso/tmp_test_object_server_ObjectController/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769866.00000 test INFO: Object update sweep completed on /tmp/tmppfv_zuso/tmp_test_object_server_ObjectController/sda1 in 0.00s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824531) test INFO: Object update sweep of sda1 completed: 0.00s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:3200', 'cdevice')] (txn: put_trans_id) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "put_trans_id" "-" 0.0016 "-" 1824531 0 test-object-controller DEBUG: Update to /.another/c/o redirected to .sharded_a/c_shard_1 (txn: put_trans_id) test INFO: Object update sweep starting on /tmp/tmp0th7cm_4/tmp_test_object_server_ObjectController/sda1 (pid: 1824531) test DEBUG: Update sent for /.sharded_a/c_shard_1/o /tmp/tmp0th7cm_4/tmp_test_object_server_ObjectController/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769867.00000 test INFO: Object update sweep completed on /tmp/tmp0th7cm_4/tmp_test_object_server_ObjectController/sda1 in 0.00s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824531) test INFO: Object update sweep of sda1 completed: 0.00s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:3200', 'cdevice')] (txn: put_trans_id) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "put_trans_id" "-" 0.0016 "-" 1824531 0 test-object-controller DEBUG: Update to /.another/c/o redirected to .sharded_a/c_shard_1 (txn: put_trans_id) test INFO: Object update sweep starting on /tmp/tmp5kzc2mm1/tmp_test_object_server_ObjectController/sda1 (pid: 1824531) test DEBUG: Update sent for /.sharded_a/c_shard_1/o /tmp/tmp5kzc2mm1/tmp_test_object_server_ObjectController/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769867.00000 test INFO: Object update sweep completed on /tmp/tmp5kzc2mm1/tmp_test_object_server_ObjectController/sda1 in 0.00s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824531) test INFO: Object update sweep of sda1 completed: 0.00s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 0 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0005 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0004 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 409 95 "-" "-" "-" 0.0004 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0010 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with chost:cport/cdevice (saving for async update later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 320, in async_update conn = http_connect(ip, port, contdevice, partition, op, full_path, headers_out) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 1475, in fake_http_connect raise Exception('test') Exception: test (txn: put_trans_id) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: put_trans_id) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "put_trans_id" "-" 0.0026 "-" 1824531 1 test-object-controller ERROR: ERROR container update failed with chost:cport/cdevice (saving for async update later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 320, in async_update conn = http_connect(ip, port, contdevice, partition, op, full_path, headers_out) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 1475, in fake_http_connect raise Exception('test') Exception: test (txn: post_trans_id) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: post_trans_id)test.unit.obj.test_server.TestObjectController.test_PUT_then_POST_async_pendings_with_EC_policy test.unit.obj.test_server.TestObjectController.test_PUT_then_POST_async_pendings_with_EC_policy ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter_order_and_reverse test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter_order_and_reverse ... ok test.unit.obj.test_server.TestObjectController.test_PUT_then_POST_async_pendings_with_repl_policy test.unit.obj.test_server.TestObjectController.test_PUT_then_POST_async_pendings_with_repl_policy ... ok test.unit.obj.test_server.TestObjectController.test_PUT_then_POST_then_fetch_system_metadata test.unit.obj.test_server.TestObjectController.test_PUT_then_POST_then_fetch_system_metadata ... ok test.unit.obj.test_server.TestObjectController.test_PUT_then_fetch_system_metadata test.unit.obj.test_server.TestObjectController.test_PUT_then_fetch_system_metadata ... ok test.unit.obj.test_server.TestObjectController.test_PUT_user_metadata test.unit.obj.test_server.TestObjectController.test_PUT_user_metadata ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_no_access test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_no_access ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_no_sign test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_no_sign ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_no_timestamp test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_no_timestamp ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4 test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4 ... ok test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/plainc/1" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/plainc/2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0029 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "HEAD /sda1/p/a/plainc" 204 - "-" "-" "-" 0.0010 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0062 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0099 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0101 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0102 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0027 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0028 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0088 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/plainc" 200 6 "-" "-" "-" 0.0020 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/a1" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/b1" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/a2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/b2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/a3" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c/b3" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 9 "-" "-" "-" 0.0112 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0074 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0098 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 1287 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 1274 "-" "-" "-" 0.0058 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 633 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 1287 "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 1274 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 200 633 "-" "-" "-" 0.0058 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0076 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 400 9 "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 412 22 "-" "-" "-" 0.0001 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 507 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0025 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0052 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c_f" 201 - "-" "-" "-" 0.0075 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "PUT /sda1/p/.shards_a/c_f" 202 - "-" "-" "-" 0.0060 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0056 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0056 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 328 "-" "-" "-" 0.0055 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0016 "-" 1824512 0 test DEBUG: Unlinked retiring db '/tmp/tmpbggb26pf/tmp_test_container_server_ContainerController/sda1/containers/p/189/b0d72ea4144f5f4c7f596aa4fe1f3189/b0d72ea4144f5f4c7f596aa4fe1f3189.db' test INFO: - - - [13/Sep/2025:13:24:26 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0115 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/.shards_a/c_f" 200 656 "-" "-" "-" 0.0018 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0077 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 2662 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 2662 "-" "-" "-" 0.0062 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1332 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 2662 "-" "-" "-" 0.0058 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0014 "-" 1824512 0test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_include_deleted test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_include_deleted ... ok test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_using_state_aliases test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_using_state_aliases ... ok test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_with_format_header test.unit.container.test_server.TestContainerController.test_GET_shard_ranges_with_format_header ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_bad_credential test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_bad_credential ... ok test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "post_trans_id" "-" 0.0033 "-" 1824531 1 test INFO: Object update sweep starting on /tmp/tmpdhvwxc_t/tmp_test_object_server_ObjectController/sda1 (pid: 1824531) test DEBUG: Update sent for /a/c/o /tmp/tmpdhvwxc_t/tmp_test_object_server_ObjectController/sda1/async_pending-1/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769868.00000 test INFO: Object update sweep completed on /tmp/tmpdhvwxc_t/tmp_test_object_server_ObjectController/sda1 in 0.00s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 1 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824531) test INFO: Object update sweep of sda1 completed: 0.00s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 1 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with chost:cport/cdevice (saving for async update later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 320, in async_update conn = http_connect(ip, port, contdevice, partition, op, full_path, headers_out) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 1475, in fake_http_connect raise Exception('test') Exception: test (txn: put_trans_id) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: put_trans_id) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "put_trans_id" "-" 0.0026 "-" 1824531 0 test-object-controller ERROR: ERROR container update failed with chost:cport/cdevice (saving for async update later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 320, in async_update conn = http_connect(ip, port, contdevice, partition, op, full_path, headers_out) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 1475, in fake_http_connect raise Exception('test') Exception: test (txn: post_trans_id) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: post_trans_id) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "post_trans_id" "-" 0.0022 "-" 1824531 0 test INFO: Object update sweep starting on /tmp/tmp0ph4lkf6/tmp_test_object_server_ObjectController/sda1 (pid: 1824531) test DEBUG: Update sent for /a/c/o /tmp/tmp0ph4lkf6/tmp_test_object_server_ObjectController/sda1/async_pending/a83/06fbf0b514e5199dfc4e00f42eb5ea83-1757769868.00000 test INFO: Object update sweep completed on /tmp/tmp0ph4lkf6/tmp_test_object_server_ObjectController/sda1 in 0.00s seconds:, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 1 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains (pid: 1824531) test INFO: Object update sweep of sda1 completed: 0.00s, 1 successes, 0 failures, 0 quarantines, 1 unlinks, 1 outdated_unlinks, 0 errors, 0 redirects, 0 skips, 0 deferrals, 0 drains test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c/o" 200 14 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 200 14 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c/o" 200 14 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 200 14 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) Filesystem at 41 does not support xattr Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 285, in write_metadata xattr.setxattr(fd, METADATA_KEY + str(key or '').encode('ascii'), ~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ metastr[:xattr_size]) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 2618, in mock_get_and_setxattr raise IOError(error_num, 'Operation not supported') OSError: [Errno 95] Operation not supported test.unit.obj.test_server.TestObjectController.test_PUT_user_metadata_no_xattr test.unit.obj.test_server.TestObjectController.test_PUT_user_metadata_no_xattr ... ok test.unit.obj.test_server.TestObjectController.test_PUT_with_full_drive test.unit.obj.test_server.TestObjectController.test_PUT_with_full_drive ... ok test.unit.obj.test_server.TestObjectController.test_PUT_with_replication_headers test.unit.obj.test_server.TestObjectController.test_PUT_with_replication_headers ... ok test.unit.obj.test_server.TestObjectController.test_PUT_zero_content_length test.unit.obj.test_server.TestObjectController.test_PUT_zero_content_length ... ok test.unit.obj.test_server.TestObjectController.test_REPLICATE_pickle_protocol test.unit.obj.test_server.TestObjectController.test_REPLICATE_pickle_protocol ... ok test.unit.obj.test_server.TestObjectController.test_REPLICATE_reclaims_tombstones test.unit.obj.test_server.TestObjectController.test_REPLICATE_reclaims_tombstones ... ok test.unit.obj.test_server.TestObjectController.test_REPLICATE_timeout test.unit.obj.test_server.TestObjectController.test_REPLICATE_timeout ... ok test.unit.obj.test_server.TestObjectController.test_REPLICATE_works test.unit.obj.test_server.TestObjectController.test_REPLICATE_works ... ok test.unit.obj.test_server.TestObjectController.test_REQUEST_SPECIAL_CHARS test.unit.obj.test_server.TestObjectController.test_REQUEST_SPECIAL_CHARS ... ok test.unit.obj.test_server.TestObjectController.test_SSYNC_can_be_called test.unit.obj.test_server.TestObjectController.test_SSYNC_can_be_called ... ok test.unit.obj.test_server.TestObjectController.test__call__returns_500 test.unit.obj.test_server.TestObjectController.test__call__returns_500 ... ok test.unit.obj.test_server.TestObjectController.test_allowed_headers test.unit.obj.test_server.TestObjectController.test_allowed_headers ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_invalid_algorithm test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_invalid_algorithm ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_invalid_credentials test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_invalid_credentials ... ok test.unit.obj.test_server.TestObjectController.test_async_update_does_not_save_on_2xx test.unit.obj.test_server.TestObjectController.test_async_update_does_not_save_on_2xx ... ok test.unit.obj.test_server.TestObjectController.test_async_update_http_connect test.unit.obj.test_server.TestObjectController.test_async_update_http_connect ... ok test.unit.obj.test_server.TestObjectController.test_async_update_saves_on_exception test.unit.obj.test_server.TestObjectController.test_async_update_saves_on_exception ... ok test.unit.obj.test_server.TestObjectController.test_async_update_saves_on_non_2xx test.unit.obj.test_server.TestObjectController.test_async_update_saves_on_non_2xx ... ok test.unit.obj.test_server.TestObjectController.test_async_update_saves_on_timeout test.unit.obj.test_server.TestObjectController.test_async_update_saves_on_timeout ... ok test.unit.obj.test_server.TestObjectController.test_bad_sinces test.unit.obj.test_server.TestObjectController.test_bad_sinces ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter_prefix_delim ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_missing_signature test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_missing_signature ... ok test.unit.obj.test_server.TestObjectController.test_call_bad_method test.unit.obj.test_server.TestObjectController.test_call_bad_method ... ok test.unit.obj.test_server.TestObjectController.test_call_bad_request test.unit.obj.test_server.TestObjectController.test_call_bad_request ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_missing_signed_headers test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_missing_signed_headers ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_missing_x_amz_date test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_signed_urls_v4_missing_x_amz_date ... ok test.unit.container.test_server.TestContainerController.test_GET_with_override_deleted_for_namespaces test.unit.container.test_server.TestContainerController.test_GET_with_override_deleted_for_namespaces ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_tagging test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_tagging ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_token_generation test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_token_generation ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_torrent test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_torrent ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_unsupported_method test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_unsupported_method ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_website test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_website ... ok test.unit.container.test_server.TestContainerController.test_GET_with_override_deleted_for_shard_ranges test.unit.container.test_server.TestContainerController.test_GET_with_override_deleted_for_shard_ranges ... ok test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 507 109 "-" "-" "-" 0.0018 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 507 109 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "REPLICATE /sda1/p/" 200 - "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/0/a/c/o" 404 70 "-" "-" "-" 0.0009 "-" 1824531 0 test-object-controller DEBUG: Run listdir on /tmp/tmpo684cx6z/tmp_test_object_server_ObjectController/sda1/objects/0 test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "REPLICATE /sda1/0" 200 56 "-" "-" "-" 0.0009 "-" 1824531 0 test-object-controller DEBUG: - - - [13/Sep/2025:13:27:47 +0000] "REPLICATE /sda1/0/a43" 200 4 "-" "-" "-" - "-" 1824531 0 test-object-controller DEBUG: - - - [13/Sep/2025:13:27:47 +0000] "REPLICATE /sda1/0/" 200 6 "-" "-" "-" - "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:27:47 +0000] "DELETE /sda1/0/a/c/o" 404 70 "-" "-" "-" - "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/0/a/c/o" 404 70 "-" "-" "-" 0.0007 "-" 1824531 1 test-object-controller DEBUG: Run listdir on /tmp/tmpo684cx6z/tmp_test_object_server_ObjectController/sda1/objects-1/0 test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "REPLICATE /sda1/0" 200 61 "-" "-" "-" 0.0009 "-" 1824531 1 test-object-controller DEBUG: - - - [13/Sep/2025:13:27:47 +0000] "REPLICATE /sda1/0/a43" 200 4 "-" "-" "-" - "-" 1824531 1 test-object-controller DEBUG: - - - [13/Sep/2025:13:27:47 +0000] "REPLICATE /sda1/0/" 200 6 "-" "-" "-" - "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:27:47 +0000] "DELETE /sda1/0/a/c/o" 404 70 "-" "-" "-" - "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "REPLICATE /sda1/p/" 200 11 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/special%E6%98%86%20/%25" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/special%E6%98%86%20/%25" 200 14 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/special%E6%98%86%20/%25" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c/special%E6%98%86%20/%25" 200 14 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c/special%E6%98%86%20/%25" 204 - "-" "-" "-" 0.0016 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test DEBUG: Labeled statsd mode: disabled (test) test ERROR: ERROR __call__ error with PUT /sda1/p/a/c/o : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 1417, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 9523, in mock_put_method raise Exception() Exception test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test DEBUG: Labeled statsd mode: disabled (test) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 127.0.0.1:1234/sdc1 (saving for async update later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 320, in async_update conn = http_connect(ip, port, contdevice, partition, op, full_path, headers_out) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 6254, in fake_http_connect raise Exception('test') Exception: test test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 127.0.0.1:1234/sdc1 (saving for async update later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/server.py", line 320, in async_update conn = http_connect(ip, port, contdevice, partition, op, full_path, headers_out) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_server.py", line 6583, in fake_http_connect raise Exception('test') Exception: test test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR Container update failed (saving for async update later): 199 response from 127.0.0.1:1234/sdc1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 300 response from 127.0.0.1:1234/sdc1 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 503 response from 127.0.0.1:1234/sdc1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR container update failed with 127.0.0.1:1234/sdc1 (saving for async update later): Timeout (0.001s) test-object-controller ERROR: ERROR container update failed with 127.0.0.1:1234/sdc1 (saving for async update later): Timeout (0.001s) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0045 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "INVALID /sda1/p/a/c/o" 405 91 "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 400 26 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller ERROR: Client path /b/d/x does not match path stored in object metadata /a/c/o test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/b/d/x" 403 73 "-" "-" "-" 0.0005 "-" 1824531 -test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter_with_reserved_name test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_list_objects_iter_with_reserved_name ... ok test.unit.obj.test_server.TestObjectController.test_call_name_collision test.unit.obj.test_server.TestObjectController.test_call_name_collision ... ok test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_website_redirect_location test.unit.common.middleware.s3api.test_s3api.TestS3ApiMiddleware.test_website_redirect_location ... ok test.unit.obj.test_server.TestObjectController.test_call_not_found test.unit.obj.test_server.TestObjectController.test_call_not_found ... ok test.unit.obj.test_server.TestObjectController.test_chunked_DELETE_with_full_drive test.unit.obj.test_server.TestObjectController.test_chunked_DELETE_with_full_drive ... ok test.unit.obj.test_server.TestObjectController.test_chunked_PUT_with_full_drive test.unit.obj.test_server.TestObjectController.test_chunked_PUT_with_full_drive ... ok test.unit.obj.test_server.TestObjectController.test_chunked_content_length_mismatch_zero test.unit.obj.test_server.TestObjectController.test_chunked_content_length_mismatch_zero ... ok test.unit.common.middleware.s3api.test_s3response.TestResponse.test_from_swift_resp_slo test.unit.common.middleware.s3api.test_s3response.TestResponse.test_from_swift_resp_slo ... ok test.unit.container.test_server.TestContainerController.test_GET_with_override_deleted_for_shard_ranges_db_unlinked test.unit.container.test_server.TestContainerController.test_GET_with_override_deleted_for_shard_ranges_db_unlinked ... ok test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_s3api_sysmeta_from_swift3_sysmeta test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_s3api_sysmeta_from_swift3_sysmeta ... ok test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_s3api_sysmeta_headers test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_s3api_sysmeta_headers ... ok test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_s3api_sysmeta_headers_ignore_other_sysmeta test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_s3api_sysmeta_headers_ignore_other_sysmeta ... ok test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_s3api_user_meta_headers test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_s3api_user_meta_headers ... ok test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_swift3_sysmeta_does_not_overwrite_s3api_sysmeta test.unit.common.middleware.s3api.test_s3response.TestResponse.test_response_swift3_sysmeta_does_not_overwrite_s3api_sysmeta ... ok test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_cache_middleware test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_cache_middleware ... ok test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_filter_factory test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_filter_factory ... ok test.unit.obj.test_server.TestObjectController.test_chunked_put test.unit.obj.test_server.TestObjectController.test_chunked_put ... ok test.unit.obj.test_server.TestObjectController.test_container_update_as_greenthread test.unit.obj.test_server.TestObjectController.test_container_update_as_greenthread ... ok test.unit.container.test_server.TestContainerController.test_GET_with_override_deleted_ignored_for_objects test.unit.container.test_server.TestContainerController.test_GET_with_override_deleted_ignored_for_objects ... ok test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_real_config test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_real_config ... ok test.unit.obj.test_server.TestObjectController.test_container_update_as_greenthread_with_timeout test.unit.obj.test_server.TestObjectController.test_container_update_as_greenthread_with_timeout ... ok test.unit.obj.test_server.TestObjectController.test_container_update_async test.unit.obj.test_server.TestObjectController.test_container_update_async ... ok test.unit.obj.test_server.TestObjectController.test_container_update_bad_args test.unit.obj.test_server.TestObjectController.test_container_update_bad_args ... ok test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_real_config_with_options test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_real_config_with_options ... ok test.unit.obj.test_server.TestObjectController.test_container_update_no_async_update test.unit.obj.test_server.TestObjectController.test_container_update_no_async_update ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_load_old_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_load_old_record_from_pending_file ... ok test.unit.obj.test_server.TestObjectController.test_container_update_success test.unit.obj.test_server.TestObjectController.test_container_update_success ... ok test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_real_memcache_config test.unit.common.middleware.test_memcache.TestCacheMiddleware.test_real_memcache_config ... ok test.unit.common.middleware.test_name_check.TestSwiftInfo.test_registered_configured_options test.unit.common.middleware.test_name_check.TestSwiftInfo.test_registered_configured_options ... ok test.unit.common.middleware.test_name_check.TestSwiftInfo.test_registered_defaults test.unit.common.middleware.test_name_check.TestSwiftInfo.test_registered_defaults ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_device_info test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_device_info ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_device_info_fail test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_device_info_fail ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_device_info_function test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_device_info_function ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_swift_conf_md5 test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_swift_conf_md5 ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_swift_conf_md5_fail test.unit.common.middleware.test_recon.TestReconMiddleware.test_get_swift_conf_md5_fail ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_no_content test.unit.common.middleware.test_recon.TestReconMiddleware.test_no_content ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_async test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_async ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_auditor_all test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_auditor_all ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_auditor_invalid test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_auditor_invalid ... ok test.unit.obj.test_server.TestObjectController.test_content_encoding test.unit.obj.test_server.TestObjectController.test_content_encoding ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_auditor_notype test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_auditor_notype ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_diskusage test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_diskusage ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_driveaudit test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_driveaudit ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_expirer_invalid test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_expirer_invalid ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_expirer_notype test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_expirer_notype ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_expirer_object test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_expirer_object ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_load test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_load ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_mem test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_mem ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_make_tuple_for_pickle test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_make_tuple_for_pickle ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_mounted test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_mounted ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_quarantined test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_quarantined ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_relink test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_relink ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_replication_all test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_replication_all ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_replication_notype test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_replication_notype ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_ringmd5 test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_ringmd5 ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_sharding test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_sharding ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_sockstat test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_sockstat ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_swiftconfmd5 test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_swiftconfmd5 ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_time test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_time ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_unmounted test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_unmounted ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_unmounted_empty test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_unmounted_empty ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_updater test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_updater ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_updater_invalid test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_updater_invalid ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_updater_notype test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_updater_notype ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_version test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_get_version ... ok test.unit.obj.test_server.TestObjectController.test_correct_allowed_method test.unit.obj.test_server.TestObjectController.test_correct_allowed_method ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_invalid_path test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_invalid_path ... ok test.unit.container.test_server.TestContainerController.test_GET_xml test.unit.container.test_server.TestContainerController.test_GET_xml ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_pass test.unit.common.middleware.test_recon.TestReconMiddleware.test_recon_pass ... ok test.unit.common.middleware.test_recon.TestReconMiddleware.test_reconstruction_info test.unit.common.middleware.test_recon.TestReconMiddleware.test_reconstruction_info ... ok test.unit.obj.test_server.TestObjectController.test_create_reserved_namespace_object test.unit.obj.test_server.TestObjectController.test_create_reserved_namespace_object ... ok test.unit.obj.test_server.TestObjectController.test_create_reserved_namespace_object_in_user_container test.unit.obj.test_server.TestObjectController.test_create_reserved_namespace_object_in_user_container ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_download_takes_too_long test.unit.common.middleware.test_slo.TestSloErrors.test_download_takes_too_long ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_error_fetching_first_segment_submanifest test.unit.common.middleware.test_slo.TestSloErrors.test_error_fetching_first_segment_submanifest ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_error_fetching_segment test.unit.common.middleware.test_slo.TestSloErrors.test_error_fetching_segment ... ok test.unit.container.test_server.TestContainerController.test_HEAD test.unit.container.test_server.TestContainerController.test_HEAD ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_error_fetching_submanifest test.unit.common.middleware.test_slo.TestSloErrors.test_error_fetching_submanifest ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_POST_update_same_expiration test.unit.obj.test_server.TestObjectController.test_delete_at_POST_update_same_expiration ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_first_segment_mismatched_etag test.unit.common.middleware.test_slo.TestSloErrors.test_first_segment_mismatched_etag ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_cap test.unit.obj.test_server.TestObjectController.test_delete_at_cap ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_first_segment_mismatched_size test.unit.common.middleware.test_slo.TestSloErrors.test_first_segment_mismatched_size ... ok test.unit.container.test_server.TestContainerController.test_HEAD_has_content_length test.unit.container.test_server.TestContainerController.test_HEAD_has_content_length ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_first_segment_not_available test.unit.common.middleware.test_slo.TestSloErrors.test_first_segment_not_available ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_negative test.unit.obj.test_server.TestObjectController.test_delete_at_negative ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_first_segment_not_exists test.unit.common.middleware.test_slo.TestSloErrors.test_first_segment_not_exists ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_generator_closure test.unit.common.middleware.test_slo.TestSloErrors.test_generator_closure ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_generator_closure_iter_app_resp test.unit.common.middleware.test_slo.TestSloErrors.test_generator_closure_iter_app_resp ... ok test.unit.container.test_server.TestContainerController.test_HEAD_invalid_accept test.unit.container.test_server.TestContainerController.test_HEAD_invalid_accept ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_get_bogus_manifest test.unit.common.middleware.test_slo.TestSloErrors.test_get_bogus_manifest ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_get_invalid_sysmeta_passthrough test.unit.common.middleware.test_slo.TestSloErrors.test_get_invalid_sysmeta_passthrough ... ok test.unit.container.test_server.TestContainerController.test_HEAD_invalid_content_type test.unit.container.test_server.TestContainerController.test_HEAD_invalid_content_type ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_head_does_not_validate_first_segment_mismatched_etag test.unit.common.middleware.test_slo.TestSloErrors.test_head_does_not_validate_first_segment_mismatched_etag ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_overwrite_same_expiration_different_bytes test.unit.obj.test_server.TestObjectController.test_delete_at_overwrite_same_expiration_different_bytes ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_head_does_not_validate_first_segment_mismatched_size test.unit.common.middleware.test_slo.TestSloErrors.test_head_does_not_validate_first_segment_mismatched_size ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_invalid_json_submanifest test.unit.common.middleware.test_slo.TestSloErrors.test_invalid_json_submanifest ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_mismatched_checksum test.unit.common.middleware.test_slo.TestSloErrors.test_mismatched_checksum ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_mismatched_etag test.unit.common.middleware.test_slo.TestSloErrors.test_mismatched_etag ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_mismatched_length test.unit.common.middleware.test_slo.TestSloErrors.test_mismatched_length ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_mismatched_size test.unit.common.middleware.test_slo.TestSloErrors.test_mismatched_size ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_update_cleans_old_entries test.unit.obj.test_server.TestObjectController.test_delete_at_update_cleans_old_entries ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_update_delete test.unit.obj.test_server.TestObjectController.test_delete_at_update_delete ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_recursion_limit test.unit.common.middleware.test_slo.TestSloErrors.test_recursion_limit ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_slo_sysmeta_on_error test.unit.common.middleware.test_slo.TestSloErrors.test_slo_sysmeta_on_error ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info_but_empty_host test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info_but_empty_host ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_sub_slo_recursion test.unit.common.middleware.test_slo.TestSloErrors.test_sub_slo_recursion ... ok test.unit.common.middleware.test_slo.TestSloErrors.test_sub_slo_recursion_limit test.unit.common.middleware.test_slo.TestSloErrors.test_sub_slo_recursion_limit ... ok test.unit.common.middleware.test_slo.TestSloGetRawManifest.test_get_raw_manifest test.unit.common.middleware.test_slo.TestSloGetRawManifest.test_get_raw_manifest ... ok test.unit.common.middleware.test_slo.TestSloGetRawManifest.test_get_raw_manifest_passthrough_with_ranges test.unit.common.middleware.test_slo.TestSloGetRawManifest.test_get_raw_manifest_passthrough_with_ranges ... ok test.unit.common.middleware.test_slo.TestSloHeadManifest.test_etag_is_hash_of_segment_etags test.unit.common.middleware.test_slo.TestSloHeadManifest.test_etag_is_hash_of_segment_etags ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info_but_missing_container test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info_but_missing_container ... ok test.unit.common.middleware.test_slo.TestSloHeadManifest.test_get_manifest_passthrough test.unit.common.middleware.test_slo.TestSloHeadManifest.test_get_manifest_passthrough ... ok test.unit.common.middleware.test_slo.TestSloHeadManifest.test_head_manifest_is_efficient test.unit.common.middleware.test_slo.TestSloHeadManifest.test_head_manifest_is_efficient ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info_but_missing_host test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info_but_missing_host ... ok test.unit.common.middleware.test_slo.TestSloHeadManifest.test_if_match_etag_not_matching test.unit.common.middleware.test_slo.TestSloHeadManifest.test_if_match_etag_not_matching ... ok test.unit.common.middleware.test_slo.TestSloHeadManifest.test_if_match_etag_not_matching_with_override test.unit.common.middleware.test_slo.TestSloHeadManifest.test_if_match_etag_not_matching_with_override ... ok test.unit.common.middleware.test_slo.TestSloHeadManifest.test_if_none_match_etag_matching test.unit.common.middleware.test_slo.TestSloHeadManifest.test_if_none_match_etag_matching ... ok test.unit.common.middleware.test_slo.TestSloHeadManifest.test_if_none_match_etag_matching_with_override test.unit.common.middleware.test_slo.TestSloHeadManifest.test_if_none_match_etag_matching_with_override ... ok test.unit.common.middleware.test_slo.TestSloHeadManifest.test_zero_byte_manifest test.unit.common.middleware.test_slo.TestSloHeadManifest.test_zero_byte_manifest ... ok test.unit.common.middleware.test_tempauth.PrefixAccount.test_blank_reseller test.unit.common.middleware.test_tempauth.PrefixAccount.test_blank_reseller ... ok test.unit.common.middleware.test_tempauth.PrefixAccount.test_default test.unit.common.middleware.test_tempauth.PrefixAccount.test_default ... ok test.unit.common.middleware.test_tempauth.PrefixAccount.test_multiple_resellers test.unit.common.middleware.test_tempauth.PrefixAccount.test_multiple_resellers ... ok test.unit.common.middleware.test_tempauth.PrefixAccount.test_same_as_default test.unit.common.middleware.test_tempauth.PrefixAccount.test_same_as_default ... ok test.unit.common.middleware.test_tempauth.TestParseUserCreation.test_account_with_no_user test.unit.common.middleware.test_tempauth.TestParseUserCreation.test_account_with_no_user ... ok test.unit.common.middleware.test_tempauth.TestParseUserCreation.test_base64_encoding test.unit.common.middleware.test_tempauth.TestParseUserCreation.test_base64_encoding ... ok test.unit.common.middleware.test_tempauth.TestParseUserCreation.test_key_with_no_value test.unit.common.middleware.test_tempauth.TestParseUserCreation.test_key_with_no_value ... ok test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info_but_wrong_container test.unit.obj.test_server.TestObjectController.test_delete_at_update_put_with_info_but_wrong_container ... ok test.unit.common.middleware.test_tempauth.TestParseUserCreation.test_parse_user_creation test.unit.common.middleware.test_tempauth.TestParseUserCreation.test_parse_user_creation ... ok test.unit.common.middleware.test_tempurl.TestTempurlWarning.test_deprecation_warning test.unit.common.middleware.test_tempurl.TestTempurlWarning.test_deprecation_warning ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_DELETE_on_expired_versioned_object test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_DELETE_on_expired_versioned_object ... ok test.unit.obj.test_server.TestObjectController.test_delete_backend_replication test.unit.obj.test_server.TestObjectController.test_delete_backend_replication ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_delete_latest_version_success test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_delete_latest_version_success ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_denied_DELETE_of_versioned_object test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_denied_DELETE_of_versioned_object ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_partially_upgraded_cluster test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_partially_upgraded_cluster ... ok test.unit.obj.test_server.TestObjectController.test_device_unavailable test.unit.obj.test_server.TestObjectController.test_device_unavailable ... ok test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_partially_upgraded_cluster_single_result_on_second_page test.unit.common.middleware.test_versioned_writes.VersionedWritesOldContainersTestCase.test_partially_upgraded_cluster_single_result_on_second_page ... ok test.unit.obj.test_server.TestObjectController.test_dynamic_datadir test.unit.obj.test_server.TestObjectController.test_dynamic_datadir ... ok test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 2662 "-" "-" "-" 0.0017 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0103 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0079 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0114 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0022 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1645 "-" "-" "-" 0.0059 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/.shards_a/c" 202 - "-" "-" "-" 0.0064 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/.shards_a/c" 200 1653 "-" "-" "-" 0.0035 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0074 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0055 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0056 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0056 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0159 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0026 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 53 "-" "-" "-" 0.0055 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0077 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0067 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 321 "-" "-" "-" 0.0056 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0013 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0065 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0002 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0073 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0066 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/xmlc" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/xmlc/0" 201 - "-" "-" "-" 0.0046 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/xmlc/1" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/xmlc/2" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0036 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0012 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0063 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0062 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0142 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0062 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/xmlc" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/xmlc" 200 545 "-" "-" "-" 0.0023 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0113 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0021 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0036 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 400 21 "-" "-" "-" 0.0002 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 406 - "-" "-" "-" 0.0003 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 400 34 "-" "-" "-" 0.0005 "-" 1824512 -test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_component_different_builder_order test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_component_different_builder_order ... ok test.unit.container.test_server.TestContainerController.test_HEAD_invalid_format test.unit.container.test_server.TestContainerController.test_HEAD_invalid_format ... ok test.unit.container.test_server.TestContainerController.test_HEAD_invalid_partition test.unit.container.test_server.TestContainerController.test_HEAD_invalid_partition ... ok test.unit.container.test_server.TestContainerController.test_HEAD_not_found test.unit.container.test_server.TestContainerController.test_HEAD_not_found ... ok test.unit.container.test_server.TestContainerController.test_HEAD_timestamp_with_offset test.unit.container.test_server.TestContainerController.test_HEAD_timestamp_with_offset ... ok test.unit.container.test_server.TestContainerController.test_OPTIONS test.unit.container.test_server.TestContainerController.test_OPTIONS ... ok test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components ... ok test.unit.obj.test_server.TestObjectController.test_extra_headers_contain_object_bytes test.unit.obj.test_server.TestObjectController.test_extra_headers_contain_object_bytes ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items_is_green test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items_is_green ... ok test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_different_builders test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_different_builders ... ok test.unit.obj.test_server.TestObjectController.test_global_conf_callback_does_nothing test.unit.obj.test_server.TestObjectController.test_global_conf_callback_does_nothing ... ok test.unit.container.test_server.TestContainerController.test_POST_HEAD_metadata test.unit.container.test_server.TestContainerController.test_POST_HEAD_metadata ... ok test.unit.obj.test_server.TestObjectController.test_global_conf_callback_replication_semaphore test.unit.obj.test_server.TestObjectController.test_global_conf_callback_replication_semaphore ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769986.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/00f/daeb4b33482ba0957987c36a50e7900f/daeb4b33482ba0957987c36a50e7900f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769991.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/c06/fcf5ad9577f95d312d25b6c4e66bfc06/fcf5ad9577f95d312d25b6c4e66bfc06.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769996.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/39e/fbf2358e38a5c56a22314c34028b539e/fbf2358e38a5c56a22314c34028b539e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770001.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/5e6/0505ffd42c4fe4c906142adc44f4e5e6/0505ffd42c4fe4c906142adc44f4e5e6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770011.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/03a/639b685a0d495f2e38c24576f8cb303a/639b685a0d495f2e38c24576f8cb303a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770016.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/4c8/2c74f270d1f22425e8cbd85329ca24c8/2c74f270d1f22425e8cbd85329ca24c8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770021.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/391/ff29e588b25ff3499d245fee7e673391/ff29e588b25ff3499d245fee7e673391.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770026.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7d5/12afa896fd8019e512e47c77444f47d5/12afa896fd8019e512e47c77444f47d5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770031.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/bd8/f2b5151d9d5433c1f97d3552388bfbd8/f2b5151d9d5433c1f97d3552388bfbd8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770036.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/08a/0bac0223be629936f85e27e7da2aa08a/0bac0223be629936f85e27e7da2aa08a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770041.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/1f2/d57221a0da77a6a9b83e2fc532fc11f2/d57221a0da77a6a9b83e2fc532fc11f2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770046.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/fab/e0b9deaff7e8658d413d95e5b3ea1fab/e0b9deaff7e8658d413d95e5b3ea1fab.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770051.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/523/1990b221902d604fa1229244eead0523/1990b221902d604fa1229244eead0523.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770056.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/09a/873d68a9ce955afe64a4bb76a326c09a/873d68a9ce955afe64a4bb76a326c09a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770061.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/bdf/7131d6a6fe2b9accd5a2f8eec2ea8bdf/7131d6a6fe2b9accd5a2f8eec2ea8bdf.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770066.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f4a/8230badf84a278d302008f5674bb0f4a/8230badf84a278d302008f5674bb0f4a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770071.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/0ee/e79ab44d89db60761752903205ed50ee/e79ab44d89db60761752903205ed50ee.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770076.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/2cd/5ed65aca28706155baaa427c462ba2cd/5ed65aca28706155baaa427c462ba2cd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770081.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/3b1/d38b61f2053ea8ee998fbe21ba9d83b1/d38b61f2053ea8ee998fbe21ba9d83b1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770086.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f1a/64edae903855c5b0f707ff871ed22f1a/64edae903855c5b0f707ff871ed22f1a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770091.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/d61/bb8e562d291f948c9317f51fd8db6d61/bb8e562d291f948c9317f51fd8db6d61.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770096.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7ce/a586972b9c5699f8c03e4f4c339567ce/a586972b9c5699f8c03e4f4c339567ce.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770101.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/89f/1317af59b5842ca7fdf5b268bd94289f/1317af59b5842ca7fdf5b268bd94289f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770106.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/0f3/0cac656fc49d06e2a7fdcc19989b10f3/0cac656fc49d06e2a7fdcc19989b10f3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770111.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7a2/72321bc1622ab13d5d961c77be5037a2/72321bc1622ab13d5d961c77be5037a2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770116.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/c18/0cdfcd36b296a4e98c829b445b89ec18/0cdfcd36b296a4e98c829b445b89ec18.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770121.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/d4f/3d3499deb50e781b5841ed9df4873d4f/3d3499deb50e781b5841ed9df4873d4f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770126.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/101/b00ee0542d4ea27c4704a4e08ac3e101/b00ee0542d4ea27c4704a4e08ac3e101.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770131.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e6c/8c740096650402e4eab2b7d74e919e6c/8c740096650402e4eab2b7d74e919e6c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770136.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/af5/1a7fa1f74fd808aa72933fde0806eaf5/1a7fa1f74fd808aa72933fde0806eaf5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770141.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/6e7/51a4e80eab87e66599eae93447ada6e7/51a4e80eab87e66599eae93447ada6e7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770146.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ab3/cd301fbc5feac7014d9b029c59741ab3/cd301fbc5feac7014d9b029c59741ab3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770151.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/dc8/05672acb88159105c27c6eeb07734dc8/05672acb88159105c27c6eeb07734dc8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770156.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/3cf/c829193ce57810651471e3df634a03cf/c829193ce57810651471e3df634a03cf.dbtest.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_different_number_builders test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_different_number_builders ... ok test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_duplicate_builder_ids test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_duplicate_builder_ids ... ok test.unit.obj.test_server.TestObjectController.test_handling_of_replication_semaphore_config test.unit.obj.test_server.TestObjectController.test_handling_of_replication_semaphore_config ... ok test.unit.obj.test_server.TestObjectController.test_init test.unit.obj.test_server.TestObjectController.test_init ... ok test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_insufficient_builders test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_insufficient_builders ... ok test.unit.container.test_server.TestContainerController.test_POST_HEAD_no_timestamp_update test.unit.container.test_server.TestContainerController.test_POST_HEAD_no_timestamp_update ... ok test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_missing_builder_id test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_missing_builder_id ... ok test.unit.obj.test_server.TestObjectController.test_insufficient_storage_mount_check_false test.unit.obj.test_server.TestObjectController.test_insufficient_storage_mount_check_false ... ok test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_older_builder test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_older_builder ... ok test.unit.container.test_server.TestContainerController.test_POST_HEAD_sys_metadata test.unit.container.test_server.TestContainerController.test_POST_HEAD_sys_metadata ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items_overwrite test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items_overwrite ... ok test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_replica_count_changed test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_replica_count_changed ... ok test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_unchanged_builders test.unit.common.ring.test_composite_builder.TestLoadComponents.test_load_components_unchanged_builders ... ok test.unit.common.ring.test_io.TestRoundTrip.test_recompressed test.unit.common.ring.test_io.TestRoundTrip.test_recompressed ... ok test.unit.container.test_server.TestContainerController.test_POST_after_DELETE_not_found test.unit.container.test_server.TestContainerController.test_POST_after_DELETE_not_found ... ok Exception ignored in: Traceback (most recent call last): File "/usr/lib/python3.13/gzip.py", line 373, in close test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0053 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 507 109 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: 127.0.0.1 - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: 127.0.0.1 - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: 127.0.0.1 - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: 127.0.0.1 - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0015 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (1.4142s) waiting for [('1.2.3.4:5', 'sdb1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0014 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0015 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from chost:cport/cdevice (txn: 123) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR Container update failed: different numbers of hosts and devices in request: "chost,badhost" vs "cdevice" test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('chost:cport', 'cdevice')] (txn: 123) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "123" "-" 0.0016 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0007 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/%00c/%00o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/%00o" 400 61 "-" "-" "-" 0.0083 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "txn1" "-" 0.0055 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "txn2" "-" 0.0016 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "txn3" "-" 0.0054 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "txn1" "-" 0.0080 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "txn2" "-" 0.0016 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller WARNING: X-Delete-At-Container header must be specified for expiring objects background PUT to work properly. Making best guess as to the container name for now. test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Proxy X-Delete-At-Container '1757769997' does not match expected '1757721521' for current expirer_config. test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 507 109 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 507 109 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 507 109 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c/o" 507 - "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c/o" 507 109 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0093 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0018 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0056 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0054 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller)test.unit.obj.test_server.TestObjectController.test_insufficient_storage_mount_check_true test.unit.obj.test_server.TestObjectController.test_insufficient_storage_mount_check_true ... ok test.unit.obj.test_server.TestObjectController.test_invalid_method_doesnt_exist test.unit.obj.test_server.TestObjectController.test_invalid_method_doesnt_exist ... ok test.unit.obj.test_server.TestObjectController.test_invalid_method_is_not_public test.unit.obj.test_server.TestObjectController.test_invalid_method_is_not_public ... ok test.unit.common.ring.test_io.TestRoundTrip.test_sections test.unit.common.ring.test_io.TestRoundTrip.test_sections ... ok test.unit.common.ring.test_io.TestRoundTrip.test_sections_with_corruption test.unit.common.ring.test_io.TestRoundTrip.test_sections_with_corruption ... ok test.unit.common.ring.test_io.TestRoundTrip.test_sections_with_unsupported_checksum test.unit.common.ring.test_io.TestRoundTrip.test_sections_with_unsupported_checksum ... ok test.unit.common.ring.test_io.TestRoundTrip.test_version_too_high test.unit.common.ring.test_io.TestRoundTrip.test_version_too_high ... ok fileobj.write(self.compress.flush()) File "/usr/lib/python3.13/tempfile.py", line 691, in func_wrapper return func(*args, **kwargs) ValueError: write to closed file test.unit.common.ring.test_io.TestRoundTrip.test_write_failure test.unit.common.ring.test_io.TestRoundTrip.test_write_failure ... ok test.unit.common.ring.test_ring.TestRingData.test_attrs test.unit.common.ring.test_ring.TestRingData.test_attrs ... ok test.unit.common.ring.test_ring.TestRingData.test_byteswapped_serialization test.unit.common.ring.test_ring.TestRingData.test_byteswapped_serialization ... ok test.unit.common.ring.test_ring.TestRingData.test_deserialize_v1 test.unit.common.ring.test_ring.TestRingData.test_deserialize_v1 ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_delete_error test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_delete_error ... ok test.unit.common.ring.test_ring.TestRingData.test_deserialize_v2 test.unit.common.ring.test_ring.TestRingData.test_deserialize_v2 ... ok test.unit.common.ring.test_ring.TestRingData.test_deterministic_serialization test.unit.common.ring.test_ring.TestRingData.test_deterministic_serialization ... ok test.unit.container.test_server.TestContainerController.test_POST_ignores_policy_change test.unit.container.test_server.TestContainerController.test_POST_ignores_policy_change ... ok test.unit.container.test_server.TestContainerController.test_POST_insufficient_space test.unit.container.test_server.TestContainerController.test_POST_insufficient_space ... ok test.unit.container.test_server.TestContainerController.test_POST_invalid_container_sync_to test.unit.container.test_server.TestContainerController.test_POST_invalid_container_sync_to ... ok test.unit.common.ring.test_ring.TestRingData.test_load test.unit.common.ring.test_ring.TestRingData.test_load ... ok test.unit.common.ring.test_ring.TestRingData.test_load_closes_file test.unit.common.ring.test_ring.TestRingData.test_load_closes_file ... ok test.unit.container.test_server.TestContainerController.test_POST_invalid_partition test.unit.container.test_server.TestContainerController.test_POST_invalid_partition ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_empty_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_empty_old_style_shard_container ... ok test.unit.common.ring.test_ring.TestRingData.test_load_metadata_only test.unit.common.ring.test_ring.TestRingData.test_load_metadata_only ... ok test.unit.common.ring.test_ring.TestRingData.test_permissions test.unit.common.ring.test_ring.TestRingData.test_permissions ... ok test.unit.common.ring.test_ring.TestRingData.test_replica_count test.unit.common.ring.test_ring.TestRingData.test_replica_count ... ok test.unit.common.ring.test_ring.TestRingData.test_roundtrip_serialization test.unit.common.ring.test_ring.TestRingData.test_roundtrip_serialization ... ok test.unit.common.ring.test_ring.TestRingData.test_save test.unit.common.ring.test_ring.TestRingData.test_save ... ok Exception ignored in: Traceback (most recent call last): File "/usr/lib/python3.13/gzip.py", line 373, in close fileobj.write(self.compress.flush()) File "/usr/lib/python3.13/tempfile.py", line 691, in func_wrapper return func(*args, **kwargs) ValueError: write to closed file test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_delete_success test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_delete_success ... ok test.unit.common.ring.test_ring.TestRingData.test_save_bad_dev_id_bytes test.unit.common.ring.test_ring.TestRingData.test_save_bad_dev_id_bytes ... ok test.unit.container.test_server.TestContainerController.test_POST_reset_container_sync test.unit.container.test_server.TestContainerController.test_POST_reset_container_sync ... ok test.unit.common.ring.test_ring.TestRingExtensibility.test test.unit.common.ring.test_ring.TestRingExtensibility.test ... ok test.unit.common.ring.test_ring.TestRingExtensibility.test_missing_custom_data test.unit.common.ring.test_ring.TestRingExtensibility.test_missing_custom_data ... ok test.unit.common.test_daemon.TestWorkerDaemon.test_my_worker_daemon test.unit.common.test_daemon.TestWorkerDaemon.test_my_worker_daemon ... ok test.unit.common.test_daemon.TestWorkerDaemon.test_stubs test.unit.common.test_daemon.TestWorkerDaemon.test_stubs ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_client_exception test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_client_exception ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_account test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_account ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_account_failure test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_account_failure ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_account_replication_net test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_account_replication_net ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_error test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_obj_error test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_obj_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_object test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_object ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_get_error test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_get_error ... ok test.unit.container.test_server.TestContainerController.test_POST_timestamp_not_float test.unit.container.test_server.TestContainerController.test_POST_timestamp_not_float ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_replication_net test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_replication_net ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_with_timestamp test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_container_with_timestamp ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_object test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_object ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_object_error test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_object_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_object_with_timestamp test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_delete_object_with_timestamp ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items_overwrite_unicode test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items_overwrite_unicode ... ok test.unit.container.test_server.TestContainerController.test_PUT test.unit.container.test_server.TestContainerController.test_PUT ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_account test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_account ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_account_error test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_account_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_account_no_content_does_not_parse_body test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_account_no_content_does_not_parse_body ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_get_success test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_get_success ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_head_error test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_head_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_container test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_container ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_container_no_content_does_not_decode_body test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_container_no_content_does_not_decode_body ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_container_with_extra_params test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_container_with_extra_params ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_object test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_object ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_object_chunks test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_object_chunks ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_object_error test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_object_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_recon test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_recon ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_suffix_hashes test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_suffix_hashes ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_suffix_hashes_503 test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_suffix_hashes_503 ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_suffix_hashes_507 test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_get_suffix_hashes_507 ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_container test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_container ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_container_deleted test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_container_deleted ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_container_error test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_container_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_container_replication_net test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_container_replication_net ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_object test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_object ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_object_error test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_object_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_object_not_found test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_head_object_not_found ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_post_container test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_post_container ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_post_object test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_post_object ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_post_object_error test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_post_object_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container_chunked test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container_chunked ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container_fail test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container_fail ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container_object test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container_object ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container_object_error test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_container_object_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_args test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_args ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_chunked test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_chunked ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_fail test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_fail ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_head_success test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_head_success ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_header_content_length test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_header_content_length ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_with_content_length test.unit.common.test_direct_client.TestUTF8DirectClient.test_direct_put_object_with_content_length ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_gen_headers test.unit.common.test_direct_client.TestUTF8DirectClient.test_gen_headers ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_retry test.unit.common.test_direct_client.TestUTF8DirectClient.test_retry ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_post_error test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_post_error ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_retry_client_exception test.unit.common.test_direct_client.TestUTF8DirectClient.test_retry_client_exception ... ok test.unit.common.test_direct_client.TestUTF8DirectClient.test_retry_http_exception test.unit.common.test_direct_client.TestUTF8DirectClient.test_retry_http_exception ... ok test.unit.common.test_linkat.TestLinkat.test_available test.unit.common.test_linkat.TestLinkat.test_available ... ok test.unit.common.test_linkat.TestLinkat.test_errno test.unit.common.test_linkat.TestLinkat.test_errno ... ok test.unit.common.test_linkat.TestLinkat.test_flags test.unit.common.test_linkat.TestLinkat.test_flags ... ok test.unit.common.test_linkat.TestLinkat.test_linkat_fd_not_integer test.unit.common.test_linkat.TestLinkat.test_linkat_fd_not_integer ... ok test.unit.common.test_linkat.TestLinkat.test_linkat_success test.unit.common.test_linkat.TestLinkat.test_linkat_success ... ok test.unit.common.test_linkat.TestLinkat.test_unavailable test.unit.common.test_linkat.TestLinkat.test_unavailable ... ok test.unit.common.test_linkat.TestLinkat.test_unavailable_in_libc test.unit.common.test_linkat.TestLinkat.test_unavailable_in_libc ... ok test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/./a/c" 400 20 "-" "-" "-" 0.0002 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 404 - "-" "-" "-" 0.0059 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0158 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0031 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0063 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0077 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0044 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0073 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0010 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0058 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0010 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0056 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0015 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0010 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0054 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0059 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0160 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0025 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/" 404 - "-" "-" "-" 0.0010 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0076 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0048 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0022 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0035 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/./a/c" 400 20 "-" "-" "-" 0.0002 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0046 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0070 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 400 26 "-" "-" "-" 0.0001 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0038 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0056 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0049 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0020 "-" 1824512 0test.unit.container.test_server.TestContainerController.test_PUT_GET_metadata test.unit.container.test_server.TestContainerController.test_PUT_GET_metadata ... ok test.unit.container.test_server.TestContainerController.test_PUT_GET_object_timing_metrics test.unit.container.test_server.TestContainerController.test_PUT_GET_object_timing_metrics ... ok test.unit.common.test_swob.TestMatch.test_match test.unit.common.test_swob.TestMatch.test_match ... ok test.unit.common.test_swob.TestMatch.test_match_lots_of_optional_white_space test.unit.common.test_swob.TestMatch.test_match_lots_of_optional_white_space ... ok test.unit.common.test_swob.TestMatch.test_match_no_optional_white_space test.unit.common.test_swob.TestMatch.test_match_no_optional_white_space ... ok test.unit.common.test_swob.TestMatch.test_match_noquote test.unit.common.test_swob.TestMatch.test_match_noquote ... ok test.unit.common.test_swob.TestMatch.test_match_star test.unit.common.test_swob.TestMatch.test_match_star ... ok test.unit.common.test_utils.TestDistributeEvenly.test_evenly_divided test.unit.common.test_utils.TestDistributeEvenly.test_evenly_divided ... ok test.unit.common.test_utils.TestDistributeEvenly.test_just_one test.unit.common.test_utils.TestDistributeEvenly.test_just_one ... ok test.unit.common.test_utils.TestDistributeEvenly.test_more_buckets_than_items test.unit.common.test_utils.TestDistributeEvenly.test_more_buckets_than_items ... ok test.unit.common.test_utils.TestDistributeEvenly.test_uneven test.unit.common.test_utils.TestDistributeEvenly.test_uneven ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_put_error test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_put_error ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_put_post_success test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_put_post_success ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_507 test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_507 ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_bad_policy test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_bad_policy ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_blocking_last_next_explodes test.unit.common.test_utils.TestGreenAsyncPile.test_blocking_last_next_explodes ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_exceptions_at_end_of_streaming_pile test.unit.common.test_utils.TestGreenAsyncPile.test_exceptions_at_end_of_streaming_pile ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_policy test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_policy ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_exceptions_in_streaming_pile test.unit.common.test_utils.TestGreenAsyncPile.test_exceptions_in_streaming_pile ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_is_asynchronous test.unit.common.test_utils.TestGreenAsyncPile.test_is_asynchronous ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_next_when_empty test.unit.common.test_utils.TestGreenAsyncPile.test_next_when_empty ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_no_blocking_last_next_explodes test.unit.common.test_utils.TestGreenAsyncPile.test_no_blocking_last_next_explodes ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_pending test.unit.common.test_utils.TestGreenAsyncPile.test_pending ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_runs_everything test.unit.common.test_utils.TestGreenAsyncPile.test_runs_everything ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_wait_with_firstn test.unit.common.test_utils.TestGreenAsyncPile.test_wait_with_firstn ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_skip_rehash test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_skip_rehash ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_success test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_replicate_success ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items_post_overwrite_out_of_order test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_items_post_overwrite_out_of_order ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_ssync_bad_policy test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_ssync_bad_policy ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_ssync_error test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_ssync_error ... ok test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_ssync_success test.unit.obj.test_server.TestObjectController.test_legacy_and_labeled_timing_stats_ssync_success ... ok test.unit.obj.test_server.TestObjectController.test_list_allowed_methods test.unit.obj.test_server.TestObjectController.test_list_allowed_methods ... ok test.unit.obj.test_server.TestObjectController.test_log_line_format test.unit.obj.test_server.TestObjectController.test_log_line_format ... ok test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "method_doesnt_exist /sda1/p/a/c/o" 405 91 "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "__init__ /sda1/p/a/c/o" 405 91 "-" "-" "-" 0.0002 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c/o" 507 109 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 507 109 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c/o" 507 - "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "HEAD /sda1/p/a/c/o" 200 6 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 507 109 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 507 109 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "REPLICATE /sda1/p/" 507 109 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "REPLICATE /sda1/p/" 503 23 "-" "-" "-" - "-" 1824531 99 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "REPLICATE /sda1/p/" 200 6 "-" "-" "-" - "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "REPLICATE /sda1/p/123-abc" 200 4 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "REPLICATE /sda1/p/" 200 6 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "SSYNC /sda1/0" 503 23 "-" "-" "-" - "-" 1824531 99 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "SSYNC /sda1/0" 507 109 "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: - - - [13/Sep/2025:13:24:27 +0000] "SSYNC /sda1/0" 200 - "-" "-" "-" - "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: 1.2.3.4 - - [01/Jan/1970:02:46:42 +0000] "HEAD /sda1/p/a/c/o" 404 - "-" "-" "-" 2.0000 "-" 1234 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/1111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111111" 201 - "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/22222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222222" 400 43 "-" "-" "-" 0.0002 "-" 1824531 -test.unit.obj.test_server.TestObjectController.test_max_object_name_length test.unit.obj.test_server.TestObjectController.test_max_object_name_length ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_waitall_timeout_completes test.unit.common.test_utils.TestGreenAsyncPile.test_waitall_timeout_completes ... ok test DEBUG: Get listing from /v1/.shards_a/c_pie?marker=koolaid&format=json&limit=10000&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txe90cb432fd3d454c85d13-0068c57081) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: txe90cb432fd3d454c85d13-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txe90cb432fd3d454c85d13-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_?marker=koolaid&format=json&limit=10000&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txe90cb432fd3d454c85d13-0068c57081) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1024 (txn: txe90cb432fd3d454c85d13-0068c57081) test DEBUG: GET listing from 2 shards for: /v1/a/c?marker=koolaid&reverse=true&format=json&states=listing (txn: txaa4db14a54af4b0dbb215-0068c57081) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txaa4db14a54af4b0dbb215-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_pie?marker=koolaid&reverse=true&format=json&limit=10000&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: txaa4db14a54af4b0dbb215-0068c57081) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: txaa4db14a54af4b0dbb215-0068c57081) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txaa4db14a54af4b0dbb215-0068c57081) test DEBUG: Get listing from /v1/.shards_a/c_ham?marker=koolaid&reverse=true&format=json&limit=10000&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txaa4db14a54af4b0dbb215-0068c57081) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txaa4db14a54af4b0dbb215-0068c57081) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='onion', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Found 1 objects in shard (state=unsharded), total = 41 (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='rhubarb', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9959&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1065 (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Setting object count to 1065 (txn: txe682d456e7354b6c8a19a-0068c57084) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='onion') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=onion%00 {'X-Backend-Record-Type': 'auto'} (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='onion', upper='rhubarb') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=rhubarb%00 {'X-Backend-Record-Type': 'auto'} (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Found 1 objects in shard (state=unsharded), total = 41 (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='rhubarb', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9959&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1065 (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Setting object count to 1065 (txn: tx36c37ad4064f43cf88482-0068c57087) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx54be29bfda2c4dbd99c27-0068c5708a) test DEBUG: GET listing from 0 shards for: /v1/a/c?marker=bb&end_marker=aa&format=json&states=listing (txn: tx54be29bfda2c4dbd99c27-0068c5708a) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx917ba21045294210877de-0068c5708b) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'auto'} (txn: tx917ba21045294210877de-0068c5708b) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=10000&marker=&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: tx917ba21045294210877de-0068c5708b) test DEBUG: Found 1 objects in shard (state=unsharded), total = 1 (txn: tx917ba21045294210877de-0068c5708b) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_c', lower='b', upper='c') .shards_a/c_c with {'X-Backend-Record-Type': 'auto'} (txn: tx917ba21045294210877de-0068c5708b) test DEBUG: Get listing from /v1/.shards_a/c_c?format=json&limit=9999&marker=b&end_marker=c%00 {'X-Backend-Record-Type': 'auto'} (txn: tx917ba21045294210877de-0068c5708b) test DEBUG: Found 1 objects in shard (state=unsharded), total = 2 (txn: tx917ba21045294210877de-0068c5708b)test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_mix_ok_and_unavailable_shards test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_mix_ok_and_unavailable_shards ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_mixed_policies_error test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_mixed_policies_error ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770161.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/08c/f45d9210b6212eaf254db1213ceb608c/f45d9210b6212eaf254db1213ceb608c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770166.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f09/84656f98f1833c32dab85ec6facd5f09/84656f98f1833c32dab85ec6facd5f09.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770171.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/bb2/c54371273cf1be7530f7eb36d8e5cbb2/c54371273cf1be7530f7eb36d8e5cbb2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770176.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/0a4/6c2bd06d9ff1d49fe8a3596d857fd0a4/6c2bd06d9ff1d49fe8a3596d857fd0a4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770181.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/d4e/d13c8ffba692dfd033e7142d847b9d4e/d13c8ffba692dfd033e7142d847b9d4e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770186.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/cc5/e7656707611f0a2c313964e70f3b8cc5/e7656707611f0a2c313964e70f3b8cc5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770191.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a5d/925d8acf14ebdde6dcfc43252c64fa5d/925d8acf14ebdde6dcfc43252c64fa5d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770196.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/35b/920c5e7b31983bd46b1fe49c40d3d35b/920c5e7b31983bd46b1fe49c40d3d35b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770201.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/11c/7d16e14ec52f46841bc806b49a40211c/7d16e14ec52f46841bc806b49a40211c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770206.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a73/f542dec40ea7013817cb80b3250cba73/f542dec40ea7013817cb80b3250cba73.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770211.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/5b8/721c343aaced8caf8c06360bb112a5b8/721c343aaced8caf8c06360bb112a5b8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770216.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/d3d/ebfd8cff9713746160e0fe8163a35d3d/ebfd8cff9713746160e0fe8163a35d3d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770221.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/cfa/0dfbfd23c47271d53bb5c50750c69cfa/0dfbfd23c47271d53bb5c50750c69cfa.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770226.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/05d/1ca50b7e8f0be0e47cbd6af2bb64b05d/1ca50b7e8f0be0e47cbd6af2bb64b05d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770231.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/d4d/3ef7eedfd968e5ef0cfa68d5de60ed4d/3ef7eedfd968e5ef0cfa68d5de60ed4d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770236.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e31/744f1c1ca728fd5ba0990a5ceb2bae31/744f1c1ca728fd5ba0990a5ceb2bae31.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770241.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/b2e/6d67e229502e7d264b818584db2f8b2e/6d67e229502e7d264b818584db2f8b2e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770246.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/33f/11275d8c4f282bce16d7e666d31e633f/11275d8c4f282bce16d7e666d31e633f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770251.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/273/16be9d7ef776b86babdbb2c7bda6e273/16be9d7ef776b86babdbb2c7bda6e273.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770256.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ed5/4cc0102e10ae8b725bcec485876dced5/4cc0102e10ae8b725bcec485876dced5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770261.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/8c3/c9f491bf00483970a7b478f4797bb8c3/c9f491bf00483970a7b478f4797bb8c3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770266.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/3a1/5ea151e8adbc495bb49b58ea5bf963a1/5ea151e8adbc495bb49b58ea5bf963a1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770271.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ce3/7a8d5c91865081ce714a3efdbe109ce3/7a8d5c91865081ce714a3efdbe109ce3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770276.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e79/23e44193a7e89364c4de0c683a366e79/23e44193a7e89364c4de0c683a366e79.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770281.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/203/1c5c1e3bc10ed5890b5a9e2edd756203/1c5c1e3bc10ed5890b5a9e2edd756203.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770286.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ee4/876999b37f9a9212531ac17cc9a7fee4/876999b37f9a9212531ac17cc9a7fee4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770291.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/71e/eed07c456f06c473352aff3a1174e71e/eed07c456f06c473352aff3a1174e71e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770296.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/bcf/69fd05fb5ed2093ce8115955ec777bcf/69fd05fb5ed2093ce8115955ec777bcf.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770301.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/9d6/33a23f05f413011c5380cb75b38169d6/33a23f05f413011c5380cb75b38169d6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770306.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f03/ada859bf2f427ec91bcfdba66cc7af03/ada859bf2f427ec91bcfdba66cc7af03.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770311.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/9c4/b3fdbda4a2bc45ceeb21456cfffc09c4/b3fdbda4a2bc45ceeb21456cfffc09c4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770316.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f43/638930869d7405d1661733d0243e3f43/638930869d7405d1661733d0243e3f43.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770321.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/5ea/390cfd8b186db256509afc34dff9b5ea/390cfd8b186db256509afc34dff9b5ea.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770326.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/5e9/765e3edc372f40b7685783935b6ca5e9/765e3edc372f40b7685783935b6ca5e9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770331.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/cbc/b2c1c0249d12ae9f5d221ed14d779cbc/b2c1c0249d12ae9f5d221ed14d779cbc.db test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0086 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0109 "-" 1824512 0 test INFO: - - - [01/Jan/1970:00:16:40 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" - "-" 1824512 - test INFO: - - - [01/Jan/1970:00:16:40 +0000] "GET /sda1/p/a/c" 200 117 "-" "-" "-" - "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0074 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/obj_0" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c/obj_1" 201 - "-" "-" "-" 0.0008 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0025 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 255 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1683 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1683 "-" "-" "-" 0.0026 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 332 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 340 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 676 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 330 "-" "-" "-" 0.0024 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 330 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 670 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 670 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1021 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1021 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1323 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1323 "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 657 "-" "-" "-" 0.0055 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 657 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1339 "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1339 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 318 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 318 "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 324 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 324 "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0080 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 340 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 340 "-" "-" "-" 0.0013 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1353 "-" "-" "-" 0.0025 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0081 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1017 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1017 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 677 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 677 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1351 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1353 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1017 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1017 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1006 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 677 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1351 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 677 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 676 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 676 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1021 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 1021 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 685 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 685 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 345 "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0012 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0011 "-" 1824512 0test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_shard_range_single_record test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_shard_range_single_record ... ok test.unit.container.test_server.TestContainerController.test_PUT_GET_shard_ranges test.unit.container.test_server.TestContainerController.test_PUT_GET_shard_ranges ... ok test.unit.container.test_server.TestContainerController.test_PUT_GET_shards_timing_metrics test.unit.container.test_server.TestContainerController.test_PUT_GET_shards_timing_metrics ... ok test.unit.container.test_server.TestContainerController.test_PUT_GET_sys_metadata test.unit.container.test_server.TestContainerController.test_PUT_GET_sys_metadata ... ok test.unit.container.test_server.TestContainerController.test_PUT_GET_to_sharding_container test.unit.container.test_server.TestContainerController.test_PUT_GET_to_sharding_container ... ok test.unit.container.test_server.TestContainerController.test_PUT_HEAD_put_timestamp_updates test.unit.container.test_server.TestContainerController.test_PUT_HEAD_put_timestamp_updates ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_shard_redirects_between_shards test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_shard_redirects_between_shards ... ok test.unit.container.test_server.TestContainerController.test_PUT_account_update test.unit.container.test_server.TestContainerController.test_PUT_account_update ... ok test.unit.container.test_server.TestContainerController.test_PUT_bad_policy_change test.unit.container.test_server.TestContainerController.test_PUT_bad_policy_change ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770336.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/8d7/3336ecfb5a79b53d71c20bf680da18d7/3336ecfb5a79b53d71c20bf680da18d7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770341.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/8c4/5c1c65bc6c81ebd669af0e0ba4c148c4/5c1c65bc6c81ebd669af0e0ba4c148c4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770346.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a9c/f8cda812c747d2a7074c1bb185fc4a9c/f8cda812c747d2a7074c1bb185fc4a9c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770351.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/271/e6cfbc5ca1565a00a661269c4a8a5271/e6cfbc5ca1565a00a661269c4a8a5271.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770356.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/8b0/d55ffe9917c51ae2e1e9173ff3aa78b0/d55ffe9917c51ae2e1e9173ff3aa78b0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770361.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/cc7/e2d371ad20db82d41841073ea9765cc7/e2d371ad20db82d41841073ea9765cc7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770366.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/442/472fca8c5eaab35e9902d595d7189442/472fca8c5eaab35e9902d595d7189442.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770371.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/986/886dc7d702da91fab1dc06bdf989f986/886dc7d702da91fab1dc06bdf989f986.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770376.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/96f/81378748d61dba6eada5eac44543f96f/81378748d61dba6eada5eac44543f96f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770381.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f1e/ef2f6e3fb85a4124aeaf95ef86d68f1e/ef2f6e3fb85a4124aeaf95ef86d68f1e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770386.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/75a/f4a47e2915dc1e82535f926634bab75a/f4a47e2915dc1e82535f926634bab75a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770391.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/1f1/75ee0aa17e5b12d69a22c8e014a161f1/75ee0aa17e5b12d69a22c8e014a161f1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770396.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a64/9201b46eeb09c9fdf5575af0c3c98a64/9201b46eeb09c9fdf5575af0c3c98a64.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770401.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/718/8d742a96394ca24c12635a0a760ae718/8d742a96394ca24c12635a0a760ae718.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770406.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e9d/eeddd4dd16e7e7636c909a88193c2e9d/eeddd4dd16e7e7636c909a88193c2e9d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770411.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/eae/a8b4d5df698e2ab6d1cdf79de03e0eae/a8b4d5df698e2ab6d1cdf79de03e0eae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770416.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/81e/e7b90af0706b2494cb57799107d8a81e/e7b90af0706b2494cb57799107d8a81e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770421.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/2c5/84a3b92395f399bae081d517adb712c5/84a3b92395f399bae081d517adb712c5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770426.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/698/42bce5dae6cb5b2f337c45c042c73698/42bce5dae6cb5b2f337c45c042c73698.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770431.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/aca/3123bcb0b8289eb1627a2fef842ccaca/3123bcb0b8289eb1627a2fef842ccaca.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770436.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/5ed/3ca52fadcf786229e783b074292605ed/3ca52fadcf786229e783b074292605ed.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770441.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/3ae/6dd71413d977c75d7f62ab20f438c3ae/6dd71413d977c75d7f62ab20f438c3ae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770446.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/814/b656dfdaeaf54c09c0ef908011e95814/b656dfdaeaf54c09c0ef908011e95814.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770451.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/821/7028558593924a73df9c9a8bde3d0821/7028558593924a73df9c9a8bde3d0821.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770456.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a71/b07d877f4d18eef9ff912076acdb0a71/b07d877f4d18eef9ff912076acdb0a71.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770461.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a37/ee0d051da9c037ff7100432294011a37/ee0d051da9c037ff7100432294011a37.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770466.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a34/432b8d264fd331590a825ae899b1ba34/432b8d264fd331590a825ae899b1ba34.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770471.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/95a/1e896678e403994dad0f1f1bcfc8695a/1e896678e403994dad0f1f1bcfc8695a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770476.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/602/200c3c2d39dd310500adcf2eec027602/200c3c2d39dd310500adcf2eec027602.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770481.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7ef/409d7f17b593b4c65f03c39c0907e7ef/409d7f17b593b4c65f03c39c0907e7ef.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770486.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/272/a5852d390b5c9eec512e1d8d5bb75272/a5852d390b5c9eec512e1d8d5bb75272.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770491.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/0f3/f1e2dd88211a58833c496871a786e0f3/f1e2dd88211a58833c496871a786e0f3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770496.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/1a6/c82233504ba41c9c0963c32d96cdf1a6/c82233504ba41c9c0963c32d96cdf1a6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770501.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ca0/327a2bdad82055d011350528dda62ca0/327a2bdad82055d011350528dda62ca0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770506.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/1f2/2350dba591b57dfe3366e1e48e0951f2/2350dba591b57dfe3366e1e48e0951f2.dbtest.unit.container.test_server.TestContainerController.test_PUT_bad_policy_specified test.unit.container.test_server.TestContainerController.test_PUT_bad_policy_specified ... ok test.unit.container.test_server.TestContainerController.test_PUT_container_timing_metrics test.unit.container.test_server.TestContainerController.test_PUT_container_timing_metrics ... ok test.unit.container.test_server.TestContainerController.test_PUT_good_policy_specified test.unit.container.test_server.TestContainerController.test_PUT_good_policy_specified ... ok test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:27 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0022 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0063 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0061 "-" 1824512 0 test DEBUG: Unlinked retiring db '/tmp/tmpwubi2i3d/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 666 "-" "-" "-" 0.0118 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 1337 "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 336 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 1353 "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 1347 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 340 "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/" 200 1017 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/" 200 330 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/" 200 330 "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/" 200 1017 "-" "-" "-" 0.0025 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [01/Jan/1970:00:16:40 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" - "-" 1824512 0 test INFO: - - - [01/Jan/1970:00:16:40 +0000] "GET /sda1/p/a/c" 200 664 "-" "-" "-" - "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0038 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0016 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0024 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0037 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/unsharded" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 134 "-" "-" "-" 0.0031 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/sharding" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 134 "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/racing_update" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 134 "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 200 134 "-" "-" "-" 0.0035 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0021 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0118 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0028 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 404 - "-" "-" "-" 0.0029 "-" 1824512 - test ERROR: ERROR Account update failed with 127.0.0.1:39173/sda1 (will retry later): Response 503 OK test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0026 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0036 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 409 - "-" "-" "-" 0.0020 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0020 "-" 1824512 1 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 400 45 "-" "-" "-" 0.0006 "-" 1824512 nada test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [01/Jan/1970:00:16:40 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" - "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0019 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf'test.unit.container.test_server.TestContainerController.test_PUT_insufficient_space test.unit.container.test_server.TestContainerController.test_PUT_insufficient_space ... ok test.unit.container.test_server.TestContainerController.test_PUT_invalid_partition test.unit.container.test_server.TestContainerController.test_PUT_invalid_partition ... ok test.unit.container.test_server.TestContainerController.test_PUT_no_policy_change test.unit.container.test_server.TestContainerController.test_PUT_no_policy_change ... ok test.unit.container.test_server.TestContainerController.test_PUT_no_policy_for_existing_default test.unit.container.test_server.TestContainerController.test_PUT_no_policy_for_existing_default ... ok test.unit.container.test_server.TestContainerController.test_PUT_no_policy_for_existing_non_default test.unit.container.test_server.TestContainerController.test_PUT_no_policy_for_existing_non_default ... ok test.unit.container.test_server.TestContainerController.test_PUT_no_policy_specified test.unit.container.test_server.TestContainerController.test_PUT_no_policy_specified ... ok test.unit.container.test_server.TestContainerController.test_PUT_non_utf8_metadata test.unit.container.test_server.TestContainerController.test_PUT_non_utf8_metadata ... ok test.unit.container.test_server.TestContainerController.test_PUT_obj_not_found test.unit.container.test_server.TestContainerController.test_PUT_obj_not_found ... ok test.unit.obj.test_server.TestObjectController.test_max_upload_time test.unit.obj.test_server.TestObjectController.test_max_upload_time ... ok test.unit.obj.test_server.TestObjectController.test_multiphase_put_draining test.unit.obj.test_server.TestObjectController.test_multiphase_put_draining ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_empty_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_empty_shard_container ... ok test.unit.obj.test_server.TestObjectController.test_not_allowed_method test.unit.obj.test_server.TestObjectController.test_not_allowed_method ... ok test.unit.obj.test_server.TestObjectController.test_not_utf8_and_not_logging_requests test.unit.obj.test_server.TestObjectController.test_not_utf8_and_not_logging_requests ... ok test.unit.obj.test_server.TestObjectController.test_object_delete_at_async_update test.unit.obj.test_server.TestObjectController.test_object_delete_at_async_update ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_waitall_timeout_timesout test.unit.common.test_utils.TestGreenAsyncPile.test_waitall_timeout_timesout ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_enable_sharding test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_enable_sharding ... ok test.unit.common.test_utils.TestGreenAsyncPile.test_waitfirst_only_returns_first test.unit.common.test_utils.TestGreenAsyncPile.test_waitfirst_only_returns_first ... ok test.unit.common.test_utils.TestInputProxy.test_bytes_received test.unit.common.test_utils.TestInputProxy.test_bytes_received ... ok test.unit.common.test_utils.TestInputProxy.test_chunk_update_modifies_chunk test.unit.common.test_utils.TestInputProxy.test_chunk_update_modifies_chunk ... ok test.unit.common.test_utils.TestInputProxy.test_close test.unit.common.test_utils.TestInputProxy.test_close ... ok test.unit.common.test_utils.TestInputProxy.test_read_all test.unit.common.test_utils.TestInputProxy.test_read_all ... ok test.unit.common.test_utils.TestInputProxy.test_read_client_disconnect test.unit.common.test_utils.TestInputProxy.test_read_client_disconnect ... ok test.unit.common.test_utils.TestInputProxy.test_read_piecemeal_chunk_update test.unit.common.test_utils.TestInputProxy.test_read_piecemeal_chunk_update ... ok test.unit.common.test_utils.TestInputProxy.test_read_size test.unit.common.test_utils.TestInputProxy.test_read_size ... ok test.unit.common.test_utils.TestInputProxy.test_read_unlimited_chunk_update test.unit.common.test_utils.TestInputProxy.test_read_unlimited_chunk_update ... ok test.unit.common.test_utils.TestInputProxy.test_readline test.unit.common.test_utils.TestInputProxy.test_readline ... ok test.unit.common.test_utils.TestInputProxy.test_readline_client_disconnect test.unit.common.test_utils.TestInputProxy.test_readline_client_disconnect ... ok test.unit.common.test_utils.TestInputProxy.test_readline_piecemeal_chunk_update test.unit.common.test_utils.TestInputProxy.test_readline_piecemeal_chunk_update ... ok test.unit.common.test_utils.TestInputProxy.test_readline_unlimited_chunk_update test.unit.common.test_utils.TestInputProxy.test_readline_unlimited_chunk_update ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_provides_a_swift_log_adapter test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_provides_a_swift_log_adapter ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_provides_statsd_client test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_provides_statsd_client ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_replaces_statsd_client test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_replaces_statsd_client ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_statsd_client_default_conf test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_statsd_client_default_conf ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_statsd_client_non_default_conf test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_statsd_client_non_default_conf ... ok test.unit.obj.test_server.TestObjectController.test_object_update_with_offset test.unit.obj.test_server.TestObjectController.test_object_update_with_offset ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_statsd_client_prefix test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_logger_statsd_client_prefix ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_prefixed_logger_adopts_statsd_client test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_prefixed_logger_adopts_statsd_client ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_exception test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_exception ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_prefixed_logger_calls_get_prefixed_swift_logger test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_prefixed_logger_calls_get_prefixed_swift_logger ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_prefixed_logger_no_statsd_client test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_prefixed_logger_no_statsd_client ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_prefixed_logger_with_mutilated_statsd_client test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_get_prefixed_logger_with_mutilated_statsd_client ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods_client_deleted_from_source test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods_client_deleted_from_source ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods_source_is_none test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods_source_is_none ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods_source_no_statsd_client test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods_source_no_statsd_client ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods_source_statsd_client_is_none test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_patch_statsd_methods_source_statsd_client_is_none ... ok test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_statsd_set_prefix_deprecation test.unit.common.test_utils.TestLoggerStatsdClientDelegation.test_statsd_set_prefix_deprecation ... ok test.unit.common.test_utils.TestParseContentDisposition.test_basic_content_type test.unit.common.test_utils.TestParseContentDisposition.test_basic_content_type ... ok test.unit.common.test_utils.TestParseContentDisposition.test_content_disposition test.unit.common.test_utils.TestParseContentDisposition.test_content_disposition ... ok test.unit.common.test_utils.TestParseContentDisposition.test_content_disposition_without_white_space test.unit.common.test_utils.TestParseContentDisposition.test_content_disposition_without_white_space ... ok test.unit.common.test_utils.TestParseContentDisposition.test_content_type_with_charset test.unit.common.test_utils.TestParseContentDisposition.test_content_type_with_charset ... ok test.unit.common.test_utils.TestRateLimitedIterator.test_limit_after test.unit.common.test_utils.TestRateLimitedIterator.test_limit_after ... ok test.unit.common.test_utils.TestRateLimitedIterator.test_rate_limiting test.unit.common.test_utils.TestRateLimitedIterator.test_rate_limiting ... ok test.unit.common.test_utils.TestRateLimitedIterator.test_rate_limiting_sometimes test.unit.common.test_utils.TestRateLimitedIterator.test_rate_limiting_sometimes ... ok test.unit.common.test_wsgi.TestWorkersStrategy.test_log_sock_exit test.unit.common.test_wsgi.TestWorkersStrategy.test_log_sock_exit ... ok test.unit.obj.test_server.TestObjectController.test_other_methods_reserved_namespace_object test.unit.obj.test_server.TestObjectController.test_other_methods_reserved_namespace_object ... ok test.unit.common.test_wsgi.TestWorkersStrategy.test_loop_timeout test.unit.common.test_wsgi.TestWorkersStrategy.test_loop_timeout ... ok test.unit.common.test_wsgi.TestWorkersStrategy.test_new_worker_socks test.unit.common.test_wsgi.TestWorkersStrategy.test_new_worker_socks ... ok test.unit.common.test_wsgi.TestWorkersStrategy.test_no_fork_sock test.unit.common.test_wsgi.TestWorkersStrategy.test_no_fork_sock ... ok root: STDOUT: test2 root: STDERR: test4 test.unit.common.test_wsgi.TestWorkersStrategy.test_post_fork_hook test.unit.common.test_wsgi.TestWorkersStrategy.test_post_fork_hook ... ok test.unit.common.test_wsgi.TestWorkersStrategy.test_shutdown_sockets test.unit.common.test_wsgi.TestWorkersStrategy.test_shutdown_sockets ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_shard_ranges ... ok root: STDERR: test6 root: STDOUT: a#012b#012c root: STDOUT: d test.unit.common.utils.test_config.TestUtilsConfig.test_TRUE_VALUES test.unit.common.utils.test_config.TestUtilsConfig.test_TRUE_VALUES ... ok test.unit.common.utils.test_config.TestUtilsConfig.test_config_auto_int_value test.unit.common.utils.test_config.TestUtilsConfig.test_config_auto_int_value ... ok test.unit.common.utils.test_config.TestUtilsConfig.test_config_fallocate_value test.unit.common.utils.test_config.TestUtilsConfig.test_config_fallocate_value ... ok test.unit.common.utils.test_config.TestUtilsConfig.test_config_float_value test.unit.common.utils.test_config.TestUtilsConfig.test_config_float_value ... ok test.unit.common.utils.test_config.TestUtilsConfig.test_config_percent_value test.unit.common.utils.test_config.TestUtilsConfig.test_config_percent_value ... ok test.unit.common.utils.test_config.TestUtilsConfig.test_config_positive_int_value test.unit.common.utils.test_config.TestUtilsConfig.test_config_positive_int_value ... ok test.unit.common.utils.test_config.TestUtilsConfig.test_config_request_node_count_value test.unit.common.utils.test_config.TestUtilsConfig.test_config_request_node_count_value ... ok test.unit.common.utils.test_config.TestUtilsConfig.test_config_true_value test.unit.common.utils.test_config.TestUtilsConfig.test_config_true_value ... ok test.unit.common.utils.test_config.TestUtilsConfig.test_non_negative_float test.unit.common.utils.test_config.TestUtilsConfig.test_non_negative_float ... ok test.unit.common.utils.test_config.TestUtilsConfig.test_non_negative_int test.unit.common.utils.test_config.TestUtilsConfig.test_non_negative_int ... ok test.unit.obj.test_server.TestObjectController.test_override_etag_footer_trumps_header test.unit.obj.test_server.TestObjectController.test_override_etag_footer_trumps_header ... ok test.unit.obj.test_server.TestObjectController.test_override_etag_lone_header_footer test.unit.obj.test_server.TestObjectController.test_override_etag_lone_header_footer ... ok fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift DEBUG: Calling S3Api Middleware fake-swift INFO: - - 13/Sep/2025/13/24/27 GET /bucket/object HTTP/1.0 200 - Mozzarella%20Foxfire - - - - - - 0.0010 - - 1757769867.065029621 1757769867.066001415 0 test:tester fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift DEBUG: Calling S3Api Middleware fake-swift INFO: - - 13/Sep/2025/13/24/27 GET /bucket/object%3FX-Amz-Algorithm%3DAWS4-HMAC-SHA256%26X-Amz-Credential%3Dtest%253Atester%252F20250913%252Fus-east-1%252Fs3%252Faws4_request%26X-Amz-Date%3D20250913T132427Z%26X-Amz-Expires%3D1000%26X-Amz-SignedHeaders%3Dhost%26X-Amz-Signature%3DX HTTP/1.0 200 - Mozzarella%20Foxfire - - - - - - 0.0010 - - 1757769867.155499697 1757769867.156474590 0 test:tester fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift WARNING: multipart: No SLO middleware in pipeline fake-swift DEBUG: Calling S3Api Middleware fake-swift DEBUG: Calling S3Api Middleware fake-swift WARNING: multipart: No SLO middleware in pipeline fake-swift ERROR: While processing manifest /v1/AUTH_test/gettest/manifest-abcd, max LO GET time of 86400s exceeded fake-swift ERROR: while fetching /v1/AUTH_test/gettest/manifest-manifest-a, GET of submanifest /v1/AUTH_test/gettest/manifest-a failed with status 403 (

Forbidden

Access was denied to this reso...) fake-swift ERROR: While processing manifest /v1/AUTH_test/gettest/manifest-abcd, got 401 (

Unauthorized

This server could not verif...) while retrieving /v1/AUTH_test/gettest/c_15 fake-swift ERROR: while fetching /v1/AUTH_test/gettest/manifest-abcd, GET of submanifest /v1/AUTH_test/gettest/manifest-bc failed with status 401 (

Unauthorized

This server could not verif...) fake-swift ERROR: Object segment no longer valid: /v1/AUTH_test/gettest/a_5 etag: 594f803b380a41396ed63dca39503542 != wrong! or 5 != 5. fake-swift ERROR: Object segment no longer valid: /v1/AUTH_test/gettest/a_5 etag: 594f803b380a41396ed63dca39503542 != 594f803b380a41396ed63dca39503542 or 5 != 999999. fake-swift ERROR: While processing manifest /v1/AUTH_test/gettest/manifest-not-avail, got 503 (

Service Unavailable

The server is curren...) while retrieving /v1/AUTH_test/gettest/not_avail_obj fake-swift ERROR: While processing manifest /v1/AUTH_test/gettest/manifest-not-exists, got 404 (

Not Found

The resource could not be foun...) while retrieving /v1/AUTH_test/gettest/not_exists_obj fake-swift ERROR: Unable to load SLO manifest: Expecting value: line 1 column 2 (char 1) fake-swift ERROR: Unable to load SLO manifest: Expecting value: line 1 column 2 (char 1) fake-swift ERROR: while fetching /v1/AUTH_test/gettest/manifest-abcd, JSON-decoding of submanifest /v1/AUTH_test/gettest/manifest-bc failed with 500 Internal Error fake-swift ERROR: Bad MD5 checksum for /v1/AUTH_test/gettest/a_5 as part of /v1/AUTH_test/gettest/manifest: headers had 594f803b380a41396ed63dca39503542, but object MD5 was actually fb0e22c79ac75679e9881e6ba183b354 fake-swift ERROR: Object segment no longer valid: /v1/AUTH_test/gettest/b_10 etag: 82136b4240d6ce4ea7d03e51469a393b != wrong! or 10 != 10. fake-swift ERROR: Bad response length for /v1/AUTH_test/gettest/a_5 as part of /v1/AUTH_test/gettest/manifest: headers had 5, but response length was actually 4 fake-swift ERROR: Object segment no longer valid: /v1/AUTH_test/gettest/b_10 etag: 82136b4240d6ce4ea7d03e51469a393b != 82136b4240d6ce4ea7d03e51469a393b or 10 != 999999. fake-swift ERROR: While processing manifest '/v1/AUTH_test/gettest/man1', max recursion depth was exceeded fake-swift ERROR: Unable to load SLO manifest: Expecting value: line 1 column 1 (char 0) fake-swift ERROR: While processing manifest '/v1/AUTH_test/gettest/man1', max recursion depth was exceeded test WARNING: The following digest algorithms are configured but deprecated: sha1. Support will be removed in a future release. direct-client-test ERROR: Object server 1.2.3.4:6200 direct DELETE '/sda/0/%D8%AA%20account/%D8%AA%20container/%D8%AA%20obj/name' gave status 500: 1.2.3.4:6200 500 Internal Error: device sda direct-client-test ERROR: Object server 1.2.3.4:6200 direct DELETE '/sda/0/%D8%AA%20account/%D8%AA%20container/%D8%AA%20obj/name' gave status 500: 1.2.3.4:6200 500 Internal Error: device sda direct-client-test ERROR: Object server 1.2.3.4:6200 direct DELETE '/sda/0/%D8%AA%20account/%D8%AA%20container/%D8%AA%20obj/name' gave status 500: 1.2.3.4:6200 500 Internal Error: device sda direct-client-test ERROR: Kaboom! direct-client-test ERROR: Kaboom! direct-client-test ERROR: Kaboom! test NOTICE: Child 1824514 exiting normally test NOTICE: Started child 88 from parent 1824514 test NOTICE: Started child 89 from parent 1824514 test ERROR: Removing dead child 88 from parent 1824514 test NOTICE: Started child 90 from parent 1824514 test NOTICE: Started child 88 from parent 1824514 test NOTICE: Started child 89 from parent 1824514 test1 STDOUT: test2 STDERR: test4 test5 STDERR: test6 test8 STDOUT: a#012b#012c STDOUT: d test.unit.common.utils.test_logs.TestUtilsLogs.test_LoggerFileObject test.unit.common.utils.test_logs.TestUtilsLogs.test_LoggerFileObject ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_NullLogger test.unit.common.utils.test_logs.TestUtilsLogs.test_NullLogger ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_capture_stdio test.unit.common.utils.test_logs.TestUtilsLogs.test_capture_stdio ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_clean_logger_exception test.unit.common.utils.test_logs.TestUtilsLogs.test_clean_logger_exception ... ok test.unit.obj.test_server.TestObjectController.test_override_etag_sysmeta_footer_trumps_backend_header test.unit.obj.test_server.TestObjectController.test_override_etag_sysmeta_footer_trumps_backend_header ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_log_line test.unit.common.utils.test_logs.TestUtilsLogs.test_get_log_line ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_policy_index test.unit.common.utils.test_logs.TestUtilsLogs.test_get_policy_index ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger_exception_method test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger_exception_method ... ok test.unit.obj.test_server.TestObjectController.test_override_etag_sysmeta_header_trumps_backend_footer test.unit.obj.test_server.TestObjectController.test_override_etag_sysmeta_header_trumps_backend_footer ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger_isolation test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger_isolation ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger_non_string_values test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger_non_string_values ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger_replaces_prefix test.unit.common.utils.test_logs.TestUtilsLogs.test_get_prefixed_swift_logger_replaces_prefix ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger_console test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger_console ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger_custom_log_handlers test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger_custom_log_handlers ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger_name_and_route test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger_name_and_route ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger_sysloghandler_plumbing test.unit.common.utils.test_logs.TestUtilsLogs.test_get_swift_logger_sysloghandler_plumbing ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_log_string_formatter test.unit.common.utils.test_logs.TestUtilsLogs.test_log_string_formatter ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_str_anonymizer test.unit.common.utils.test_logs.TestUtilsLogs.test_str_anonymizer ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_str_anonymizer_python_maddness test.unit.common.utils.test_logs.TestUtilsLogs.test_str_anonymizer_python_maddness ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_str_format_time test.unit.common.utils.test_logs.TestUtilsLogs.test_str_format_time ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_swift_log_formatter test.unit.common.utils.test_logs.TestUtilsLogs.test_swift_log_formatter ... ok test.unit.common.utils.test_logs.TestUtilsLogs.test_swift_log_formatter_max_line_length test.unit.common.utils.test_logs.TestUtilsLogs.test_swift_log_formatter_max_line_length ... ok test.unit.obj.test_server.TestObjectController.test_override_etag_sysmeta_trumps_backend test.unit.obj.test_server.TestObjectController.test_override_etag_sysmeta_trumps_backend ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770511.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/df7/2327b15e58c69b71da0422a34777bdf7/2327b15e58c69b71da0422a34777bdf7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770516.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/0b4/39597c3b239e3e8f67cec929404430b4/39597c3b239e3e8f67cec929404430b4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770521.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e52/a3e501e49d56c5f8470106b92b825e52/a3e501e49d56c5f8470106b92b825e52.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770526.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/3db/91ab9d20ff4dbc6a5eebcc98a8c813db/91ab9d20ff4dbc6a5eebcc98a8c813db.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770531.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/18e/8eb3450da06d921e7b2c128f28a7c18e/8eb3450da06d921e7b2c128f28a7c18e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770536.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ae0/579603b4cf791f384dbc3476b5a79ae0/579603b4cf791f384dbc3476b5a79ae0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770541.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7c0/ba9cc9f4c165416a2e6e40dd833fb7c0/ba9cc9f4c165416a2e6e40dd833fb7c0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770546.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/218/8b5027b46dc064dff0241f2c17c31218/8b5027b46dc064dff0241f2c17c31218.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770551.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/4b8/0acfe1a1ef7b4b5fd759e8b9e22f94b8/0acfe1a1ef7b4b5fd759e8b9e22f94b8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770556.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/913/6815be54308236c2796acf9980f1e913/6815be54308236c2796acf9980f1e913.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770561.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/fde/6c520a9e851a492bfac04c8ee97a1fde/6c520a9e851a492bfac04c8ee97a1fde.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770566.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/3d6/a8031d7dd179bb37d66863a1e57b83d6/a8031d7dd179bb37d66863a1e57b83d6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770571.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/252/62afa42cd1b7bce1bec7f3cf75724252/62afa42cd1b7bce1bec7f3cf75724252.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770576.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/6f3/e7f0bb3be6eb06ca99772578eb84b6f3/e7f0bb3be6eb06ca99772578eb84b6f3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770581.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/bd1/77f781e41cec0571a79b560654097bd1/77f781e41cec0571a79b560654097bd1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770586.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/4f2/9bf4db91773c51c3cbb08fdd2f77f4f2/9bf4db91773c51c3cbb08fdd2f77f4f2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770591.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/179/2ca7adfa44bbab3716f500c44d26b179/2ca7adfa44bbab3716f500c44d26b179.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770596.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/81d/1a6a53fef5ebaabbb01777de1816981d/1a6a53fef5ebaabbb01777de1816981d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770601.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/645/8967ba46f952108a5894f9a726cc6645/8967ba46f952108a5894f9a726cc6645.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770606.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/d14/5a5c98b1cddbf2e0d5bcedf931dacd14/5a5c98b1cddbf2e0d5bcedf931dacd14.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770611.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/c3d/9cb6693a33e249a947308d99d748bc3d/9cb6693a33e249a947308d99d748bc3d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770616.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/117/a471e820577802a49ac344c6d73b1117/a471e820577802a49ac344c6d73b1117.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770621.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/dca/df6a30d2b7f1514bea59ac6591616dca/df6a30d2b7f1514bea59ac6591616dca.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770626.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/208/41fb9151aa8f00967d7d3b0627d32208/41fb9151aa8f00967d7d3b0627d32208.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770631.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/1fe/31b863ceed5ffb4f59bd68976cc8a1fe/31b863ceed5ffb4f59bd68976cc8a1fe.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770636.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/715/df2589f96c32f11da23f070352d3e715/df2589f96c32f11da23f070352d3e715.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770641.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/0cc/7331956a41c021fd4e9f81c60d98f0cc/7331956a41c021fd4e9f81c60d98f0cc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770646.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e03/7445cc1ad6e942590fe7fdbe05be7e03/7445cc1ad6e942590fe7fdbe05be7e03.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770651.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/101/0a7b31f3347176395b0f249035c55101/0a7b31f3347176395b0f249035c55101.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770656.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/db2/5adf917c6f87c59c4f6f59642c2eadb2/5adf917c6f87c59c4f6f59642c2eadb2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770661.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/467/4d8b23eaded9c9d2f18cb4019a3d5467/4d8b23eaded9c9d2f18cb4019a3d5467.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770666.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/4df/efc5b898828a42fa49c5eee9045c54df/efc5b898828a42fa49c5eee9045c54df.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770671.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/23c/c6fcffa014d134a1c62cc761a9db123c/c6fcffa014d134a1c62cc761a9db123c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770676.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f8c/5a5ef3ac2516e8cad6459bc8b0191f8c/5a5ef3ac2516e8cad6459bc8b0191f8c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770681.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/46b/ac7f974d42559cad2efb9200c0a3946b/ac7f974d42559cad2efb9200c0a3946b.dbtest.unit.obj.test_server.TestObjectController.test_race_doesnt_quarantine test.unit.obj.test_server.TestObjectController.test_race_doesnt_quarantine ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_batch_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_batch_reclaim ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_shard_ranges_deleted test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_shard_ranges_deleted ... ok test.unit.obj.test_server.TestObjectController.test_race_with_PUT_POST_PUT test.unit.obj.test_server.TestObjectController.test_race_with_PUT_POST_PUT ... ok test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/./a/c" 400 20 "-" "-" "-" 0.0002 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0074 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0060 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0056 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 1 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0023 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0038 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0012 "-" 1824512 1 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 400 28 "-" "-" "-" 0.0043 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 400 28 "-" "-" "-" 0.0014 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 400 28 "-" "-" "-" 0.0014 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0013 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0004 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/bashful" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0026 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy10" 201 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy10_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy20" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy20_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy30" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy30_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0014 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy40" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy40_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0023 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy50" 201 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy50_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy60" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy60_no_header" 201 - "-" "-" "-" 0.0050 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy70" 201 - "-" "-" "-" 0.0012 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy70_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy80" 201 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpy80_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0055 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier10" 201 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier10_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier20" 301 - "-" "-" "-" 0.0052 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier20_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier30" 301 - "-" "-" "-" 0.0050 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier30_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier40" 301 - "-" "-" "-" 0.0062 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier40_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier50" 201 - "-" "-" "-" 0.0052 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier50_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier60" 301 - "-" "-" "-" 0.0050 "-" 1824512 -test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_chexor test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_chexor ... ok test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.4045 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 408 116 "-" "-" "-" 0.1015 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/0/a/c/o" 201 - "-" "-" "-" 0.0018 "-" 1824531 1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [01/Jan/1970:02:46:41 +0000] "PUT /sda1/p/a/c/o" 405 91 "-" "-" "-" 1.0000 "-" 1234 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test DEBUG: Labeled statsd mode: disabled (test) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from 10.0.0.0:1000/sda test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('10.0.0.1:6201', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0080 "-" 1824531 0 test-object-controller ERROR: ERROR Container update failed (saving for async update later): 500 response from 10.0.0.1:6201/sda1 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('10.0.0.1:8080', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0096 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('10.0.0.1:8080', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0035 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('10.0.0.1:8080', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0058 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/o" 200 5 "-" "-" "-" 0.0006 "-" 1824531 - test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('10.0.0.1:8080', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0085 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('10.0.0.1:8080', 'sda1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0003 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/%00c/%00o%00v1" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/%00o%00v1" 400 61 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/%00c/%00o%00v1" 200 - "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/%00o%00v1" 400 61 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "POST /sda1/p/a/%00c/%00o%00v1" 202 76 "-" "-" "-" 0.0051 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "POST /sda1/p/a/c/%00o%00v1" 400 61 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/%00c/%00o%00v1" 204 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/%00o%00v1" 400 61 "-" "-" "-" 0.0001 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0014 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0016 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0014 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0016 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0014 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0014 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0056 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0014 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0015 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0093 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 404 70 "-" "-" "-" 0.0105 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c/o" 200 9 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0091 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "POST /sda1/p/a/c/o" 503 118 "-" "-" "-" 0.0098 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c/o" 200 9 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test DEBUG: Labeled statsd mode: disabled (test) test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c/o" 200 - "-" "-" "-" 0.0004 "-" 1824531 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/o" 200 - "-" "-" "-" 0.0086 "-" 1824531 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0009 "-" 1824531 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "OPTIONS /sda1/p/a/c/o" 200 - "-" "-" "-" 0.0001 "-" 1824531 -test.unit.obj.test_server.TestObjectController.test_replication_server_call_all_methods test.unit.obj.test_server.TestObjectController.test_replication_server_call_all_methods ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_create_broker test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_create_broker ... ok test.unit.obj.test_server.TestObjectController.test_serv_reserv test.unit.obj.test_server.TestObjectController.test_serv_reserv ... ok test.unit.obj.test_server.TestObjectController.test_short_body test.unit.obj.test_server.TestObjectController.test_short_body ... ok test.unit.obj.test_server.TestObjectController.test_storage_policy_index_is_validated test.unit.obj.test_server.TestObjectController.test_storage_policy_index_is_validated ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_creation test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_creation ... ok test.unit.obj.test_server.TestObjectController.test_updating_multiple_container_servers test.unit.obj.test_server.TestObjectController.test_updating_multiple_container_servers ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_db_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_db_file ... ok test.unit.obj.test_server.TestObjectController.test_updating_multiple_delete_at_container_servers test.unit.obj.test_server.TestObjectController.test_updating_multiple_delete_at_container_servers ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_delete_db_does_not_clear_particular_sharding_meta test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_delete_db_does_not_clear_particular_sharding_meta ... ok test.unit.obj.test_server.TestObjectController.test_x_if_delete_at_formats test.unit.obj.test_server.TestObjectController.test_x_if_delete_at_formats ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_delete_object test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_delete_object ... ok test.unit.obj.test_ssync_sender.TestSenderEC.test_missing_check_non_durable test.unit.obj.test_ssync_sender.TestSenderEC.test_missing_check_non_durable ... ok test.unit.obj.test_ssync_sender.TestSenderEC.test_updates_put_non_durable test.unit.obj.test_ssync_sender.TestSenderEC.test_updates_put_non_durable ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_double_check_trailing_delimiter test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_double_check_trailing_delimiter ... ok test.unit.obj.test_updater.TestRateLimiterBucket.test_bool test.unit.obj.test_updater.TestRateLimiterBucket.test_bool ... ok test.unit.obj.test_updater.TestRateLimiterBucket.test_bucket_ordering test.unit.obj.test_updater.TestRateLimiterBucket.test_bucket_ordering ... ok test.unit.obj.test_updater.TestRateLimiterBucket.test_len test.unit.obj.test_updater.TestRateLimiterBucket.test_len ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_all_found test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_all_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_half_not_found_headers_and_body test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_half_not_found_headers_and_body ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_double_check_trailing_delimiter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_double_check_trailing_delimiter_non_slash ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_half_not_found_statuses test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_half_not_found_statuses ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_handoff test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_handoff ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_insufficient_found_plus_404_507 test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_insufficient_found_plus_404_507 ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_insufficient_found_plus_404_507_and_handoffs_fail test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_insufficient_found_plus_404_507_and_handoffs_fail ... ok test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 499 89 "-" "-" "-" 0.0088 "-" 1824531 - test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0053 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0010 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0041 "-" 1824531 0 test-object-controller DEBUG: - - - [13/Sep/2025:13:24:28 +0000] "REPLICATE /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0001 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0010 "-" 1824531 0 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0010 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "POST /sda1/p/a/c/o" 202 76 "-" "-" "-" 0.0091 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0007 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c/o" 200 6 "-" "-" "-" 0.0006 "-" 1824531 1 test-object-controller DEBUG: - - - [13/Sep/2025:13:24:28 +0000] "REPLICATE /sda1/p/a/c/o" 200 4 "-" "-" "-" 0.0001 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0052 "-" 1824531 1 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 503 22 "-" "-" "-" 0.0001 "-" 1824531 2 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "POST /sda1/p/a/c/o" 503 22 "-" "-" "-" 0.0001 "-" 1824531 2 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "GET /sda1/p/a/c/o" 503 22 "-" "-" "-" 0.0001 "-" 1824531 2 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c/o" 503 22 "-" "-" "-" 0.0001 "-" 1824531 2 test-object-controller DEBUG: - - - [13/Sep/2025:13:24:28 +0000] "REPLICATE /sda1/p/a/c/o" 503 22 "-" "-" "-" 0.0001 "-" 1824531 2 test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 503 22 "-" "-" "-" 0.0001 "-" 1824531 2 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('1.2.3.4:5', 'sdb1'), ('6.7.8.9:10', 'sdf1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0059 "-" 1824531 26 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller DEBUG: Container update timeout (0.0000s) waiting for [('1.2.3.4:5', 'sdb1')] test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0060 "-" 1824531 0 test-object-controller DEBUG: Labeled statsd mode: disabled (test-object-controller) test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0020 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0009 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 400 31 "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0095 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 400 31 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0054 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0010 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0011 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 412 43 "-" "-" "-" 0.0005 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 412 43 "-" "-" "-" 0.0071 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0013 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 412 43 "-" "-" "-" 0.0004 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0012 "-" 1824531 - test-object-controller INFO: - - - [13/Sep/2025:13:24:28 +0000] "DELETE /sda1/p/a/c/o" 412 43 "-" "-" "-" 0.0005 "-" 1824531 - proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: txf3683d97a4fa41dea4b74-0068c5708c) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: txf3683d97a4fa41dea4b74-0068c5708c) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_insufficient_found_plus_507_and_handoffs_fail test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_insufficient_found_plus_507_and_handoffs_fail ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_insufficient_found_plus_timeouts test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_insufficient_found_plus_timeouts ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_limits_expirer_queue_updates test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_limits_expirer_queue_updates ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_missing_one test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_missing_one ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_mostly_found test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_mostly_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_mostly_not_found test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_mostly_not_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_none_found test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_none_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_one_found test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_one_found ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_simple test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_simple ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_with_write_affinity test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_with_write_affinity ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_write_affinity_after_replication test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_write_affinity_after_replication ... ok test.unit.container.test_server.TestContainerController.test_PUT_object_update_redirected_to_shard test.unit.container.test_server.TestContainerController.test_PUT_object_update_redirected_to_shard ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_write_affinity_before_replication test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_DELETE_write_affinity_before_replication ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_GET_all_primaries_error_limited test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_GET_all_primaries_error_limited ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_simple test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_simple ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_find_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_find_shard_ranges ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_x_newest test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_x_newest ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770686.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/607/44d0ecc0855dbb91f3009fbe72b29607/44d0ecc0855dbb91f3009fbe72b29607.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770691.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a9f/c18499be67f6a5800226bc8b8e346a9f/c18499be67f6a5800226bc8b8e346a9f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770696.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/762/d787dc1295eabdd41f9eec07195fe762/d787dc1295eabdd41f9eec07195fe762.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770701.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/8d7/c397e8c84a771e9e1658bce1496dd8d7/c397e8c84a771e9e1658bce1496dd8d7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770706.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/48d/d40ddf25084d44d9cabf66487b64a48d/d40ddf25084d44d9cabf66487b64a48d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770711.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/dd6/5642b45105b809e7485a1ad22aaf4dd6/5642b45105b809e7485a1ad22aaf4dd6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770716.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ec3/74d0c4c4ded3f89ca1448253bf65bec3/74d0c4c4ded3f89ca1448253bf65bec3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770721.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a8d/b652d3e513050aa0b46afec71e506a8d/b652d3e513050aa0b46afec71e506a8d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770726.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/28f/d48e402c0a51e3148dd9263620c3528f/d48e402c0a51e3148dd9263620c3528f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770731.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7f1/f4777d9b6f374026c3e4e588da9537f1/f4777d9b6f374026c3e4e588da9537f1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770736.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/925/1d786f11471002c35e5680158fcf8925/1d786f11471002c35e5680158fcf8925.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770741.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e88/3456e7dc6ba7d383863713af41308e88/3456e7dc6ba7d383863713af41308e88.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770746.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/9c3/4297547afe9ee70245520dbc474909c3/4297547afe9ee70245520dbc474909c3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770751.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/df2/dc2d930c342567af440f8fb2a8c78df2/dc2d930c342567af440f8fb2a8c78df2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770756.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e36/2d57d9856a21c8553dc3fbf46e02fe36/2d57d9856a21c8553dc3fbf46e02fe36.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770761.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/10c/ea89ab45c1c262822a76f3b3fe68610c/ea89ab45c1c262822a76f3b3fe68610c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770766.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/de5/4caf30a65af22ae4bf812912022b4de5/4caf30a65af22ae4bf812912022b4de5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770771.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f76/3f3f529011037a073afb31b4da739f76/3f3f529011037a073afb31b4da739f76.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770776.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/20d/f1c641878d4ea8e0ad70b00ae062620d/f1c641878d4ea8e0ad70b00ae062620d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770781.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/8ab/ac54b191dcb66ffd9fc54125f156d8ab/ac54b191dcb66ffd9fc54125f156d8ab.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770786.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f32/eb9994d1a6d5781fb73bd593e204cf32/eb9994d1a6d5781fb73bd593e204cf32.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770791.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/4e2/2f4dcb10e1f5446e836f1e91fdce84e2/2f4dcb10e1f5446e836f1e91fdce84e2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770796.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/fd6/9afbcfe91366b1eebb870932b5acefd6/9afbcfe91366b1eebb870932b5acefd6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770801.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7b0/fbbd8da18e93e60cd75ab130aa1297b0/fbbd8da18e93e60cd75ab130aa1297b0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770806.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f81/5fb9f5266f07744860b3c3a7ae525f81/5fb9f5266f07744860b3c3a7ae525f81.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770811.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/86c/cae3c53210803730e644ac82faa3886c/cae3c53210803730e644ac82faa3886c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770816.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7cb/006f9a01b1280e915be1b9e4756477cb/006f9a01b1280e915be1b9e4756477cb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770821.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/37b/8c383556313a1b1c3e0c7bf06124037b/8c383556313a1b1c3e0c7bf06124037b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770826.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/467/dcfd0c85144e1183bda6fa811be24467/dcfd0c85144e1183bda6fa811be24467.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770831.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/822/1d603cd6d6592e6fa56c5df5afed2822/1d603cd6d6592e6fa56c5df5afed2822.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770836.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/fae/5bfa840ad3d70abf6e4fd609286a9fae/5bfa840ad3d70abf6e4fd609286a9fae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770841.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/253/372430ae35c92581ab143e0170f1d253/372430ae35c92581ab143e0170f1d253.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770846.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e24/9834ec1dae3034c125c5af4f6e2f3e24/9834ec1dae3034c125c5af4f6e2f3e24.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770851.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/b8b/984a94a2931696510655d5f02cc44b8b/984a94a2931696510655d5f02cc44b8b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770856.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a43/bacd03102854b611938ade58aa5c7a43/bacd03102854b611938ade58aa5c7a43.dbtest.unit.container.test_server.TestContainerController.test_PUT_proxy_default_no_policy_for_existing_default test.unit.container.test_server.TestContainerController.test_PUT_proxy_default_no_policy_for_existing_default ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_x_newest_different_timestamps test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_x_newest_different_timestamps ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_x_newest_with_some_missing test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_x_newest_with_some_missing ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_x_newest_with_two_vector_timestamps test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_HEAD_x_newest_with_two_vector_timestamps ... ok test.unit.container.test_server.TestContainerController.test_PUT_reset_container_sync test.unit.container.test_server.TestContainerController.test_PUT_reset_container_sync ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_find_shard_ranges_errors test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_find_shard_ranges_errors ... ok proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: txb95e8f29bab246728a0e9-0068c5708c) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: txb95e8f29bab246728a0e9-0068c5708c) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.1:1001/sda, error: ERROR Insufficient Storage (txn: txb95e8f29bab246728a0e9-0068c5708c) proxy-server DEBUG: Node is error limited: 10.0.0.1:1001/sda (txn: txb95e8f29bab246728a0e9-0068c5708c) proxy-server ERROR: Object DELETE returning 503 for (503,) (txn: txb95e8f29bab246728a0e9-0068c5708c) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: tx0440c11f5b5d428bae210-0068c5708c) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx18c94f5deac6459e81684-0068c5708c) proxy-server ERROR: Object GET returning 503 for [] (txn: tx18c94f5deac6459e81684-0068c5708c) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_all_primaries_fail_insufficient_handoff_succeeds test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_all_primaries_fail_insufficient_handoff_succeeds ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_all_primaries_fail_sufficient_handoff_succeeds test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_all_primaries_fail_sufficient_handoff_succeeds ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_all_primaries_succeed test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_all_primaries_succeed ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_delete_at_in_past test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_delete_at_in_past ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_delete_at_non_integer test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_delete_at_non_integer ... ok test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier60_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier70" 201 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier70_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier80" 201 - "-" "-" "-" 0.0230 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpier80_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey10" 201 - "-" "-" "-" 0.0012 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey10_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey20" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey20_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey30" 301 - "-" "-" "-" 0.0092 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey30_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey40" 301 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey40_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey50" 201 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey50_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey60" 301 - "-" "-" "-" 0.0052 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey60_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey70" 201 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey70_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey80" 201 - "-" "-" "-" 0.0012 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey80_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/bashful" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/dopey" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test DEBUG: Unlinked retiring db '/tmp/tmpqxb0dld1/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0098 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest10" 201 - "-" "-" "-" 0.0012 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest10_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest20" 301 - "-" "-" "-" 0.0011 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest20_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest30" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest30_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest40" 301 - "-" "-" "-" 0.0052 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest40_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest50" 201 - "-" "-" "-" 0.0053 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest50_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0057 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest60" 301 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest60_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest70" 201 - "-" "-" "-" 0.0010 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest70_no_header" 201 - "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest80" 201 - "-" "-" "-" 0.0014 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c/grumpiest80_no_header" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0038 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0071 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:28 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0053 "-" 1824512 1 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0128 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0022 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.shards_a/shard_c" 404 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.shards_a/shard_c" 400 49 "-" "-" "-" 0.0002 "-" 1824512 -test.unit.container.test_server.TestContainerController.test_PUT_shard_range_autocreates_shard_container test.unit.container.test_server.TestContainerController.test_PUT_shard_range_autocreates_shard_container ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_insufficient_primaries_others_fail_handoffs_404 test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_insufficient_primaries_others_fail_handoffs_404 ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_insufficient_primaries_others_fail_handoffs_fail test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_insufficient_primaries_others_fail_handoffs_fail ... ok test.unit.container.test_server.TestContainerController.test_PUT_shard_range_json_in_body test.unit.container.test_server.TestContainerController.test_PUT_shard_range_json_in_body ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_insufficient_primaries_succeed_others_404 test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_insufficient_primaries_succeed_others_404 ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_limits_expirer_queue_deletes test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_limits_expirer_queue_deletes ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_negative_delete_after test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_negative_delete_after ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_non_int_delete_after test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_non_int_delete_after ... ok test.unit.container.test_server.TestContainerController.test_PUT_shard_range_to_deleted_container test.unit.container.test_server.TestContainerController.test_PUT_shard_range_to_deleted_container ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_sufficient_primaries_succeed_others_404 test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_sufficient_primaries_succeed_others_404 ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_sufficient_primaries_succeed_others_fail test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_POST_sufficient_primaries_succeed_others_fail ... ok test.unit.container.test_server.TestContainerController.test_PUT_simulated_create_race test.unit.container.test_server.TestContainerController.test_PUT_simulated_create_race ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_delete_at_in_past test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_delete_at_in_past ... ok test.unit.container.test_server.TestContainerController.test_PUT_timestamp_not_float test.unit.container.test_server.TestContainerController.test_PUT_timestamp_not_float ... ok test.unit.container.test_server.TestContainerController.test_PUT_utf8 test.unit.container.test_server.TestContainerController.test_PUT_utf8 ... ok test.unit.container.test_server.TestContainerController.test_REPLICATE_complete_rsync_works test.unit.container.test_server.TestContainerController.test_REPLICATE_complete_rsync_works ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_delete_at_non_integer test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_delete_at_non_integer ... ok test.unit.container.test_server.TestContainerController.test_REPLICATE_insufficient_space test.unit.container.test_server.TestContainerController.test_REPLICATE_insufficient_space ... ok test.unit.container.test_server.TestContainerController.test_REPLICATE_rsync_then_merge_works test.unit.container.test_server.TestContainerController.test_REPLICATE_rsync_then_merge_works ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_limits_expirer_queue_deletes test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_limits_expirer_queue_deletes ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_negative_delete_after test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_negative_delete_after ... ok test.unit.container.test_server.TestContainerController.test_REPLICATE_unknown_sync test.unit.container.test_server.TestContainerController.test_REPLICATE_unknown_sync ... ok test.unit.container.test_server.TestContainerController.test_REPLICATE_value_error_works test.unit.container.test_server.TestContainerController.test_REPLICATE_value_error_works ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_find_shard_ranges_with_misplaced_objects test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_find_shard_ranges_with_misplaced_objects ... ok test.unit.container.test_server.TestContainerController.test_UPDATE test.unit.container.test_server.TestContainerController.test_UPDATE ... ok test.unit.container.test_server.TestContainerController.test_UPDATE_autocreate test.unit.container.test_server.TestContainerController.test_UPDATE_autocreate ... ok test.unit.container.test_server.TestContainerController.test__call__raise_timeout test.unit.container.test_server.TestContainerController.test__call__raise_timeout ... ok test.unit.container.test_server.TestContainerController.test_account_update_account_override_deleted test.unit.container.test_server.TestContainerController.test_account_update_account_override_deleted ... ok proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx13468765aab2463ab9d35-0068c5708d) proxy-server ERROR: Object POST returning 503 for (503,) (txn: tx13468765aab2463ab9d35-0068c5708d) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx82b65cd3ad46498f99cb5-0068c5708d) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx6c15706f640e45aa84e82-0068c5708d) proxy-server ERROR: Object POST returning 503 for (503,) (txn: tx6c15706f640e45aa84e82-0068c5708d) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx5e983e2e3eb046a69ab0d-0068c5708d) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.1:1001/sda, error: ERROR Insufficient Storage (txn: tx5e983e2e3eb046a69ab0d-0068c5708d) proxy-server DEBUG: Node is error limited: 10.0.0.1:1001/sda (txn: tx5e983e2e3eb046a69ab0d-0068c5708d) proxy-server ERROR: Object POST returning 503 for (503,) (txn: tx5e983e2e3eb046a69ab0d-0068c5708d) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_non_int_delete_after test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_non_int_delete_after ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_requires_length test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_PUT_requires_length ... ok test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.shards_a/shard_c" 201 - "-" "-" "-" 0.0248 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.shards_a/shard_c" 202 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.shards_a/shard_c" 202 - "-" "-" "-" 0.0017 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 404 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0100 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0060 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 400 74 "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 400 74 "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 400 69 "-" "-" "-" 0.0005 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 400 75 "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 400 35 "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0015 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test DEBUG: Unlinked retiring db '/tmp/tmpup3d4_ew/tmp_test_container_server_ContainerController/sda1/containers/p/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0043 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0013 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0027 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0016 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 400 26 "-" "-" "-" 0.0001 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/b%27%5Cxe2%5Cx98%5Cx83%27" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: - - - [13/Sep/2025:13:24:29 +0000] "REPLICATE /sda1/p/a/" 204 - "-" "-" "-" 0.0003 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: - - - [13/Sep/2025:13:24:29 +0000] "REPLICATE /sda1/p/a/" 204 - "-" "-" "-" 0.0003 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: - - - [13/Sep/2025:13:24:29 +0000] "REPLICATE /sda1/p/a/" 404 - "-" "-" "-" 0.0039 "-" 1824512 - test ERROR: ERROR __call__ error with REPLICATE /sda1/p/a/ : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 1023, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/swift/common/base_storage_server.py", line 71, in _timing_stats resp = func(ctrl, *args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 947, in REPLICATE ret = self.replicator_rpc.dispatch(post_args, args) File "/build/reproducible-path/swift-2.36.0/swift/common/db_replicator.py", line 903, in dispatch return getattr(self, op)( ~~~~~~~^^^^^^^^^^ AttributeError: 'ContainerReplicatorRpc' object has no attribute 'unknown_sync' test DEBUG: - - - [13/Sep/2025:13:24:29 +0000] "REPLICATE /sda1/p/a/" 500 714 "-" "-" "-" 0.0022 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: - - - [13/Sep/2025:13:24:29 +0000] "REPLICATE /sda1/p/a/" 400 49 "-" "-" "-" 0.0003 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0042 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "UPDATE /sda1/p/a/c" 400 41 "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0020 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "UPDATE /sda1/p/a/c" 202 - "-" "-" "-" 0.0021 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 131 "-" "-" "-" 0.0020 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/.a/c" 404 - "-" "-" "-" 0.0004 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "UPDATE /sda1/p/.a/c" 202 - "-" "-" "-" 0.0044 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/.a/c" 200 131 "-" "-" "-" 0.0021 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test ERROR: ERROR __call__ error with PUT /sda1/p/a/c : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 1023, in __call__ res = getattr(self, req.method)(req) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_server.py", line 6149, in mock_put_method raise Exception() Exception test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0045 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf'test.unit.container.test_server.TestContainerController.test_account_update_mismatched_host_device test.unit.container.test_server.TestContainerController.test_account_update_mismatched_host_device ... ok test.unit.container.test_server.TestContainerController.test_acl_container test.unit.container.test_server.TestContainerController.test_acl_container ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_connect_put_node_timeout test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_connect_put_node_timeout ... ok test.unit.container.test_server.TestContainerController.test_change_storage_policy_via_DELETE_then_PUT test.unit.container.test_server.TestContainerController.test_change_storage_policy_via_DELETE_then_PUT ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_container_sync_delete test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_container_sync_delete ... ok test.unit.container.test_server.TestContainerController.test_change_to_default_storage_policy_via_DELETE_then_PUT test.unit.container.test_server.TestContainerController.test_change_to_default_storage_policy_via_DELETE_then_PUT ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_empty test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_empty ... ok test.unit.container.test_server.TestContainerController.test_content_type_on_HEAD test.unit.container.test_server.TestContainerController.test_content_type_on_HEAD ... ok test.unit.container.test_server.TestContainerController.test_correct_allowed_method test.unit.container.test_server.TestContainerController.test_correct_allowed_method ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_container_update_backend_requests test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_container_update_backend_requests ... ok test.unit.container.test_server.TestContainerController.test_create_reserved_namespace_container test.unit.container.test_server.TestContainerController.test_create_reserved_namespace_container ... ok test.unit.container.test_server.TestContainerController.test_create_reserved_object_in_container test.unit.container.test_server.TestContainerController.test_create_reserved_object_in_container ... ok test.unit.container.test_server.TestContainerController.test_creation test.unit.container.test_server.TestContainerController.test_creation ... ok test.unit.container.test_server.TestContainerController.test_delete_auto_create test.unit.container.test_server.TestContainerController.test_delete_auto_create ... ok test.unit.container.test_server.TestContainerController.test_deleted_headers test.unit.container.test_server.TestContainerController.test_deleted_headers ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_delete_at_backend_requests test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_delete_at_backend_requests ... ok test.unit.container.test_server.TestContainerController.test_delimiter_with_reserved test.unit.container.test_server.TestContainerController.test_delimiter_with_reserved ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_brokers test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_brokers ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_expirer_DELETE_suppresses_expirer_queue_updates test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_expirer_DELETE_suppresses_expirer_queue_updates ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_handoff_local_first_default test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_handoff_local_first_default ... ok test.unit.container.test_server.TestContainerController.test_get_and_validate_policy_index test.unit.container.test_server.TestContainerController.test_get_and_validate_policy_index ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_handoff_local_first_non_default test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_handoff_local_first_non_default ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_local_first_best_effort test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_local_first_best_effort ... ok test.unit.container.test_server.TestContainerController.test_insufficient_storage_mount_check_false test.unit.container.test_server.TestContainerController.test_insufficient_storage_mount_check_false ... ok test.unit.container.test_server.TestContainerController.test_insufficient_storage_mount_check_true test.unit.container.test_server.TestContainerController.test_insufficient_storage_mount_check_true ... ok test.unit.container.test_server.TestContainerController.test_invalid_method_doesnt_exist test.unit.container.test_server.TestContainerController.test_invalid_method_doesnt_exist ... ok test ERROR: ERROR Account update failed: different numbers of hosts and devices in request: "127.0.0.1:0" vs "sda1,sda2" test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0073 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0076 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0052 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c2" 201 - "-" "-" "-" 0.0078 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c2" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0074 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0024 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0018 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0010 "-" 1824512 1 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0042 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0032 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/o" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0012 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0059 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/o" 204 - "-" "-" "-" 0.0012 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00c" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00c%00test" 201 - "-" "-" "-" 0.0054 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/" 201 - "-" "-" "-" 0.0036 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/%00o" 400 61 "-" "-" "-" 0.0001 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/.a/c/o" 404 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/.a/c/o" 204 - "-" "-" "-" 0.0033 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/.c/o" 404 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/.c/.o" 404 - "-" "-" "-" 0.0001 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/.shards_a/c/o" 404 - "-" "-" "-" 0.0001 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0032 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/.shards_a/c/o" 204 - "-" "-" "-" 0.0032 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0026 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0010 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c" 404 - "-" "-" "-" 0.0009 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00test02" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 26 "-" "-" "-" 0.0029 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 32 "-" "-" "-" 0.0020 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/container_default" 201 - "-" "-" "-" 0.0045 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/container_default" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c_nada" 400 45 "-" "-" "-" 0.0002 "-" 1824512 nada test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c_999" 400 42 "-" "-" "-" 0.0001 "-" 1824512 999 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c_nulo" 201 - "-" "-" "-" 0.0046 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c_nulo" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c_unu" 201 - "-" "-" "-" 0.0032 "-" 1824512 1 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c_unu" 204 - "-" "-" "-" 0.0013 "-" 1824512 1 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "method_doesnt_exist /sda1/p/a/c" 405 - "-" "-" "-" 0.0002 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf'test.unit.container.test_server.TestContainerController.test_invalid_method_is_not_public test.unit.container.test_server.TestContainerController.test_invalid_method_is_not_public ... ok test.unit.container.test_server.TestContainerController.test_list_allowed_methods test.unit.container.test_server.TestContainerController.test_list_allowed_methods ... ok test.unit.container.test_server.TestContainerController.test_listing_with_reserved test.unit.container.test_server.TestContainerController.test_listing_with_reserved ... ok test.unit.container.test_server.TestContainerController.test_log_line_format test.unit.container.test_server.TestContainerController.test_log_line_format ... ok test.unit.container.test_server.TestContainerController.test_markers_with_reserved test.unit.container.test_server.TestContainerController.test_markers_with_reserved ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_db_state test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_db_state ... ok test.unit.container.test_server.TestContainerController.test_not_allowed_method test.unit.container.test_server.TestContainerController.test_not_allowed_method ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_empty_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_empty_old_style_shard_container ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770861.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/231/4466ee2f2835f3542aed0e85a59ce231/4466ee2f2835f3542aed0e85a59ce231.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770866.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/67f/23522bb7f7993261ad47f62ebdd2c67f/23522bb7f7993261ad47f62ebdd2c67f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770871.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/239/00b67bd171d65b4041e812a112b8d239/00b67bd171d65b4041e812a112b8d239.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770876.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/15a/91dc478fa231b7d716b817d1d5ce515a/91dc478fa231b7d716b817d1d5ce515a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770881.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/2d5/3d93166f075614498816ac1837c1b2d5/3d93166f075614498816ac1837c1b2d5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770886.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/4ea/d25b87099126305b05a0d984a7ab54ea/d25b87099126305b05a0d984a7ab54ea.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770891.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/633/060c4de3a5821fbd6378d99e079a0633/060c4de3a5821fbd6378d99e079a0633.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770896.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/e84/1aff2195b028b97033606d3efd7a6e84/1aff2195b028b97033606d3efd7a6e84.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770901.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/d39/4928d6706a2894748c491c427f5d6d39/4928d6706a2894748c491c427f5d6d39.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770906.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/2ec/99e46c557056c75f510479d3e0ad72ec/99e46c557056c75f510479d3e0ad72ec.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770911.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7e8/cc24d05c145e782f6228716f174aa7e8/cc24d05c145e782f6228716f174aa7e8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770916.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/8e5/4ddfc1bc6ee169d37f361e218e15f8e5/4ddfc1bc6ee169d37f361e218e15f8e5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770921.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/93b/400ef350c7028c1c297cda297fa2293b/400ef350c7028c1c297cda297fa2293b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770926.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/04c/33576de24b9f2054d8f4f31db03c504c/33576de24b9f2054d8f4f31db03c504c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770931.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/88a/97c26d329eb8bd93fe0cb81f83bec88a/97c26d329eb8bd93fe0cb81f83bec88a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770936.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/cc2/8dbfa3b86e9a19feb31d6c0635080cc2/8dbfa3b86e9a19feb31d6c0635080cc2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770941.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/767/9767e34ff1159817ff7bfe3dd7a90767/9767e34ff1159817ff7bfe3dd7a90767.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770946.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ea3/d1bdf27be4c7ee60feba91da50887ea3/d1bdf27be4c7ee60feba91da50887ea3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770951.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/f6c/845ff5fc1a553d2fe1f0de4092d4af6c/845ff5fc1a553d2fe1f0de4092d4af6c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770956.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ca9/871058a6dda9564b8b0f8f4779d0dca9/871058a6dda9564b8b0f8f4779d0dca9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770961.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/2c4/6d19c6183b7ef602c35990ddd14fc2c4/6d19c6183b7ef602c35990ddd14fc2c4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770966.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ae0/adb22564293d61eed1dc531ee22bbae0/adb22564293d61eed1dc531ee22bbae0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770971.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/cc2/c8cf3cec074548734e24f46544eb8cc2/c8cf3cec074548734e24f46544eb8cc2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770976.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/d42/9518efd74a3ef40033332ecc8d7efd42/9518efd74a3ef40033332ecc8d7efd42.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770981.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/852/b77fae20d17d45c0694992da797a3852/b77fae20d17d45c0694992da797a3852.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770986.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/299/62524544e5e8786571c1401d0acba299/62524544e5e8786571c1401d0acba299.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770991.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a8e/c3d8829acd4b2e8c50a12d8b0f9e9a8e/c3d8829acd4b2e8c50a12d8b0f9e9a8e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770996.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/ebc/985eee817acf084b9c8c48f871823ebc/985eee817acf084b9c8c48f871823ebc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771001.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/962/e025465395e4131510e9489aaeb71962/e025465395e4131510e9489aaeb71962.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771006.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/1c5/793b1321c38ea5e46e53dda9a96ee1c5/793b1321c38ea5e46e53dda9a96ee1c5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771011.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/575/bcd0332badd360ee07c0a399006c4575/bcd0332badd360ee07c0a399006c4575.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771016.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/d29/4ef76b6a514f8718ed7c5fbfde86fd29/4ef76b6a514f8718ed7c5fbfde86fd29.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771021.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/998/4746a5e08b00fd203039a4a225218998/4746a5e08b00fd203039a4a225218998.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771026.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/0d9/71753fe96a0c7c23a5f7fbf3b5fdd0d9/71753fe96a0c7c23a5f7fbf3b5fdd0d9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771031.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/7b7/d9380713c78e6152919fa488fdbde7b7/d9380713c78e6152919fa488fdbde7b7.dbtest.unit.container.test_server.TestContainerController.test_object_update_with_multiple_timestamps test.unit.container.test_server.TestContainerController.test_object_update_with_multiple_timestamps ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info ... ok test.unit.container.test_server.TestContainerController.test_object_update_with_offset test.unit.container.test_server.TestContainerController.test_object_update_with_offset ... ok test.unit.container.test_server.TestContainerController.test_params_format test.unit.container.test_server.TestContainerController.test_params_format ... ok test.unit.container.test_server.TestContainerController.test_params_utf8 test.unit.container.test_server.TestContainerController.test_params_utf8 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info_is_deleted ... ok test INFO: - - - [13/Sep/2025:13:24:29 +0000] "__init__ /sda1/p/a/c" 405 - "-" "-" "-" 0.0002 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0080 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0131 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 183 "-" "-" "-" 0.0020 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: 1.2.3.4 - - [01/Jan/1970:02:46:42 +0000] "HEAD /sda1/p/a/c" 404 - "-" "-" "-" 2.0000 "-" 1234 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0072 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00test02" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 367 "-" "-" "-" 0.0021 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 184 "-" "-" "-" 0.0020 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0031 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0030 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0006 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0026 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0031 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0029 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0030 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 127 "-" "-" "-" 0.0074 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0035 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "HEAD /sda1/p/a/c" 204 - "-" "-" "-" 0.0011 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 117 "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 116 "-" "-" "-" 0.0040 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0031 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 120 "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c/o" 204 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0030 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 61 "-" "-" "-" 0.0019 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 2 "-" "-" "-" 0.0017 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 400 37 "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 400 33 "-" "-" "-" 0.0001 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 400 34 "-" "-" "-" 0.0001 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 400 32 "-" "-" "-" 0.0001 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 400 34 "-" "-" "-" 0.0001 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 400 38 "-" "-" "-" 0.0001 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 400 34 "-" "-" "-" 0.0001 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0032 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0018 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0017 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 204 - "-" "-" "-" 0.0016 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0042 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00test02" 201 - "-" "-" "-" 0.0004 "-" 1824512 -test.unit.container.test_server.TestContainerController.test_prefix_and_delim_with_reserved test.unit.container.test_server.TestContainerController.test_prefix_and_delim_with_reserved ... ok test.unit.container.test_server.TestContainerController.test_prefix_with_reserved test.unit.container.test_server.TestContainerController.test_prefix_with_reserved ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_local_first_moves_locals_first test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_local_first_moves_locals_first ... ok test.unit.container.test_server.TestContainerController.test_put_auto_create test.unit.container.test_server.TestContainerController.test_put_auto_create ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_local_first_noops_when_no_affinity test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_local_first_noops_when_no_affinity ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info_no_stale_reads test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info_no_stale_reads ... ok test.unit.container.test_server.TestContainerController.test_replication_server_call_all_methods test.unit.container.test_server.TestContainerController.test_replication_server_call_all_methods ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_local_handoff_first_noops_when_no_affinity test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_iter_nodes_local_handoff_first_noops_when_no_affinity ... ok test.unit.container.test_server.TestContainerController.test_serv_reserv test.unit.container.test_server.TestContainerController.test_serv_reserv ... ok test.unit.container.test_server.TestContainerController.test_swift_bytes_in_content_type test.unit.container.test_server.TestContainerController.test_swift_bytes_in_content_type ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_object_DELETE_backend_update_container_ip_default test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_object_DELETE_backend_update_container_ip_default ... ok test.unit.container.test_server.TestContainerController.test_through_call test.unit.container.test_server.TestContainerController.test_through_call ... ok test.unit.container.test_server.TestContainerController.test_through_call_invalid_path test.unit.container.test_server.TestContainerController.test_through_call_invalid_path ... ok test.unit.container.test_server.TestContainerController.test_through_call_invalid_path_utf8 test.unit.container.test_server.TestContainerController.test_through_call_invalid_path_utf8 ... ok test.unit.container.test_server.TestContainerController.test_update_sync_store_on_DELETE test.unit.container.test_server.TestContainerController.test_update_sync_store_on_DELETE ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_repl_object_DELETE_backend_update_container_repl_ip test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_repl_object_DELETE_backend_update_container_repl_ip ... ok test.unit.container.test_server.TestContainerController.test_update_sync_store_on_POST test.unit.container.test_server.TestContainerController.test_update_sync_store_on_POST ... ok test.unit.container.test_server.TestContainerController.test_update_sync_store_on_PUT test.unit.container.test_server.TestContainerController.test_update_sync_store_on_PUT ... ok test.unit.container.test_server.TestContainerController.test_updating_multiple_container_servers test.unit.container.test_server.TestContainerController.test_updating_multiple_container_servers ... ok test.unit.container.test_server.TestContainerController.test_weird_content_types test.unit.container.test_server.TestContainerController.test_weird_content_types ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_check_policy test.unit.obj.test_diskfile.TestDiskFileManager.test_check_policy ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_cleanup_ondisk_files_reclaim_non_data_files test.unit.obj.test_diskfile.TestDiskFileManager.test_cleanup_ondisk_files_reclaim_non_data_files ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_cleanup_ondisk_files_reclaim_with_data_files test.unit.obj.test_diskfile.TestDiskFileManager.test_cleanup_ondisk_files_reclaim_with_data_files ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_cleanup_uses_configured_reclaim_age test.unit.obj.test_diskfile.TestDiskFileManager.test_cleanup_uses_configured_reclaim_age ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_construct_dev_path test.unit.obj.test_diskfile.TestDiskFileManager.test_construct_dev_path ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_focused_yield_hashes_does_not_clean_up test.unit.obj.test_diskfile.TestDiskFileManager.test_focused_yield_hashes_does_not_clean_up ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_smooth_distributed_backend_requests test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_smooth_distributed_backend_requests ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_and_filenames_from_hash test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_and_filenames_from_hash ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_bad_meta_name test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_bad_meta_name ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_some_404s_and_507s test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_some_404s_and_507s ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_dev_path_fail test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_dev_path_fail ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_no_actual_files test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_no_actual_files ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_write_affinity_not_configured test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_write_affinity_not_configured ... ok test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00foo" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00nullish" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0100 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 207 "-" "-" "-" 0.0022 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null" 201 - "-" "-" "-" 0.0116 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00test01" 201 - "-" "-" "-" 0.0045 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00test02" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00null%00foo" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/%00null/%00nullish" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 2 "-" "-" "-" 0.0040 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/%00null" 200 367 "-" "-" "-" 0.0067 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 404 - "-" "-" "-" 0.0007 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.a/c/o" 404 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.a/c/o" 201 - "-" "-" "-" 0.0040 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/.c/o" 404 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/.o" 404 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o" 201 - "-" "-" "-" 0.0034 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.shards_a/c/o" 404 - "-" "-" "-" 0.0002 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.shards_a/c" 404 - "-" "-" "-" 0.0002 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/.shards_a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0033 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o1" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/o2" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 280 "-" "-" "-" 0.0032 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 404 - "-" "-" "-" 0.0004 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /bob" 400 18 "-" "-" "-" 0.0037 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c%D8%3E%2520/%25" 412 29 "-" "-" "-" 0.0001 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0052 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "DELETE /sda1/p/a/c" 204 - "-" "-" "-" 0.0030 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0045 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0023 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "POST /sda1/p/a/c" 204 - "-" "-" "-" 0.0027 "-" 1824512 - test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0046 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 202 - "-" "-" "-" 0.0025 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test ERROR: ERROR account update failed with 1.2.3.4:5/sdb1 (will retry later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 268, in account_update account_response = conn.getresponse() ^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'getresponse' test ERROR: ERROR account update failed with 6.7.8.9:10/sdf1 (will retry later): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/server.py", line 268, in account_update account_response = conn.getresponse() ^^^^^^^^^^^^^^^^ AttributeError: 'NoneType' object has no attribute 'getresponse' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0046 "-" 1824512 0 test DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c" 201 - "-" "-" "-" 0.0034 "-" 1824512 0 test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/0" 201 - "-" "-" "-" 0.0004 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "PUT /sda1/p/a/c/1" 201 - "-" "-" "-" 0.0003 "-" 1824512 - test INFO: - - - [13/Sep/2025:13:24:29 +0000] "GET /sda1/p/a/c" 200 248 "-" "-" "-" 0.0031 "-" 1824512 0 test-TestDiskFileManager WARNING: Unexpected file /tmp/tmpvgb5y6lx/tmp_test_obj_server_DiskFile/8d8956bd-98a1-4dc0-b5dd-127001cce764/junk: Invalid Timestamp value in filename 'junk' Quarantined /srv/dev/objects/9/900/9a7175077c01a23ade5956b8a2bba900 to because it could not be listed Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1570, in get_diskfile_and_filenames_from_hash filenames = self.cleanup_ondisk_files(object_path)['files'] ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_no_data test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_no_data ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_no_dir test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_no_dir ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_no_meta_name test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_no_meta_name ... ok Quarantined /srv/dev/objects/9/900/9a7175077c01a23ade5956b8a2bba900 to because it is not a directory Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1570, in get_diskfile_and_filenames_from_hash filenames = self.cleanup_ondisk_files(object_path)['files'] ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_not_dir test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_not_dir ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_other_oserror test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_other_oserror ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_read_metadata_problem test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_read_metadata_problem ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info_sharding_states test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info_sharding_states ... ok Quarantined /srv/dev/objects/9/900/9a7175077c01a23ade5956b8a2bba900 to because it could not be listed Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1570, in get_diskfile_and_filenames_from_hash filenames = self.cleanup_ondisk_files(object_path)['files'] ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_unclean test.unit.obj.test_diskfile.TestDiskFileManager.test_get_diskfile_from_hash_unclean ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_no_rsync_temp_file_warning test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_no_rsync_temp_file_warning ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_with_empty_dir test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_with_empty_dir ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_with_repl_policy test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_with_repl_policy ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_with_stray_meta test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_with_stray_meta ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_with_unexpected_file test.unit.obj.test_diskfile.TestDiskFileManager.test_get_ondisk_files_with_unexpected_file ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_init test.unit.obj.test_diskfile.TestDiskFileManager.test_init ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server :/ re: Expect: 100-continue on /a/c/o: ConnectionTimeout (0.05s) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_write_affinity_per_policy_config test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_write_affinity_per_policy_config ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_write_affinity_per_policy_config_overrides_and_inherits test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_write_affinity_per_policy_config_overrides_and_inherits ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_init_commit_window test.unit.obj.test_diskfile.TestDiskFileManager.test_init_commit_window ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_listdir test.unit.obj.test_diskfile.TestDiskFileManager.test_listdir ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_listdir_enoent test.unit.obj.test_diskfile.TestDiskFileManager.test_listdir_enoent ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_listdir_other_oserror test.unit.obj.test_diskfile.TestDiskFileManager.test_listdir_other_oserror ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info_stale_read_ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_info_stale_read_ok ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_empty_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_empty_shard_container ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_missing_splice_warning test.unit.obj.test_diskfile.TestDiskFileManager.test_missing_splice_warning ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_object_audit_location_generator test.unit.obj.test_diskfile.TestDiskFileManager.test_object_audit_location_generator ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_parse_on_disk_filename test.unit.obj.test_diskfile.TestDiskFileManager.test_parse_on_disk_filename ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_write_affinity_proxy_server_config test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_write_affinity_proxy_server_config ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_parse_on_disk_filename_errors test.unit.obj.test_diskfile.TestDiskFileManager.test_parse_on_disk_filename_errors ... ok test.unit.container.test_sharder.TestSharder.test_audit_old_style_shard_root_ranges_not_merged_not_cleaving test.unit.container.test_sharder.TestSharder.test_audit_old_style_shard_root_ranges_not_merged_not_cleaving ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_enable_sharding test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_enable_sharding ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_exception test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_exception ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_items_since test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_items_since ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_x_open_expired_custom_config test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_x_open_expired_custom_config ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_x_open_expired_default_config test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerVariousReplicas.test_x_open_expired_default_config ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_namespaces test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_namespaces ... ok test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='c', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx917ba21045294210877de-0068c5708b) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9998&marker=c&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx917ba21045294210877de-0068c5708b) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.0:1000/sda (txn: tx917ba21045294210877de-0068c5708b) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.2:1002/sdc (txn: tx917ba21045294210877de-0068c5708b) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.1:1001/sdb (txn: tx917ba21045294210877de-0068c5708b) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.3:1003/sda (txn: tx917ba21045294210877de-0068c5708b) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.4:1004/sda (txn: tx917ba21045294210877de-0068c5708b) test ERROR: ERROR 503 b'""' Trying to GET /.shards_a/c_ From Container Server 10.0.0.5:1005/sda (txn: tx917ba21045294210877de-0068c5708b) test ERROR: Container GET returning 503 for [503, 503, 503, 503, 503, 503] (txn: tx917ba21045294210877de-0068c5708b) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_?format=json&limit=9998&marker=c&end_marker=&states=listing: 503 (txn: tx917ba21045294210877de-0068c5708b) test ERROR: Aborting listing from shards due to bad response: [200, 200, 503] (txn: tx917ba21045294210877de-0068c5708b) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 1 shards for: /v1/a/c?format=json&states=listing (txn: tx0c119bdf3c6b434f8188c-0068c5708b) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_pie', lower='', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx0c119bdf3c6b434f8188c-0068c5708b) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx0c119bdf3c6b434f8188c-0068c5708b) test ERROR: Aborting listing from shards due to bad shard policy index: 0 (expected 1) (txn: tx0c119bdf3c6b434f8188c-0068c5708b) test DEBUG: GET listing from 1 shards for: /v1/a/c?format=json&states=listing (txn: txe95b479c1cf64941b700f-0068c5708b) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_pie', lower='', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txe95b479c1cf64941b700f-0068c5708b) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txe95b479c1cf64941b700f-0068c5708b) test ERROR: Aborting listing from shards due to bad shard policy index: None (expected 1) (txn: txe95b479c1cf64941b700f-0068c5708b) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: Setting object count to 3120 (txn: tx7489c426b4804b458a6ed-0068c5708d) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e)test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_shard_redirects_to_root_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_shard_redirects_to_root_no_memcache ... ok test.unit.container.test_sharder.TestSharder.test_audit_root_container test.unit.container.test_sharder.TestSharder.test_audit_root_container ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (1-replica): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (4-replica): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (1-replica): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (4-replica): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (1-replica): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (4-replica): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '3 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (1-replica): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (4-replica): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '3 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmp4pc7grw6/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp4pc7grw6/tmp_test_proxy_server_chunked/container-sync-realms.conf'test.unit.container.test_sharder.TestSharder.test_audit_root_container_reset_epoch test.unit.container.test_sharder.TestSharder.test_audit_root_container_reset_epoch ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_partition_lock_and_replication_lock_same_partition test.unit.obj.test_diskfile.TestDiskFileManager.test_partition_lock_and_replication_lock_same_partition ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_find_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_find_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_namespaces_root_container_fill_gap test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_namespaces_root_container_fill_gap ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771036.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/6f9/de36e127df4750060f2942982df916f9/de36e127df4750060f2942982df916f9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771041.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/65e/f011c10bbc7ba1907fd2d7bc239ac65e/f011c10bbc7ba1907fd2d7bc239ac65e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771046.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/fb2/c799d957005cee6642ace40b97cc1fb2/c799d957005cee6642ace40b97cc1fb2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771051.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/c10/27fbe984f6c52a394405c07751b1bc10/27fbe984f6c52a394405c07751b1bc10.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771056.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/bf5/38dd43b40daa3ce84310b78cd98d0bf5/38dd43b40daa3ce84310b78cd98d0bf5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771061.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/0cd/f8b90cfbcf9c1a9cf76bc08dc31da0cd/f8b90cfbcf9c1a9cf76bc08dc31da0cd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771066.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/39c/435c6e0bb6b8bcfca630b0528504839c/435c6e0bb6b8bcfca630b0528504839c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771071.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/b32/cbff83cebaa98a2d0ba9459c47535b32/cbff83cebaa98a2d0ba9459c47535b32.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771076.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/3fd/b287ff64209201fb0e0d977e046bd3fd/b287ff64209201fb0e0d977e046bd3fd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771081.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/fd4/4f0f70ec01fa703b77ebf7a0553a4fd4/4f0f70ec01fa703b77ebf7a0553a4fd4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771086.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/673/b4149d9d8a42946b2b14e507eeeff673/b4149d9d8a42946b2b14e507eeeff673.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771091.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/4eb/45f612000cd2705822d5badf8c2774eb/45f612000cd2705822d5badf8c2774eb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771096.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/399/9f123af2a87e43a64a6c5b1142dad399/9f123af2a87e43a64a6c5b1142dad399.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771101.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/384/a28b45cf19c8f894ebdd4e1a924ac384/a28b45cf19c8f894ebdd4e1a924ac384.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771106.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/62d/699ba336155ff2d46ccee7a9b2ab962d/699ba336155ff2d46ccee7a9b2ab962d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771111.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/613/e39606998ae38f2062969c7533fbc613/e39606998ae38f2062969c7533fbc613.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771116.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/a22/549ef60f603b72528cccd3cc0e176a22/549ef60f603b72528cccd3cc0e176a22.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771121.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/c73/8816e286dca57cbf4ecb7a0f0e186c73/8816e286dca57cbf4ecb7a0f0e186c73.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771126.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/afd/259170b2dcb081bff3638ceaf792fafd/259170b2dcb081bff3638ceaf792fafd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771131.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/637/ebbc7ce6348ab7bf075f37d3fca18637/ebbc7ce6348ab7bf075f37d3fca18637.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771136.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/fac/41638668f7891aaee3710ccc4b9fbfac/41638668f7891aaee3710ccc4b9fbfac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771141.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/6dc/c15c7a0c526a494f28daaef75b4626dc/c15c7a0c526a494f28daaef75b4626dc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771146.00000-0, db: /tmp/tmp_lyo75sy/sda/containers/0/c4f/f017a9288490b0ca227e75036de95c4f/f017a9288490b0ca227e75036de95c4f.db sharder-test WARNING: Audit failed for root: overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmph9aaal47/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for root: overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmph9aaal47/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for root: overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmph9aaal47/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for root: overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmph9aaal47/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for root: overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmph9aaal47/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for root: missing range(s): 3 (use swift-manage-shard-ranges repair), overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmph9aaal47/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for root: missing range(s): 3 (use swift-manage-shard-ranges repair), overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmph9aaal47/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for root: missing range(s): 3 (use swift-manage-shard-ranges repair), overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmph9aaal47/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for root: missing range(s): 3 (use swift-manage-shard-ranges repair), overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmph9aaal47/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Audit failed for root: own_shard_range reset to None should be 1757769870.00000, path: a/c, db: /tmp/tmptumoc_mf/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769870.00000.db sharder-test WARNING: Audit failed for root: overlapping ranges: 2 (use swift-manage-shard-ranges repair), path: a/c, db: /tmp/tmp58aj0lna/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_sharder.TestSharder.test_audit_root_container_with_parent_child_overlapping test.unit.container.test_sharder.TestSharder.test_audit_root_container_with_parent_child_overlapping ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_find_shard_ranges_errors test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_find_shard_ranges_errors ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_active_root_range_merged_while_shrinking test.unit.container.test_sharder.TestSharder.test_audit_shard_active_root_range_merged_while_shrinking ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_find_shard_ranges_with_misplaced_objects test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_find_shard_ranges_with_misplaced_objects ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_brokers test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_brokers ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_partition_lock_same_partition test.unit.obj.test_diskfile.TestDiskFileManager.test_partition_lock_same_partition ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_partition_lock_same_partition_different_name test.unit.obj.test_diskfile.TestDiskFileManager.test_partition_lock_same_partition_different_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_namespaces_state_filtering test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_namespaces_state_filtering ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_pickle_async_update test.unit.obj.test_diskfile.TestDiskFileManager.test_pickle_async_update ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_db_state test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_db_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_objects test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_objects ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_container test.unit.container.test_sharder.TestSharder.test_audit_shard_container ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_container_ancestors_not_merged_while_sharding test.unit.container.test_sharder.TestSharder.test_audit_shard_container_ancestors_not_merged_while_sharding ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info_is_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info_no_stale_reads test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info_no_stale_reads ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_2 test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_2 ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_another_device_fine test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_another_device_fine ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_off test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_off ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_objects_since_row test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_objects_since_row ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info_sharding_states test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info_sharding_states ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info_stale_read_ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_info_stale_read_ok ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769871.00000-0, db: /tmp/tmp8tyhsoo0/sda/containers/0/66c/15fb98d7484e543aee2d42b3dcd9166c/15fb98d7484e543aee2d42b3dcd9166c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769871.00000-0, db: /tmp/tmp8tyhsoo0/sda/containers/0/66c/15fb98d7484e543aee2d42b3dcd9166c/15fb98d7484e543aee2d42b3dcd9166c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769874.00000-0, db: /tmp/tmp8tyhsoo0/sda/containers/0/f7d/aafd98527371ae6e05b2feff69488f7d/aafd98527371ae6e05b2feff69488f7d.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769874.00000-0, db: /tmp/tmp8tyhsoo0/sda/containers/0/f7d/aafd98527371ae6e05b2feff69488f7d/aafd98527371ae6e05b2feff69488f7d.db sharder-test WARNING: Audit failed for shard: missing own shard range (skipping), path: bad_account/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test WARNING: Audit warnings for shard: account not in shards namespace '.shards_', path: bad_account/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test WARNING: Audit failed for shard: missing own shard range (skipping), path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Updated own shard range from ShardRange<'j' to 'k' as of 1757769871.00000, (0, 0) as of 1757769871.00000, active as of 1757769871.00000> to ShardRange<'k' to 't' as of 1757769872.00000, (0, 0) as of 1757769872.00000, active as of 1757769872.00000>, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test WARNING: Failed to get shard ranges from a/c: bad, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test WARNING: Audit warnings for shard: unable to get shard ranges from root, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769876.00000, (0, 0) as of 1757769876.00000, shrinking as of 1757769873.00000> to ShardRange<'k' to 't' as of 1757769876.00000, (0, 0) as of 1757769876.00000, sharding as of 1757769877.00000>, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Marked shard container as deleted, path: .shards_a/shard_c, db: /tmp/tmpqen_86xj/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-5311e381d5d30689f79a586aea576755-1757769875.00000-2, db: /tmp/tmpzuihr7rs/sda/containers/0/75f/0a613b47a545b24038b471e86125575f/0a613b47a545b24038b471e86125575f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769880.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/491/d42d0e32697f34a0f77f2f39b9a38491/d42d0e32697f34a0f77f2f39b9a38491.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769880.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/491/d42d0e32697f34a0f77f2f39b9a38491/d42d0e32697f34a0f77f2f39b9a38491.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769889.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/254/c8d30e031094356cadea11e9df213254/c8d30e031094356cadea11e9df213254.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769889.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/254/c8d30e031094356cadea11e9df213254/c8d30e031094356cadea11e9df213254.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769898.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/9d4/59e9b1ef1b23f928e4de6e2e0c2ed9d4/59e9b1ef1b23f928e4de6e2e0c2ed9d4.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769898.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/9d4/59e9b1ef1b23f928e4de6e2e0c2ed9d4/59e9b1ef1b23f928e4de6e2e0c2ed9d4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769907.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/e4e/83923578ea0c3690a2d84dd36d726e4e/83923578ea0c3690a2d84dd36d726e4e.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769907.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/e4e/83923578ea0c3690a2d84dd36d726e4e/83923578ea0c3690a2d84dd36d726e4e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769916.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/92a/ece143dfa8fb8ce14a5b363320dfc92a/ece143dfa8fb8ce14a5b363320dfc92a.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769916.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/92a/ece143dfa8fb8ce14a5b363320dfc92a/ece143dfa8fb8ce14a5b363320dfc92a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769925.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/092/bd8c5436a59738389794f701058d7092/bd8c5436a59738389794f701058d7092.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769925.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/092/bd8c5436a59738389794f701058d7092/bd8c5436a59738389794f701058d7092.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769934.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/4ea/1a22b23992d79681c38fe74db983a4ea/1a22b23992d79681c38fe74db983a4ea.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769934.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/4ea/1a22b23992d79681c38fe74db983a4ea/1a22b23992d79681c38fe74db983a4ea.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769943.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/80e/b35c505e83341c0c86067404fee2f80e/b35c505e83341c0c86067404fee2f80e.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_items_since test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_items_since ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_on test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_on ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_server.TestProxyServerConfigLoading.test_default_proxy_config test.unit.proxy.test_server.TestProxyServerConfigLoading.test_default_proxy_config ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_namespaces test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_namespaces ... ok test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: Setting object count to 3120 (txn: tx2413a64f82274f6c813db-0068c5708e) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: Setting object count to 3120 (txn: tx42c594e9563c4f24b7c71-0068c5708e) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Getting listing part 2 from shard Namespace(name='a/c', lower='pie', upper='') a/c with {'X-Backend-Record-Type': 'object'} (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Get listing from /v1/a/c?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'object'} (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Found 3072 objects in shard (state=sharded), total = 3120 (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: Setting object count to 3120 (txn: txaba087151d00441596c00-0068c5708e) test DEBUG: GET listing from 5 shards for: /v1/a/c?reverse=true&limit=&format=json&states=listing (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_?reverse=true&limit=10000&format=json&marker=&end_marker=%F0%9F%8C%B4 {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1024 (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?reverse=true&limit=8976&format=json&marker=%F0%9F%8C%B5&end_marker=%E2%98%83 {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2048 (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?reverse=true&limit=7952&format=json&marker=%E2%98%84&end_marker=pie {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3072 (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_pie?reverse=true&limit=6928&format=json&marker=q&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Found 8 objects in shard (state=unsharded), total = 3080 (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_ham?reverse=true&limit=6920&format=json&marker=i&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Found 40 objects in shard (state=unsharded), total = 3120 (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: Setting object count to 3120 (txn: tx7368a0f3c88143988ee38-0068c5708e) test DEBUG: GET listing from 5 shards for: /v1/a/c?limit=49&format=json&states=listing (txn: tx12d1fd3d19f240db8fdca-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx12d1fd3d19f240db8fdca-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_ham?limit=49&format=json&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx12d1fd3d19f240db8fdca-0068c5708e)test.unit.proxy.test_server.TestProxyServerConfigLoading.test_log_name test.unit.proxy.test_server.TestProxyServerConfigLoading.test_log_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_namespaces_root_container_fill_gap test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_namespaces_root_container_fill_gap ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_container_children_merged_while_sharding test.unit.container.test_sharder.TestSharder.test_audit_shard_container_children_merged_while_sharding ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_own_shard_range test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_own_shard_range ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_namespaces_state_filtering test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_namespaces_state_filtering ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_bad_section_name test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_bad_section_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_policy_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_policy_info ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_objects test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_objects ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_same_partition test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_lock_same_partition ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_one_per_device_deprecation test.unit.obj.test_diskfile.TestDiskFileManager.test_replication_one_per_device_deprecation ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_replication_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_replication_info ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_verify_ondisk_files test.unit.obj.test_diskfile.TestDiskFileManager.test_verify_ondisk_files ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_cleans_up_everything test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_cleans_up_everything ... ok sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769943.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/80e/b35c505e83341c0c86067404fee2f80e/b35c505e83341c0c86067404fee2f80e.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769943.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/80e/b35c505e83341c0c86067404fee2f80e/b35c505e83341c0c86067404fee2f80e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769952.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/62c/16d2bb854d416454a05edde3fba5262c/16d2bb854d416454a05edde3fba5262c.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769952.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/62c/16d2bb854d416454a05edde3fba5262c/16d2bb854d416454a05edde3fba5262c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769952.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/62c/16d2bb854d416454a05edde3fba5262c/16d2bb854d416454a05edde3fba5262c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769961.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/cfe/a5f0cc77cd4ced0aa8a82726cf34dcfe/a5f0cc77cd4ced0aa8a82726cf34dcfe.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769961.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/cfe/a5f0cc77cd4ced0aa8a82726cf34dcfe/a5f0cc77cd4ced0aa8a82726cf34dcfe.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769961.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/cfe/a5f0cc77cd4ced0aa8a82726cf34dcfe/a5f0cc77cd4ced0aa8a82726cf34dcfe.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769970.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/ddb/a6dc3e312836dd027b3a30478e5d2ddb/a6dc3e312836dd027b3a30478e5d2ddb.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769970.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/ddb/a6dc3e312836dd027b3a30478e5d2ddb/a6dc3e312836dd027b3a30478e5d2ddb.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769970.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/ddb/a6dc3e312836dd027b3a30478e5d2ddb/a6dc3e312836dd027b3a30478e5d2ddb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769979.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/c97/74621ea6dc66b3965771ba772b2d0c97/74621ea6dc66b3965771ba772b2d0c97.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769979.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/c97/74621ea6dc66b3965771ba772b2d0c97/74621ea6dc66b3965771ba772b2d0c97.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769979.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/c97/74621ea6dc66b3965771ba772b2d0c97/74621ea6dc66b3965771ba772b2d0c97.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769988.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/24b/e18d518c944405a51be6b14288caa24b/e18d518c944405a51be6b14288caa24b.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769988.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/24b/e18d518c944405a51be6b14288caa24b/e18d518c944405a51be6b14288caa24b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769988.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/24b/e18d518c944405a51be6b14288caa24b/e18d518c944405a51be6b14288caa24b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769997.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/6dd/1298d092443f0deb7992ffa072b096dd/1298d092443f0deb7992ffa072b096dd.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769997.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/6dd/1298d092443f0deb7992ffa072b096dd/1298d092443f0deb7992ffa072b096dd.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769997.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/6dd/1298d092443f0deb7992ffa072b096dd/1298d092443f0deb7992ffa072b096dd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757770006.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/057/1cac8dd888656614e6f012e346282057/1cac8dd888656614e6f012e346282057.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757770006.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/057/1cac8dd888656614e6f012e346282057/1cac8dd888656614e6f012e346282057.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757770006.00000-2, db: /tmp/tmpk_17gq06/sda/containers/0/057/1cac8dd888656614e6f012e346282057/1cac8dd888656614e6f012e346282057.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8.db sharder-test INFO: Updated own shard range from ShardRange<'a' to 'b' as of 1757769871.00000, (0, 0) as of 1757769871.00000, active as of 1757769871.00000> to ShardRange<'a' to 'b' as of 1757769871.00000, (0, 0) as of 1757769871.00000, sharding as of 1757769876.00000>, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8.db sharder-test DEBUG: Updating 0 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8_1757769871.00000.db sharder-test DEBUG: Updating 2 children shard ranges from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8_1757769871.00000.db sharder-test DEBUG: Updating 0 other shard range(s) from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8_1757769871.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8_1757769871.00000.db sharder-test INFO: Updated own shard range from ShardRange<'a' to 'b' as of 1757769871.00000, (0, 0) as of 1757769871.00000, sharding as of 1757769877.00000> to ShardRange<'a' to 'b' as of 1757769871.00000, (0, 0) as of 1757769871.00000, sharded as of 1757769880.00000>, path: .shards_a/root-63a9f0ea7bb98050796b649e85481845-1757769871.00000-2, db: /tmp/tmp8lof3x8a/sda/containers/0/fb8/126450ec012bf73bb1bb0c884f6d1fb8/126450ec012bf73bb1bb0c884f6d1fb8_1757769871.00000.dbtest.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_no_memcache ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_dev_path_fail test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_dev_path_fail ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_empty test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_empty ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_container_children_not_merged_once_sharded test.unit.container.test_sharder.TestSharder.test_audit_shard_container_children_not_merged_once_sharded ... ok cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmp4pc7grw6/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp4pc7grw6/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/0/a" 201 - "-" "test" "-" 0.0114 "-" 1824531 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/0/a" 201 - "-" "test" "-" 0.0116 "-" 1824531 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0028 "-" 1824531 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0028 "-" 1824531 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfee181ebc8da405a89ed4-0068c5708e" "proxy-server 1824531" 0.0051 "-" 1824531 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://127.0.0.1:40587/sda1/3/a/c" "txfee181ebc8da405a89ed4-0068c5708e" "container-server 1824531" 0.0011 "-" 1824531 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://127.0.0.1:59907/sdb1/3/a/c" "txfee181ebc8da405a89ed4-0068c5708e" "container-server 1824531" 0.0010 "-" 1824531 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "txfee181ebc8da405a89ed4-0068c5708e" "proxy-server 1824531" 0.0208 "-" 1824531 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "txfee181ebc8da405a89ed4-0068c5708e" "proxy-server 1824531" 0.0302 "-" 1824531 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/30 PUT /v1/a/c HTTP/1.0 201 - - t - - - txfee181ebc8da405a89ed4-0068c5708e - 0.0415 - - 1757769870.259843588 1757769870.301311970 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "HEAD /sdb1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx50bbfcd7f27940caa3d42-0068c5708e" "proxy-server 1824531" 0.0011 "-" 1824531 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:59907/sdb1/0/a1/c1" "tx50bbfcd7f27940caa3d42-0068c5708e" "container-server 1824531" 0.0010 "-" 1824531 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:40587/sda1/0/a1/c1" "tx50bbfcd7f27940caa3d42-0068c5708e" "container-server 1824531" 0.0010 "-" 1824531 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx50bbfcd7f27940caa3d42-0068c5708e" "proxy-server 1824531" 0.0163 "-" 1824531 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx50bbfcd7f27940caa3d42-0068c5708e" "proxy-server 1824531" 0.0252 "-" 1824531 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/30 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx50bbfcd7f27940caa3d42-0068c5708e - 0.0407 - - 1757769870.306720972 1757769870.347412109 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5b2515cd5f274b53af196-0068c5708e" "proxy-server 1824531" 0.0060 "-" 1824531 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://127.0.0.1:40587/sda1/3/a/c1" "tx5b2515cd5f274b53af196-0068c5708e" "container-server 1824531" 0.0018 "-" 1824531 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://127.0.0.1:59907/sdb1/3/a/c1" "tx5b2515cd5f274b53af196-0068c5708e" "container-server 1824531" 0.0052 "-" 1824531 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx5b2515cd5f274b53af196-0068c5708e" "proxy-server 1824531" 0.0326 "-" 1824531 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx5b2515cd5f274b53af196-0068c5708e" "proxy-server 1824531" 0.0250 "-" 1824531 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/30 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx5b2515cd5f274b53af196-0068c5708e - 0.0493 - - 1757769870.348849297 1757769870.398128748 1 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf379984445b24270a2916-0068c5708e" "proxy-server 1824531" 0.0060 "-" 1824531 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://127.0.0.1:59907/sdb1/0/a/c2" "txf379984445b24270a2916-0068c5708e" "container-server 1824531" 0.0011 "-" 1824531 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://127.0.0.1:40587/sda1/0/a/c2" "txf379984445b24270a2916-0068c5708e" "container-server 1824531" 0.0016 "-" 1824531 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txf379984445b24270a2916-0068c5708e" "proxy-server 1824531" 0.0211 "-" 1824531 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:30 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txf379984445b24270a2916-0068c5708e" "proxy-server 1824531" 0.0299 "-" 1824531 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/30 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txf379984445b24270a2916-0068c5708e - 0.0418 - - 1757769870.403621435 1757769870.445463657 2 - test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 1}, app)test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_equality test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_equality ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_inherits_defaults test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_inherits_defaults ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_empty_suffixes test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_empty_suffixes ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_invalid_read_affinity_value test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_invalid_read_affinity_value ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_fails_with_bad_ondisk_filesets test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_fails_with_bad_ondisk_filesets ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_suffix_filter test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_suffix_filter ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_tombstones test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_tombstones ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_report_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_report_info ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_yields_content_type_timestamp test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_yields_content_type_timestamp ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_invalid_sorting_method_value test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_invalid_sorting_method_value ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_yields_meta_timestamp test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_hashes_yields_meta_timestamp ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_objects_since_row test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_objects_since_row ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_suffixes test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_suffixes ... ok test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_suffixes_dev_path_fail test.unit.obj.test_diskfile.TestDiskFileManager.test_yield_suffixes_dev_path_fail ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_invalid_write_affinity_node_count_value test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_invalid_write_affinity_node_count_value ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_quarantine_age_conf test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_quarantine_age_conf ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_own_shard_range test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_own_shard_range ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_invalid_write_affinity_value test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_invalid_write_affinity_value ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_quarantine_threshold_conf test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_quarantine_threshold_conf ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_range_rows_with_limit test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_range_rows_with_limit ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_policy_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_policy_info ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_none_configured test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_none_configured ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_all_404s_fails test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_all_404s_fails ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_replication_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_replication_info ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_one_configured test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_one_configured ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769871.00000, db: /tmp/tmptf5dotb5/sda/containers/0/4f7/ea21579308786a53b2c41621562e44f7/ea21579308786a53b2c41621562e44f7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769873.00000, db: /tmp/tmptf5dotb5/sda/containers/0/fae/a52fed4b400d2b79ef45db3dd7b96fae/a52fed4b400d2b79ef45db3dd7b96fae.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769872.00000, (0, 0) as of 1757769872.00000, found as of 1757769872.00000> to ShardRange<'k' to 't' as of 1757769873.00000, (0, 0) as of 1757769873.00000, created as of 1757769873.00000>, path: .shards_a/shard_c_1757769873.00000, db: /tmp/tmptf5dotb5/sda/containers/0/fae/a52fed4b400d2b79ef45db3dd7b96fae/a52fed4b400d2b79ef45db3dd7b96fae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769875.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6af/4b1b9a3c6b1127eae2d996eddfee16af/4b1b9a3c6b1127eae2d996eddfee16af.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769874.00000, (0, 0) as of 1757769874.00000, found as of 1757769874.00000> to ShardRange<'k' to 't' as of 1757769875.00000, (0, 0) as of 1757769875.00000, cleaved as of 1757769875.00000>, path: .shards_a/shard_c_1757769875.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6af/4b1b9a3c6b1127eae2d996eddfee16af/4b1b9a3c6b1127eae2d996eddfee16af.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769877.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6a9/171a1e531a8685c90fa129e7749d26a9/171a1e531a8685c90fa129e7749d26a9.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769876.00000, (0, 0) as of 1757769876.00000, found as of 1757769876.00000> to ShardRange<'k' to 't' as of 1757769877.00000, (0, 0) as of 1757769877.00000, active as of 1757769877.00000>, path: .shards_a/shard_c_1757769877.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6a9/171a1e531a8685c90fa129e7749d26a9/171a1e531a8685c90fa129e7749d26a9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769879.00000, db: /tmp/tmptf5dotb5/sda/containers/0/2a4/4c18a0a351a33501e8b0e101892352a4/4c18a0a351a33501e8b0e101892352a4.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769878.00000, (0, 0) as of 1757769878.00000, found as of 1757769878.00000> to ShardRange<'k' to 't' as of 1757769879.00000, (0, 0) as of 1757769879.00000, shrinking as of 1757769879.00000>, path: .shards_a/shard_c_1757769879.00000, db: /tmp/tmptf5dotb5/sda/containers/0/2a4/4c18a0a351a33501e8b0e101892352a4/4c18a0a351a33501e8b0e101892352a4.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769879.00000, db: /tmp/tmptf5dotb5/sda/containers/0/2a4/4c18a0a351a33501e8b0e101892352a4/4c18a0a351a33501e8b0e101892352a4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769881.00000, db: /tmp/tmptf5dotb5/sda/containers/0/ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769880.00000, (0, 0) as of 1757769880.00000, found as of 1757769880.00000> to ShardRange<'k' to 't' as of 1757769881.00000, (0, 0) as of 1757769881.00000, sharding as of 1757769881.00000>, path: .shards_a/shard_c_1757769881.00000, db: /tmp/tmptf5dotb5/sda/containers/0/ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769881.00000, db: /tmp/tmptf5dotb5/sda/containers/0/ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2/ac85d5ee377eb8bdbba1b94f37bd7ab2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769883.00000, db: /tmp/tmptf5dotb5/sda/containers/0/21f/2d232698690ed0b3c3a15ec552b8821f/2d232698690ed0b3c3a15ec552b8821f.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769882.00000, (0, 0) as of 1757769882.00000, found as of 1757769882.00000> to ShardRange<'k' to 't' as of 1757769883.00000, (0, 0) as of 1757769883.00000, sharded as of 1757769883.00000>, path: .shards_a/shard_c_1757769883.00000, db: /tmp/tmptf5dotb5/sda/containers/0/21f/2d232698690ed0b3c3a15ec552b8821f/2d232698690ed0b3c3a15ec552b8821f.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769883.00000, db: /tmp/tmptf5dotb5/sda/containers/0/21f/2d232698690ed0b3c3a15ec552b8821f/2d232698690ed0b3c3a15ec552b8821f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769885.00000, db: /tmp/tmptf5dotb5/sda/containers/0/a85/aa4389525f92add7afdf896686e6ea85/aa4389525f92add7afdf896686e6ea85.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769884.00000, (0, 0) as of 1757769884.00000, found as of 1757769884.00000> to ShardRange<'k' to 't' as of 1757769885.00000, (0, 0) as of 1757769885.00000, shrunk as of 1757769885.00000>, path: .shards_a/shard_c_1757769885.00000, db: /tmp/tmptf5dotb5/sda/containers/0/a85/aa4389525f92add7afdf896686e6ea85/aa4389525f92add7afdf896686e6ea85.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769885.00000, db: /tmp/tmptf5dotb5/sda/containers/0/a85/aa4389525f92add7afdf896686e6ea85/aa4389525f92add7afdf896686e6ea85.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769887.00000, db: /tmp/tmptf5dotb5/sda/containers/0/966/eb35fe62f3504ede7cf738f7a74ae966/eb35fe62f3504ede7cf738f7a74ae966.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769886.00000, (0, 0) as of 1757769886.00000, created as of 1757769886.00000> to ShardRange<'k' to 't' as of 1757769887.00000, (0, 0) as of 1757769887.00000, found as of 1757769887.00000>, path: .shards_a/shard_c_1757769887.00000, db: /tmp/tmptf5dotb5/sda/containers/0/966/eb35fe62f3504ede7cf738f7a74ae966/eb35fe62f3504ede7cf738f7a74ae966.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769889.00000, db: /tmp/tmptf5dotb5/sda/containers/0/873/9b2962a7350720474ea832c741eff873/9b2962a7350720474ea832c741eff873.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769891.00000, db: /tmp/tmptf5dotb5/sda/containers/0/cf2/3deb9d98214ccdbed5ecb44ad1883cf2/3deb9d98214ccdbed5ecb44ad1883cf2.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769890.00000, (0, 0) as of 1757769890.00000, created as of 1757769890.00000> to ShardRange<'k' to 't' as of 1757769891.00000, (0, 0) as of 1757769891.00000, cleaved as of 1757769891.00000>, path: .shards_a/shard_c_1757769891.00000, db: /tmp/tmptf5dotb5/sda/containers/0/cf2/3deb9d98214ccdbed5ecb44ad1883cf2/3deb9d98214ccdbed5ecb44ad1883cf2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769893.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d4c/2423b061c759b966fa726b8c67ea5d4c/2423b061c759b966fa726b8c67ea5d4c.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769892.00000, (0, 0) as of 1757769892.00000, created as of 1757769892.00000> to ShardRange<'k' to 't' as of 1757769893.00000, (0, 0) as of 1757769893.00000, active as of 1757769893.00000>, path: .shards_a/shard_c_1757769893.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d4c/2423b061c759b966fa726b8c67ea5d4c/2423b061c759b966fa726b8c67ea5d4c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769895.00000, db: /tmp/tmptf5dotb5/sda/containers/0/dd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769894.00000, (0, 0) as of 1757769894.00000, created as of 1757769894.00000> to ShardRange<'k' to 't' as of 1757769895.00000, (0, 0) as of 1757769895.00000, shrinking as of 1757769895.00000>, path: .shards_a/shard_c_1757769895.00000, db: /tmp/tmptf5dotb5/sda/containers/0/dd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7.dbtest.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_all_404s_fails_custom_request_node_count test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_all_404s_fails_custom_request_node_count ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_overrides_default_affinity test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_overrides_default_affinity ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_report_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_report_info ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_overrides_default_concurrency_settings test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_overrides_default_concurrency_settings ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_error_with_invalid_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_error_with_invalid_header ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_range_rows_with_limit test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_range_rows_with_limit ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_overrides_default_sorting_method test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_overrides_default_sorting_method ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_section_name_inherits_from_app_section_name test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_section_name_inherits_from_app_section_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_ranges ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_errors_works test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_errors_works ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges_attempts test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges_attempts ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges_includes test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges_includes ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges_with_sharding_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges_with_sharding_overlaps ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': 3, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=100', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': 3, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=100', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': 4, 'rebalance_missing_suppression_count': 2, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=10', 'write_affinity': 'r2', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': 2, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=100', 'write_affinity': 'r1', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': 3, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': 'r3', 'write_affinity_node_count': '4', 'write_affinity_handoff_delete_count': 4, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': True, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.6, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': True, 'concurrency_timeout': 0.3, 'concurrent_ec_extra_requests': 1}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=100', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_sets_timing_sorting_method test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_sets_timing_sorting_method ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_warns_about_sorting_method_mismatch test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_warns_about_sorting_method_mismatch ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_warns_override_sorting_method_mismatch test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_warns_override_sorting_method_mismatch ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_with_DEFAULT_options test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_with_DEFAULT_options ... ok test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_with_unknown_policy test.unit.proxy.test_server.TestProxyServerConfigLoading.test_per_policy_conf_with_unknown_policy ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges_with_shrinking_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_ranges_with_shrinking_overlaps ... ok test.unit.proxy.test_server.TestProxyServerLoading.test_concurrent_ec_options test.unit.proxy.test_server.TestProxyServerLoading.test_concurrent_ec_options ... ok test.unit.proxy.test_server.TestProxyServerLoading.test_float_timeouts test.unit.proxy.test_server.TestProxyServerLoading.test_float_timeouts ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_usage test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_get_shard_usage ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_ranges_includes test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_ranges_includes ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_has_multiple_policies test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_has_multiple_policies ... ok test.unit.proxy.test_server.TestProxyServerLoading.test_load_policy_rings test.unit.proxy.test_server.TestProxyServerLoading.test_load_policy_rings ... ok sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769895.00000, db: /tmp/tmptf5dotb5/sda/containers/0/dd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7/a44e9d0f4ad2c1ba87db2d6dfc2dddd7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769897.00000, db: /tmp/tmptf5dotb5/sda/containers/0/183/8ee9f1814cd40c01464241bee0f60183/8ee9f1814cd40c01464241bee0f60183.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769896.00000, (0, 0) as of 1757769896.00000, created as of 1757769896.00000> to ShardRange<'k' to 't' as of 1757769897.00000, (0, 0) as of 1757769897.00000, sharding as of 1757769897.00000>, path: .shards_a/shard_c_1757769897.00000, db: /tmp/tmptf5dotb5/sda/containers/0/183/8ee9f1814cd40c01464241bee0f60183/8ee9f1814cd40c01464241bee0f60183.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769897.00000, db: /tmp/tmptf5dotb5/sda/containers/0/183/8ee9f1814cd40c01464241bee0f60183/8ee9f1814cd40c01464241bee0f60183.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769899.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d2f/e2488a16152542fad2e9de030084fd2f/e2488a16152542fad2e9de030084fd2f.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769898.00000, (0, 0) as of 1757769898.00000, created as of 1757769898.00000> to ShardRange<'k' to 't' as of 1757769899.00000, (0, 0) as of 1757769899.00000, sharded as of 1757769899.00000>, path: .shards_a/shard_c_1757769899.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d2f/e2488a16152542fad2e9de030084fd2f/e2488a16152542fad2e9de030084fd2f.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769899.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d2f/e2488a16152542fad2e9de030084fd2f/e2488a16152542fad2e9de030084fd2f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769901.00000, db: /tmp/tmptf5dotb5/sda/containers/0/959/33940f310031c7b4fe655f10a32da959/33940f310031c7b4fe655f10a32da959.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769900.00000, (0, 0) as of 1757769900.00000, created as of 1757769900.00000> to ShardRange<'k' to 't' as of 1757769901.00000, (0, 0) as of 1757769901.00000, shrunk as of 1757769901.00000>, path: .shards_a/shard_c_1757769901.00000, db: /tmp/tmptf5dotb5/sda/containers/0/959/33940f310031c7b4fe655f10a32da959/33940f310031c7b4fe655f10a32da959.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769901.00000, db: /tmp/tmptf5dotb5/sda/containers/0/959/33940f310031c7b4fe655f10a32da959/33940f310031c7b4fe655f10a32da959.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769903.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f9d/bb78a69059b5bd01c1a46978bdd38f9d/bb78a69059b5bd01c1a46978bdd38f9d.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769902.00000, (0, 0) as of 1757769902.00000, cleaved as of 1757769902.00000> to ShardRange<'k' to 't' as of 1757769903.00000, (0, 0) as of 1757769903.00000, found as of 1757769903.00000>, path: .shards_a/shard_c_1757769903.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f9d/bb78a69059b5bd01c1a46978bdd38f9d/bb78a69059b5bd01c1a46978bdd38f9d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769905.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f02/a8b1afe462b78d02629d333b1839ff02/a8b1afe462b78d02629d333b1839ff02.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769904.00000, (0, 0) as of 1757769904.00000, cleaved as of 1757769904.00000> to ShardRange<'k' to 't' as of 1757769905.00000, (0, 0) as of 1757769905.00000, created as of 1757769905.00000>, path: .shards_a/shard_c_1757769905.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f02/a8b1afe462b78d02629d333b1839ff02/a8b1afe462b78d02629d333b1839ff02.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769907.00000, db: /tmp/tmptf5dotb5/sda/containers/0/ad9/5e170677330de9080c7e57b95bdb4ad9/5e170677330de9080c7e57b95bdb4ad9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769909.00000, db: /tmp/tmptf5dotb5/sda/containers/0/a73/35e717d22237d428402bf822b7ad1a73/35e717d22237d428402bf822b7ad1a73.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769908.00000, (0, 0) as of 1757769908.00000, cleaved as of 1757769908.00000> to ShardRange<'k' to 't' as of 1757769909.00000, (0, 0) as of 1757769909.00000, active as of 1757769909.00000>, path: .shards_a/shard_c_1757769909.00000, db: /tmp/tmptf5dotb5/sda/containers/0/a73/35e717d22237d428402bf822b7ad1a73/35e717d22237d428402bf822b7ad1a73.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769911.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c53/c8ea902322a73cedcd940ca647e41c53/c8ea902322a73cedcd940ca647e41c53.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769910.00000, (0, 0) as of 1757769910.00000, cleaved as of 1757769910.00000> to ShardRange<'k' to 't' as of 1757769911.00000, (0, 0) as of 1757769911.00000, shrinking as of 1757769911.00000>, path: .shards_a/shard_c_1757769911.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c53/c8ea902322a73cedcd940ca647e41c53/c8ea902322a73cedcd940ca647e41c53.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769911.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c53/c8ea902322a73cedcd940ca647e41c53/c8ea902322a73cedcd940ca647e41c53.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769913.00000, db: /tmp/tmptf5dotb5/sda/containers/0/bac/25cfc95ac015d6283eda321f6f42fbac/25cfc95ac015d6283eda321f6f42fbac.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769912.00000, (0, 0) as of 1757769912.00000, cleaved as of 1757769912.00000> to ShardRange<'k' to 't' as of 1757769913.00000, (0, 0) as of 1757769913.00000, sharding as of 1757769913.00000>, path: .shards_a/shard_c_1757769913.00000, db: /tmp/tmptf5dotb5/sda/containers/0/bac/25cfc95ac015d6283eda321f6f42fbac/25cfc95ac015d6283eda321f6f42fbac.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769913.00000, db: /tmp/tmptf5dotb5/sda/containers/0/bac/25cfc95ac015d6283eda321f6f42fbac/25cfc95ac015d6283eda321f6f42fbac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769915.00000, db: /tmp/tmptf5dotb5/sda/containers/0/838/d1720079edbfbfa62e0382f6ffcca838/d1720079edbfbfa62e0382f6ffcca838.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769914.00000, (0, 0) as of 1757769914.00000, cleaved as of 1757769914.00000> to ShardRange<'k' to 't' as of 1757769915.00000, (0, 0) as of 1757769915.00000, sharded as of 1757769915.00000>, path: .shards_a/shard_c_1757769915.00000, db: /tmp/tmptf5dotb5/sda/containers/0/838/d1720079edbfbfa62e0382f6ffcca838/d1720079edbfbfa62e0382f6ffcca838.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769915.00000, db: /tmp/tmptf5dotb5/sda/containers/0/838/d1720079edbfbfa62e0382f6ffcca838/d1720079edbfbfa62e0382f6ffcca838.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769917.00000, db: /tmp/tmptf5dotb5/sda/containers/0/24f/846cf025ce1eb9fe72f29c394eb2724f/846cf025ce1eb9fe72f29c394eb2724f.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769916.00000, (0, 0) as of 1757769916.00000, cleaved as of 1757769916.00000> to ShardRange<'k' to 't' as of 1757769917.00000, (0, 0) as of 1757769917.00000, shrunk as of 1757769917.00000>, path: .shards_a/shard_c_1757769917.00000, db: /tmp/tmptf5dotb5/sda/containers/0/24f/846cf025ce1eb9fe72f29c394eb2724f/846cf025ce1eb9fe72f29c394eb2724f.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769917.00000, db: /tmp/tmptf5dotb5/sda/containers/0/24f/846cf025ce1eb9fe72f29c394eb2724f/846cf025ce1eb9fe72f29c394eb2724f.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_has_other_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_has_other_shard_ranges ... ok test-TestDiskFileManager DEBUG: Rsync tempfile: /tmp/tmp50n64am8/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/.1472017820.44503.data.QBYCYU test-TestDiskFileManager DEBUG: Rsync tempfile: /tmp/tmp50n64am8/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/.total-bs.abcdef test-TestDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects/junk: Invalid Timestamp value in filename 'junk' test-TestDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects/junk.data: Invalid Timestamp value in filename 'junk.data' test-TestDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects/.junk: Invalid Timestamp value in filename '.junk' test-TestDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects-1/junk: Invalid Timestamp value in filename 'junk' test-TestDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects-1/junk.data: Invalid Timestamp value in filename 'junk.data' test-TestDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects-1/.junk: Invalid Timestamp value in filename '.junk' test-TestDiskFileManager WARNING: Use of splice() requested (config says "splice = yes"), but the system does not support it. splice() will not be used. test-TestDiskFileManager WARNING: Option replication_one_per_device is deprecated and will be removed in a future version. Update your configuration to use option replication_concurrency_per_device. test-TestDiskFileManager WARNING: Option replication_one_per_device is deprecated and will be removed in a future version. Update your configuration to use option replication_concurrency_per_device. test-TestDiskFileManager WARNING: Option replication_one_per_device ignored as replication_concurrency_per_device is defined. test-TestDiskFileManager WARNING: Option replication_one_per_device ignored as replication_concurrency_per_device is defined. test-TestDiskFileManager WARNING: Option replication_one_per_device ignored as replication_concurrency_per_device is defined. test-TestDiskFileManager DEBUG: Run listdir on /tmp/tmp0ibhp1xy/tmp_test_obj_server_DiskFile/sda1/objects/0 object-reconstructor INFO: Nothing reconstructed for 1.0728836059570312e-05 seconds. object-reconstructor INFO: Nothing reconstructed for 9.059906005859375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 2.384185791015625e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 2.384185791015625e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.6:1006/sdg/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'None') object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.6:1006/sdg/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 7, 8, 9, 10, 11] object-reconstructor ERROR: Trying to GET 10.0.0.6:1006/sdg/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 2, 3, 5, 7, 8, 9, 10, 11, 12] object-reconstructor ERROR: Trying to GET 10.0.0.0:1000/sda/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.6:1006/sdg/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [2, 3, 5, 7, 8, 9, 10, 11, 12, 13] object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.0:1000/sda/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.2:1002/sdc/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.3:1003/sdd/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.4:1004/sde/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.5:1005/sdf/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.6:1006/sdg/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.7:1007/sdh/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.8:1008/sdi/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom!test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_exceptions_fails test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_exceptions_fails ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_finds_duplicate_does_not_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_finds_duplicate_does_not_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_finds_missing_frag_does_not_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_finds_missing_frag_does_not_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_frags_on_handoffs test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_frags_on_handoffs ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_invalid_frag_index_headers test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_invalid_frag_index_headers ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_missing_headers test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_missing_headers ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_ranges_with_sharding_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_ranges_with_sharding_overlaps ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_initialize_container_broker_in_default test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_initialize_container_broker_in_default ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_mixed_meta_timestamps_works test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_mixed_meta_timestamps_works ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_mixture_of_errors_fails test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_mixture_of_errors_fails ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_ranges_with_shrinking_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_ranges_with_shrinking_overlaps ... ok test.unit.proxy.test_server.TestProxyServerLoading.test_missing_rings test.unit.proxy.test_server.TestProxyServerLoading.test_missing_rings ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_errors test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_errors ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769919.00000, db: /tmp/tmptf5dotb5/sda/containers/0/9c2/1c328d811a117db798490c14fc4169c2/1c328d811a117db798490c14fc4169c2.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769918.00000, (0, 0) as of 1757769918.00000, active as of 1757769918.00000> to ShardRange<'k' to 't' as of 1757769919.00000, (0, 0) as of 1757769919.00000, found as of 1757769919.00000>, path: .shards_a/shard_c_1757769919.00000, db: /tmp/tmptf5dotb5/sda/containers/0/9c2/1c328d811a117db798490c14fc4169c2/1c328d811a117db798490c14fc4169c2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769921.00000, db: /tmp/tmptf5dotb5/sda/containers/0/dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769920.00000, (0, 0) as of 1757769920.00000, active as of 1757769920.00000> to ShardRange<'k' to 't' as of 1757769921.00000, (0, 0) as of 1757769921.00000, created as of 1757769921.00000>, path: .shards_a/shard_c_1757769921.00000, db: /tmp/tmptf5dotb5/sda/containers/0/dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7/de919d47fd1cc3b07f1b1c3c8a2e3dc7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769923.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f08/8901cd65118f345943a36ccc8969bf08/8901cd65118f345943a36ccc8969bf08.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769922.00000, (0, 0) as of 1757769922.00000, active as of 1757769922.00000> to ShardRange<'k' to 't' as of 1757769923.00000, (0, 0) as of 1757769923.00000, cleaved as of 1757769923.00000>, path: .shards_a/shard_c_1757769923.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f08/8901cd65118f345943a36ccc8969bf08/8901cd65118f345943a36ccc8969bf08.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769925.00000, db: /tmp/tmptf5dotb5/sda/containers/0/b1d/4c68ce376413d69ed951996fb9809b1d/4c68ce376413d69ed951996fb9809b1d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769927.00000, db: /tmp/tmptf5dotb5/sda/containers/0/001/c29174a1b99ed1ec61c121a00ea98001/c29174a1b99ed1ec61c121a00ea98001.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769926.00000, (0, 0) as of 1757769926.00000, active as of 1757769926.00000> to ShardRange<'k' to 't' as of 1757769927.00000, (0, 0) as of 1757769927.00000, shrinking as of 1757769927.00000>, path: .shards_a/shard_c_1757769927.00000, db: /tmp/tmptf5dotb5/sda/containers/0/001/c29174a1b99ed1ec61c121a00ea98001/c29174a1b99ed1ec61c121a00ea98001.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769927.00000, db: /tmp/tmptf5dotb5/sda/containers/0/001/c29174a1b99ed1ec61c121a00ea98001/c29174a1b99ed1ec61c121a00ea98001.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769929.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769928.00000, (0, 0) as of 1757769928.00000, active as of 1757769928.00000> to ShardRange<'k' to 't' as of 1757769929.00000, (0, 0) as of 1757769929.00000, sharding as of 1757769929.00000>, path: .shards_a/shard_c_1757769929.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769929.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e/9f3d6e1b98cfbbdad4ea800c70d4bd8e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769931.00000, db: /tmp/tmptf5dotb5/sda/containers/0/2c5/4f55d8279a32c43d78554b52b4a812c5/4f55d8279a32c43d78554b52b4a812c5.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769930.00000, (0, 0) as of 1757769930.00000, active as of 1757769930.00000> to ShardRange<'k' to 't' as of 1757769931.00000, (0, 0) as of 1757769931.00000, sharded as of 1757769931.00000>, path: .shards_a/shard_c_1757769931.00000, db: /tmp/tmptf5dotb5/sda/containers/0/2c5/4f55d8279a32c43d78554b52b4a812c5/4f55d8279a32c43d78554b52b4a812c5.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769931.00000, db: /tmp/tmptf5dotb5/sda/containers/0/2c5/4f55d8279a32c43d78554b52b4a812c5/4f55d8279a32c43d78554b52b4a812c5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769933.00000, db: /tmp/tmptf5dotb5/sda/containers/0/b30/e53cd26c4555d6f33da71fc70de40b30/e53cd26c4555d6f33da71fc70de40b30.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769932.00000, (0, 0) as of 1757769932.00000, active as of 1757769932.00000> to ShardRange<'k' to 't' as of 1757769933.00000, (0, 0) as of 1757769933.00000, shrunk as of 1757769933.00000>, path: .shards_a/shard_c_1757769933.00000, db: /tmp/tmptf5dotb5/sda/containers/0/b30/e53cd26c4555d6f33da71fc70de40b30/e53cd26c4555d6f33da71fc70de40b30.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769933.00000, db: /tmp/tmptf5dotb5/sda/containers/0/b30/e53cd26c4555d6f33da71fc70de40b30/e53cd26c4555d6f33da71fc70de40b30.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769935.00000, db: /tmp/tmptf5dotb5/sda/containers/0/2d2/ebbef58771b789d75f0a35856d0742d2/ebbef58771b789d75f0a35856d0742d2.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769934.00000, (0, 0) as of 1757769934.00000, shrinking as of 1757769934.00000> to ShardRange<'k' to 't' as of 1757769935.00000, (0, 0) as of 1757769935.00000, found as of 1757769935.00000>, path: .shards_a/shard_c_1757769935.00000, db: /tmp/tmptf5dotb5/sda/containers/0/2d2/ebbef58771b789d75f0a35856d0742d2/ebbef58771b789d75f0a35856d0742d2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769937.00000, db: /tmp/tmptf5dotb5/sda/containers/0/68d/388f825274c49e60c829a527fe0c868d/388f825274c49e60c829a527fe0c868d.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769936.00000, (0, 0) as of 1757769936.00000, shrinking as of 1757769936.00000> to ShardRange<'k' to 't' as of 1757769937.00000, (0, 0) as of 1757769937.00000, created as of 1757769937.00000>, path: .shards_a/shard_c_1757769937.00000, db: /tmp/tmptf5dotb5/sda/containers/0/68d/388f825274c49e60c829a527fe0c868d/388f825274c49e60c829a527fe0c868d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769939.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f9b/450c6f57470a7424ee76ae4977a9df9b/450c6f57470a7424ee76ae4977a9df9b.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769938.00000, (0, 0) as of 1757769938.00000, shrinking as of 1757769938.00000> to ShardRange<'k' to 't' as of 1757769939.00000, (0, 0) as of 1757769939.00000, cleaved as of 1757769939.00000>, path: .shards_a/shard_c_1757769939.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f9b/450c6f57470a7424ee76ae4977a9df9b/450c6f57470a7424ee76ae4977a9df9b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769941.00000, db: /tmp/tmptf5dotb5/sda/containers/0/529/a972b5fe426b4af4b4603423a8bbe529/a972b5fe426b4af4b4603423a8bbe529.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769940.00000, (0, 0) as of 1757769940.00000, shrinking as of 1757769940.00000> to ShardRange<'k' to 't' as of 1757769941.00000, (0, 0) as of 1757769941.00000, active as of 1757769941.00000>, path: .shards_a/shard_c_1757769941.00000, db: /tmp/tmptf5dotb5/sda/containers/0/529/a972b5fe426b4af4b4603423a8bbe529/a972b5fe426b4af4b4603423a8bbe529.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769943.00000, db: /tmp/tmptf5dotb5/sda/containers/0/644/473d3480816af0f3a01d153174862644/473d3480816af0f3a01d153174862644.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_usage test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_get_shard_usage ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_frag_not_old_enough test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_frag_not_old_enough ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_has_multiple_policies test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_has_multiple_policies ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_frag_resp_different_timestamp test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_frag_resp_different_timestamp ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_frag_resp_mixed_etags test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_frag_resp_mixed_etags ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_frag_resp_mixed_timestamps test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_frag_resp_mixed_timestamps ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_invalid_frag_index_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_invalid_frag_index_header ... ok sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769943.00000, db: /tmp/tmptf5dotb5/sda/containers/0/644/473d3480816af0f3a01d153174862644/473d3480816af0f3a01d153174862644.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769945.00000, db: /tmp/tmptf5dotb5/sda/containers/0/e99/a1663205739c0ae6ceb582a66629be99/a1663205739c0ae6ceb582a66629be99.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769944.00000, (0, 0) as of 1757769944.00000, shrinking as of 1757769944.00000> to ShardRange<'k' to 't' as of 1757769945.00000, (0, 0) as of 1757769945.00000, sharding as of 1757769945.00000>, path: .shards_a/shard_c_1757769945.00000, db: /tmp/tmptf5dotb5/sda/containers/0/e99/a1663205739c0ae6ceb582a66629be99/a1663205739c0ae6ceb582a66629be99.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769945.00000, db: /tmp/tmptf5dotb5/sda/containers/0/e99/a1663205739c0ae6ceb582a66629be99/a1663205739c0ae6ceb582a66629be99.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769947.00000, db: /tmp/tmptf5dotb5/sda/containers/0/47c/c53a22dc05c539a8733754cd3527a47c/c53a22dc05c539a8733754cd3527a47c.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769946.00000, (0, 0) as of 1757769946.00000, shrinking as of 1757769946.00000> to ShardRange<'k' to 't' as of 1757769947.00000, (0, 0) as of 1757769947.00000, sharded as of 1757769947.00000>, path: .shards_a/shard_c_1757769947.00000, db: /tmp/tmptf5dotb5/sda/containers/0/47c/c53a22dc05c539a8733754cd3527a47c/c53a22dc05c539a8733754cd3527a47c.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769947.00000, db: /tmp/tmptf5dotb5/sda/containers/0/47c/c53a22dc05c539a8733754cd3527a47c/c53a22dc05c539a8733754cd3527a47c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769949.00000, db: /tmp/tmptf5dotb5/sda/containers/0/aff/c5a4f4205b55c149906e29c56f6a4aff/c5a4f4205b55c149906e29c56f6a4aff.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769948.00000, (0, 0) as of 1757769948.00000, shrinking as of 1757769948.00000> to ShardRange<'k' to 't' as of 1757769949.00000, (0, 0) as of 1757769949.00000, shrunk as of 1757769949.00000>, path: .shards_a/shard_c_1757769949.00000, db: /tmp/tmptf5dotb5/sda/containers/0/aff/c5a4f4205b55c149906e29c56f6a4aff/c5a4f4205b55c149906e29c56f6a4aff.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769949.00000, db: /tmp/tmptf5dotb5/sda/containers/0/aff/c5a4f4205b55c149906e29c56f6a4aff/c5a4f4205b55c149906e29c56f6a4aff.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769951.00000, db: /tmp/tmptf5dotb5/sda/containers/0/359/21c3f6abca1214e1a52995d2f81ae359/21c3f6abca1214e1a52995d2f81ae359.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769950.00000, (0, 0) as of 1757769950.00000, sharding as of 1757769950.00000> to ShardRange<'k' to 't' as of 1757769951.00000, (0, 0) as of 1757769951.00000, found as of 1757769951.00000>, path: .shards_a/shard_c_1757769951.00000, db: /tmp/tmptf5dotb5/sda/containers/0/359/21c3f6abca1214e1a52995d2f81ae359/21c3f6abca1214e1a52995d2f81ae359.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769953.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8cc/2489c158f88285ded27fa68bffb8f8cc/2489c158f88285ded27fa68bffb8f8cc.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769952.00000, (0, 0) as of 1757769952.00000, sharding as of 1757769952.00000> to ShardRange<'k' to 't' as of 1757769953.00000, (0, 0) as of 1757769953.00000, created as of 1757769953.00000>, path: .shards_a/shard_c_1757769953.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8cc/2489c158f88285ded27fa68bffb8f8cc/2489c158f88285ded27fa68bffb8f8cc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769955.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d2e/7857ea434996e656ea554796972fed2e/7857ea434996e656ea554796972fed2e.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769954.00000, (0, 0) as of 1757769954.00000, sharding as of 1757769954.00000> to ShardRange<'k' to 't' as of 1757769955.00000, (0, 0) as of 1757769955.00000, cleaved as of 1757769955.00000>, path: .shards_a/shard_c_1757769955.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d2e/7857ea434996e656ea554796972fed2e/7857ea434996e656ea554796972fed2e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769957.00000, db: /tmp/tmptf5dotb5/sda/containers/0/63d/3ab2c4fdfac325c8b53d8ec3c08b063d/3ab2c4fdfac325c8b53d8ec3c08b063d.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769956.00000, (0, 0) as of 1757769956.00000, sharding as of 1757769956.00000> to ShardRange<'k' to 't' as of 1757769957.00000, (0, 0) as of 1757769957.00000, active as of 1757769957.00000>, path: .shards_a/shard_c_1757769957.00000, db: /tmp/tmptf5dotb5/sda/containers/0/63d/3ab2c4fdfac325c8b53d8ec3c08b063d/3ab2c4fdfac325c8b53d8ec3c08b063d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769959.00000, db: /tmp/tmptf5dotb5/sda/containers/0/5f7/3605ae3bc8ce18beb49cc732f9fcb5f7/3605ae3bc8ce18beb49cc732f9fcb5f7.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769958.00000, (0, 0) as of 1757769958.00000, sharding as of 1757769958.00000> to ShardRange<'k' to 't' as of 1757769959.00000, (0, 0) as of 1757769959.00000, shrinking as of 1757769959.00000>, path: .shards_a/shard_c_1757769959.00000, db: /tmp/tmptf5dotb5/sda/containers/0/5f7/3605ae3bc8ce18beb49cc732f9fcb5f7/3605ae3bc8ce18beb49cc732f9fcb5f7.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769959.00000, db: /tmp/tmptf5dotb5/sda/containers/0/5f7/3605ae3bc8ce18beb49cc732f9fcb5f7/3605ae3bc8ce18beb49cc732f9fcb5f7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769961.00000, db: /tmp/tmptf5dotb5/sda/containers/0/5f9/25d5d55ffd1dd3da981779bbad3825f9/25d5d55ffd1dd3da981779bbad3825f9.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769961.00000, db: /tmp/tmptf5dotb5/sda/containers/0/5f9/25d5d55ffd1dd3da981779bbad3825f9/25d5d55ffd1dd3da981779bbad3825f9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769963.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6dd/43239cdd812864922f999610ba4b06dd/43239cdd812864922f999610ba4b06dd.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769962.00000, (0, 0) as of 1757769962.00000, sharding as of 1757769962.00000> to ShardRange<'k' to 't' as of 1757769963.00000, (0, 0) as of 1757769963.00000, sharded as of 1757769963.00000>, path: .shards_a/shard_c_1757769963.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6dd/43239cdd812864922f999610ba4b06dd/43239cdd812864922f999610ba4b06dd.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769963.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6dd/43239cdd812864922f999610ba4b06dd/43239cdd812864922f999610ba4b06dd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769965.00000, db: /tmp/tmptf5dotb5/sda/containers/0/0ec/96d58672111b8bb6b6c89da8e62af0ec/96d58672111b8bb6b6c89da8e62af0ec.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769964.00000, (0, 0) as of 1757769964.00000, sharding as of 1757769964.00000> to ShardRange<'k' to 't' as of 1757769965.00000, (0, 0) as of 1757769965.00000, shrunk as of 1757769965.00000>, path: .shards_a/shard_c_1757769965.00000, db: /tmp/tmptf5dotb5/sda/containers/0/0ec/96d58672111b8bb6b6c89da8e62af0ec/96d58672111b8bb6b6c89da8e62af0ec.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769965.00000, db: /tmp/tmptf5dotb5/sda/containers/0/0ec/96d58672111b8bb6b6c89da8e62af0ec/96d58672111b8bb6b6c89da8e62af0ec.dbtest.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_missing_etag_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_missing_etag_header ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_is_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_is_old_enough_to_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_is_old_enough_to_reclaim ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_has_other_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_has_other_shard_ranges ... ok object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Unable to get enough responses (13 x unknown error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor DEBUG: Found existing frag #4 at 10.0.0.5:1005/sdf/0/a/c/o policy#0 while rebuilding to 10.0.0.4:1004/sde/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor DEBUG: Reconstructing frag from handoffs, node_count=28 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'None') object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'invalid') object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 2.6226043701171875e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: None) object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0, frag index 0 (missing Etag) object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0, frag index 0 (missing X-Backend-Data-Timestamp and X-Backend-Timestamp) object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 3.814697265625e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.0:1000/sda/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.5:1005/sdf/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor WARNING: Invalid response 507 from 10.0.0.3:1003/sdd/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.6:1006/sdg/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.7:1007/sdh/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.9:1009/sdj/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.12:1012/sdm/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (4 x unknown, 4 x 404, 5 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 2.384185791015625e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 1.1920928955078125e-05 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor ERROR: Mixed Etag (unexpected_etag, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 5.7220458984375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 7.867813110351562e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'two') object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 11 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 7.152557373046875e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/o policy#0, frag index 3 (missing Etag) object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 11 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 7.62939453125e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: '')test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_missing_frag_index_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_missing_frag_index_header ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_missing_timestamp_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_missing_timestamp_header ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_is_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_is_reclaimable ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_initialize_container_broker_in_default test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_initialize_container_broker_in_default ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_last_modified_time test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_last_modified_time ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769967.00000, db: /tmp/tmptf5dotb5/sda/containers/0/75e/9c500d0ec9e120201f482f094431a75e/9c500d0ec9e120201f482f094431a75e.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769966.00000, (0, 0) as of 1757769966.00000, sharded as of 1757769966.00000> to ShardRange<'k' to 't' as of 1757769967.00000, (0, 0) as of 1757769967.00000, found as of 1757769967.00000>, path: .shards_a/shard_c_1757769967.00000, db: /tmp/tmptf5dotb5/sda/containers/0/75e/9c500d0ec9e120201f482f094431a75e/9c500d0ec9e120201f482f094431a75e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769969.00000, db: /tmp/tmptf5dotb5/sda/containers/0/4a0/a5f98d9b92353f93b43aae303cefe4a0/a5f98d9b92353f93b43aae303cefe4a0.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769968.00000, (0, 0) as of 1757769968.00000, sharded as of 1757769968.00000> to ShardRange<'k' to 't' as of 1757769969.00000, (0, 0) as of 1757769969.00000, created as of 1757769969.00000>, path: .shards_a/shard_c_1757769969.00000, db: /tmp/tmptf5dotb5/sda/containers/0/4a0/a5f98d9b92353f93b43aae303cefe4a0/a5f98d9b92353f93b43aae303cefe4a0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769971.00000, db: /tmp/tmptf5dotb5/sda/containers/0/806/7199c93ccfddc75301c516ffe5745806/7199c93ccfddc75301c516ffe5745806.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769970.00000, (0, 0) as of 1757769970.00000, sharded as of 1757769970.00000> to ShardRange<'k' to 't' as of 1757769971.00000, (0, 0) as of 1757769971.00000, cleaved as of 1757769971.00000>, path: .shards_a/shard_c_1757769971.00000, db: /tmp/tmptf5dotb5/sda/containers/0/806/7199c93ccfddc75301c516ffe5745806/7199c93ccfddc75301c516ffe5745806.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769973.00000, db: /tmp/tmptf5dotb5/sda/containers/0/b2f/4fc33dca908b12e11b52bb32e542ab2f/4fc33dca908b12e11b52bb32e542ab2f.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769972.00000, (0, 0) as of 1757769972.00000, sharded as of 1757769972.00000> to ShardRange<'k' to 't' as of 1757769973.00000, (0, 0) as of 1757769973.00000, active as of 1757769973.00000>, path: .shards_a/shard_c_1757769973.00000, db: /tmp/tmptf5dotb5/sda/containers/0/b2f/4fc33dca908b12e11b52bb32e542ab2f/4fc33dca908b12e11b52bb32e542ab2f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769975.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8f6/6b89862619852170b663c913582f98f6/6b89862619852170b663c913582f98f6.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769974.00000, (0, 0) as of 1757769974.00000, sharded as of 1757769974.00000> to ShardRange<'k' to 't' as of 1757769975.00000, (0, 0) as of 1757769975.00000, shrinking as of 1757769975.00000>, path: .shards_a/shard_c_1757769975.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8f6/6b89862619852170b663c913582f98f6/6b89862619852170b663c913582f98f6.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769975.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8f6/6b89862619852170b663c913582f98f6/6b89862619852170b663c913582f98f6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769977.00000, db: /tmp/tmptf5dotb5/sda/containers/0/3d8/2eb68ae9504b8297e9c879dd66fdb3d8/2eb68ae9504b8297e9c879dd66fdb3d8.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769976.00000, (0, 0) as of 1757769976.00000, sharded as of 1757769976.00000> to ShardRange<'k' to 't' as of 1757769977.00000, (0, 0) as of 1757769977.00000, sharding as of 1757769977.00000>, path: .shards_a/shard_c_1757769977.00000, db: /tmp/tmptf5dotb5/sda/containers/0/3d8/2eb68ae9504b8297e9c879dd66fdb3d8/2eb68ae9504b8297e9c879dd66fdb3d8.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769977.00000, db: /tmp/tmptf5dotb5/sda/containers/0/3d8/2eb68ae9504b8297e9c879dd66fdb3d8/2eb68ae9504b8297e9c879dd66fdb3d8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769979.00000, db: /tmp/tmptf5dotb5/sda/containers/0/fbb/29a5937be533dad006377cfa32229fbb/29a5937be533dad006377cfa32229fbb.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769979.00000, db: /tmp/tmptf5dotb5/sda/containers/0/fbb/29a5937be533dad006377cfa32229fbb/29a5937be533dad006377cfa32229fbb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769981.00000, db: /tmp/tmptf5dotb5/sda/containers/0/96f/918274de5441d0ab35ddad801d48396f/918274de5441d0ab35ddad801d48396f.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769980.00000, (0, 0) as of 1757769980.00000, sharded as of 1757769980.00000> to ShardRange<'k' to 't' as of 1757769981.00000, (0, 0) as of 1757769981.00000, shrunk as of 1757769981.00000>, path: .shards_a/shard_c_1757769981.00000, db: /tmp/tmptf5dotb5/sda/containers/0/96f/918274de5441d0ab35ddad801d48396f/918274de5441d0ab35ddad801d48396f.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769981.00000, db: /tmp/tmptf5dotb5/sda/containers/0/96f/918274de5441d0ab35ddad801d48396f/918274de5441d0ab35ddad801d48396f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769983.00000, db: /tmp/tmptf5dotb5/sda/containers/0/193/02349bc76b94567efcb729049bf9d193/02349bc76b94567efcb729049bf9d193.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769982.00000, (0, 0) as of 1757769982.00000, shrunk as of 1757769982.00000> to ShardRange<'k' to 't' as of 1757769983.00000, (0, 0) as of 1757769983.00000, found as of 1757769983.00000>, path: .shards_a/shard_c_1757769983.00000, db: /tmp/tmptf5dotb5/sda/containers/0/193/02349bc76b94567efcb729049bf9d193/02349bc76b94567efcb729049bf9d193.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769985.00000, db: /tmp/tmptf5dotb5/sda/containers/0/48f/cc7e89ca95f0a0a33de14dcbff90748f/cc7e89ca95f0a0a33de14dcbff90748f.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769984.00000, (0, 0) as of 1757769984.00000, shrunk as of 1757769984.00000> to ShardRange<'k' to 't' as of 1757769985.00000, (0, 0) as of 1757769985.00000, created as of 1757769985.00000>, path: .shards_a/shard_c_1757769985.00000, db: /tmp/tmptf5dotb5/sda/containers/0/48f/cc7e89ca95f0a0a33de14dcbff90748f/cc7e89ca95f0a0a33de14dcbff90748f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769987.00000, db: /tmp/tmptf5dotb5/sda/containers/0/7f9/6ea77b52e91069e93e5f7accc57907f9/6ea77b52e91069e93e5f7accc57907f9.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769986.00000, (0, 0) as of 1757769986.00000, shrunk as of 1757769986.00000> to ShardRange<'k' to 't' as of 1757769987.00000, (0, 0) as of 1757769987.00000, cleaved as of 1757769987.00000>, path: .shards_a/shard_c_1757769987.00000, db: /tmp/tmptf5dotb5/sda/containers/0/7f9/6ea77b52e91069e93e5f7accc57907f9/6ea77b52e91069e93e5f7accc57907f9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769989.00000, db: /tmp/tmptf5dotb5/sda/containers/0/e02/2ecb6bd53e7f7e8daa0d29fa7b25ae02/2ecb6bd53e7f7e8daa0d29fa7b25ae02.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769988.00000, (0, 0) as of 1757769988.00000, shrunk as of 1757769988.00000> to ShardRange<'k' to 't' as of 1757769989.00000, (0, 0) as of 1757769989.00000, active as of 1757769989.00000>, path: .shards_a/shard_c_1757769989.00000, db: /tmp/tmptf5dotb5/sda/containers/0/e02/2ecb6bd53e7f7e8daa0d29fa7b25ae02/2ecb6bd53e7f7e8daa0d29fa7b25ae02.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769991.00000, db: /tmp/tmptf5dotb5/sda/containers/0/260/ce6ba856ee776d108fe6d1f81e25a260/ce6ba856ee776d108fe6d1f81e25a260.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_legacy_pending_files test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_legacy_pending_files ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter ... ok object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 11 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 6.9141387939453125e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/o policy#0, frag index 3 (missing X-Backend-Data-Timestamp and X-Backend-Timestamp) object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 11 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 6.9141387939453125e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (3/10 from 3 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (10 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (9 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (3/10 from 3 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (10 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (9 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (3/10 from 3 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r2=10', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r1=100', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test WARNING: sorting_method is set to 'timing', not 'affinity'; (default) read_affinity setting will have no effect. test WARNING: sorting_method is set to 'timing', not 'affinity'; policy 0 (nulo) read_affinity setting will have no effect. test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=10', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r2=10', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test WARNING: sorting_method is set to 'timing', not 'affinity'; policy 0 (nulo) read_affinity setting will have no effect. test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': 'r1=100', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=100', 'write_affinity': 'r2', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0=100', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test WARNING: sorting_method is set to 'shuffle', not 'affinity'; (default) read_affinity setting will have no effect. test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=10', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': True, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 4}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.2, 'concurrent_ec_extra_requests': 0}, app) sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769990.00000, (0, 0) as of 1757769990.00000, shrunk as of 1757769990.00000> to ShardRange<'k' to 't' as of 1757769991.00000, (0, 0) as of 1757769991.00000, shrinking as of 1757769991.00000>, path: .shards_a/shard_c_1757769991.00000, db: /tmp/tmptf5dotb5/sda/containers/0/260/ce6ba856ee776d108fe6d1f81e25a260/ce6ba856ee776d108fe6d1f81e25a260.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769991.00000, db: /tmp/tmptf5dotb5/sda/containers/0/260/ce6ba856ee776d108fe6d1f81e25a260/ce6ba856ee776d108fe6d1f81e25a260.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769993.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6a4/a55be364f94cc0a8359c09101d1656a4/a55be364f94cc0a8359c09101d1656a4.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769992.00000, (0, 0) as of 1757769992.00000, shrunk as of 1757769992.00000> to ShardRange<'k' to 't' as of 1757769993.00000, (0, 0) as of 1757769993.00000, sharding as of 1757769993.00000>, path: .shards_a/shard_c_1757769993.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6a4/a55be364f94cc0a8359c09101d1656a4/a55be364f94cc0a8359c09101d1656a4.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769993.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6a4/a55be364f94cc0a8359c09101d1656a4/a55be364f94cc0a8359c09101d1656a4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769995.00000, db: /tmp/tmptf5dotb5/sda/containers/0/4ba/7f92c01aef2737f5224b6b48f648c4ba/7f92c01aef2737f5224b6b48f648c4ba.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769994.00000, (0, 0) as of 1757769994.00000, shrunk as of 1757769994.00000> to ShardRange<'k' to 't' as of 1757769995.00000, (0, 0) as of 1757769995.00000, sharded as of 1757769995.00000>, path: .shards_a/shard_c_1757769995.00000, db: /tmp/tmptf5dotb5/sda/containers/0/4ba/7f92c01aef2737f5224b6b48f648c4ba/7f92c01aef2737f5224b6b48f648c4ba.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769995.00000, db: /tmp/tmptf5dotb5/sda/containers/0/4ba/7f92c01aef2737f5224b6b48f648c4ba/7f92c01aef2737f5224b6b48f648c4ba.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769997.00000, db: /tmp/tmptf5dotb5/sda/containers/0/441/c9eac7f3f0e17c0200a17fb9db7f7441/c9eac7f3f0e17c0200a17fb9db7f7441.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757769997.00000, db: /tmp/tmptf5dotb5/sda/containers/0/441/c9eac7f3f0e17c0200a17fb9db7f7441/c9eac7f3f0e17c0200a17fb9db7f7441.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757769998.00000, db: /tmp/tmptf5dotb5/sda/containers/0/753/3026bf7107d8309d9feae2d6d4a46753/3026bf7107d8309d9feae2d6d4a46753.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770000.00000, db: /tmp/tmptf5dotb5/sda/containers/0/030/9f9d9a4402d2087bcb85c6dde6987030/9f9d9a4402d2087bcb85c6dde6987030.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770002.00000, db: /tmp/tmptf5dotb5/sda/containers/0/12c/cab9aad1fb93ad2b60bb00b87665412c/cab9aad1fb93ad2b60bb00b87665412c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770004.00000, db: /tmp/tmptf5dotb5/sda/containers/0/ee5/edacc2f29f93f5f9a49e9ac919b6bee5/edacc2f29f93f5f9a49e9ac919b6bee5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770006.00000, db: /tmp/tmptf5dotb5/sda/containers/0/178/53faf6b8f3cd4bb1aaca63bcc77e4178/53faf6b8f3cd4bb1aaca63bcc77e4178.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770008.00000, db: /tmp/tmptf5dotb5/sda/containers/0/3a3/469edde635f0aeb5001b66826d4ff3a3/469edde635f0aeb5001b66826d4ff3a3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770010.00000, db: /tmp/tmptf5dotb5/sda/containers/0/144/72524d79efe3281e32a881e4fbf15144/72524d79efe3281e32a881e4fbf15144.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770012.00000, db: /tmp/tmptf5dotb5/sda/containers/0/e0e/b94b3e3a73713a851267ccec21895e0e/b94b3e3a73713a851267ccec21895e0e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770014.00000, db: /tmp/tmptf5dotb5/sda/containers/0/61b/18124be94268e50e1d3ca9c8294b661b/18124be94268e50e1d3ca9c8294b661b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770016.00000, db: /tmp/tmptf5dotb5/sda/containers/0/6b8/a9b1d8db31f3a3915734521a66c836b8/a9b1d8db31f3a3915734521a66c836b8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770018.00000, db: /tmp/tmptf5dotb5/sda/containers/0/dad/290095d6215545c9267509d74adbedad/290095d6215545c9267509d74adbedad.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770020.00000, db: /tmp/tmptf5dotb5/sda/containers/0/df3/8e40a487530e2eafce8be27a1eb3ddf3/8e40a487530e2eafce8be27a1eb3ddf3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770022.00000, db: /tmp/tmptf5dotb5/sda/containers/0/405/a8473bc9beb692a63248ad788ec81405/a8473bc9beb692a63248ad788ec81405.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770024.00000, db: /tmp/tmptf5dotb5/sda/containers/0/690/f06bc96d6b335668546729f04962f690/f06bc96d6b335668546729f04962f690.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770026.00000, db: /tmp/tmptf5dotb5/sda/containers/0/922/557f1d1694723b5a232ff883c84f3922/557f1d1694723b5a232ff883c84f3922.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770028.00000, db: /tmp/tmptf5dotb5/sda/containers/0/cc0/e46754d75003021046cd313bf847acc0/e46754d75003021046cd313bf847acc0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770030.00000, db: /tmp/tmptf5dotb5/sda/containers/0/b50/bcf2ceff0406b0b6241146f1e38f1b50/bcf2ceff0406b0b6241146f1e38f1b50.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770032.00000, db: /tmp/tmptf5dotb5/sda/containers/0/370/5c14e7af1dd0bf19c2794326df018370/5c14e7af1dd0bf19c2794326df018370.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770034.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c68/fffc86fcd89740f0977ba82660b8bc68/fffc86fcd89740f0977ba82660b8bc68.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770036.00000, db: /tmp/tmptf5dotb5/sda/containers/0/58b/4979c91969c180a1fd5590afdc7e758b/4979c91969c180a1fd5590afdc7e758b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770038.00000, db: /tmp/tmptf5dotb5/sda/containers/0/7d4/32bda3c620aef1a35edafa59390e27d4/32bda3c620aef1a35edafa59390e27d4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770040.00000, db: /tmp/tmptf5dotb5/sda/containers/0/400/b446dbb10e8b362542824c9087a26400/b446dbb10e8b362542824c9087a26400.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770042.00000, db: /tmp/tmptf5dotb5/sda/containers/0/af0/f6cd7c1ceeaa4fc306060f78f866daf0/f6cd7c1ceeaa4fc306060f78f866daf0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770044.00000, db: /tmp/tmptf5dotb5/sda/containers/0/48c/2abdf695962730b97b47c96feb5db48c/2abdf695962730b97b47c96feb5db48c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770046.00000, db: /tmp/tmptf5dotb5/sda/containers/0/cfd/d1cc2e53ee1fbf4f7d721b6f83653cfd/d1cc2e53ee1fbf4f7d721b6f83653cfd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770048.00000, db: /tmp/tmptf5dotb5/sda/containers/0/b09/d5c8be75b55be4aef442e12175bbab09/d5c8be75b55be4aef442e12175bbab09.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter_non_slash ... ok test ERROR: Aborting listing from shards due to bad response: [200, 503] (txn: txf96078d81cfc4ae5925c4-0068c5708a) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_a', lower='', upper='a') .shards_a/c_a with {'X-Backend-Record-Type': 'auto'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Get listing from /v1/.shards_a/c_a?format=json&limit=10000&marker=&end_marker=a%00 {'X-Backend-Record-Type': 'auto'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Found 33 objects in shard (state=unsharded), total = 33 (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'auto'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=9967&marker=a&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: GET listing from 1 shards for: /v1/.shards_a/c_b?format=json&limit=9967&marker=a&end_marker=b%00&states=listing (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='b', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9967&marker=a&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: GET listing from 1 shards for: /v1/.shards_a/c_?format=json&limit=9967&marker=a&end_marker=b%00&states=listing (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'object'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=9967&marker=a&end_marker=b%00 {'X-Backend-Record-Type': 'object'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Found 1 objects in shard (state=unsharded), total = 1 (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Found 1 objects in shard (state=sharded), total = 1 (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Found 1 objects in shard (state=sharded), total = 34 (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='b', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'object'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9966&marker=b&end_marker= {'X-Backend-Record-Type': 'object'} (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1058 (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Setting object count to 1058 (txn: tx9bfa7614196f4dd69a33f-0068c5708c) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 1 shards for: /v1/a/c?format=json&states=listing (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=10000&marker=&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: GET listing from 1 shards for: /v1/.shards_a/c_?format=json&limit=10000&marker=&end_marker=&states=listing (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c', lower='', upper='') a/c with {'X-Backend-Record-Type': 'object'} (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: Get listing from /v1/a/c?format=json&limit=10000&marker=&end_marker= {'X-Backend-Record-Type': 'object'} (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: Found 1024 objects in shard (state=sharded), total = 1024 (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: Setting object count to 1024 (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: Found 1024 objects in shard (state=sharding), total = 1024 (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: Setting object count to 1024 (txn: tx3fedb10518154dd28741b-0068c5708e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test INFO: Caching listing namespaces for shard-listing-v2/.shards_a/c_pie (3 namespaces) (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: GET listing from 3 shards for: /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c_sub_juice', lower='ham', upper='juice') a/c_sub_juice with {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Get listing from /v1/a/c_sub_juice?format=json&limit=9960&marker=h&end_marker=juice%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Getting listing part 1 from shard Namespace(name='a/c_sub_lemon', lower='juice', upper='lemon') a/c_sub_lemon with {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Get listing from /v1/a/c_sub_lemon?format=json&limit=9958&marker=j&end_marker=lemon%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Found 2 objects in shard (state=unsharded), total = 4 (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Getting listing part 2 from shard Namespace(name='a/c_sub_pie', lower='lemon', upper='') a/c_sub_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Get listing from /v1/a/c_sub_pie?format=json&limit=9956&marker=l&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f)test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_sharded_shard_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_sharded_shard_with_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter_order_and_reverse test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter_order_and_reverse ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter_prefix_delim ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter_with_reserved_name test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_list_objects_iter_with_reserved_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_load_old_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_load_old_record_from_pending_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_make_tuple_for_pickle test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_make_tuple_for_pickle ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_is_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items_is_green test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items_is_green ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_is_old_enough_to_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_is_old_enough_to_reclaim ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items_overwrite test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items_overwrite ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_is_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_is_reclaimable ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770050.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c23/06999da89cf056210dc67079982d5c23/06999da89cf056210dc67079982d5c23.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770052.00000, db: /tmp/tmptf5dotb5/sda/containers/0/e64/b92739c4d4ac61dbd2bcadb05e912e64/b92739c4d4ac61dbd2bcadb05e912e64.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770054.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f9c/23754b899af243ca96ec1c2e6303ff9c/23754b899af243ca96ec1c2e6303ff9c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770056.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8a3/9496a3039328c2ae02d71b2e44a058a3/9496a3039328c2ae02d71b2e44a058a3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770058.00000, db: /tmp/tmptf5dotb5/sda/containers/0/b71/629275bf537e214c07eac19b09166b71/629275bf537e214c07eac19b09166b71.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770060.00000, db: /tmp/tmptf5dotb5/sda/containers/0/afa/1a3c5cb0f84dd07153c9d2f50d99fafa/1a3c5cb0f84dd07153c9d2f50d99fafa.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770062.00000, db: /tmp/tmptf5dotb5/sda/containers/0/87d/08ab99a1679fb11f2203f1b486aa487d/08ab99a1679fb11f2203f1b486aa487d.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770062.00000, db: /tmp/tmptf5dotb5/sda/containers/0/87d/08ab99a1679fb11f2203f1b486aa487d/08ab99a1679fb11f2203f1b486aa487d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770064.00000, db: /tmp/tmptf5dotb5/sda/containers/0/432/506797ab0d49f11bb0fc1f65963f4432/506797ab0d49f11bb0fc1f65963f4432.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770064.00000, db: /tmp/tmptf5dotb5/sda/containers/0/432/506797ab0d49f11bb0fc1f65963f4432/506797ab0d49f11bb0fc1f65963f4432.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770066.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c38/cab07a7980f0e6e235f7d9faa2233c38/cab07a7980f0e6e235f7d9faa2233c38.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770066.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c38/cab07a7980f0e6e235f7d9faa2233c38/cab07a7980f0e6e235f7d9faa2233c38.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770068.00000, db: /tmp/tmptf5dotb5/sda/containers/0/a68/1b56c88cae07d689c4ee5c01b6f76a68/1b56c88cae07d689c4ee5c01b6f76a68.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770068.00000, db: /tmp/tmptf5dotb5/sda/containers/0/a68/1b56c88cae07d689c4ee5c01b6f76a68/1b56c88cae07d689c4ee5c01b6f76a68.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770070.00000, db: /tmp/tmptf5dotb5/sda/containers/0/573/c22d33b03313f95efb4c3d81f28b4573/c22d33b03313f95efb4c3d81f28b4573.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770070.00000, db: /tmp/tmptf5dotb5/sda/containers/0/573/c22d33b03313f95efb4c3d81f28b4573/c22d33b03313f95efb4c3d81f28b4573.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770072.00000, db: /tmp/tmptf5dotb5/sda/containers/0/ff0/ba3d83dafe7d4b4c5bbfc6c8d6cbeff0/ba3d83dafe7d4b4c5bbfc6c8d6cbeff0.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770072.00000, db: /tmp/tmptf5dotb5/sda/containers/0/ff0/ba3d83dafe7d4b4c5bbfc6c8d6cbeff0/ba3d83dafe7d4b4c5bbfc6c8d6cbeff0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770074.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f57/62bf4fa826d239b3edd69dad639c9f57/62bf4fa826d239b3edd69dad639c9f57.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770074.00000, db: /tmp/tmptf5dotb5/sda/containers/0/f57/62bf4fa826d239b3edd69dad639c9f57/62bf4fa826d239b3edd69dad639c9f57.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770076.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8ec/a5f321ae5cf1c4feab98d2b50cc568ec/a5f321ae5cf1c4feab98d2b50cc568ec.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770076.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8ec/a5f321ae5cf1c4feab98d2b50cc568ec/a5f321ae5cf1c4feab98d2b50cc568ec.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770078.00000, db: /tmp/tmptf5dotb5/sda/containers/0/dd4/656a58509af1b0f777e5b53184915dd4/656a58509af1b0f777e5b53184915dd4.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770078.00000, db: /tmp/tmptf5dotb5/sda/containers/0/dd4/656a58509af1b0f777e5b53184915dd4/656a58509af1b0f777e5b53184915dd4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770080.00000, db: /tmp/tmptf5dotb5/sda/containers/0/83c/a18c46b3bb4598e19085256dd902b83c/a18c46b3bb4598e19085256dd902b83c.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770080.00000, db: /tmp/tmptf5dotb5/sda/containers/0/83c/a18c46b3bb4598e19085256dd902b83c/a18c46b3bb4598e19085256dd902b83c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770082.00000, db: /tmp/tmptf5dotb5/sda/containers/0/1fc/519ab3e36f88d01e724fb561b8eb51fc/519ab3e36f88d01e724fb561b8eb51fc.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770082.00000, db: /tmp/tmptf5dotb5/sda/containers/0/1fc/519ab3e36f88d01e724fb561b8eb51fc/519ab3e36f88d01e724fb561b8eb51fc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770084.00000, db: /tmp/tmptf5dotb5/sda/containers/0/cb2/3b773fd64d693463068ea0805bb2dcb2/3b773fd64d693463068ea0805bb2dcb2.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770084.00000, db: /tmp/tmptf5dotb5/sda/containers/0/cb2/3b773fd64d693463068ea0805bb2dcb2/3b773fd64d693463068ea0805bb2dcb2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770086.00000, db: /tmp/tmptf5dotb5/sda/containers/0/337/f78ff13f7541c07b6ce4b976fdd53337/f78ff13f7541c07b6ce4b976fdd53337.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770086.00000, db: /tmp/tmptf5dotb5/sda/containers/0/337/f78ff13f7541c07b6ce4b976fdd53337/f78ff13f7541c07b6ce4b976fdd53337.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770088.00000, db: /tmp/tmptf5dotb5/sda/containers/0/a90/48bb5f5379c17646a148aa2005877a90/48bb5f5379c17646a148aa2005877a90.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770088.00000, db: /tmp/tmptf5dotb5/sda/containers/0/a90/48bb5f5379c17646a148aa2005877a90/48bb5f5379c17646a148aa2005877a90.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770090.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8fa/57168db851cd5cea0df237301dd408fa/57168db851cd5cea0df237301dd408fa.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770090.00000, db: /tmp/tmptf5dotb5/sda/containers/0/8fa/57168db851cd5cea0df237301dd408fa/57168db851cd5cea0df237301dd408fa.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770092.00000, db: /tmp/tmptf5dotb5/sda/containers/0/34c/e40110c572ab9ecda6ddd1ac63a9834c/e40110c572ab9ecda6ddd1ac63a9834c.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770092.00000, db: /tmp/tmptf5dotb5/sda/containers/0/34c/e40110c572ab9ecda6ddd1ac63a9834c/e40110c572ab9ecda6ddd1ac63a9834c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770094.00000, db: /tmp/tmptf5dotb5/sda/containers/0/900/57d5e34d5bcd7313b9606ae8ede83900/57d5e34d5bcd7313b9606ae8ede83900.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items_overwrite_unicode test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items_overwrite_unicode ... ok object-reconstructor ERROR: Unable to get enough responses (10 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (9 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (9 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_last_modified_time test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_last_modified_time ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items_post_overwrite_out_of_order test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_items_post_overwrite_out_of_order ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_more_than_threshold_frags test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_more_than_threshold_frags ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_range_single_record test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_range_single_record ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_legacy_pending_files test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_legacy_pending_files ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_container_merge_other_ranges test.unit.container.test_sharder.TestSharder.test_audit_shard_container_merge_other_ranges ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_deleted_range_in_root_container test.unit.container.test_sharder.TestSharder.test_audit_shard_deleted_range_in_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_deleted_range_missing_from_root_container test.unit.container.test_sharder.TestSharder.test_audit_shard_deleted_range_missing_from_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges_fails_to_migrate_table test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges_fails_to_migrate_table ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges_migrates_table test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges_migrates_table ... ok sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770094.00000, db: /tmp/tmptf5dotb5/sda/containers/0/900/57d5e34d5bcd7313b9606ae8ede83900/57d5e34d5bcd7313b9606ae8ede83900.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770096.00000, db: /tmp/tmptf5dotb5/sda/containers/0/9ae/d87365f50b2b6b352c9e567dcd2279ae/d87365f50b2b6b352c9e567dcd2279ae.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770096.00000, db: /tmp/tmptf5dotb5/sda/containers/0/9ae/d87365f50b2b6b352c9e567dcd2279ae/d87365f50b2b6b352c9e567dcd2279ae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770098.00000, db: /tmp/tmptf5dotb5/sda/containers/0/468/0f3c1c3ffd1f6e232b08fb01aabdc468/0f3c1c3ffd1f6e232b08fb01aabdc468.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770098.00000, db: /tmp/tmptf5dotb5/sda/containers/0/468/0f3c1c3ffd1f6e232b08fb01aabdc468/0f3c1c3ffd1f6e232b08fb01aabdc468.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770100.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c0d/7d3ce109b68ae112e0900499311cec0d/7d3ce109b68ae112e0900499311cec0d.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770100.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c0d/7d3ce109b68ae112e0900499311cec0d/7d3ce109b68ae112e0900499311cec0d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770102.00000, db: /tmp/tmptf5dotb5/sda/containers/0/ecb/25569328a6b79e33bf4151d852000ecb/25569328a6b79e33bf4151d852000ecb.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770102.00000, db: /tmp/tmptf5dotb5/sda/containers/0/ecb/25569328a6b79e33bf4151d852000ecb/25569328a6b79e33bf4151d852000ecb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770104.00000, db: /tmp/tmptf5dotb5/sda/containers/0/aad/f384c412c199d98c8821ed0fe298eaad/f384c412c199d98c8821ed0fe298eaad.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770104.00000, db: /tmp/tmptf5dotb5/sda/containers/0/aad/f384c412c199d98c8821ed0fe298eaad/f384c412c199d98c8821ed0fe298eaad.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770106.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d45/cc61b0b9dc88725c0d37418947dc4d45/cc61b0b9dc88725c0d37418947dc4d45.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770106.00000, db: /tmp/tmptf5dotb5/sda/containers/0/d45/cc61b0b9dc88725c0d37418947dc4d45/cc61b0b9dc88725c0d37418947dc4d45.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770108.00000, db: /tmp/tmptf5dotb5/sda/containers/0/1c9/1a854628b19268607951b33186d8b1c9/1a854628b19268607951b33186d8b1c9.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770108.00000, db: /tmp/tmptf5dotb5/sda/containers/0/1c9/1a854628b19268607951b33186d8b1c9/1a854628b19268607951b33186d8b1c9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770110.00000, db: /tmp/tmptf5dotb5/sda/containers/0/7c3/e2cc1dfa99509d814501c9d589a017c3/e2cc1dfa99509d814501c9d589a017c3.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770110.00000, db: /tmp/tmptf5dotb5/sda/containers/0/7c3/e2cc1dfa99509d814501c9d589a017c3/e2cc1dfa99509d814501c9d589a017c3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770112.00000, db: /tmp/tmptf5dotb5/sda/containers/0/fd5/af55656917432cc6caec5d66613d7fd5/af55656917432cc6caec5d66613d7fd5.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770112.00000, db: /tmp/tmptf5dotb5/sda/containers/0/fd5/af55656917432cc6caec5d66613d7fd5/af55656917432cc6caec5d66613d7fd5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770114.00000, db: /tmp/tmptf5dotb5/sda/containers/0/1ba/415ac11404ed6e59cc20fc9813c6f1ba/415ac11404ed6e59cc20fc9813c6f1ba.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770114.00000, db: /tmp/tmptf5dotb5/sda/containers/0/1ba/415ac11404ed6e59cc20fc9813c6f1ba/415ac11404ed6e59cc20fc9813c6f1ba.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770116.00000, db: /tmp/tmptf5dotb5/sda/containers/0/0e3/53d6efa1f81445fd945c4276f1b550e3/53d6efa1f81445fd945c4276f1b550e3.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770116.00000, db: /tmp/tmptf5dotb5/sda/containers/0/0e3/53d6efa1f81445fd945c4276f1b550e3/53d6efa1f81445fd945c4276f1b550e3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770118.00000, db: /tmp/tmptf5dotb5/sda/containers/0/14f/9da7388ef6eedc1b0f0b2503d2f3d14f/9da7388ef6eedc1b0f0b2503d2f3d14f.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770118.00000, db: /tmp/tmptf5dotb5/sda/containers/0/14f/9da7388ef6eedc1b0f0b2503d2f3d14f/9da7388ef6eedc1b0f0b2503d2f3d14f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770120.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c99/2dc8dc6886cbedf5ea8d090535b69c99/2dc8dc6886cbedf5ea8d090535b69c99.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770120.00000, db: /tmp/tmptf5dotb5/sda/containers/0/c99/2dc8dc6886cbedf5ea8d090535b69c99/2dc8dc6886cbedf5ea8d090535b69c99.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770122.00000, db: /tmp/tmptf5dotb5/sda/containers/0/653/4fa2760129f62a72ae7bda366b5e2653/4fa2760129f62a72ae7bda366b5e2653.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770122.00000, db: /tmp/tmptf5dotb5/sda/containers/0/653/4fa2760129f62a72ae7bda366b5e2653/4fa2760129f62a72ae7bda366b5e2653.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c_1757770124.00000, db: /tmp/tmptf5dotb5/sda/containers/0/405/c269aec143dfcc3ab6f84ddbeeb8e405/c269aec143dfcc3ab6f84ddbeeb8e405.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/shard_c_1757770124.00000, db: /tmp/tmptf5dotb5/sda/containers/0/405/c269aec143dfcc3ab6f84ddbeeb8e405/c269aec143dfcc3ab6f84ddbeeb8e405.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/shard_c, db: /tmp/tmpb4ymc30k/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Updated own shard range from ShardRange<'k' to 't' as of 1757769872.00000, (0, 0) as of 1757769872.00000, active as of 1757769872.00000> to ShardRange<'k' to 't' as of 1757769873.00000, (0, 0) as of 1757769873.00000, sharded as of 1757769874.00000>, path: .shards_a/shard_c, db: /tmp/tmpb4ymc30k/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Marked shard container as deleted, path: .shards_a/shard_c, db: /tmp/tmpb4ymc30k/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Marked shard container as deleted, path: .shards_a/shard_c, db: /tmp/tmp1ag_f7x3/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769873.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/d4d/37c3277169ce137caef9c5f051485d4d/37c3277169ce137caef9c5f051485d4d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769876.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/f75/0267ffe67847f132b8c030aede97df75/0267ffe67847f132b8c030aede97df75.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769879.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/57d/45b778c9eb45328fdde6aca05e03457d/45b778c9eb45328fdde6aca05e03457d.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_range_not_merged_while_shrinking test.unit.container.test_sharder.TestSharder.test_audit_shard_root_range_not_merged_while_shrinking ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_range_overlap_not_merged_while_shrinking test.unit.container.test_sharder.TestSharder.test_audit_shard_root_range_overlap_not_merged_while_shrinking ... ok object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor DEBUG: Found existing frag #3 at 10.0.0.1:1001/sdb/0/a/c/o policy#0 while rebuilding to 10.0.0.3:1003/sdd/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 2 ok responses) to reconstruct non-durable 10.0.0.3:1003/sdd/0/a/c/o policy#0 frag#3 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769871.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.3:1003/sdd/0/a/c/o policy#0 frag#3 object-reconstructor INFO: Nothing reconstructed for 8.106231689453125e-06 seconds. object-reconstructor WARNING: Invalid response 400 from 10.0.0.13:1013/sdn/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.27:1027/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.41:1041/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 39 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.181:1181/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 179 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.17:1017/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.17:1017/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.17:1017/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.13:1013/sdn/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.27:1027/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.41:1041/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (39 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.181:1181/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (179 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter_non_slash ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_non_404_response test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_no_quarantine_non_404_response ... ok test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx12d1fd3d19f240db8fdca-0068c5708e) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx12d1fd3d19f240db8fdca-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_pie?limit=9&format=json&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx12d1fd3d19f240db8fdca-0068c5708e) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx12d1fd3d19f240db8fdca-0068c5708e) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx12d1fd3d19f240db8fdca-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?limit=1&format=json&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx12d1fd3d19f240db8fdca-0068c5708e) test DEBUG: Found 1 objects in shard (state=unsharded), total = 49 (txn: tx12d1fd3d19f240db8fdca-0068c5708e) test DEBUG: GET listing from 2 shards for: /v1/a/c?marker=%E2%98%86&format=json&states=listing (txn: txecdb65518a114170a6183-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: txecdb65518a114170a6183-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%86&format=json&limit=10000&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: txecdb65518a114170a6183-0068c5708e) test DEBUG: Found 1022 objects in shard (state=unsharded), total = 1022 (txn: txecdb65518a114170a6183-0068c5708e) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txecdb65518a114170a6183-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_?marker=%E2%A8%83&format=json&limit=8978&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txecdb65518a114170a6183-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2046 (txn: txecdb65518a114170a6183-0068c5708e) test DEBUG: GET listing from 4 shards for: /v1/a/c?end_marker=%E2%98%8A&format=json&states=listing (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_ham?end_marker=ham%00&format=json&limit=10000&marker= {'X-Backend-Record-Type': 'auto'} (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_pie?end_marker=pie%00&format=json&limit=9960&marker=h {'X-Backend-Record-Type': 'auto'} (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?end_marker=%E2%98%83%00&format=json&limit=9952&marker=p {'X-Backend-Record-Type': 'auto'} (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?end_marker=%E2%98%8A&format=json&limit=8928&marker=%D1%B0 {'X-Backend-Record-Type': 'auto'} (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: Found 6 objects in shard (state=unsharded), total = 1078 (txn: tx1ca50ba2f21f45c6ab8c5-0068c5708e) test DEBUG: GET listing from 5 shards for: /v1/a/c?prefix=hat&format=json&states=listing (txn: txb717f49d363040ac8bab9-0068c5708e) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txb717f49d363040ac8bab9-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_pie?prefix=hat&format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txb717f49d363040ac8bab9-0068c5708e) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: txb717f49d363040ac8bab9-0068c5708e) test DEBUG: GET listing from 1 shards for: /v1/a/c?marker=%E2%98%86&end_marker=%E2%98%8A&limit=2&format=json&states=listing (txn: tx4f05f650a96846a4bded8-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx4f05f650a96846a4bded8-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%86&end_marker=%E2%98%8A&limit=2&format=json {'X-Backend-Record-Type': 'auto'} (txn: tx4f05f650a96846a4bded8-0068c5708e) test DEBUG: Found 4 objects in shard (state=unsharded), total = 4 (txn: tx4f05f650a96846a4bded8-0068c5708e) test DEBUG: GET listing from 1 shards for: /v1/a/c?marker=%E2%98%8A&end_marker=%E2%98%86&limit=2&reverse=true&format=json&states=listing (txn: tx93863540ae7a43d6b4de9-0068c5708e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx93863540ae7a43d6b4de9-0068c5708e) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%8A&end_marker=%E2%98%86&limit=2&reverse=true&format=json {'X-Backend-Record-Type': 'auto'} (txn: tx93863540ae7a43d6b4de9-0068c5708e) test DEBUG: Found 4 objects in shard (state=unsharded), total = 4 (txn: tx93863540ae7a43d6b4de9-0068c5708e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='lemon', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: Found 1020 objects in shard (state=unsharded), total = 1068 (txn: tx2db4a016f0e8418096cc1-0068c57090)test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_overlapping_shards_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_overlapping_shards_no_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter_order_and_reverse test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter_order_and_reverse ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter_prefix_delim ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769882.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/a01/ebadf156143425e35151d39dfad37a01/ebadf156143425e35151d39dfad37a01.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769888.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/14e/06aae6d6b588a59c64f6528cb463a14e/06aae6d6b588a59c64f6528cb463a14e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769894.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769897.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/6d0/cb77bd015829c04863e9d2518065f6d0/cb77bd015829c04863e9d2518065f6d0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769900.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/bea/5e6e3d0ecc4cb6fe6f0265b00a314bea/5e6e3d0ecc4cb6fe6f0265b00a314bea.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769903.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/e5f/62353c7988233cb2bf2b2ecfab502e5f/62353c7988233cb2bf2b2ecfab502e5f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769906.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/41c/036de6688bc7eeac874c629324f6041c/036de6688bc7eeac874c629324f6041c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769909.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/ef5/e9595b55140ebac1fa5f96aab791def5/e9595b55140ebac1fa5f96aab791def5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769912.00000-0, db: /tmp/tmp_8r4yvuw/sda/containers/0/1ba/dcd3d64f1e1fe9e78d9f86832fda81ba/dcd3d64f1e1fe9e78d9f86832fda81ba.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769873.00000-0, db: /tmp/tmpz3w9tndd/sda/containers/0/d4d/37c3277169ce137caef9c5f051485d4d/37c3277169ce137caef9c5f051485d4d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769877.00000-0, db: /tmp/tmpz3w9tndd/sda/containers/0/9c5/816991eb394f60f98cbc144a76b2f9c5/816991eb394f60f98cbc144a76b2f9c5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769875.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/fab/6372a6571436fa6659afa7fc1330ffab/6372a6571436fa6659afa7fc1330ffab.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769879.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/57d/45b778c9eb45328fdde6aca05e03457d/45b778c9eb45328fdde6aca05e03457d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769883.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/40e/5b8c86b2927c02f8eff5ab546c4a040e/5b8c86b2927c02f8eff5ab546c4a040e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769887.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/c4e/6ca47e6a490852386f4a08f6d3049c4e/6ca47e6a490852386f4a08f6d3049c4e.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769887.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/c4e/6ca47e6a490852386f4a08f6d3049c4e/6ca47e6a490852386f4a08f6d3049c4e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769895.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/f23/ee518d315de13f098b3e3dc1cecbbf23/ee518d315de13f098b3e3dc1cecbbf23.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769899.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/28a/a945d49a6ac5f2a989dca38070a8328a/a945d49a6ac5f2a989dca38070a8328a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769903.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/e5f/62353c7988233cb2bf2b2ecfab502e5f/62353c7988233cb2bf2b2ecfab502e5f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769907.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/ea2/3330e89568ca8f797c0453f18faa0ea2/3330e89568ca8f797c0453f18faa0ea2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769911.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/051/ae88c7797d05d3f4dd6e94ada1621051/ae88c7797d05d3f4dd6e94ada1621051.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769915.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/671/db3ee6d2d9e50d873c7dfa4757f7c671/db3ee6d2d9e50d873c7dfa4757f7c671.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769919.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/02f/3d3793b06830504df1ee74ae88ae202f/3d3793b06830504df1ee74ae88ae202f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769919.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/02f/3d3793b06830504df1ee74ae88ae202f/3d3793b06830504df1ee74ae88ae202f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769923.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/f75/8c6559a9a6e18a895550d3e02f627f75/8c6559a9a6e18a895550d3e02f627f75.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769927.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/5cd/68e82dded13ef9285c4b54d2349cc5cd/68e82dded13ef9285c4b54d2349cc5cd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769931.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/14c/4047d06a80ae92b9efae76c95e23914c/4047d06a80ae92b9efae76c95e23914c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769935.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/c15/27cc49bee634e19ddbaee6827ac2dc15/27cc49bee634e19ddbaee6827ac2dc15.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769939.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/8d4/f8d139c52b153c3112590fd8ce68b8d4/f8d139c52b153c3112590fd8ce68b8d4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769943.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/83a/4bb00f1b19de9160959911b5d5f2583a/4bb00f1b19de9160959911b5d5f2583a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769947.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/7c5/a3b4bef6bf9cc9f81d1f4e71b2ad77c5/a3b4bef6bf9cc9f81d1f4e71b2ad77c5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769951.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/a52/d6352d444eab28d775b0f8d6673f0a52/d6352d444eab28d775b0f8d6673f0a52.db object-reconstructor WARNING: Invalid response 503 from 10.0.0.17:1017/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.17:1017/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.17:1017/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.13:1013/sdn/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.27:1027/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.41:1041/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (39 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.181:1181/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (179 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.17:1017/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.17:1017/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.17:1017/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter_with_reserved_name test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_list_objects_iter_with_reserved_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_load_old_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_load_old_record_from_pending_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_make_tuple_for_pickle test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_make_tuple_for_pickle ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items ... ok object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (14 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (15 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (16 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (17 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items_is_green test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items_is_green ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_shard_ranges_state test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_shard_ranges_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_newid test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_newid ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items_overwrite test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items_overwrite ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items_overwrite_unicode test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items_overwrite_unicode ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_sharding_shard_mixed_policies test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_sharding_shard_mixed_policies ... ok sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769951.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/a52/d6352d444eab28d775b0f8d6673f0a52/d6352d444eab28d775b0f8d6673f0a52.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769955.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/4c7/3417d997fde47f3ab723fae8a62354c7/3417d997fde47f3ab723fae8a62354c7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769959.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/b6b/e63f3fd6950083e9ef92cd21e15e3b6b/e63f3fd6950083e9ef92cd21e15e3b6b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769963.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/330/830714cae014cb4740753397ba137330/830714cae014cb4740753397ba137330.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769967.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/00b/2703965338dfecd5a001019c06a4c00b/2703965338dfecd5a001019c06a4c00b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769971.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/cb9/5902f68abce1d85074c866fa560cacb9/5902f68abce1d85074c866fa560cacb9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769975.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/7da/5d7b76fcf49519368d450589b78557da/5d7b76fcf49519368d450589b78557da.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769979.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/f1f/44023a11ce20df5bd9315c384ba4df1f/44023a11ce20df5bd9315c384ba4df1f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769983.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/21b/d76321697f42bd34a321bab450a3621b/d76321697f42bd34a321bab450a3621b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769983.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/21b/d76321697f42bd34a321bab450a3621b/d76321697f42bd34a321bab450a3621b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769987.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/9ec/da35ddeb4a1a070e28f8e46aa40769ec/da35ddeb4a1a070e28f8e46aa40769ec.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769991.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/c06/fcf5ad9577f95d312d25b6c4e66bfc06/fcf5ad9577f95d312d25b6c4e66bfc06.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769995.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/1bf/9ad896090b65b856835185eb80de41bf/9ad896090b65b856835185eb80de41bf.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769999.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/2d9/69aef83f08f906951b8425cc8f5a52d9/69aef83f08f906951b8425cc8f5a52d9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770003.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/ac6/131211a9c882d251ad06f43c98680ac6/131211a9c882d251ad06f43c98680ac6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770007.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/a4c/5522a35ecfedf9ab5c1ff664c7fdca4c/5522a35ecfedf9ab5c1ff664c7fdca4c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770011.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/03a/639b685a0d495f2e38c24576f8cb303a/639b685a0d495f2e38c24576f8cb303a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770015.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/63c/97bb8688e4f53a863a50169f18f6263c/97bb8688e4f53a863a50169f18f6263c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770015.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/63c/97bb8688e4f53a863a50169f18f6263c/97bb8688e4f53a863a50169f18f6263c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770019.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/2aa/2ce6e017e1f36959ea6edd5843f6f2aa/2ce6e017e1f36959ea6edd5843f6f2aa.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770023.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/88c/903bb10990f80e21e48243ad0050a88c/903bb10990f80e21e48243ad0050a88c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770027.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/f52/f308a86bbc68a6cff9ed9a6407f9ff52/f308a86bbc68a6cff9ed9a6407f9ff52.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770031.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/bd8/f2b5151d9d5433c1f97d3552388bfbd8/f2b5151d9d5433c1f97d3552388bfbd8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770035.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/fd0/2758d24b02496d7a66b8c9231f3ecfd0/2758d24b02496d7a66b8c9231f3ecfd0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770039.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/56f/cedb083397b56cd7fb9c11d24b99d56f/cedb083397b56cd7fb9c11d24b99d56f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770043.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/ddc/d968febfb41877b4217f64815f39eddc/d968febfb41877b4217f64815f39eddc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770047.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/cba/ff788fce32ebb9972f233e9ed32c6cba/ff788fce32ebb9972f233e9ed32c6cba.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770047.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/cba/ff788fce32ebb9972f233e9ed32c6cba/ff788fce32ebb9972f233e9ed32c6cba.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770051.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/523/1990b221902d604fa1229244eead0523/1990b221902d604fa1229244eead0523.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770055.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/f35/0aabe6f75c6e418cf8d7bf1b8bb20f35/0aabe6f75c6e418cf8d7bf1b8bb20f35.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770059.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/05a/c650b089de8e46b65abc802f1b18205a/c650b089de8e46b65abc802f1b18205a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770063.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/4bb/dc626d1b51fff20b1b43317ff65aa4bb/dc626d1b51fff20b1b43317ff65aa4bb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770067.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/466/1543aa844e69e556a39f461be5808466/1543aa844e69e556a39f461be5808466.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770071.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/0ee/e79ab44d89db60761752903205ed50ee/e79ab44d89db60761752903205ed50ee.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770075.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/e92/cae083294e87ea978f8e541002901e92/cae083294e87ea978f8e541002901e92.db object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (20 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (21 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (22 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (23 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (24 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (28 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (29 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (30 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (31 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (32 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items_post_overwrite_out_of_order test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_items_post_overwrite_out_of_order ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_one_rnc_absolute_number test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_one_rnc_absolute_number ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_object_stats_old_style_root_container test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_object_stats_old_style_root_container ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_one_rnc_four_replicas test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_one_rnc_four_replicas ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_one_rnc_three_replicas test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_one_rnc_three_replicas ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_one_rnc_two_replicas test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_one_rnc_two_replicas ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_two test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_two ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_two_with_quarantine_age test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_quarantine_threshold_two_with_quarantine_age ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_etag_with_same_timestamp test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_etag_with_same_timestamp ... ok object-reconstructor ERROR: Unable to get enough responses (33 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (34 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (35 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (36 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (37 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (38 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (39 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp3npnpy0b/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 7.152557373046875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (40 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpt4mjshq4/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (40 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpz73_3x0p/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpw0dwjo2r/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpluzozh2e/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 7.3909759521484375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpf2d1k0o6/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769872.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.9141387939453125e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Mixed Etag (some garbage, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 3.814697265625e-06 seconds. object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_etags_same_timestamp_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_etags_same_timestamp_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_new_etag test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_new_etag ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_old_etag test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_old_etag ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_timestamps_etags_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_fa_with_mixed_timestamps_etags_fail ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_object_stats_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_object_stats_old_style_shard_container ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_parity_fa_with_data_node_failure test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_reconstruct_parity_fa_with_data_node_failure ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_request_node_count_conf test.unit.obj.test_reconstructor.TestReconstructFragmentArchive.test_request_node_count_conf ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_quarantine_age_conf test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_quarantine_age_conf ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_quarantine_threshold_conf test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_quarantine_threshold_conf ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_all_404s_fails test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_all_404s_fails ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_object_stats_root_container test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_object_stats_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_shard_range_single_record test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_shard_range_single_record ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_all_404s_fails_custom_request_node_count test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_all_404s_fails_custom_request_node_count ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_error_with_invalid_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_error_with_invalid_header ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_errors_works test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_errors_works ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_object_stats_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_object_stats_shard_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges_state test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_merge_shard_ranges_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_old_style_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_old_style_root_account_container_path ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770079.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/779/c6fc3a5d48b5a3d8863dbaa0e19cf779/c6fc3a5d48b5a3d8863dbaa0e19cf779.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770079.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/779/c6fc3a5d48b5a3d8863dbaa0e19cf779/c6fc3a5d48b5a3d8863dbaa0e19cf779.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770083.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/bc9/227bc7287a522d9ee673c1e336b0ebc9/227bc7287a522d9ee673c1e336b0ebc9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770087.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/a1e/fec616840475c3f192c56725b3a28a1e/fec616840475c3f192c56725b3a28a1e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770091.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/d61/bb8e562d291f948c9317f51fd8db6d61/bb8e562d291f948c9317f51fd8db6d61.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770095.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/386/faf5f9b0b409718cad6771f085437386/faf5f9b0b409718cad6771f085437386.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770099.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/c5e/0656f2b12641a5e8bc0ec4fb44b28c5e/0656f2b12641a5e8bc0ec4fb44b28c5e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770103.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/712/8fd2afebacecb539a055a88c71111712/8fd2afebacecb539a055a88c71111712.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770107.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/726/afe0053c56d6571bd5b3fc9c990df726/afe0053c56d6571bd5b3fc9c990df726.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770111.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/7a2/72321bc1622ab13d5d961c77be5037a2/72321bc1622ab13d5d961c77be5037a2.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770111.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/7a2/72321bc1622ab13d5d961c77be5037a2/72321bc1622ab13d5d961c77be5037a2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770115.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/7a6/c87e3fae463d102d5179a543848377a6/c87e3fae463d102d5179a543848377a6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770119.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/4a0/5df95d99209bd1d9a935b4b5b10fa4a0/5df95d99209bd1d9a935b4b5b10fa4a0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770123.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/5fb/466202de971a2b78395b6402782415fb/466202de971a2b78395b6402782415fb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770127.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/30a/74da4e203f7b3379fa8175f55aa8630a/74da4e203f7b3379fa8175f55aa8630a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770131.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/e6c/8c740096650402e4eab2b7d74e919e6c/8c740096650402e4eab2b7d74e919e6c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770135.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/75b/2846ac95ae825cf1995acd598bf5d75b/2846ac95ae825cf1995acd598bf5d75b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770139.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/9b0/d82553b947df09a7d691c6bae81899b0/d82553b947df09a7d691c6bae81899b0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770143.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/a49/faee88f7624823756001dd3a6ea0aa49/faee88f7624823756001dd3a6ea0aa49.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770147.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/afe/7c5fdc36b0e6cdad014b321317a3fafe/7c5fdc36b0e6cdad014b321317a3fafe.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770151.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/dc8/05672acb88159105c27c6eeb07734dc8/05672acb88159105c27c6eeb07734dc8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770155.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/f99/892da868cf01f456e39beb8b2387df99/892da868cf01f456e39beb8b2387df99.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770159.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/02f/3f93f30c28834988d71c37f18e0ee02f/3f93f30c28834988d71c37f18e0ee02f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770163.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/749/9daeadbb188fc0c1a1fe1e4bfd0db749/9daeadbb188fc0c1a1fe1e4bfd0db749.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770167.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/b24/3cbf425b0eca737c392bd0f9c91a3b24/3cbf425b0eca737c392bd0f9c91a3b24.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770171.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/bb2/c54371273cf1be7530f7eb36d8e5cbb2/c54371273cf1be7530f7eb36d8e5cbb2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770175.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/509/82b96045ea8f7fdc6a669e0439c07509/82b96045ea8f7fdc6a669e0439c07509.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770179.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/aed/639fc3c6d3814dfd02ee85eb81ddeaed/639fc3c6d3814dfd02ee85eb81ddeaed.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770183.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/442/d74e6dca9112fc2ad6fc5cb32639f442/d74e6dca9112fc2ad6fc5cb32639f442.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770187.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/0c3/264f1ab66b0e9c04e81cc15f98ce40c3/264f1ab66b0e9c04e81cc15f98ce40c3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770191.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/a5d/925d8acf14ebdde6dcfc43252c64fa5d/925d8acf14ebdde6dcfc43252c64fa5d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770195.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/98c/93a2e6b1dd30e36a758e1d8b30e0098c/93a2e6b1dd30e36a758e1d8b30e0098c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770199.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/38f/7c03ab8e55b35e5982491b6dc426538f/7c03ab8e55b35e5982491b6dc426538f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770203.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/955/6ca057c8c515f5efb52ba21b478c1955/6ca057c8c515f5efb52ba21b478c1955.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770207.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/a40/3b7841263e01d3412821f99ba5c0ba40/3b7841263e01d3412821f99ba5c0ba40.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_newid test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_newid ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_object_stats_old_style_root_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_object_stats_old_style_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_object_stats_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_object_stats_old_style_shard_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_object_stats_root_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_object_stats_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_shard_ranges_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_shard_ranges_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_object_stats_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_object_stats_shard_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_old_style_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_old_style_root_account_container_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_overlap_shard_range_order test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_overlap_shard_range_order ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_path test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_pending_file_name test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_pending_file_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_policy_stat_tracking test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_policy_stat_tracking ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_misplaced_object_does_not_effect_container_stats test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_misplaced_object_does_not_effect_container_stats ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_overlap_shard_range_order test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_overlap_shard_range_order ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object_multiple_encoded_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object_multiple_encoded_timestamps_using_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object_multiple_encoded_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object_multiple_encoded_timestamps_using_memory ... ok object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 13 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor DEBUG: Found existing frag #1 at 10.0.0.0:1000/sda/0/a/c/o policy#0 while rebuilding to 10.0.0.1:1001/sdb/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769872.00000 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag c5fb6d138d0e30c1a777a2e70fdf44b8 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag fb3d200eb5be7226d6ab1839145d575b and timestamp 1757769874.00000 object-reconstructor INFO: Nothing reconstructed for 3.814697265625e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 2, 3, 4, 5, 6, 7, 8, 11] object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 3, 4, 5, 6, 7, 8, 11, 12] object-reconstructor ERROR: Trying to GET 10.0.0.4:1004/sde/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 3, 5, 6, 7, 8, 11, 12, 13] object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 7.3909759521484375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 6.9141387939453125e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 4.0531158447265625e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.9:1009/sdj/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'None') object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 8, 10, 11] object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.27:1027/sdb/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Trying to GET 10.0.0.27:1027/sdb/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 9, 10, 11] object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.27:1027/sdb/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 9, 11, 12] object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.0:1000/sda/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.2:1002/sdc/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.3:1003/sdd/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.4:1004/sde/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.5:1005/sdf/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.6:1006/sdg/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.7:1007/sdh/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.8:1008/sdi/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.14:1014/sdo/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.15:1015/sdp/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.16:1016/sdq/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.17:1017/sdr/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.18:1018/sds/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.19:1019/sdt/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.20:1020/sdu/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.21:1021/sdv/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.22:1022/sdw/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.23:1023/sdx/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.24:1024/sdy/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.25:1025/sdz/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.26:1026/sda/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom!test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_exceptions_fails test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_exceptions_fails ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_finds_duplicate_does_not_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_finds_duplicate_does_not_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_finds_missing_frag_does_not_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_finds_missing_frag_does_not_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_frags_on_handoffs test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_frags_on_handoffs ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_invalid_frag_index_headers test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_invalid_frag_index_headers ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_missing_headers test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_missing_headers ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_mixed_meta_timestamps_works test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_mixed_meta_timestamps_works ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_mixture_of_errors_fails test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_mixture_of_errors_fails ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_errors test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_errors ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_duplicate_frags test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_duplicate_frags ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object_multiple_explicit_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object_multiple_explicit_timestamps_using_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_path test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object_multiple_explicit_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_put_object_multiple_explicit_timestamps_using_memory ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_frag_not_old_enough test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_frag_not_old_enough ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_frag_resp_different_timestamp test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_frag_resp_different_timestamp ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reclaim ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770211.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/5b8/721c343aaced8caf8c06360bb112a5b8/721c343aaced8caf8c06360bb112a5b8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770215.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/2b5/287c4304ad8ec3a74fe3dcce5e2402b5/287c4304ad8ec3a74fe3dcce5e2402b5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770219.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/96d/ab064aa680d0d98fd55ba46525bb696d/ab064aa680d0d98fd55ba46525bb696d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770223.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/44f/4a22a7176ad16ecfb29633aaa016544f/4a22a7176ad16ecfb29633aaa016544f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770227.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/9dc/10d0fbcfcc7eaeae016bf5a3a3a789dc/10d0fbcfcc7eaeae016bf5a3a3a789dc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770231.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/d4d/3ef7eedfd968e5ef0cfa68d5de60ed4d/3ef7eedfd968e5ef0cfa68d5de60ed4d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770235.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/3a9/d47e7ea8be98bd40af6f98aceb6ce3a9/d47e7ea8be98bd40af6f98aceb6ce3a9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770239.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/311/05405509a7ed7b36e08ffeaa3ae38311/05405509a7ed7b36e08ffeaa3ae38311.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770243.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/342/98d8b16bff2e3744da7426966d0ee342/98d8b16bff2e3744da7426966d0ee342.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770247.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/e43/2e01e233b175799160f9875ce5fc7e43/2e01e233b175799160f9875ce5fc7e43.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770251.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/273/16be9d7ef776b86babdbb2c7bda6e273/16be9d7ef776b86babdbb2c7bda6e273.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770255.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/7a7/5595d20053e367062df433606f4637a7/5595d20053e367062df433606f4637a7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770259.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/ecb/d59d649aded697f5188741a93889cecb/d59d649aded697f5188741a93889cecb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770263.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/068/f59ab0b93457c625b0f591408a02d068/f59ab0b93457c625b0f591408a02d068.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770267.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/766/17fa3d47ca8f76e95e98e40fef9e5766/17fa3d47ca8f76e95e98e40fef9e5766.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770271.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/ce3/7a8d5c91865081ce714a3efdbe109ce3/7a8d5c91865081ce714a3efdbe109ce3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770275.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/b72/11ea36e316fbccd65b215ec7fe979b72/11ea36e316fbccd65b215ec7fe979b72.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770279.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/3d6/7c5b055930264e848d68c9965f5a73d6/7c5b055930264e848d68c9965f5a73d6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770283.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/2c3/dcde59db39533c47d9663b8086d332c3/dcde59db39533c47d9663b8086d332c3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770287.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/772/984eb95698fdb6b4b3fcf90c45e43772/984eb95698fdb6b4b3fcf90c45e43772.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770291.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/71e/eed07c456f06c473352aff3a1174e71e/eed07c456f06c473352aff3a1174e71e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770295.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/296/ba9b4f242e36264c62bf585891b3a296/ba9b4f242e36264c62bf585891b3a296.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770299.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/4e9/1af1371d02b2428f2a8b86b61845d4e9/1af1371d02b2428f2a8b86b61845d4e9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770303.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/ed1/a334c75f1ac71bdc6c759516c0ad7ed1/a334c75f1ac71bdc6c759516c0ad7ed1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770307.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/9fc/688c5d277442618fce6df0c8ba3639fc/688c5d277442618fce6df0c8ba3639fc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770311.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/9c4/b3fdbda4a2bc45ceeb21456cfffc09c4/b3fdbda4a2bc45ceeb21456cfffc09c4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770315.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/9d2/cd03df7449a11534d887986dd6f4f9d2/cd03df7449a11534d887986dd6f4f9d2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770319.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/acc/f8365f471fb75f1b14a0b234dd606acc/f8365f471fb75f1b14a0b234dd606acc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770323.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/b1a/b44f8ad34c2914072596c13c5b6a5b1a/b44f8ad34c2914072596c13c5b6a5b1a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770327.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/cdd/e6accbe73d410969e07773843ac36cdd/e6accbe73d410969e07773843ac36cdd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770331.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/cbc/b2c1c0249d12ae9f5d221ed14d779cbc/b2c1c0249d12ae9f5d221ed14d779cbc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770335.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/e6a/d46d1ac0d168e90eb28eac6ed8e9ce6a/d46d1ac0d168e90eb28eac6ed8e9ce6a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770339.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/c98/1462da7542746ddf2ae7e0363e4f8c98/1462da7542746ddf2ae7e0363e4f8c98.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770343.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/1fd/eb8aa26d71997d7ed348353b01d021fd/eb8aa26d71997d7ed348353b01d021fd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770347.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/014/7f8ada2c0c91318dad6dcc6499fff014/7f8ada2c0c91318dad6dcc6499fff014.dbtest.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_pending_file_name test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_pending_file_name ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_frag_resp_mixed_etags test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_frag_resp_mixed_etags ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_policy_stat_tracking test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_policy_stat_tracking ... ok object-reconstructor ERROR: Trying to GET 10.0.0.27:1027/sdb/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Unable to get enough responses (27 x unknown error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor DEBUG: Found existing frag #3 at 10.0.0.4:1004/sde/0/a/c/o policy#0 while rebuilding to 10.0.0.3:1003/sdd/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #3 with frag indexes [0, 1, 2, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor DEBUG: Reconstructing frag from handoffs, node_count=56 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'None') object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'invalid') object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 3.814697265625e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: None) object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0, frag index 0 (missing Etag) object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/o policy#0, frag index 0 (missing X-Backend-Data-Timestamp and X-Backend-Timestamp) object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 6.9141387939453125e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.0:1000/sda/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.5:1005/sdf/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.19:1019/sdt/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.21:1021/sdv/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.22:1022/sdw/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.26:1026/sda/0/a/c/o policy#0: Timeout (Nones) object-reconstructor WARNING: Invalid response 507 from 10.0.0.3:1003/sdd/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.4:1004/sde/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.6:1006/sdg/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.7:1007/sdh/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.8:1008/sdi/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.14:1014/sdo/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.15:1015/sdp/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.23:1023/sdx/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.25:1025/sdz/0/a/c/o policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.27:1027/sdb/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (9 x unknown, 8 x 404, 10 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 1.1682510375976562e-05 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 2 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 7.62939453125e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor ERROR: Mixed Etag (unexpected_etag, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_frag_resp_mixed_timestamps test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_frag_resp_mixed_timestamps ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_invalid_frag_index_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_invalid_frag_index_header ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_missing_etag_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_missing_etag_header ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_missing_frag_index_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_missing_frag_index_header ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_missing_timestamp_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_missing_timestamp_header ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_cleaving_not_merged_while_cleaving test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_cleaving_not_merged_while_cleaving ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_fetch_fails_while_shrinking test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_fetch_fails_while_shrinking ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_misplaced_object_does_not_effect_container_stats test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_misplaced_object_does_not_effect_container_stats ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_shard_ranges_state test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_shard_ranges_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_newid test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_newid ... ok object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'two') object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 25 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/o policy#0, frag index 3 (missing Etag) object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 25 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 6.9141387939453125e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/o policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: '') object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 25 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/o policy#0, frag index 3 (missing X-Backend-Data-Timestamp and X-Backend-Timestamp) object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 25 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/o policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (3/10 from 3 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (24 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (23 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (22 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (21 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (20 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (3/10 from 3 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (24 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (23 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (22 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (21 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_stats_old_style_root_container test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_stats_old_style_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object_multiple_encoded_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object_multiple_encoded_timestamps_using_file ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_sharding_shard_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_sharding_shard_no_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_stats_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_stats_old_style_shard_container ... ok test DEBUG: Found 4 objects in shard (state=unsharded), total = 8 (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Found 8 objects in shard (state=sharded), total = 48 (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Setting object count to 1072 (txn: tx4b6993385e284a16b4800-0068c5708f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: GET listing from 3 shards for: /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c_sub_juice', lower='ham', upper='juice') a/c_sub_juice with {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Get listing from /v1/a/c_sub_juice?format=json&limit=9960&marker=h&end_marker=juice%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Getting listing part 1 from shard Namespace(name='a/c_sub_lemon', lower='juice', upper='lemon') a/c_sub_lemon with {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Get listing from /v1/a/c_sub_lemon?format=json&limit=9958&marker=j&end_marker=lemon%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Found 2 objects in shard (state=unsharded), total = 4 (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_pie', lower='lemon', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'object'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9956&marker=l&end_marker=pie%00 {'X-Backend-Record-Type': 'object'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Found 4 objects in shard (state=sharding), total = 8 (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Found 8 objects in shard (state=sharding), total = 48 (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Setting object count to 1072 (txn: tx7e489b0b84d84155bece3-0068c57090) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: GET listing from 3 shards for: /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c_sub_juice', lower='ham', upper='juice') a/c_sub_juice with {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Get listing from /v1/a/c_sub_juice?format=json&limit=9960&marker=h&end_marker=juice%00 {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Getting listing part 1 from shard Namespace(name='a/c_sub_lemon', lower='juice', upper='lemon') a/c_sub_lemon with {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Get listing from /v1/a/c_sub_lemon?format=json&limit=9958&marker=j&end_marker=lemon%00 {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Found 2 objects in shard (state=unsharded), total = 4 (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_pie', lower='lemon', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'object'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9956&marker=l&end_marker=pie%00 {'X-Backend-Record-Type': 'object'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Found 4 objects in shard (state=sharding), total = 8 (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Found 8 objects in shard (state=sharding), total = 48 (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Setting object count to 1072 (txn: txf65b87bd630c467298ba3-0068c57091) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770351.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/271/e6cfbc5ca1565a00a661269c4a8a5271/e6cfbc5ca1565a00a661269c4a8a5271.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770355.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/68d/a2c58c2cef546e9b7be1d382ddda568d/a2c58c2cef546e9b7be1d382ddda568d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770359.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/327/beaaba4168d2e819e97a3a72271b8327/beaaba4168d2e819e97a3a72271b8327.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770363.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/bff/06a1ddd9c8817157588b32c6eed49bff/06a1ddd9c8817157588b32c6eed49bff.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770367.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/032/ff1e5d0ad32cc70de7fbec52bf10e032/ff1e5d0ad32cc70de7fbec52bf10e032.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770371.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/986/886dc7d702da91fab1dc06bdf989f986/886dc7d702da91fab1dc06bdf989f986.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770375.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/2c7/9252c9f033f361df300165410445c2c7/9252c9f033f361df300165410445c2c7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770379.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/901/d8cb496404fb75e96f1e1025ced5f901/d8cb496404fb75e96f1e1025ced5f901.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770383.00000-0, db: /tmp/tmpfupr8ok5/sda/containers/0/660/42628bab3a26c962ad58855bddedb660/42628bab3a26c962ad58855bddedb660.db sharder-test WARNING: Failed to get shard ranges from a/c: bad, path: .shards_a/shard_c, db: /tmp/tmpf5powpxg/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769874.00000.db sharder-test WARNING: Audit warnings for shard: unable to get shard ranges from root, path: .shards_a/shard_c, db: /tmp/tmpf5powpxg/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769874.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769877.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/9c5/816991eb394f60f98cbc144a76b2f9c5/816991eb394f60f98cbc144a76b2f9c5_1757769877.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769877.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/9c5/816991eb394f60f98cbc144a76b2f9c5/816991eb394f60f98cbc144a76b2f9c5_1757769877.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769880.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/e81/a2c4cf33f011f6dd57cb84f16527be81/a2c4cf33f011f6dd57cb84f16527be81_1757769880.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769880.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/e81/a2c4cf33f011f6dd57cb84f16527be81/a2c4cf33f011f6dd57cb84f16527be81_1757769880.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769883.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/40e/5b8c86b2927c02f8eff5ab546c4a040e/5b8c86b2927c02f8eff5ab546c4a040e_1757769883.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769883.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/40e/5b8c86b2927c02f8eff5ab546c4a040e/5b8c86b2927c02f8eff5ab546c4a040e_1757769883.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f_1757769886.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f_1757769886.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441_1757769889.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441_1757769889.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769892.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/932/3156e29d34d555a1864eda78508fe932/3156e29d34d555a1864eda78508fe932_1757769892.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769892.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/932/3156e29d34d555a1864eda78508fe932/3156e29d34d555a1864eda78508fe932_1757769892.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769895.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f23/ee518d315de13f098b3e3dc1cecbbf23/ee518d315de13f098b3e3dc1cecbbf23_1757769895.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769895.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f23/ee518d315de13f098b3e3dc1cecbbf23/ee518d315de13f098b3e3dc1cecbbf23_1757769895.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769898.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d_1757769898.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769898.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d_1757769898.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769901.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/774/7747f025f0720db7ac5c8ba9faa84774/7747f025f0720db7ac5c8ba9faa84774_1757769901.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769901.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/774/7747f025f0720db7ac5c8ba9faa84774/7747f025f0720db7ac5c8ba9faa84774_1757769901.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769904.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/50c/f03c7d0afda28f03f1aaf9cc97d7650c/f03c7d0afda28f03f1aaf9cc97d7650c_1757769904.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769904.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/50c/f03c7d0afda28f03f1aaf9cc97d7650c/f03c7d0afda28f03f1aaf9cc97d7650c_1757769904.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769907.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/ea2/3330e89568ca8f797c0453f18faa0ea2/3330e89568ca8f797c0453f18faa0ea2_1757769907.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769907.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/ea2/3330e89568ca8f797c0453f18faa0ea2/3330e89568ca8f797c0453f18faa0ea2_1757769907.00000.dbtest.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object_multiple_encoded_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object_multiple_encoded_timestamps_using_memory ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_stats_root_container test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_stats_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object_multiple_explicit_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object_multiple_explicit_timestamps_using_file ... ok object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (20 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (3/10 from 3 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (24 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (23 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (22 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (21 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (20 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (23 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (22 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (21 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (20 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (22 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (21 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (20 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object_multiple_explicit_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_put_object_multiple_explicit_timestamps_using_memory ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_stats_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_stats_shard_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_table_migration test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_object_table_migration ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reclaim ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_more_than_threshold_frags test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_more_than_threshold_frags ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_old_style_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_old_style_root_account_container_path ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769910.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1_1757769910.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769910.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1_1757769910.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769913.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/e78/654282fb44cb0ccca86097f6a5abae78/654282fb44cb0ccca86097f6a5abae78_1757769913.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769913.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/e78/654282fb44cb0ccca86097f6a5abae78/654282fb44cb0ccca86097f6a5abae78_1757769913.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769916.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/7be/53bd02c37d4dca9b69bcc559deec27be/53bd02c37d4dca9b69bcc559deec27be_1757769916.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769916.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/7be/53bd02c37d4dca9b69bcc559deec27be/53bd02c37d4dca9b69bcc559deec27be_1757769916.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769919.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/02f/3d3793b06830504df1ee74ae88ae202f/3d3793b06830504df1ee74ae88ae202f_1757769919.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769919.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/02f/3d3793b06830504df1ee74ae88ae202f/3d3793b06830504df1ee74ae88ae202f_1757769919.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769922.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a_1757769922.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769922.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a_1757769922.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769925.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/e07/afde046acf5ff4350c667ee65cd90e07/afde046acf5ff4350c667ee65cd90e07_1757769925.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769925.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/e07/afde046acf5ff4350c667ee65cd90e07/afde046acf5ff4350c667ee65cd90e07_1757769925.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769928.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/960/08f47547171eaa7a4da5ac3c1753b960/08f47547171eaa7a4da5ac3c1753b960_1757769928.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769928.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/960/08f47547171eaa7a4da5ac3c1753b960/08f47547171eaa7a4da5ac3c1753b960_1757769928.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769931.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/14c/4047d06a80ae92b9efae76c95e23914c/4047d06a80ae92b9efae76c95e23914c_1757769931.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769931.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/14c/4047d06a80ae92b9efae76c95e23914c/4047d06a80ae92b9efae76c95e23914c_1757769931.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769934.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04_1757769934.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769934.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04_1757769934.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769937.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/31a/f5aa84e6e0d1b5fe1d656e023d2fb31a/f5aa84e6e0d1b5fe1d656e023d2fb31a_1757769937.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769937.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/31a/f5aa84e6e0d1b5fe1d656e023d2fb31a/f5aa84e6e0d1b5fe1d656e023d2fb31a_1757769937.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769940.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/023/9d538d68ba3454eb7472997c4a7d7023/9d538d68ba3454eb7472997c4a7d7023_1757769940.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769940.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/023/9d538d68ba3454eb7472997c4a7d7023/9d538d68ba3454eb7472997c4a7d7023_1757769940.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769943.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/83a/4bb00f1b19de9160959911b5d5f2583a/4bb00f1b19de9160959911b5d5f2583a_1757769943.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769943.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/83a/4bb00f1b19de9160959911b5d5f2583a/4bb00f1b19de9160959911b5d5f2583a_1757769943.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94_1757769946.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94_1757769946.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769949.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/38f/ebc7f8f4906eab8327849aea9930738f/ebc7f8f4906eab8327849aea9930738f_1757769949.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769949.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/38f/ebc7f8f4906eab8327849aea9930738f/ebc7f8f4906eab8327849aea9930738f_1757769949.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769952.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/5d9/fc39ec9a5176e852feae41e327ed75d9/fc39ec9a5176e852feae41e327ed75d9_1757769952.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769952.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/5d9/fc39ec9a5176e852feae41e327ed75d9/fc39ec9a5176e852feae41e327ed75d9_1757769952.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769955.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/4c7/3417d997fde47f3ab723fae8a62354c7/3417d997fde47f3ab723fae8a62354c7_1757769955.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769955.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/4c7/3417d997fde47f3ab723fae8a62354c7/3417d997fde47f3ab723fae8a62354c7_1757769955.00000.dbtest.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_overlap_shard_range_order test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_overlap_shard_range_order ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_path test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_path ... ok object-reconstructor ERROR: Unable to get enough responses (21 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (20 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (20 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor DEBUG: Found existing frag #3 at 10.0.0.1:1001/sdb/0/a/c/o policy#0 while rebuilding to 10.0.0.3:1003/sdd/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 2 ok responses) to reconstruct non-durable 10.0.0.3:1003/sdd/0/a/c/o policy#0 frag#3 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769873.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.3:1003/sdd/0/a/c/o policy#0 frag#3 object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor WARNING: Invalid response 400 from 10.0.0.27:1027/sdb/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.55:1055/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 53 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.83:1083/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 81 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.363:1363/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 361 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.31:1031/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 53 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.31:1031/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 55 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.31:1031/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 55 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.27:1027/sdb/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.55:1055/sda/0/a/c/o policy#0test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_pending_file_name test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_pending_file_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_policy_stat_tracking test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_policy_stat_tracking ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_misplaced_object_does_not_effect_container_stats test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_misplaced_object_does_not_effect_container_stats ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object_multiple_encoded_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object_multiple_encoded_timestamps_using_file ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_non_404_response test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_no_quarantine_non_404_response ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object_multiple_encoded_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object_multiple_encoded_timestamps_using_memory ... ok object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (53 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.83:1083/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (81 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.363:1363/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (361 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.31:1031/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (53 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.31:1031/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (55 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.31:1031/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (55 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.27:1027/sdb/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.55:1055/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (53 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.83:1083/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (81 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.363:1363/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (361 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.31:1031/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (53 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.31:1031/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (55 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.31:1031/sda/0/a/c/o policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (55 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object_multiple_explicit_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object_multiple_explicit_timestamps_using_file ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769958.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f_1757769958.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769958.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f_1757769958.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769961.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/cc2/414f8a41641642191e055adb2dd3ecc2/414f8a41641642191e055adb2dd3ecc2_1757769961.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769961.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/cc2/414f8a41641642191e055adb2dd3ecc2/414f8a41641642191e055adb2dd3ecc2_1757769961.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769964.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/798/f3e090e1e2c81b5177c09e83643ff798/f3e090e1e2c81b5177c09e83643ff798_1757769964.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769964.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/798/f3e090e1e2c81b5177c09e83643ff798/f3e090e1e2c81b5177c09e83643ff798_1757769964.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769967.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/00b/2703965338dfecd5a001019c06a4c00b/2703965338dfecd5a001019c06a4c00b_1757769967.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769967.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/00b/2703965338dfecd5a001019c06a4c00b/2703965338dfecd5a001019c06a4c00b_1757769967.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769970.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702_1757769970.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769970.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702_1757769970.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769973.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/a76/a64672d48006c8a3676f03b69c3d6a76/a64672d48006c8a3676f03b69c3d6a76_1757769973.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769973.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/a76/a64672d48006c8a3676f03b69c3d6a76/a64672d48006c8a3676f03b69c3d6a76_1757769973.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769976.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/171/3440bebe2d880ff654d5218a4faf5171/3440bebe2d880ff654d5218a4faf5171_1757769976.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769976.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/171/3440bebe2d880ff654d5218a4faf5171/3440bebe2d880ff654d5218a4faf5171_1757769976.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769979.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f1f/44023a11ce20df5bd9315c384ba4df1f/44023a11ce20df5bd9315c384ba4df1f_1757769979.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769979.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f1f/44023a11ce20df5bd9315c384ba4df1f/44023a11ce20df5bd9315c384ba4df1f_1757769979.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769982.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254_1757769982.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769982.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254_1757769982.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769985.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/fa0/15f48c8b39539b4fee51730ed04e3fa0/15f48c8b39539b4fee51730ed04e3fa0_1757769985.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769985.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/fa0/15f48c8b39539b4fee51730ed04e3fa0/15f48c8b39539b4fee51730ed04e3fa0_1757769985.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769988.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/cae/c53213b4f1951028909d2cd9b4389cae/c53213b4f1951028909d2cd9b4389cae_1757769988.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769988.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/cae/c53213b4f1951028909d2cd9b4389cae/c53213b4f1951028909d2cd9b4389cae_1757769988.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769991.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/c06/fcf5ad9577f95d312d25b6c4e66bfc06/fcf5ad9577f95d312d25b6c4e66bfc06_1757769991.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769991.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/c06/fcf5ad9577f95d312d25b6c4e66bfc06/fcf5ad9577f95d312d25b6c4e66bfc06_1757769991.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769994.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b_1757769994.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769994.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b_1757769994.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769997.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/b0f/4e49e2ece244e508344191944078ab0f/4e49e2ece244e508344191944078ab0f_1757769997.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769997.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/b0f/4e49e2ece244e508344191944078ab0f/4e49e2ece244e508344191944078ab0f_1757769997.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770000.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/d31/bf0292701ed7e66dce6ab38a4377fd31/bf0292701ed7e66dce6ab38a4377fd31_1757770000.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770000.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/d31/bf0292701ed7e66dce6ab38a4377fd31/bf0292701ed7e66dce6ab38a4377fd31_1757770000.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770003.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/ac6/131211a9c882d251ad06f43c98680ac6/131211a9c882d251ad06f43c98680ac6_1757770003.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770003.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/ac6/131211a9c882d251ad06f43c98680ac6/131211a9c882d251ad06f43c98680ac6_1757770003.00000.dbtest.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object_multiple_explicit_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_put_object_multiple_explicit_timestamps_using_memory ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reclaim ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_sharding_shard_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_sharding_shard_with_memcache ... ok object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4_1757770006.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4_1757770006.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770009.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/0a1/4ac7dd5a0e83dc1f23572945104a60a1/4ac7dd5a0e83dc1f23572945104a60a1_1757770009.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770009.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/0a1/4ac7dd5a0e83dc1f23572945104a60a1/4ac7dd5a0e83dc1f23572945104a60a1_1757770009.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770012.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/5ae/5695b6b21bf519ffcf9f2185cc8525ae/5695b6b21bf519ffcf9f2185cc8525ae_1757770012.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770012.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/5ae/5695b6b21bf519ffcf9f2185cc8525ae/5695b6b21bf519ffcf9f2185cc8525ae_1757770012.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770015.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/63c/97bb8688e4f53a863a50169f18f6263c/97bb8688e4f53a863a50169f18f6263c_1757770015.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770015.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/63c/97bb8688e4f53a863a50169f18f6263c/97bb8688e4f53a863a50169f18f6263c_1757770015.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770018.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181_1757770018.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770018.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181_1757770018.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770021.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/391/ff29e588b25ff3499d245fee7e673391/ff29e588b25ff3499d245fee7e673391_1757770021.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770021.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/391/ff29e588b25ff3499d245fee7e673391/ff29e588b25ff3499d245fee7e673391_1757770021.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770024.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/671/3f60a0256ff770d09fd664a741862671/3f60a0256ff770d09fd664a741862671_1757770024.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770024.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/671/3f60a0256ff770d09fd664a741862671/3f60a0256ff770d09fd664a741862671_1757770024.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770027.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f52/f308a86bbc68a6cff9ed9a6407f9ff52/f308a86bbc68a6cff9ed9a6407f9ff52_1757770027.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770027.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f52/f308a86bbc68a6cff9ed9a6407f9ff52/f308a86bbc68a6cff9ed9a6407f9ff52_1757770027.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770030.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b_1757770030.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770030.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b_1757770030.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770033.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/2e2/51fdb6672a9b63d2cbcb179e54ae02e2/51fdb6672a9b63d2cbcb179e54ae02e2_1757770033.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770033.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/2e2/51fdb6672a9b63d2cbcb179e54ae02e2/51fdb6672a9b63d2cbcb179e54ae02e2_1757770033.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770036.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/08a/0bac0223be629936f85e27e7da2aa08a/0bac0223be629936f85e27e7da2aa08a_1757770036.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770036.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/08a/0bac0223be629936f85e27e7da2aa08a/0bac0223be629936f85e27e7da2aa08a_1757770036.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770039.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/56f/cedb083397b56cd7fb9c11d24b99d56f/cedb083397b56cd7fb9c11d24b99d56f_1757770039.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770039.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/56f/cedb083397b56cd7fb9c11d24b99d56f/cedb083397b56cd7fb9c11d24b99d56f_1757770039.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770042.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30_1757770042.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770042.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30_1757770042.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770045.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9_1757770045.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770045.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9_1757770045.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770048.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/717/c9bbcef45e3501beb9e338079dd86717/c9bbcef45e3501beb9e338079dd86717_1757770048.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770048.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/717/c9bbcef45e3501beb9e338079dd86717/c9bbcef45e3501beb9e338079dd86717_1757770048.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770051.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/523/1990b221902d604fa1229244eead0523/1990b221902d604fa1229244eead0523_1757770051.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770051.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/523/1990b221902d604fa1229244eead0523/1990b221902d604fa1229244eead0523_1757770051.00000.dbtest.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_merge_while_sharding test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_merge_while_sharding ... ok object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (28 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (29 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (30 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770054.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/c70/daf5a0eb378ef3de22b0d169999b0c70/daf5a0eb378ef3de22b0d169999b0c70_1757770054.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770054.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/c70/daf5a0eb378ef3de22b0d169999b0c70/daf5a0eb378ef3de22b0d169999b0c70_1757770054.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770057.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/d10/ac39eebf7ef84793c3dee9b411b60d10/ac39eebf7ef84793c3dee9b411b60d10_1757770057.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770057.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/d10/ac39eebf7ef84793c3dee9b411b60d10/ac39eebf7ef84793c3dee9b411b60d10_1757770057.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770060.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/50d/c901d91fe54b13aa300c7c918f7ff50d/c901d91fe54b13aa300c7c918f7ff50d_1757770060.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770060.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/50d/c901d91fe54b13aa300c7c918f7ff50d/c901d91fe54b13aa300c7c918f7ff50d_1757770060.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770063.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/4bb/dc626d1b51fff20b1b43317ff65aa4bb/dc626d1b51fff20b1b43317ff65aa4bb_1757770063.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770063.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/4bb/dc626d1b51fff20b1b43317ff65aa4bb/dc626d1b51fff20b1b43317ff65aa4bb_1757770063.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770066.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f4a/8230badf84a278d302008f5674bb0f4a/8230badf84a278d302008f5674bb0f4a_1757770066.00000.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770066.00000-0, db: /tmp/tmpvwvny1y7/sda/containers/0/f4a/8230badf84a278d302008f5674bb0f4a/8230badf84a278d302008f5674bb0f4a_1757770066.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769878.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/dee/3d44346411be13e4f6cb3380da876dee/3d44346411be13e4f6cb3380da876dee.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769878.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/dee/3d44346411be13e4f6cb3380da876dee/3d44346411be13e4f6cb3380da876dee.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769882.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a01/ebadf156143425e35151d39dfad37a01/ebadf156143425e35151d39dfad37a01.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769882.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a01/ebadf156143425e35151d39dfad37a01/ebadf156143425e35151d39dfad37a01.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769890.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/3b2/3765e01d751df8f49be93d964108c3b2/3765e01d751df8f49be93d964108c3b2.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769890.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/3b2/3765e01d751df8f49be93d964108c3b2/3765e01d751df8f49be93d964108c3b2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769894.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769894.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769898.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769898.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769902.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/02d/4f83ea50dc672752a1fa5b1e466ac02d/4f83ea50dc672752a1fa5b1e466ac02d.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769902.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/02d/4f83ea50dc672752a1fa5b1e466ac02d/4f83ea50dc672752a1fa5b1e466ac02d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769906.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/41c/036de6688bc7eeac874c629324f6041c/036de6688bc7eeac874c629324f6041c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769906.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/41c/036de6688bc7eeac874c629324f6041c/036de6688bc7eeac874c629324f6041c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769910.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769910.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769914.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/b38/a72ab5118ff841acbf588e313d52eb38/a72ab5118ff841acbf588e313d52eb38.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769914.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/b38/a72ab5118ff841acbf588e313d52eb38/a72ab5118ff841acbf588e313d52eb38.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769918.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/20e/e0f61c6ff90bcc453f230bcccefe020e/e0f61c6ff90bcc453f230bcccefe020e.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769918.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/20e/e0f61c6ff90bcc453f230bcccefe020e/e0f61c6ff90bcc453f230bcccefe020e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769922.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769922.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reclaim_deadlock test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reclaim_deadlock ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reclaim_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reclaim_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reclaim_with_duplicate_names test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reclaim_with_duplicate_names ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reconciler_sync test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reconciler_sync ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769926.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/760/47f397e2962e064a251785aaf2e85760/47f397e2962e064a251785aaf2e85760.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769926.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/760/47f397e2962e064a251785aaf2e85760/47f397e2962e064a251785aaf2e85760.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769930.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/ee3/acbc6ecb60e8573b25129fae97317ee3/acbc6ecb60e8573b25129fae97317ee3.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769930.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/ee3/acbc6ecb60e8573b25129fae97317ee3/acbc6ecb60e8573b25129fae97317ee3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769934.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769934.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769938.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/262/b41b1a0b53b772b9f980ea9cd30f6262/b41b1a0b53b772b9f980ea9cd30f6262.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769938.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/262/b41b1a0b53b772b9f980ea9cd30f6262/b41b1a0b53b772b9f980ea9cd30f6262.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769942.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/f21/e285d1e95bb038f55a52f2302e351f21/e285d1e95bb038f55a52f2302e351f21.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769942.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/f21/e285d1e95bb038f55a52f2302e351f21/e285d1e95bb038f55a52f2302e351f21.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769950.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/737/2acd3ee53ba709b6e23600ab299b7737/2acd3ee53ba709b6e23600ab299b7737.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769950.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/737/2acd3ee53ba709b6e23600ab299b7737/2acd3ee53ba709b6e23600ab299b7737.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769954.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/76e/90cbcb19a6441f33163fd617552fb76e/90cbcb19a6441f33163fd617552fb76e.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769954.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/76e/90cbcb19a6441f33163fd617552fb76e/90cbcb19a6441f33163fd617552fb76e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769958.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769958.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769962.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/926/9e972780cfac694c2278e38887567926/9e972780cfac694c2278e38887567926.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769962.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/926/9e972780cfac694c2278e38887567926/9e972780cfac694c2278e38887567926.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769966.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a84/972206c5ddfbe3104eb36c180e751a84/972206c5ddfbe3104eb36c180e751a84.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769966.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a84/972206c5ddfbe3104eb36c180e751a84/972206c5ddfbe3104eb36c180e751a84.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769970.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769970.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769974.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/24b/42d708516f4a7c61801285ccf5cc124b/42d708516f4a7c61801285ccf5cc124b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769974.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/24b/42d708516f4a7c61801285ccf5cc124b/42d708516f4a7c61801285ccf5cc124b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769978.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/ca2/0ceaff639804d55fbcb0ccf8f409dca2/0ceaff639804d55fbcb0ccf8f409dca2.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769978.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/ca2/0ceaff639804d55fbcb0ccf8f409dca2/0ceaff639804d55fbcb0ccf8f409dca2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769982.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769982.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769986.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/00f/daeb4b33482ba0957987c36a50e7900f/daeb4b33482ba0957987c36a50e7900f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769986.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/00f/daeb4b33482ba0957987c36a50e7900f/daeb4b33482ba0957987c36a50e7900f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769990.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/ba6/7a7a3414e9e1e5e6a5916a35e09daba6/7a7a3414e9e1e5e6a5916a35e09daba6.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769990.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/ba6/7a7a3414e9e1e5e6a5916a35e09daba6/7a7a3414e9e1e5e6a5916a35e09daba6.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_remove_objects test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_remove_objects ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_resolve_shard_range_states test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_resolve_shard_range_states ... ok object-reconstructor ERROR: Unable to get enough responses (31 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (32 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (33 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (34 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (35 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (36 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (37 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (38 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (39 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (40 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (41 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (42 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (43 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (44 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (45 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reverse_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_reverse_prefix_delim ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_root_account_container_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_save_and_load_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_save_and_load_record_from_pending_file ... ok test ERROR: Problem finding shard upper in '/tmp/tmp9sryro8c/test_container.db': : LockTimeout (Nones) test ERROR: Problem finding shard upper in '/tmp/tmp9sryro8c/test_container.db': : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2498, in find_shard_ranges next_shard_upper = sub_broker._get_next_shard_range_upper( shard_size, last_shard_upper) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect sqlite3.OperationalError test DEBUG: Unlinked retiring db '/tmp/tmpljz0n3lr/containers/part/suffix/hash/container.db' test WARNING: Unexpected db files will be ignored: ['/tmp/tmpljz0n3lr/containers/part/suffix/hash/container.db'] Container 'a/c' cannot be set to sharded state while in unsharded state Container 'a/c' cannot be set to sharding state: missing epoch Container 'a/c' cannot be set to sharding state while in sharding state sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769994.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769994.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769998.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/e46/f02e8b95a9214e9d40fffb8230fb5e46/f02e8b95a9214e9d40fffb8230fb5e46.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769998.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/e46/f02e8b95a9214e9d40fffb8230fb5e46/f02e8b95a9214e9d40fffb8230fb5e46.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770002.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/c12/76b71b6ec35a27b6c9fe4113a5440c12/76b71b6ec35a27b6c9fe4113a5440c12.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770002.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/c12/76b71b6ec35a27b6c9fe4113a5440c12/76b71b6ec35a27b6c9fe4113a5440c12.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770010.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/017/92a291d966dba6c9b1089a086b63c017/92a291d966dba6c9b1089a086b63c017.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770010.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/017/92a291d966dba6c9b1089a086b63c017/92a291d966dba6c9b1089a086b63c017.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770014.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/c25/85f577ea58bd766d7f752b9572505c25/85f577ea58bd766d7f752b9572505c25.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770014.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/c25/85f577ea58bd766d7f752b9572505c25/85f577ea58bd766d7f752b9572505c25.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770018.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770018.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770022.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/fe3/49f7a23c2b83a7d5c9fd9c905970cfe3/49f7a23c2b83a7d5c9fd9c905970cfe3.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770022.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/fe3/49f7a23c2b83a7d5c9fd9c905970cfe3/49f7a23c2b83a7d5c9fd9c905970cfe3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770026.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/7d5/12afa896fd8019e512e47c77444f47d5/12afa896fd8019e512e47c77444f47d5.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770026.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/7d5/12afa896fd8019e512e47c77444f47d5/12afa896fd8019e512e47c77444f47d5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770030.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770030.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770034.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a2a/5f96cad0418db7d73a3cdad013767a2a/5f96cad0418db7d73a3cdad013767a2a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770034.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a2a/5f96cad0418db7d73a3cdad013767a2a/5f96cad0418db7d73a3cdad013767a2a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770038.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/936/3bcfc3413edd64d9d5742bbefe8e3936/3bcfc3413edd64d9d5742bbefe8e3936.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770038.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/936/3bcfc3413edd64d9d5742bbefe8e3936/3bcfc3413edd64d9d5742bbefe8e3936.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770042.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770042.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770046.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/fab/e0b9deaff7e8658d413d95e5b3ea1fab/e0b9deaff7e8658d413d95e5b3ea1fab.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770046.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/fab/e0b9deaff7e8658d413d95e5b3ea1fab/e0b9deaff7e8658d413d95e5b3ea1fab.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770050.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/208/81f17a6a22245fa05b87b57422bac208/81f17a6a22245fa05b87b57422bac208.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770050.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/208/81f17a6a22245fa05b87b57422bac208/81f17a6a22245fa05b87b57422bac208.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770054.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/c70/daf5a0eb378ef3de22b0d169999b0c70/daf5a0eb378ef3de22b0d169999b0c70.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770054.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/c70/daf5a0eb378ef3de22b0d169999b0c70/daf5a0eb378ef3de22b0d169999b0c70.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770058.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/bc8/496c29c9e34f592e2351069dcb983bc8/496c29c9e34f592e2351069dcb983bc8.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770058.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/bc8/496c29c9e34f592e2351069dcb983bc8/496c29c9e34f592e2351069dcb983bc8.dbContainer 'a/c' cannot be set to sharded state while in sharded state test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_shard_errors_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_shard_errors_no_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_db_states test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_db_states ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_sharded_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_sharded_state_errors ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_sharding_state test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_sharding_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_sharding_state_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_sharding_state_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_sharding_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_sharding_state_errors ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_storage_policy_index test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_storage_policy_index ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_storage_policy_index_empty test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_storage_policy_index_empty ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_x_syncs test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_set_x_syncs ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_sharding_initiated_and_required test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_sharding_initiated_and_required ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770062.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/572/c300fc77f99f60d8a3661473a89f5572/c300fc77f99f60d8a3661473a89f5572.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770062.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/572/c300fc77f99f60d8a3661473a89f5572/c300fc77f99f60d8a3661473a89f5572.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770066.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/f4a/8230badf84a278d302008f5674bb0f4a/8230badf84a278d302008f5674bb0f4a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770066.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/f4a/8230badf84a278d302008f5674bb0f4a/8230badf84a278d302008f5674bb0f4a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770070.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/fbb/5ef6f7b7c542ba088408fe4a9610cfbb/5ef6f7b7c542ba088408fe4a9610cfbb.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770070.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/fbb/5ef6f7b7c542ba088408fe4a9610cfbb/5ef6f7b7c542ba088408fe4a9610cfbb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770074.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/283/0286fe4904518334b59e90de88cc2283/0286fe4904518334b59e90de88cc2283.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770074.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/283/0286fe4904518334b59e90de88cc2283/0286fe4904518334b59e90de88cc2283.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770078.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/fcb/3aed9a234fff8c87412fc276ef733fcb/3aed9a234fff8c87412fc276ef733fcb.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770078.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/fcb/3aed9a234fff8c87412fc276ef733fcb/3aed9a234fff8c87412fc276ef733fcb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770082.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/ceb/0d06db2594b100745697da614b412ceb/0d06db2594b100745697da614b412ceb.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770082.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/ceb/0d06db2594b100745697da614b412ceb/0d06db2594b100745697da614b412ceb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770086.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/f1a/64edae903855c5b0f707ff871ed22f1a/64edae903855c5b0f707ff871ed22f1a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770086.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/f1a/64edae903855c5b0f707ff871ed22f1a/64edae903855c5b0f707ff871ed22f1a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770090.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/3b6/b5e516de671d5a968c268b19d31ce3b6/b5e516de671d5a968c268b19d31ce3b6.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770090.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/3b6/b5e516de671d5a968c268b19d31ce3b6/b5e516de671d5a968c268b19d31ce3b6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770094.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/237/086f9986210d254e4f306346cc31b237/086f9986210d254e4f306346cc31b237.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770094.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/237/086f9986210d254e4f306346cc31b237/086f9986210d254e4f306346cc31b237.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770098.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/d41/659bc26fbfaabefadba828e8e3629d41/659bc26fbfaabefadba828e8e3629d41.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770098.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/d41/659bc26fbfaabefadba828e8e3629d41/659bc26fbfaabefadba828e8e3629d41.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770102.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/9f9/669435364d85b096d0ba452b348c69f9/669435364d85b096d0ba452b348c69f9.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770102.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/9f9/669435364d85b096d0ba452b348c69f9/669435364d85b096d0ba452b348c69f9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770106.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/0f3/0cac656fc49d06e2a7fdcc19989b10f3/0cac656fc49d06e2a7fdcc19989b10f3.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770106.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/0f3/0cac656fc49d06e2a7fdcc19989b10f3/0cac656fc49d06e2a7fdcc19989b10f3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770110.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/9ed/b8726b74e99249e0373d956be93e49ed/b8726b74e99249e0373d956be93e49ed.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770110.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/9ed/b8726b74e99249e0373d956be93e49ed/b8726b74e99249e0373d956be93e49ed.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770114.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/219/e653153336ad25603277b84517e29219/e653153336ad25603277b84517e29219.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770114.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/219/e653153336ad25603277b84517e29219/e653153336ad25603277b84517e29219.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770118.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/74e/761983bd37ed51999c0e938ef1d6c74e/761983bd37ed51999c0e938ef1d6c74e.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770118.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/74e/761983bd37ed51999c0e938ef1d6c74e/761983bd37ed51999c0e938ef1d6c74e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770122.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/1de/2e3edb6f95662afb0b233fc393c5f1de/2e3edb6f95662afb0b233fc393c5f1de.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770122.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/1de/2e3edb6f95662afb0b233fc393c5f1de/2e3edb6f95662afb0b233fc393c5f1de.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770126.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/101/b00ee0542d4ea27c4704a4e08ac3e101/b00ee0542d4ea27c4704a4e08ac3e101.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770126.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/101/b00ee0542d4ea27c4704a4e08ac3e101/b00ee0542d4ea27c4704a4e08ac3e101.dbtest.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_merge_while_unsharded test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_merge_while_unsharded ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_sharding_state_is_not_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_sharding_state_is_not_reclaimable ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_sharding_sysmeta test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_sharding_sysmeta ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_storage_policy_property test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_storage_policy_property ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_deleted_shard test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_deleted_shard ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_sync_merging test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeReportedColumn.test_sync_merging ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_can_read_old_meta test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_can_read_old_meta ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_extract_policy test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_extract_policy ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_get_async_dir test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_get_async_dir ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_get_data_dir test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_get_data_dir ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_get_part_path test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_get_part_path ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_get_tmp_dir test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_get_tmp_dir ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_pickle_async_update_tmp_dir test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_pickle_async_update_tmp_dir ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_quarantine_renamer test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_quarantine_renamer ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_read_file_metadata test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_read_file_metadata ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_read_file_metadata_nonexistent_file test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_read_file_metadata_nonexistent_file ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_read_metadata_nonexistent_file test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_read_metadata_nonexistent_file ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_different_file_exists test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_different_file_exists ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_makedirs_error test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_makedirs_error ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_makedirs_race test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_makedirs_race ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_object_dir_exists_but_not_dir test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_object_dir_exists_but_not_dir ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_os_link_error test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_os_link_error ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_os_link_race test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_os_link_race ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_same_file_exists test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_same_file_exists ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_target_path_does_not_exist test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_relink_paths_target_path_does_not_exist ... ok test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_write_read_metadata test.unit.obj.test_diskfile.TestDiskFileModuleMethods.test_write_read_metadata ... ok test.unit.obj.test_diskfile.TestDiskFileRouter.test_invalid_policy_config test.unit.obj.test_diskfile.TestDiskFileRouter.test_invalid_policy_config ... ok test.unit.obj.test_diskfile.TestDiskFileRouter.test_policy test.unit.obj.test_diskfile.TestDiskFileRouter.test_policy ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_build_reconstruction_jobs test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_build_reconstruction_jobs ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_check_ring test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_check_ring ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_collect_parts test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_collect_parts ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_collect_parts_mkdirs_error test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_collect_parts_mkdirs_error ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770130.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/023/3a85040ad044d17acf3a079392ea0023/3a85040ad044d17acf3a079392ea0023.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770130.00000-0, db: /tmp/tmpvaedzo9g/sda/containers/0/023/3a85040ad044d17acf3a079392ea0023/3a85040ad044d17acf3a079392ea0023.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769880.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/e81/a2c4cf33f011f6dd57cb84f16527be81/a2c4cf33f011f6dd57cb84f16527be81.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769880.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/e81/a2c4cf33f011f6dd57cb84f16527be81/a2c4cf33f011f6dd57cb84f16527be81.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769883.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/40e/5b8c86b2927c02f8eff5ab546c4a040e/5b8c86b2927c02f8eff5ab546c4a040e.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769883.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/40e/5b8c86b2927c02f8eff5ab546c4a040e/5b8c86b2927c02f8eff5ab546c4a040e.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769892.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/932/3156e29d34d555a1864eda78508fe932/3156e29d34d555a1864eda78508fe932.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769892.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/932/3156e29d34d555a1864eda78508fe932/3156e29d34d555a1864eda78508fe932.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769895.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/f23/ee518d315de13f098b3e3dc1cecbbf23/ee518d315de13f098b3e3dc1cecbbf23.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769895.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/f23/ee518d315de13f098b3e3dc1cecbbf23/ee518d315de13f098b3e3dc1cecbbf23.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769898.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769898.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769901.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/774/7747f025f0720db7ac5c8ba9faa84774/7747f025f0720db7ac5c8ba9faa84774.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769901.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/774/7747f025f0720db7ac5c8ba9faa84774/7747f025f0720db7ac5c8ba9faa84774.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769904.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/50c/f03c7d0afda28f03f1aaf9cc97d7650c/f03c7d0afda28f03f1aaf9cc97d7650c.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769904.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/50c/f03c7d0afda28f03f1aaf9cc97d7650c/f03c7d0afda28f03f1aaf9cc97d7650c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769907.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/ea2/3330e89568ca8f797c0453f18faa0ea2/3330e89568ca8f797c0453f18faa0ea2.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769907.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/ea2/3330e89568ca8f797c0453f18faa0ea2/3330e89568ca8f797c0453f18faa0ea2.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769910.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769910.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769913.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/e78/654282fb44cb0ccca86097f6a5abae78/654282fb44cb0ccca86097f6a5abae78.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769913.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/e78/654282fb44cb0ccca86097f6a5abae78/654282fb44cb0ccca86097f6a5abae78.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769916.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/7be/53bd02c37d4dca9b69bcc559deec27be/53bd02c37d4dca9b69bcc559deec27be.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769916.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/7be/53bd02c37d4dca9b69bcc559deec27be/53bd02c37d4dca9b69bcc559deec27be.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769919.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/02f/3d3793b06830504df1ee74ae88ae202f/3d3793b06830504df1ee74ae88ae202f.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769919.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/02f/3d3793b06830504df1ee74ae88ae202f/3d3793b06830504df1ee74ae88ae202f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769922.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769922.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769925.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/e07/afde046acf5ff4350c667ee65cd90e07/afde046acf5ff4350c667ee65cd90e07.db object-reconstructor ERROR: Unable to get enough responses (46 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (47 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (48 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (49 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (50 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (51 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (52 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (53 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (54 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (55 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (56 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (57 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (58 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (59 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (60 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_delete_partition test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_delete_partition ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_delete_reverted test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_delete_reverted ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_delete_reverted_max_objects_per_revert test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_delete_reverted_max_objects_per_revert ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_delete_reverted_nondurable test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_delete_reverted_nondurable ... ok sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769925.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/e07/afde046acf5ff4350c667ee65cd90e07/afde046acf5ff4350c667ee65cd90e07.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769928.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/960/08f47547171eaa7a4da5ac3c1753b960/08f47547171eaa7a4da5ac3c1753b960.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769928.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/960/08f47547171eaa7a4da5ac3c1753b960/08f47547171eaa7a4da5ac3c1753b960.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769931.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/14c/4047d06a80ae92b9efae76c95e23914c/4047d06a80ae92b9efae76c95e23914c.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769931.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/14c/4047d06a80ae92b9efae76c95e23914c/4047d06a80ae92b9efae76c95e23914c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769934.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769934.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769937.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/31a/f5aa84e6e0d1b5fe1d656e023d2fb31a/f5aa84e6e0d1b5fe1d656e023d2fb31a.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769937.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/31a/f5aa84e6e0d1b5fe1d656e023d2fb31a/f5aa84e6e0d1b5fe1d656e023d2fb31a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769940.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/023/9d538d68ba3454eb7472997c4a7d7023/9d538d68ba3454eb7472997c4a7d7023.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769940.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/023/9d538d68ba3454eb7472997c4a7d7023/9d538d68ba3454eb7472997c4a7d7023.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769943.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/83a/4bb00f1b19de9160959911b5d5f2583a/4bb00f1b19de9160959911b5d5f2583a.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769943.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/83a/4bb00f1b19de9160959911b5d5f2583a/4bb00f1b19de9160959911b5d5f2583a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769949.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/38f/ebc7f8f4906eab8327849aea9930738f/ebc7f8f4906eab8327849aea9930738f.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769949.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/38f/ebc7f8f4906eab8327849aea9930738f/ebc7f8f4906eab8327849aea9930738f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769952.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/5d9/fc39ec9a5176e852feae41e327ed75d9/fc39ec9a5176e852feae41e327ed75d9.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769952.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/5d9/fc39ec9a5176e852feae41e327ed75d9/fc39ec9a5176e852feae41e327ed75d9.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769955.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/4c7/3417d997fde47f3ab723fae8a62354c7/3417d997fde47f3ab723fae8a62354c7.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769955.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/4c7/3417d997fde47f3ab723fae8a62354c7/3417d997fde47f3ab723fae8a62354c7.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769958.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769958.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769961.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/cc2/414f8a41641642191e055adb2dd3ecc2/414f8a41641642191e055adb2dd3ecc2.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769961.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/cc2/414f8a41641642191e055adb2dd3ecc2/414f8a41641642191e055adb2dd3ecc2.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769964.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/798/f3e090e1e2c81b5177c09e83643ff798/f3e090e1e2c81b5177c09e83643ff798.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769964.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/798/f3e090e1e2c81b5177c09e83643ff798/f3e090e1e2c81b5177c09e83643ff798.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769967.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/00b/2703965338dfecd5a001019c06a4c00b/2703965338dfecd5a001019c06a4c00b.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769967.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/00b/2703965338dfecd5a001019c06a4c00b/2703965338dfecd5a001019c06a4c00b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769970.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769970.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769973.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/a76/a64672d48006c8a3676f03b69c3d6a76/a64672d48006c8a3676f03b69c3d6a76.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769973.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/a76/a64672d48006c8a3676f03b69c3d6a76/a64672d48006c8a3676f03b69c3d6a76.dbtest.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_get_part_jobs test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_get_part_jobs ... ok object-reconstructor ERROR: Unable to get enough responses (61 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (62 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (63 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (64 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (65 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (66 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (67 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (68 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (69 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (70 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (71 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (72 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (73 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (74 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (75 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_get_partners test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_get_partners ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reclaim_deadlock test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reclaim_deadlock ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_one_rnc_absolute_number test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_one_rnc_absolute_number ... ok test ERROR: Failed to unlink '/tmp/tmp_l333ohd/containers/part/suffix/hash/container.db': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2235, in set_sharded_state os.unlink(retiring_file) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: 1 test DEBUG: Unlinked retiring db '/tmp/tmp_l333ohd/containers/part/suffix/hash/container_1757769876.00000.db' test WARNING: Still have multiple db files after unlinking '/tmp/tmp_l333ohd/containers/part/suffix/hash/container_1757769876.00000.db': ['/tmp/tmp_l333ohd/containers/part/suffix/hash/container.db', '/tmp/tmp_l333ohd/containers/part/suffix/hash/container_1757769877.00000.db'] test WARNING: Refusing to delete db file for 'a/c': no fresher db file found in ['/tmp/tmp_l333ohd/containers/part/suffix/hash/container_1757769877.00000.db']. test ERROR: Failed to set the ROWID of the fresh database for a/c: test ERROR: Failed to sync the container_stat table/view with the fresh database for a/c: test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpbdexgj9z/node/sda1/objects-1/0 test-reconstructor DEBUG: Run listdir on /tmp/tmpbdexgj9z/node/sda1/objects-1/1 (txn: tx4757d2704c0f4952a3c64-0068c57087) test-reconstructor DEBUG: Run listdir on /tmp/tmpbdexgj9z/node/sda1/objects-1/2 (txn: tx151865d4ba3e4ec1aba5a-0068c5707e) test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor ERROR: Unable to create /tmp/tmp6t711g1o/node/sda1/objects-1: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 1350, in collect_parts mkdirs(obj_path) ~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_reconstructor.py", line 1047, in blowup_mkdirs raise OSError('Ow!') OSError: Ow! test-reconstructor WARNING: sda5 is not mounted test-reconstructor ERROR: Unable to create /tmp/tmp6t711g1o/node/sda1/objects-2: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 1350, in collect_parts mkdirs(obj_path) ~~~~~~^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_reconstructor.py", line 1047, in blowup_mkdirs raise OSError('Ow!') OSError: Ow! test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpymp2131e/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (308.54/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpymp2131e/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmpymp2131e/node/sda1/objects-1/2 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpymp2131e/node/sda1/objects-1/2 test-reconstructor INFO: Removing partition: /tmp/tmpymp2131e/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (556.94/sec, 0s remaining) test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp9agbb2yl/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmp9agbb2yl/node/sda1/objects-1/0 test-reconstructor DEBUG: Run listdir on /tmp/tmp9agbb2yl/node/sda1/objects-1/2 test-reconstructor INFO: 3/3 (100.00%) partitions reconstructed in 0.01s (217.24/sec, 0s remaining) test-reconstructor INFO: 12 suffixes checked - 0.00% hashed, 100.00% synced test-reconstructor INFO: Partition times: max 0.0050s, min 0.0002s, med 0.0003s test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp9agbb2yl/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmp9agbb2yl/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmp9agbb2yl/node/sda1/objects-1/0 test-reconstructor INFO: 3/3 (100.00%) partitions reconstructed in 0.01s (206.74/sec, 0s remaining) test-reconstructor INFO: 12 suffixes checked - 0.00% hashed, 100.00% synced test-reconstructor INFO: Partition times: max 0.0036s, min 0.0005s, med 0.0007s test-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp9tuzd1ql/node/sda1/objects-1/2 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (319.06/sec, 0s remaining) test-reconstructor INFO: Handoffs only mode still has handoffs remaining. Next pass will continue to revert handoffs. test-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp9tuzd1ql/node/sda1/objects-1/2 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (426.73/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpjv08bmmw/node/sda1/objects-1/2 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (312.68/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpjv08bmmw/node/sda1/objects-1/2 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (247.33/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor DEBUG: Run listdir on /tmp/tmp1kqgx220/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmp1kqgx220/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmp1kqgx220/node/sda1/objects-1/0 test-reconstructor ERROR: Trying to GET 10.0.0.0:7200/sda0/0/nada policy#1: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception test-reconstructor ERROR: Trying to GET 10.0.0.0:7200/sda0/0/nada policy#1: Timeout (Nones)test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_get_response test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_get_response ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_handoffs_only test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_handoffs_only ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_one_rnc_four_replicas test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_one_rnc_four_replicas ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_one_rnc_three_replicas test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_one_rnc_three_replicas ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_ignores_status_file test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_ignores_status_file ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_one_rnc_two_replicas test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_one_rnc_two_replicas ... ok sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769976.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/171/3440bebe2d880ff654d5218a4faf5171/3440bebe2d880ff654d5218a4faf5171.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769976.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/171/3440bebe2d880ff654d5218a4faf5171/3440bebe2d880ff654d5218a4faf5171.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769979.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/f1f/44023a11ce20df5bd9315c384ba4df1f/44023a11ce20df5bd9315c384ba4df1f.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769979.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/f1f/44023a11ce20df5bd9315c384ba4df1f/44023a11ce20df5bd9315c384ba4df1f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769982.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769982.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769985.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/fa0/15f48c8b39539b4fee51730ed04e3fa0/15f48c8b39539b4fee51730ed04e3fa0.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769985.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/fa0/15f48c8b39539b4fee51730ed04e3fa0/15f48c8b39539b4fee51730ed04e3fa0.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769988.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/cae/c53213b4f1951028909d2cd9b4389cae/c53213b4f1951028909d2cd9b4389cae.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769988.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/cae/c53213b4f1951028909d2cd9b4389cae/c53213b4f1951028909d2cd9b4389cae.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769991.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/c06/fcf5ad9577f95d312d25b6c4e66bfc06/fcf5ad9577f95d312d25b6c4e66bfc06.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769991.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/c06/fcf5ad9577f95d312d25b6c4e66bfc06/fcf5ad9577f95d312d25b6c4e66bfc06.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769994.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769994.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769997.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/b0f/4e49e2ece244e508344191944078ab0f/4e49e2ece244e508344191944078ab0f.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769997.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/b0f/4e49e2ece244e508344191944078ab0f/4e49e2ece244e508344191944078ab0f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770000.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/d31/bf0292701ed7e66dce6ab38a4377fd31/bf0292701ed7e66dce6ab38a4377fd31.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770000.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/d31/bf0292701ed7e66dce6ab38a4377fd31/bf0292701ed7e66dce6ab38a4377fd31.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770003.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/ac6/131211a9c882d251ad06f43c98680ac6/131211a9c882d251ad06f43c98680ac6.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770003.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/ac6/131211a9c882d251ad06f43c98680ac6/131211a9c882d251ad06f43c98680ac6.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770009.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/0a1/4ac7dd5a0e83dc1f23572945104a60a1/4ac7dd5a0e83dc1f23572945104a60a1.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770009.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/0a1/4ac7dd5a0e83dc1f23572945104a60a1/4ac7dd5a0e83dc1f23572945104a60a1.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770012.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/5ae/5695b6b21bf519ffcf9f2185cc8525ae/5695b6b21bf519ffcf9f2185cc8525ae.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770012.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/5ae/5695b6b21bf519ffcf9f2185cc8525ae/5695b6b21bf519ffcf9f2185cc8525ae.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770015.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/63c/97bb8688e4f53a863a50169f18f6263c/97bb8688e4f53a863a50169f18f6263c.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770015.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/63c/97bb8688e4f53a863a50169f18f6263c/97bb8688e4f53a863a50169f18f6263c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770018.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770018.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770021.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/391/ff29e588b25ff3499d245fee7e673391/ff29e588b25ff3499d245fee7e673391.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770021.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/391/ff29e588b25ff3499d245fee7e673391/ff29e588b25ff3499d245fee7e673391.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770024.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/671/3f60a0256ff770d09fd664a741862671/3f60a0256ff770d09fd664a741862671.dbtest.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_two test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_two ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_iter_nodes_for_frag test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_iter_nodes_for_frag ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reclaim_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reclaim_shard_ranges ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_missing_own_merged_while_shrinking test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_missing_own_merged_while_shrinking ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_two_with_quarantine_age test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_quarantine_threshold_two_with_quarantine_age ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_etag_with_same_timestamp test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_etag_with_same_timestamp ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_max_objects_per_revert_only_for_revert_jobs test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_max_objects_per_revert_only_for_revert_jobs ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reclaim_with_duplicate_names test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reclaim_with_duplicate_names ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_no_delete_failed_revert test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_no_delete_failed_revert ... ok object-reconstructor ERROR: Unable to get enough responses (76 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (77 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (78 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (79 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (80 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769874.00000 object-reconstructor ERROR: Unable to get enough responses (81 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp2xdnq_dx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769874.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769876.00000 object-reconstructor ERROR: Unable to get enough responses (82 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpmbtfli7h/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769876.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769876.00000 object-reconstructor ERROR: Unable to get enough responses (82 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpnjctfj0u/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769876.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769876.00000 object-reconstructor ERROR: Unable to get enough responses (54 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmplr8li99w/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769876.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769876.00000 object-reconstructor ERROR: Unable to get enough responses (53 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmprt7a73bx/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769876.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769876.00000 object-reconstructor ERROR: Unable to get enough responses (53 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmptx1lwx31/devices/sda1/objects/9/77c/ab4a8c0dec756ad76845d2920375f77c/1757769876.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 8.821487426757812e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Mixed Etag (some garbage, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_etags_same_timestamp_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_etags_same_timestamp_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_new_etag test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_new_etag ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_process_job_all_client_error test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_process_job_all_client_error ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_old_etag test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_old_etag ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_timestamps_etags_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_fa_with_mixed_timestamps_etags_fail ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_process_job_all_insufficient_storage test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_process_job_all_insufficient_storage ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reconciler_sync test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reconciler_sync ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_parity_fa_with_data_node_failure test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_reconstruct_parity_fa_with_data_node_failure ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_process_job_all_success test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_process_job_all_success ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_request_node_count_conf test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveECDuplicationFactor.test_request_node_count_conf ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_account_acl_headers_translated_for_GET_HEAD test.unit.proxy.controllers.test_account.TestAccountController.test_account_acl_headers_translated_for_GET_HEAD ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_process_job_all_timeout test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_process_job_all_timeout ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_account_info_in_response_env test.unit.proxy.controllers.test_account.TestAccountController.test_account_info_in_response_env ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_add_acls_impossible_cases test.unit.proxy.controllers.test_account.TestAccountController.test_add_acls_impossible_cases ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_cache_key_impossible_cases test.unit.proxy.controllers.test_account.TestAccountController.test_cache_key_impossible_cases ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_get_deleted_account test.unit.proxy.controllers.test_account.TestAccountController.test_get_deleted_account ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_reconstruct_check_ring test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_reconstruct_check_ring ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_long_acct_names test.unit.proxy.controllers.test_account.TestAccountController.test_long_acct_names ... ok sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770024.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/671/3f60a0256ff770d09fd664a741862671/3f60a0256ff770d09fd664a741862671.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770027.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/f52/f308a86bbc68a6cff9ed9a6407f9ff52/f308a86bbc68a6cff9ed9a6407f9ff52.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770027.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/f52/f308a86bbc68a6cff9ed9a6407f9ff52/f308a86bbc68a6cff9ed9a6407f9ff52.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770030.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770030.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770033.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/2e2/51fdb6672a9b63d2cbcb179e54ae02e2/51fdb6672a9b63d2cbcb179e54ae02e2.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770033.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/2e2/51fdb6672a9b63d2cbcb179e54ae02e2/51fdb6672a9b63d2cbcb179e54ae02e2.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770036.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/08a/0bac0223be629936f85e27e7da2aa08a/0bac0223be629936f85e27e7da2aa08a.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770036.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/08a/0bac0223be629936f85e27e7da2aa08a/0bac0223be629936f85e27e7da2aa08a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770039.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/56f/cedb083397b56cd7fb9c11d24b99d56f/cedb083397b56cd7fb9c11d24b99d56f.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770039.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/56f/cedb083397b56cd7fb9c11d24b99d56f/cedb083397b56cd7fb9c11d24b99d56f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770042.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770042.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770045.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9.db sharder-test WARNING: Audit warnings for shard: root has no matching shard range, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770045.00000-0, db: /tmp/tmplpwqimkd/sda/containers/0/3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769881.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/5c1/2b14bcd474713767021ae671da4815c1/2b14bcd474713767021ae671da4815c1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769896.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/2e2/37c67cb6218d509e6fe1642f40a122e2/37c67cb6218d509e6fe1642f40a122e2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769901.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/774/7747f025f0720db7ac5c8ba9faa84774/7747f025f0720db7ac5c8ba9faa84774.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769906.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/41c/036de6688bc7eeac874c629324f6041c/036de6688bc7eeac874c629324f6041c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769911.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/051/ae88c7797d05d3f4dd6e94ada1621051/ae88c7797d05d3f4dd6e94ada1621051.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769916.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7be/53bd02c37d4dca9b69bcc559deec27be/53bd02c37d4dca9b69bcc559deec27be.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769921.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/361/bdd6e4a3be9c6dc778bf7947fd938361/bdd6e4a3be9c6dc778bf7947fd938361.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769926.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/760/47f397e2962e064a251785aaf2e85760/47f397e2962e064a251785aaf2e85760.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769931.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/14c/4047d06a80ae92b9efae76c95e23914c/4047d06a80ae92b9efae76c95e23914c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769936.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/64e/ea2272f9efe4db328c8f0e6eeaa3964e/ea2272f9efe4db328c8f0e6eeaa3964e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769941.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/0ff/9d781db5dd9ad7deaddd5669e86900ff/9d781db5dd9ad7deaddd5669e86900ff.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769951.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a52/d6352d444eab28d775b0f8d6673f0a52/d6352d444eab28d775b0f8d6673f0a52.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769956.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/830/3b05aa4eaca7c6eaab6c677b2c213830/3b05aa4eaca7c6eaab6c677b2c213830.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769961.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/cc2/414f8a41641642191e055adb2dd3ecc2/414f8a41641642191e055adb2dd3ecc2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769966.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a84/972206c5ddfbe3104eb36c180e751a84/972206c5ddfbe3104eb36c180e751a84.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769971.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/cb9/5902f68abce1d85074c866fa560cacb9/5902f68abce1d85074c866fa560cacb9.dbtest.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_reconstructor_skipped_partpower_increase test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_reconstructor_skipped_partpower_increase ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_reconstructor_skips_bogus_partition_dirs test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_reconstructor_skips_bogus_partition_dirs ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_response_code_for_DELETE test.unit.proxy.controllers.test_account.TestAccountController.test_response_code_for_DELETE ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_response_code_for_POST test.unit.proxy.controllers.test_account.TestAccountController.test_response_code_for_POST ... ok test DEBUG: Setting object count to 1068 (txn: tx2db4a016f0e8418096cc1-0068c57090) test DEBUG: GET listing from 3 shards for: /v1/a/c?reverse=true&format=json&states=listing (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='lemon', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_?reverse=true&format=json&limit=10000&marker=&end_marker=lemon {'X-Backend-Record-Type': 'auto'} (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1024 (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_pie?reverse=true&format=json&limit=8976&marker=m&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Found 44 objects in shard (state=unsharded), total = 1068 (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Get listing from /v1/.shards_a/c_ham?reverse=true&format=json&limit=8932&marker=A&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Found 0 objects in shard (state=unsharded), total = 1068 (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Setting object count to 1068 (txn: tx62db34d57e5348ffb2fa5-0068c57090) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txe1da991dc38145a897b6c-0068c57092) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txe1da991dc38145a897b6c-0068c57092) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txe1da991dc38145a897b6c-0068c57092) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txe1da991dc38145a897b6c-0068c57092) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txe1da991dc38145a897b6c-0068c57092) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txe1da991dc38145a897b6c-0068c57092) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing: 404 (txn: txe1da991dc38145a897b6c-0068c57092) test ERROR: Aborting listing from shards due to bad response: [200, 404] (txn: txe1da991dc38145a897b6c-0068c57092) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx28ce08d0b5884ea99fae9-0068c57093) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx28ce08d0b5884ea99fae9-0068c57093) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx28ce08d0b5884ea99fae9-0068c57093) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx28ce08d0b5884ea99fae9-0068c57093) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx28ce08d0b5884ea99fae9-0068c57093) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx28ce08d0b5884ea99fae9-0068c57093) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.0:1000/sda (txn: tx28ce08d0b5884ea99fae9-0068c57093) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.1:1001/sdb (txn: tx28ce08d0b5884ea99fae9-0068c57093) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.2:1002/sdc (txn: tx28ce08d0b5884ea99fae9-0068c57093) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.3:1003/sda (txn: tx28ce08d0b5884ea99fae9-0068c57093) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.4:1004/sda (txn: tx28ce08d0b5884ea99fae9-0068c57093) test ERROR: ERROR 500 b'[]' Trying to GET /.shards_a/c_pie From Container Server 10.0.0.5:1005/sda (txn: tx28ce08d0b5884ea99fae9-0068c57093) test ERROR: Container GET returning 503 for [500, 500, 500, 500, 500, 500] (txn: tx28ce08d0b5884ea99fae9-0068c57093) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing: 503 (txn: tx28ce08d0b5884ea99fae9-0068c57093) test ERROR: Aborting listing from shards due to bad response: [200, 503] (txn: tx28ce08d0b5884ea99fae9-0068c57093) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_a', lower='', upper='a') .shards_a/c_a with {'X-Backend-Record-Type': 'auto'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Get listing from /v1/.shards_a/c_a?format=json&limit=10000&marker=&end_marker=a%00 {'X-Backend-Record-Type': 'auto'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Found 33 objects in shard (state=unsharded), total = 33 (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'auto'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=9967&marker=a&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: GET listing from 1 shards for: /v1/.shards_a/c_b?format=json&limit=9967&marker=a&end_marker=b%00&states=listing (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='b', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9967&marker=a&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: GET listing from 1 shards for: /v1/.shards_a/c_?format=json&limit=9967&marker=a&end_marker=b%00&states=listing (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'object'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=9967&marker=a&end_marker=b%00 {'X-Backend-Record-Type': 'object'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Found 1 objects in shard (state=unsharded), total = 1 (txn: txdb42e0b97a854376b7d0e-0068c57094)test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_shard_redirects_between_shards test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_shard_redirects_between_shards ... ok test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpax4kmv_k/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpax4kmv_k/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpax4kmv_k/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (484.27/sec, 0s remaining) test-reconstructor INFO: Handoffs only mode still has handoffs remaining. Next pass will continue to revert handoffs. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpax4kmv_k/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpax4kmv_k/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpax4kmv_k/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (633.10/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp4pcm3ipi/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmp4pcm3ipi/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmp4pcm3ipi/node/sda1/objects-1/0 test-reconstructor INFO: 3/3 (100.00%) partitions reconstructed in 0.02s (180.94/sec, 0s remaining) test-reconstructor INFO: 12 suffixes checked - 0.00% hashed, 100.00% synced test-reconstructor INFO: Partition times: max 0.0038s, min 0.0005s, med 0.0009s test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpny9y3cbv/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpny9y3cbv/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor DEBUG: Run listdir on /tmp/tmpny9y3cbv/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (387.32/sec, 0s remaining) test-reconstructor INFO: Handoffs only mode still has handoffs remaining. Next pass will continue to revert handoffs. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpny9y3cbv/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpny9y3cbv/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor DEBUG: Run listdir on /tmp/tmpny9y3cbv/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (356.08/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpny9y3cbv/node/sda1/objects-1/1 while in handoffs_only mode. test-reconstructor DEBUG: Skipping sync_only job for /tmp/tmpny9y3cbv/node/sda1/objects-1/0 while in handoffs_only mode. test-reconstructor DEBUG: Run listdir on /tmp/tmpny9y3cbv/node/sda1/objects-1/2 test-reconstructor INFO: Removing partition: /tmp/tmpny9y3cbv/node/sda1/objects-1/2 test-reconstructor INFO: 1/3 (33.33%) partitions reconstructed in 0.00s (380.23/sec, 0s remaining) test-reconstructor WARNING: Handoffs only mode found no handoffs remaining. You should disable handoffs_only once all nodes are reporting no handoffs remaining. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpa6hf_fr4/node/sda1/objects-1/0 test-reconstructor ERROR: Invalid response 400 from 10.0.0.0:6200/sda0/0 policy#1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.2:6200/sda2/0 policy#1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.3:6200/sda3/0 policy#1 test-reconstructor DEBUG: Run listdir on /tmp/tmpa6hf_fr4/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmpa6hf_fr4/node/sda1/objects-1/1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.0:6200/sda0/1 policy#1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.1:6200/sda5/1 policy#1 test-reconstructor ERROR: Invalid response 400 from 10.0.0.2:6200/sda6/1 policy#1 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpo6u5hh4g/node/sda1/objects-1/1 test-reconstructor ERROR: 10.0.0.0:6200/sda0/1 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.1:6200/sda5/1 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.0:6200/sda4/1 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.2:6200/sda6/1 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.2:6200/sda2/1 policy#1 responded as unmounted test-reconstructor DEBUG: Run listdir on /tmp/tmpo6u5hh4g/node/sda1/objects-1/0 test-reconstructor ERROR: 10.0.0.0:6200/sda0/0 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.1:6200/sda5/0 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.2:6200/sda2/0 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.3:6200/sda7/0 policy#1 responded as unmounted test-reconstructor ERROR: 10.0.0.3:6200/sda3/0 policy#1 responded as unmounted test-reconstructor DEBUG: Run listdir on /tmp/tmpo6u5hh4g/node/sda1/objects-1/2 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmppvt_y5vl/node/sda1/objects-1/0 test-reconstructor DEBUG: Run listdir on /tmp/tmppvt_y5vl/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmppvt_y5vl/node/sda1/objects-1/1 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpcfiy0ari/node/sda1/objects-1/0 test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.0:6200/sda0/0 policy#1': Timeout (Nones) test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.2:6200/sda2/0 policy#1': Timeout (Nones) test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.3:6200/sda3/0 policy#1': Timeout (Nones) test-reconstructor DEBUG: Run listdir on /tmp/tmpcfiy0ari/node/sda1/objects-1/1 test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.0:6200/sda0/1 policy#1': Timeout (Nones) test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.1:6200/sda5/1 policy#1': Timeout (Nones) test-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.2:6200/sda6/1 policy#1': Timeout (Nones) test-reconstructor DEBUG: Run listdir on /tmp/tmpcfiy0ari/node/sda1/objects-1/2 test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor INFO: Ring change detected for policy 1 (one). Aborting current reconstruction pass for this policy. test-reconstructor DEBUG: Run listdir on /tmp/tmp7u157ifr/node/sda1/objects-2/2 test-reconstructor INFO: Removing partition: /tmp/tmp7u157ifr/node/sda1/objects-2/2 test-reconstructor DEBUG: Run listdir on /tmp/tmp7u157ifr/node/sda1/objects-2/0 test-reconstructor DEBUG: Run listdir on /tmp/tmp7u157ifr/node/sda1/objects-2/1 test-reconstructor INFO: 3/6 (50.00%) partitions reconstructed in 0.00s (845.57/sec, 0s remaining) test-reconstructor WARNING: next_part_power set in policy 'one'. Skipping test-reconstructor WARNING: sda5 is not mounted test-reconstructor INFO: Nothing reconstructed for 0.0006132125854492188 seconds. test-reconstructor WARNING: Unexpected entity in data dir: '/tmp/tmpak_u_4yw/node/sda1/objects-1/burrito' test-reconstructor INFO: Removing partition: /tmp/tmpak_u_4yw/node/sda1/objects-1/burrito test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: Unable to read '/tmp/tmp2mkap_0x/node/sda1/objects-1/1/hashes.pkl' Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1336, in __get_hashes orig_hashes = self.consolidate_hashes(partition_path) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 436, in consolidate_hashes with lock_path(partition_dir): ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1294, in lock_path mkdirs(directory) ~~~~~~^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 802, in mkdirs os.makedirs(path) ~~~~~~~~~~~^^^^^^ File "", line 228, in makedirs FileExistsError: [Errno 17] File exists: '/tmp/tmp2mkap_0x/node/sda1/objects-1/1'test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_removes_zbf test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_removes_zbf ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_response_code_for_PUT test.unit.proxy.controllers.test_account.TestAccountController.test_response_code_for_PUT ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_run_once test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_run_once ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_run_once_override_devices test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_run_once_override_devices ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_stripping_swift_admin_headers test.unit.proxy.controllers.test_account.TestAccountController.test_stripping_swift_admin_headers ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_remove_objects test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_remove_objects ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_swift_owner test.unit.proxy.controllers.test_account.TestAccountController.test_swift_owner ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_sync_old_nondurable_before_committed_non_zero_commit_window test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_sync_old_nondurable_before_committed_non_zero_commit_window ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_resolve_shard_range_states test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_resolve_shard_range_states ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_sys_meta_headers_POST test.unit.proxy.controllers.test_account.TestAccountController.test_sys_meta_headers_POST ... ok test.unit.proxy.controllers.test_account.TestAccountController.test_sys_meta_headers_PUT test.unit.proxy.controllers.test_account.TestAccountController.test_sys_meta_headers_PUT ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_sync_old_nondurable_before_committed_past_commit_window test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_sync_old_nondurable_before_committed_past_commit_window ... ok test.unit.proxy.controllers.test_account.TestGetAccountInfo.test_get_deleted_account_410 test.unit.proxy.controllers.test_account.TestGetAccountInfo.test_get_deleted_account_410 ... ok test.unit.proxy.controllers.test_base.TestGetterSource.test_close test.unit.proxy.controllers.test_base.TestGetterSource.test_close ... ok test.unit.proxy.controllers.test_base.TestGetterSource.test_init test.unit.proxy.controllers.test_base.TestGetterSource.test_init ... ok test.unit.proxy.controllers.test_base.TestGetterSource.test_sort test.unit.proxy.controllers.test_base.TestGetterSource.test_sort ... ok test.unit.proxy.controllers.test_base.TestGetterSource.test_timestamp test.unit.proxy.controllers.test_base.TestGetterSource.test_timestamp ... ok test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_sync_old_nondurable_before_committed_zero_commit_window test.unit.obj.test_reconstructor.TestGlobalSetupObjectReconstructor.test_sync_old_nondurable_before_committed_zero_commit_window ... ok test.unit.proxy.controllers.test_container.TestGetExplicitRecordType.test_GET_record_type_object_makes_no_cache_lookup test.unit.proxy.controllers.test_container.TestGetExplicitRecordType.test_GET_record_type_object_makes_no_cache_lookup ... ok test.unit.proxy.controllers.test_container.TestGetExplicitRecordType.test_GET_shard_ranges_no_cache_when_include_deleted_shards test.unit.proxy.controllers.test_container.TestGetExplicitRecordType.test_GET_shard_ranges_no_cache_when_include_deleted_shards ... ok test.unit.proxy.controllers.test_container.TestGetExplicitRecordType.test_GET_shard_ranges_no_cache_when_requesting_listing_shards test.unit.proxy.controllers.test_container.TestGetExplicitRecordType.test_GET_shard_ranges_no_cache_when_requesting_listing_shards ... ok test.unit.proxy.controllers.test_container.TestGetExplicitRecordType.test_GET_shard_ranges_no_cache_when_requesting_updating_shards test.unit.proxy.controllers.test_container.TestGetExplicitRecordType.test_GET_shard_ranges_no_cache_when_requesting_updating_shards ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reverse_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_reverse_prefix_delim ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_root_account_container_path ... ok object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 27 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769876.00000 object-reconstructor INFO: Nothing reconstructed for 5.7220458984375e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 11] object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor DEBUG: Found existing frag #1 at 10.0.0.2:1002/sdc/0/a/c/o policy#0 while rebuilding to 10.0.0.1:1001/sdb/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769876.00000 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag c5fb6d138d0e30c1a777a2e70fdf44b8 and timestamp 1757769877.00000 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/o policy#0 frag#1 with ETag fb3d200eb5be7226d6ab1839145d575b and timestamp 1757769878.00000 object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.7:1007/sdh/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #10 at 10.0.0.10:1010/sdk/0/a/c/o policy#0 while rebuilding to 10.0.0.24:1024/sdy/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 2, 3, 4, 5, 6, 8, 9, 11] object-reconstructor ERROR: Trying to GET 10.0.0.7:1007/sdh/0/a/c/o policy#0: Timeout (Nones) object-reconstructor DEBUG: Found existing frag #10 at 10.0.0.10:1010/sdk/0/a/c/o policy#0 while rebuilding to 10.0.0.24:1024/sdy/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 2, 3, 4, 5, 8, 9, 11, 12] object-reconstructor ERROR: Trying to GET 10.0.0.7:1007/sdh/0/a/c/o policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.8:1008/sdi/0/a/c/o policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor DEBUG: Found existing frag #10 at 10.0.0.10:1010/sdk/0/a/c/o policy#0 while rebuilding to 10.0.0.24:1024/sdy/0/a/c/o policy#0 object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 2, 3, 4, 5, 9, 11, 12, 13] object-reconstructor INFO: Nothing reconstructed for 9.059906005859375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 8.821487426757812e-06 seconds. test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to get commit status of PUT to /v1/a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 525, in _get_conn_response resp = putter.await_response( self.app.node_timeout, not final_phase) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1739, in await_response self.resp = self.conn.getexpect() ~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 840, in getexpect expect_status = self._status.get_expect_status() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 743, in get_expect_status raise expect_status Exception: kaboom! (txn: tx23a823baae6b4211aa834-0068c57094)test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_commit_exception test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_commit_exception ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_commit_timeout test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_commit_timeout ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_ec_chunkreadtimeout_during_transfer_data test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_ec_chunkreadtimeout_during_transfer_data ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_ec_error_during_transfer_data test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_ec_error_during_transfer_data ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_save_and_load_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_save_and_load_record_from_pending_file ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_ec_exception_during_transfer_data test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_ec_exception_during_transfer_data ... ok test.unit.obj.test_ssync.TestSsyncReplication.test_content_type_sync test.unit.obj.test_ssync.TestSsyncReplication.test_content_type_sync ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_ec_timeout_during_transfer_data test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_ec_timeout_during_transfer_data ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769976.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/171/3440bebe2d880ff654d5218a4faf5171/3440bebe2d880ff654d5218a4faf5171.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769981.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/17b/e345d51761e471dfb00d5a8edc2c617b/e345d51761e471dfb00d5a8edc2c617b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769986.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/00f/daeb4b33482ba0957987c36a50e7900f/daeb4b33482ba0957987c36a50e7900f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769991.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/c06/fcf5ad9577f95d312d25b6c4e66bfc06/fcf5ad9577f95d312d25b6c4e66bfc06.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769996.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/39e/fbf2358e38a5c56a22314c34028b539e/fbf2358e38a5c56a22314c34028b539e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770001.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/5e6/0505ffd42c4fe4c906142adc44f4e5e6/0505ffd42c4fe4c906142adc44f4e5e6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770011.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/03a/639b685a0d495f2e38c24576f8cb303a/639b685a0d495f2e38c24576f8cb303a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770016.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/4c8/2c74f270d1f22425e8cbd85329ca24c8/2c74f270d1f22425e8cbd85329ca24c8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770021.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/391/ff29e588b25ff3499d245fee7e673391/ff29e588b25ff3499d245fee7e673391.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770026.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7d5/12afa896fd8019e512e47c77444f47d5/12afa896fd8019e512e47c77444f47d5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770031.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/bd8/f2b5151d9d5433c1f97d3552388bfbd8/f2b5151d9d5433c1f97d3552388bfbd8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770036.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/08a/0bac0223be629936f85e27e7da2aa08a/0bac0223be629936f85e27e7da2aa08a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770041.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/1f2/d57221a0da77a6a9b83e2fc532fc11f2/d57221a0da77a6a9b83e2fc532fc11f2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770046.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/fab/e0b9deaff7e8658d413d95e5b3ea1fab/e0b9deaff7e8658d413d95e5b3ea1fab.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770051.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/523/1990b221902d604fa1229244eead0523/1990b221902d604fa1229244eead0523.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770056.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/09a/873d68a9ce955afe64a4bb76a326c09a/873d68a9ce955afe64a4bb76a326c09a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770061.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/bdf/7131d6a6fe2b9accd5a2f8eec2ea8bdf/7131d6a6fe2b9accd5a2f8eec2ea8bdf.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770066.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f4a/8230badf84a278d302008f5674bb0f4a/8230badf84a278d302008f5674bb0f4a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770071.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/0ee/e79ab44d89db60761752903205ed50ee/e79ab44d89db60761752903205ed50ee.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770076.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/2cd/5ed65aca28706155baaa427c462ba2cd/5ed65aca28706155baaa427c462ba2cd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770081.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/3b1/d38b61f2053ea8ee998fbe21ba9d83b1/d38b61f2053ea8ee998fbe21ba9d83b1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770086.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f1a/64edae903855c5b0f707ff871ed22f1a/64edae903855c5b0f707ff871ed22f1a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770091.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d61/bb8e562d291f948c9317f51fd8db6d61/bb8e562d291f948c9317f51fd8db6d61.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770096.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7ce/a586972b9c5699f8c03e4f4c339567ce/a586972b9c5699f8c03e4f4c339567ce.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770101.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/89f/1317af59b5842ca7fdf5b268bd94289f/1317af59b5842ca7fdf5b268bd94289f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770106.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/0f3/0cac656fc49d06e2a7fdcc19989b10f3/0cac656fc49d06e2a7fdcc19989b10f3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770111.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7a2/72321bc1622ab13d5d961c77be5037a2/72321bc1622ab13d5d961c77be5037a2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770116.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/c18/0cdfcd36b296a4e98c829b445b89ec18/0cdfcd36b296a4e98c829b445b89ec18.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770121.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d4f/3d3499deb50e781b5841ed9df4873d4f/3d3499deb50e781b5841ed9df4873d4f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770126.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/101/b00ee0542d4ea27c4704a4e08ac3e101/b00ee0542d4ea27c4704a4e08ac3e101.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770131.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e6c/8c740096650402e4eab2b7d74e919e6c/8c740096650402e4eab2b7d74e919e6c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770136.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/af5/1a7fa1f74fd808aa72933fde0806eaf5/1a7fa1f74fd808aa72933fde0806eaf5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770141.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/6e7/51a4e80eab87e66599eae93447ada6e7/51a4e80eab87e66599eae93447ada6e7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770146.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ab3/cd301fbc5feac7014d9b029c59741ab3/cd301fbc5feac7014d9b029c59741ab3.dbtest.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_error_commit test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_error_commit ... ok test ERROR: Invalid swift_bytes: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2995, in override_bytes_from_content_type listing_dict['bytes'] = int(swift_bytes) ~~~^^^^^^^^^^^^^ ValueError: invalid literal for int() with base 10: 'hey' test ERROR: Problem finding shard upper in '/tmp/tmpgo_3eg37/test_container.db': : LockTimeout (Nones) test ERROR: Problem finding shard upper in '/tmp/tmpgo_3eg37/test_container.db': : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2498, in find_shard_ranges next_shard_upper = sub_broker._get_next_shard_range_upper( shard_size, last_shard_upper) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect sqlite3.OperationalError test DEBUG: Unlinked retiring db '/tmp/tmpbqz7m0qg/containers/part/suffix/hash/container.db' test WARNING: Unexpected db files will be ignored: ['/tmp/tmpbqz7m0qg/containers/part/suffix/hash/container.db'] Container 'a/c' cannot be set to sharded state while in unsharded state Container 'a/c' cannot be set to sharding state: missing epoch proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to get commit status of PUT to /v1/a/c/o: Timeout (Nones) (txn: txe0a7e0f70dea4783983d1-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server WARNING: ERROR Client read timeout (Nones) (txn: tx2888f2d116d54f6c945da-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server WARNING: Client disconnected without sending last chunk (txn: tx57fbf48bac6c4e19a0b87-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR Exception transferring data to object servers {'path': '/v1/a/c/o.jpg'}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 3161, in _transfer_data chunk = next(data_source) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2446, in __next__ return self._get_next_item() ~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 5231, in _get_next_item return super(CooperativeIterator, self)._get_next_item() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2442, in _get_next_item return next(self.wrapped_iter) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 878, in reader return req.environ['wsgi.input'].read( ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^ self.app.client_chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/controllers/test_obj.py", line 7227, in read raise Exception('exception message') Exception: exception message (txn: tx61f2e8350cce40daa1f56-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR Exception causing client disconnect: Timeout (Nones) (txn: tx4bd056ba549f4d8ea84a1-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.5:1005/sdf (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.2:1002/sdc (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.8:1008/sdi (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.9:1009/sdj (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.7:1007/sdh (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.0:1000/sda (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.1:1001/sdb (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.10:1010/sdk (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.3:1003/sdd (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.4:1004/sde (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.6:1006/sdg (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.12:1012/sdm (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.11:1011/sdl (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.13:1013/sdn (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server ERROR: Not enough object servers ack'ed (got 0) (txn: txa09ca72c4da44fe9bfbfe-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.13:1013/sdn (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.5:1005/sdf (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.0:1000/sda (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.2:1002/sdc (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.8:1008/sdi (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.10:1010/sdk (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.9:1009/sdj (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.12:1012/sdm (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.6:1006/sdg (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.4:1004/sde (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.3:1003/sdd (txn: tx85bbc84cbe014f63bf8bb-0068c57094)test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_mostly_error_commit test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_mostly_error_commit ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_mostly_success test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_mostly_success ... ok Container 'a/c' cannot be set to sharding state while in sharding state test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_mostly_success_commit test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_mostly_success_commit ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_old_obj_server test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_old_obj_server ... ok Container 'a/c' cannot be set to sharded state while in sharded state test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_simple test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_simple ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_body test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_body ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_delimiter_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_delimiter_no_memcache ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_body_and_bad_etag test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_body_and_bad_etag ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_both_body test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_both_body ... ok test-reconstructor WARNING: Unexpected entity '/tmp/tmp2mkap_0x/node/sda1/objects-1/1' is not a directory test-reconstructor INFO: Removing partition: /tmp/tmp2mkap_0x/node/sda1/objects-1/1 test-reconstructor DEBUG: Run listdir on /tmp/tmp2mkap_0x/node/sda1/objects-1/2 test-reconstructor DEBUG: Run listdir on /tmp/tmp2mkap_0x/node/sda1/objects-1/0 test-reconstructor INFO: 3/3 (100.00%) partitions reconstructed in 0.01s (508.85/sec, 0s remaining) test-reconstructor INFO: Running object reconstructor in script mode. test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor INFO: 0/8 (0.00%) partitions reconstructed in 0.00s (0.00/sec, 55s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpcusq5pit/node/sdb1/objects-1/0 test-reconstructor DEBUG: Run listdir on /tmp/tmpcusq5pit/node/sdb1/objects-1/3 test-reconstructor INFO: 2/8 (25.00%) partitions reconstructed in 0.00s (817.20/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpcusq5pit/node/sda1/objects-1/1 test-reconstructor INFO: 3/8 (37.50%) partitions reconstructed in 0.00s (792.28/sec, 0s remaining) test-reconstructor INFO: 3/8 (37.50%) partitions reconstructed in 0.00s (730.08/sec, 0s remaining) test-reconstructor INFO: 3/8 (37.50%) partitions reconstructed in 0.00s (704.53/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpcusq5pit/node/sda1/objects-1/0 test-reconstructor INFO: 4/8 (50.00%) partitions reconstructed in 0.01s (735.91/sec, 0s remaining) test-reconstructor INFO: 4/8 (50.00%) partitions reconstructed in 0.01s (700.54/sec, 0s remaining) test-reconstructor INFO: 5/8 (62.50%) partitions reconstructed in 0.01s (848.19/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpcusq5pit/node/sda1/objects-1/2 test-reconstructor INFO: 5/8 (62.50%) partitions reconstructed in 0.01s (702.82/sec, 0s remaining) test-reconstructor INFO: 6/8 (75.00%) partitions reconstructed in 0.01s (818.99/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpcusq5pit/node/sdb1/objects-1/1 test-reconstructor INFO: 7/8 (87.50%) partitions reconstructed in 0.01s (836.76/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpcusq5pit/node/sdb1/objects-1/2 test-reconstructor INFO: 8/8 (100.00%) partitions reconstructed in 0.01s (857.12/sec, 0s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmpcusq5pit/node/sdc1/objects-1/0 test-reconstructor INFO: 8/8 (100.00%) partitions reconstructed in 0.01s (777.48/sec, 0s remaining) test-reconstructor INFO: 8/8 (100.00%) partitions reconstructed in 0.01s (761.15/sec, 0s remaining) test-reconstructor INFO: Object reconstruction complete (once). (0.00 minutes) test-reconstructor ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test-reconstructor INFO: Running object reconstructor in script mode. test-reconstructor INFO: 0/1 (0.00%) partitions reconstructed in 0.00s (0.00/sec, 29s remaining) test-reconstructor DEBUG: Run listdir on /tmp/tmps67adhqb/node/sdc1/objects-1/0 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (731.73/sec, 0s remaining) test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (623.50/sec, 0s remaining) test-reconstructor INFO: Object reconstruction complete (once). (0.00 minutes) test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpuontpk86/node/sda1/objects-1/1 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (518.97/sec, 0s remaining) test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmpsjpxndi6/node/sda1/objects-1/1 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (504.61/sec, 0s remaining) test-reconstructor ERROR: Problem making data file durable /tmp/tmpsjpxndi6/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165075.47975#4#d.data ([Errno 2] No such file or directory: '/tmp/tmpsjpxndi6/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c'): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3298, in _finalize_durable os.rename(data_file_path, durable_data_file_path) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpsjpxndi6/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165075.47975#4.data' -> '/tmp/tmpsjpxndi6/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165075.47975#4#d.data' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3313, in _finalize_durable files = os.listdir(self._datadir) FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmpsjpxndi6/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c' test-reconstructor WARNING: sda5 is not mounted test-reconstructor WARNING: sda5 is not mounted test-reconstructor DEBUG: Run listdir on /tmp/tmp72mlw05i/node/sda1/objects-1/1 test-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.00s (521.03/sec, 0s remaining) test-reconstructor ERROR: Problem making data file durable /tmp/tmp72mlw05i/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165075.50308#4#d.data ([Errno 2] No such file or directory: '/tmp/tmp72mlw05i/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c'): Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3298, in _finalize_durable os.rename(data_file_path, durable_data_file_path) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmp72mlw05i/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165075.50308#4.data' -> '/tmp/tmp72mlw05i/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c/1757165075.50308#4#d.data' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3313, in _finalize_durable files = os.listdir(self._datadir) FileNotFoundError: [Errno 2] No such file or directory: '/tmp/tmp72mlw05i/node/sda1/objects-1/1/78c/61af75fb1258b64ed760189e0e4db78c' test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824514) wsgi starting up on http://127.0.0.1:34731 test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 49810) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 5, available: 5, sent: 3, deletable: 5 test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:36] "SSYNC /dev/9 HTTP/1.1" 200 389 0.122988 test-ssync-sender DEBUG: Run listdir on /tmp/tmp33scsr5z/tmp_test_ssync_sender/dev/objects/9 test-ssync-receiver DEBUG: Run listdir on /tmp/tmp33scsr5z/tmp_test_ssync_receiver/dev/objects/9 test-ssync-receiver INFO: (1824514) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824514) wsgi starting up on http://127.0.0.1:59513 test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 39208) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1test.unit.obj.test_ssync.TestSsyncReplication.test_expired_object test.unit.obj.test_ssync.TestSsyncReplication.test_expired_object ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_shard_ranges_state test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_merge_shard_ranges_state ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_chunked_body test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_chunked_body ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_explicit_commit_status test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_explicit_commit_status ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_newid test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_newid ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_db_states test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_db_states ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_footers test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_footers ... ok test.unit.obj.test_ssync.TestSsyncReplication.test_meta_file_not_synced_to_legacy_receiver test.unit.obj.test_ssync.TestSsyncReplication.test_meta_file_not_synced_to_legacy_receiver ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_just_enough_durable_responses test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_just_enough_durable_responses ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_sharded_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_sharded_state_errors ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_less_durable_responses test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_less_durable_responses ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_object_stats_old_style_root_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_object_stats_old_style_root_container ... ok proxy-server ERROR: Not enough object servers ack'ed (got 3) (txn: tx85bbc84cbe014f63bf8bb-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.13:1013/sdn (txn: tx7c74730566a4422bb3ed2-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.10:1010/sdk (txn: tx7c74730566a4422bb3ed2-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.11:1011/sdl (txn: tx7c74730566a4422bb3ed2-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.0:1000/sda (txn: tx1a45c83fc4934c6689bd1-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.13:1013/sdn (txn: tx1a45c83fc4934c6689bd1-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.9:1009/sdj (txn: tx1a45c83fc4934c6689bd1-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Expect: 100-continue on /a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 3026, in _make_putter return MIMEPutter.connect( ~~~~~~~~~~~~~~~~~~^ node, part, req.swift_entity_path, headers, self.app.watchdog, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ...<4 lines>... logger=self.logger, ^^^^^^^^^^^^^^^^^^^ need_multiphase=True) ^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1990, in connect raise FooterNotSupported() swift.common.exceptions.FooterNotSupported (txn: tx8023f8558587423399c3e-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.9:1009/sdj (txn: tx6ae9e76a963644109987d-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.7:1007/sdh (txn: tx6ae9e76a963644109987d-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.5:1005/sdf (txn: tx6ae9e76a963644109987d-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.4:1004/sde (txn: tx83e8acccb2114ec4a15ed-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.13:1013/sdn (txn: tx83e8acccb2114ec4a15ed-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.6:1006/sdg (txn: tx83e8acccb2114ec4a15ed-0068c57094) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.2:1002/sdc (txn: tx83e8acccb2114ec4a15ed-0068c57094) proxy-server ERROR: Object PUT returning 503 for [201, 201, 201, 503, 201, 201, 503, 201, 503, 201, 201, 201, 503, 201] (txn: tx83e8acccb2114ec4a15ed-0068c57094) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_slow_commits test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_PUT_with_slow_commits ... ok test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_txn_id_logging_ECPUT test.unit.proxy.controllers.test_obj.TestECObjControllerMimePutter.test_txn_id_logging_ECPUT ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_sharding_state test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_sharding_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_object_stats_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_object_stats_old_style_shard_container ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770151.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/dc8/05672acb88159105c27c6eeb07734dc8/05672acb88159105c27c6eeb07734dc8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770156.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/3cf/c829193ce57810651471e3df634a03cf/c829193ce57810651471e3df634a03cf.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770161.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/08c/f45d9210b6212eaf254db1213ceb608c/f45d9210b6212eaf254db1213ceb608c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770166.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f09/84656f98f1833c32dab85ec6facd5f09/84656f98f1833c32dab85ec6facd5f09.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770171.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/bb2/c54371273cf1be7530f7eb36d8e5cbb2/c54371273cf1be7530f7eb36d8e5cbb2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770176.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/0a4/6c2bd06d9ff1d49fe8a3596d857fd0a4/6c2bd06d9ff1d49fe8a3596d857fd0a4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770181.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d4e/d13c8ffba692dfd033e7142d847b9d4e/d13c8ffba692dfd033e7142d847b9d4e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770186.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/cc5/e7656707611f0a2c313964e70f3b8cc5/e7656707611f0a2c313964e70f3b8cc5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770191.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a5d/925d8acf14ebdde6dcfc43252c64fa5d/925d8acf14ebdde6dcfc43252c64fa5d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770196.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/35b/920c5e7b31983bd46b1fe49c40d3d35b/920c5e7b31983bd46b1fe49c40d3d35b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770201.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/11c/7d16e14ec52f46841bc806b49a40211c/7d16e14ec52f46841bc806b49a40211c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770206.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a73/f542dec40ea7013817cb80b3250cba73/f542dec40ea7013817cb80b3250cba73.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770211.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/5b8/721c343aaced8caf8c06360bb112a5b8/721c343aaced8caf8c06360bb112a5b8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770216.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d3d/ebfd8cff9713746160e0fe8163a35d3d/ebfd8cff9713746160e0fe8163a35d3d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770221.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/cfa/0dfbfd23c47271d53bb5c50750c69cfa/0dfbfd23c47271d53bb5c50750c69cfa.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770226.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/05d/1ca50b7e8f0be0e47cbd6af2bb64b05d/1ca50b7e8f0be0e47cbd6af2bb64b05d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770231.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d4d/3ef7eedfd968e5ef0cfa68d5de60ed4d/3ef7eedfd968e5ef0cfa68d5de60ed4d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770236.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e31/744f1c1ca728fd5ba0990a5ceb2bae31/744f1c1ca728fd5ba0990a5ceb2bae31.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770241.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/b2e/6d67e229502e7d264b818584db2f8b2e/6d67e229502e7d264b818584db2f8b2e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770246.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/33f/11275d8c4f282bce16d7e666d31e633f/11275d8c4f282bce16d7e666d31e633f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770251.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/273/16be9d7ef776b86babdbb2c7bda6e273/16be9d7ef776b86babdbb2c7bda6e273.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770256.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ed5/4cc0102e10ae8b725bcec485876dced5/4cc0102e10ae8b725bcec485876dced5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770261.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/8c3/c9f491bf00483970a7b478f4797bb8c3/c9f491bf00483970a7b478f4797bb8c3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770266.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/3a1/5ea151e8adbc495bb49b58ea5bf963a1/5ea151e8adbc495bb49b58ea5bf963a1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770271.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ce3/7a8d5c91865081ce714a3efdbe109ce3/7a8d5c91865081ce714a3efdbe109ce3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770276.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e79/23e44193a7e89364c4de0c683a366e79/23e44193a7e89364c4de0c683a366e79.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770281.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/203/1c5c1e3bc10ed5890b5a9e2edd756203/1c5c1e3bc10ed5890b5a9e2edd756203.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770286.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ee4/876999b37f9a9212531ac17cc9a7fee4/876999b37f9a9212531ac17cc9a7fee4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770291.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/71e/eed07c456f06c473352aff3a1174e71e/eed07c456f06c473352aff3a1174e71e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770296.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/bcf/69fd05fb5ed2093ce8115955ec777bcf/69fd05fb5ed2093ce8115955ec777bcf.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770301.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/9d6/33a23f05f413011c5380cb75b38169d6/33a23f05f413011c5380cb75b38169d6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770306.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f03/ada859bf2f427ec91bcfdba66cc7af03/ada859bf2f427ec91bcfdba66cc7af03.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770311.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/9c4/b3fdbda4a2bc45ceeb21456cfffc09c4/b3fdbda4a2bc45ceeb21456cfffc09c4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770316.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f43/638930869d7405d1661733d0243e3f43/638930869d7405d1661733d0243e3f43.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770321.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/5ea/390cfd8b186db256509afc34dff9b5ea/390cfd8b186db256509afc34dff9b5ea.dbtest.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reclaim_deadlock test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reclaim_deadlock ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_sharding_state_deleted test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_sharding_state_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_object_stats_root_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_object_stats_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_sharding_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_sharding_state_errors ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reclaim_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reclaim_shard_ranges ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_server.TestContainerController.test_CORS_valid test.unit.proxy.test_server.TestContainerController.test_CORS_valid ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_storage_policy_index test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_storage_policy_index ... ok test.unit.obj.test_ssync.TestSsyncReplication.test_meta_file_sync test.unit.obj.test_ssync.TestSsyncReplication.test_meta_file_sync ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_storage_policy_index_empty test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_storage_policy_index_empty ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_x_syncs test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_set_x_syncs ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_object_stats_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_object_stats_shard_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reclaim_with_duplicate_names test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reclaim_with_duplicate_names ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmpnnlnd4rx/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpnnlnd4rx/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmpnnlnd4rx/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpnnlnd4rx/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:36 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0029 "-" 1824512 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0027 "-" 1824512 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0026 "-" 1824512 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0026 "-" 1824512 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0400730a0866422391117-0068c57095" "proxy-server 1824512" 0.0011 "-" 1824512 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:58455/sda1/1/a/c" "tx0400730a0866422391117-0068c57095" "container-server 1824512" 0.0010 "-" 1824512 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:38499/sdb1/1/a/c" "tx0400730a0866422391117-0068c57095" "container-server 1824512" 0.0010 "-" 1824512 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx0400730a0866422391117-0068c57095" "proxy-server 1824512" 0.0118 "-" 1824512 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx0400730a0866422391117-0068c57095" "proxy-server 1824512" 0.0084 "-" 1824512 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/37 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx0400730a0866422391117-0068c57095 - 0.0190 - - 1757769877.010976791 1757769877.029942513 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "HEAD /sdb1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx86cab25d63d5404591090-0068c57095" "proxy-server 1824512" 0.0011 "-" 1824512 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:38499/sdb1/1/a1/c1" "tx86cab25d63d5404591090-0068c57095" "container-server 1824512" 0.0009 "-" 1824512 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:58455/sda1/1/a1/c1" "tx86cab25d63d5404591090-0068c57095" "container-server 1824512" 0.0009 "-" 1824512 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx86cab25d63d5404591090-0068c57095" "proxy-server 1824512" 0.0115 "-" 1824512 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx86cab25d63d5404591090-0068c57095" "proxy-server 1824512" 0.0083 "-" 1824512 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/37 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx86cab25d63d5404591090-0068c57095 - 0.0188 - - 1757769877.031289101 1757769877.050040722 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb4d6fb3ff5234e1d974dd-0068c57095" "proxy-server 1824512" 0.0066 "-" 1824512 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:38499/sdb1/2/a/c1" "txb4d6fb3ff5234e1d974dd-0068c57095" "container-server 1824512" 0.0017 "-" 1824512 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:58455/sda1/2/a/c1" "txb4d6fb3ff5234e1d974dd-0068c57095" "container-server 1824512" 0.0010 "-" 1824512 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txb4d6fb3ff5234e1d974dd-0068c57095" "proxy-server 1824512" 0.0146 "-" 1824512 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txb4d6fb3ff5234e1d974dd-0068c57095" "proxy-server 1824512" 0.0115 "-" 1824512 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/37 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - txb4d6fb3ff5234e1d974dd-0068c57095 - 0.0286 - - 1757769877.055646896 1757769877.084254503 1 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7ba12c2abbf94866a2945-0068c57095" "proxy-server 1824512" 0.0018 "-" 1824512 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:38499/sdb1/1/a/c2" "tx7ba12c2abbf94866a2945-0068c57095" "container-server 1824512" 0.0010 "-" 1824512 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:58455/sda1/1/a/c2" "tx7ba12c2abbf94866a2945-0068c57095" "container-server 1824512" 0.0015 "-" 1824512 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx7ba12c2abbf94866a2945-0068c57095" "proxy-server 1824512" 0.0083 "-" 1824512 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:37 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx7ba12c2abbf94866a2945-0068c57095" "proxy-server 1824512" 0.0130 "-" 1824512 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/37 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - tx7ba12c2abbf94866a2945-0068c57095 - 0.0205 - - 1757769877.085608482 1757769877.106105089 2 - test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx38e75d21a5324f71b6353-0068c57095) test ERROR: ERROR 503 Trying to DELETE /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: txecd4a3962e1c4d83bb487-0068c57095) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:2000/sda (txn: tx8f749776aa1a43b4b5ec1-0068c57095)test.unit.proxy.test_server.TestContainerController.test_DELETE test.unit.proxy.test_server.TestContainerController.test_DELETE ... ok test.unit.proxy.test_server.TestContainerController.test_DELETE_backed_x_timestamp_header test.unit.proxy.test_server.TestContainerController.test_DELETE_backed_x_timestamp_header ... ok test.unit.proxy.test_server.TestContainerController.test_DELETE_x_account_headers_with_fewer_account_replicas test.unit.proxy.test_server.TestContainerController.test_DELETE_x_account_headers_with_fewer_account_replicas ... ok test.unit.proxy.test_server.TestContainerController.test_DELETE_x_account_headers_with_more_account_replicas test.unit.proxy.test_server.TestContainerController.test_DELETE_x_account_headers_with_more_account_replicas ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reconciler_sync test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reconciler_sync ... ok test.unit.proxy.test_server.TestContainerController.test_GET_account_non_existent test.unit.proxy.test_server.TestContainerController.test_GET_account_non_existent ... ok test.unit.proxy.test_server.TestContainerController.test_GET_auto_create_prefix_account_non_existent test.unit.proxy.test_server.TestContainerController.test_GET_auto_create_prefix_account_non_existent ... ok test.unit.proxy.test_server.TestContainerController.test_GET_calls_authorize test.unit.proxy.test_server.TestContainerController.test_GET_calls_authorize ... ok test.unit.proxy.test_server.TestContainerController.test_GET_no_content test.unit.proxy.test_server.TestContainerController.test_GET_no_content ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_old_style_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_old_style_root_account_container_path ... ok test.unit.proxy.test_server.TestContainerController.test_HEAD_GET test.unit.proxy.test_server.TestContainerController.test_HEAD_GET ... ok test.unit.proxy.test_server.TestContainerController.test_HEAD_calls_authorize test.unit.proxy.test_server.TestContainerController.test_HEAD_calls_authorize ... ok test.unit.proxy.test_server.TestContainerController.test_OPTIONS test.unit.proxy.test_server.TestContainerController.test_OPTIONS ... ok test.unit.proxy.test_server.TestContainerController.test_OPTIONS_get_info_drops_origin test.unit.proxy.test_server.TestContainerController.test_OPTIONS_get_info_drops_origin ... ok test.unit.proxy.test_server.TestContainerController.test_POST test.unit.proxy.test_server.TestContainerController.test_POST ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_shard_redirects_to_root_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_shard_redirects_to_root_no_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_sharding_initiated_and_required test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_sharding_initiated_and_required ... ok test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx8f749776aa1a43b4b5ec1-0068c57095) test ERROR: Container GET returning 503 for (204, 503, 503) (txn: tx8f749776aa1a43b4b5ec1-0068c57095) test ERROR: ERROR 503 Trying to DELETE /a/c/ From Container Server 10.0.0.0:2000/sda (txn: txf712bdd316a24ab0a0d2d-0068c57095) test ERROR: ERROR 503 Trying to DELETE /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: txf712bdd316a24ab0a0d2d-0068c57095) test ERROR: Container GET returning 503 for (204, 503, 503) (txn: txf712bdd316a24ab0a0d2d-0068c57095) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:2002/sdc (txn: txd41804da80344894ac526-0068c57095) test ERROR: Container GET returning 503 for (204, 404, 503) (txn: txd41804da80344894ac526-0068c57095) test ERROR: ERROR 503 Trying to DELETE /a/c/ From Container Server 10.0.0.0:2000/sda (txn: tx471332f53e0f481c8cf5f-0068c57095) test ERROR: Container GET returning 503 for (204, 404, 503) (txn: tx471332f53e0f481c8cf5f-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: txb3f51c70980c4041a992a-0068c57095) test INFO: Client disconnected on read of '/a/c' (txn: txb3f51c70980c4041a992a-0068c57095) test INFO: Client disconnected on read of '/a/c' (txn: tx3a77f6f163424c8480891-0068c57095) test INFO: Client disconnected on read of '/a/c' (txn: tx3a77f6f163424c8480891-0068c57095) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx2332bfd29ac4471e8725e-0068c57095) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: txeaffd43bccfc48e1b3726-0068c57095) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: txba9d51687e1f47edb980e-0068c57095) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: txba9d51687e1f47edb980e-0068c57095) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: txba9d51687e1f47edb980e-0068c57095) test ERROR: Container GET returning 503 for [500, 500, 500] (txn: txba9d51687e1f47edb980e-0068c57095) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: txabbdf0c1d67c450f8fe4e-0068c57095) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: txabbdf0c1d67c450f8fe4e-0068c57095) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: txabbdf0c1d67c450f8fe4e-0068c57095) test ERROR: Container GET returning 503 for [500, 500, 500] (txn: txabbdf0c1d67c450f8fe4e-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a: Network unreachable (txn: tx3857e7d63e6140aa9a1d4-0068c57095) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Network unreachable (txn: tx3857e7d63e6140aa9a1d4-0068c57095) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/a: Network unreachable (txn: tx3857e7d63e6140aa9a1d4-0068c57095) test ERROR: Account HEAD returning 503 for [] (txn: tx3857e7d63e6140aa9a1d4-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 500 Trying to POST /a/c From Container Server 10.0.0.0:2000/sda (txn: txefeabe7a111c48599cad0-0068c57095) test ERROR: ERROR 500 Trying to POST /a/c From Container Server 10.0.0.0:2000/sda (txn: tx229b18489b64462fb9a87-0068c57095) test ERROR: Container GET returning 503 for (204, 404, 503) (txn: tx229b18489b64462fb9a87-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestContainerController.test_POST_bad_metadata test.unit.proxy.test_server.TestContainerController.test_POST_bad_metadata ... ok test.unit.proxy.test_server.TestContainerController.test_POST_calls_clean_acl test.unit.proxy.test_server.TestContainerController.test_POST_calls_clean_acl ... ok test.unit.proxy.test_server.TestContainerController.test_POST_metadata test.unit.proxy.test_server.TestContainerController.test_POST_metadata ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_sharding_state_is_not_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_sharding_state_is_not_reclaimable ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_sharding_sysmeta test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_sharding_sysmeta ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_overlap_shard_range_order test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_overlap_shard_range_order ... ok test ERROR: ERROR with Container server 10.0.0.2:2002/sdc re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txdbd054b5dc5b4cfbb0424-0068c57095) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx82c3d2235a3d4eaab560d-0068c57095) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txaa5ceda9b05741c1b0401-0068c57095) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txe998308a565c4e1c8dc43-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 500 Trying to PUT /a/c From Container Server 10.0.0.1:2001/sdb (txn: txfb3e53defab24ebba2b6b-0068c57095) test ERROR: ERROR 500 Trying to PUT /a/c From Container Server 10.0.0.0:2000/sda (txn: tx526226d0901b4b7db42c3-0068c57095) test ERROR: Container GET returning 503 for (204, 404, 503) (txn: tx526226d0901b4b7db42c3-0068c57095) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: txd717c93436f448beb4884-0068c57095) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.2:1002/sdc (txn: txd717c93436f448beb4884-0068c57095) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: txd717c93436f448beb4884-0068c57095) test ERROR: Account HEAD returning 503 for [503, 503, 503] (txn: txd717c93436f448beb4884-0068c57095) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to PUT /account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txd717c93436f448beb4884-0068c57095) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to PUT /account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txd717c93436f448beb4884-0068c57095) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to PUT /account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txd717c93436f448beb4884-0068c57095) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: txd717c93436f448beb4884-0068c57095) test WARNING: Could not autocreate account '/account' (txn: txd717c93436f448beb4884-0068c57095) test INFO: autocreate account '/account' (txn: tx5bdb3227b863401693796-0068c57095) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: txb9c705a221814f4896af8-0068c57095) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: txb9c705a221814f4896af8-0068c57095) test ERROR: Account HEAD returning 503 for [503, 503] (txn: txb9c705a221814f4896af8-0068c57095) test ERROR: ERROR 503 Trying to PUT /account From Container Server 10.0.0.0:1000/sda (txn: txb9c705a221814f4896af8-0068c57095) test ERROR: ERROR 503 Trying to PUT /account From Container Server 10.0.0.1:1001/sdb (txn: txb9c705a221814f4896af8-0068c57095) test ERROR: ERROR 503 Trying to PUT /account From Container Server 10.0.0.2:1002/sdc (txn: txb9c705a221814f4896af8-0068c57095) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: txb9c705a221814f4896af8-0068c57095) test WARNING: Could not autocreate account '/account' (txn: txb9c705a221814f4896af8-0068c57095) test INFO: autocreate account '/account' (txn: tx575e240a3bcb4d30a108e-0068c57095) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx5b2bc9b7b0dd439caab02-0068c57095) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:2000/sda (txn: tx5b2bc9b7b0dd439caab02-0068c57095) test ERROR: Container GET returning 503 for (201, 503, 503) (txn: tx5b2bc9b7b0dd439caab02-0068c57095) test INFO: autocreate account '/account' (txn: tx8f6ae34fcb5240c1850e4-0068c57095) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.2:1002/sdc (txn: tx1edc32ccf5794ec4a4c96-0068c57095) test ERROR: ERROR 503 Trying to PUT /account From Container Server 10.0.0.0:1000/sda (txn: tx1edc32ccf5794ec4a4c96-0068c57095) test INFO: autocreate account '/account' (txn: tx1edc32ccf5794ec4a4c96-0068c57095) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.2:1002/sdc (txn: tx78689f0b78b74abaa0cfc-0068c57095)test.unit.proxy.test_server.TestContainerController.test_PUT test.unit.proxy.test_server.TestContainerController.test_PUT ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_autocreate_account_utf8 test.unit.proxy.test_server.TestContainerController.test_PUT_autocreate_account_utf8 ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_autocreate_account_with_sysmeta test.unit.proxy.test_server.TestContainerController.test_PUT_autocreate_account_with_sysmeta ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_backed_x_timestamp_header test.unit.proxy.test_server.TestContainerController.test_PUT_backed_x_timestamp_header ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_path test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_path ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_bad_metadata test.unit.proxy.test_server.TestContainerController.test_PUT_bad_metadata ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_calls_clean_acl test.unit.proxy.test_server.TestContainerController.test_PUT_calls_clean_acl ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_pending_file_name test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_pending_file_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_remove_objects test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_remove_objects ... ok test.unit.obj.test_ssync.TestSsyncReplication.test_no_longer_expired_object_syncs test.unit.obj.test_ssync.TestSsyncReplication.test_no_longer_expired_object_syncs ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_policy_stat_tracking test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_policy_stat_tracking ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_resolve_shard_range_states test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_resolve_shard_range_states ... ok test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx78689f0b78b74abaa0cfc-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: autocreate account '/☃' (txn: txcd8b9e573e3c4dec8a3ef-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: autocreate account '/account' (txn: tx7c6aa924fb8249e3a806d-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txb6058ee19aa14fc297ca1-0068c57095) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txbb6000956c5b4ce89b5c5-0068c57095) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx67b2d9c21fde479b9c273-0068c57095) test ERROR: ERROR with Container server 10.0.0.2:2002/sdc re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txe186e335e2a04982b0045-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.2:2002/sdc re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txbd2bc006d0514a2f88c2f-0068c57095) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to PUT /a/c/: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx1405aa8fa08a434b87a2e-0068c57095) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txc6a7f17f0e56407e942a6-0068c57095) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txc6a7f17f0e56407e942a6-0068c57095) test ERROR: Container GET returning 503 for (201, 503, 503) (txn: txc6a7f17f0e56407e942a6-0068c57095) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c/: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txf759939774ee4776b0834-0068c57095) test ERROR: ERROR with Container server 10.0.0.2:2002/sdc re: Trying to PUT /a/c/: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txf759939774ee4776b0834-0068c57095) test ERROR: Container GET returning 503 for (201, 503, 503) (txn: txf759939774ee4776b0834-0068c57095)test.unit.proxy.test_server.TestContainerController.test_PUT_connect_exceptions test.unit.proxy.test_server.TestContainerController.test_PUT_connect_exceptions ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_max_container_name_length test.unit.proxy.test_server.TestContainerController.test_PUT_max_container_name_length ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_storage_policy_property test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_storage_policy_property ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_misplaced_object_does_not_effect_container_stats test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_misplaced_object_does_not_effect_container_stats ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_max_containers_per_account test.unit.proxy.test_server.TestContainerController.test_PUT_max_containers_per_account ... ok test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_sync_merging test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_sync_merging ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_metadata test.unit.proxy.test_server.TestContainerController.test_PUT_metadata ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_batch_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_batch_reclaim ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_policy_headers test.unit.proxy.test_server.TestContainerController.test_PUT_policy_headers ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770326.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/5e9/765e3edc372f40b7685783935b6ca5e9/765e3edc372f40b7685783935b6ca5e9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770331.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/cbc/b2c1c0249d12ae9f5d221ed14d779cbc/b2c1c0249d12ae9f5d221ed14d779cbc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770336.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/8d7/3336ecfb5a79b53d71c20bf680da18d7/3336ecfb5a79b53d71c20bf680da18d7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770341.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/8c4/5c1c65bc6c81ebd669af0e0ba4c148c4/5c1c65bc6c81ebd669af0e0ba4c148c4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770346.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a9c/f8cda812c747d2a7074c1bb185fc4a9c/f8cda812c747d2a7074c1bb185fc4a9c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770351.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/271/e6cfbc5ca1565a00a661269c4a8a5271/e6cfbc5ca1565a00a661269c4a8a5271.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770356.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/8b0/d55ffe9917c51ae2e1e9173ff3aa78b0/d55ffe9917c51ae2e1e9173ff3aa78b0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770361.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/cc7/e2d371ad20db82d41841073ea9765cc7/e2d371ad20db82d41841073ea9765cc7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770366.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/442/472fca8c5eaab35e9902d595d7189442/472fca8c5eaab35e9902d595d7189442.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770371.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/986/886dc7d702da91fab1dc06bdf989f986/886dc7d702da91fab1dc06bdf989f986.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770376.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/96f/81378748d61dba6eada5eac44543f96f/81378748d61dba6eada5eac44543f96f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770381.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f1e/ef2f6e3fb85a4124aeaf95ef86d68f1e/ef2f6e3fb85a4124aeaf95ef86d68f1e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770386.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/75a/f4a47e2915dc1e82535f926634bab75a/f4a47e2915dc1e82535f926634bab75a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770391.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/1f1/75ee0aa17e5b12d69a22c8e014a161f1/75ee0aa17e5b12d69a22c8e014a161f1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770396.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a64/9201b46eeb09c9fdf5575af0c3c98a64/9201b46eeb09c9fdf5575af0c3c98a64.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770401.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/718/8d742a96394ca24c12635a0a760ae718/8d742a96394ca24c12635a0a760ae718.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770406.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e9d/eeddd4dd16e7e7636c909a88193c2e9d/eeddd4dd16e7e7636c909a88193c2e9d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770411.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/eae/a8b4d5df698e2ab6d1cdf79de03e0eae/a8b4d5df698e2ab6d1cdf79de03e0eae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770416.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/81e/e7b90af0706b2494cb57799107d8a81e/e7b90af0706b2494cb57799107d8a81e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770421.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/2c5/84a3b92395f399bae081d517adb712c5/84a3b92395f399bae081d517adb712c5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770426.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/698/42bce5dae6cb5b2f337c45c042c73698/42bce5dae6cb5b2f337c45c042c73698.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770431.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/aca/3123bcb0b8289eb1627a2fef842ccaca/3123bcb0b8289eb1627a2fef842ccaca.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770436.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/5ed/3ca52fadcf786229e783b074292605ed/3ca52fadcf786229e783b074292605ed.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770441.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/3ae/6dd71413d977c75d7f62ab20f438c3ae/6dd71413d977c75d7f62ab20f438c3ae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770446.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/814/b656dfdaeaf54c09c0ef908011e95814/b656dfdaeaf54c09c0ef908011e95814.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770451.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/821/7028558593924a73df9c9a8bde3d0821/7028558593924a73df9c9a8bde3d0821.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770456.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a71/b07d877f4d18eef9ff912076acdb0a71/b07d877f4d18eef9ff912076acdb0a71.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770461.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a37/ee0d051da9c037ff7100432294011a37/ee0d051da9c037ff7100432294011a37.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770466.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a34/432b8d264fd331590a825ae899b1ba34/432b8d264fd331590a825ae899b1ba34.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770471.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/95a/1e896678e403994dad0f1f1bcfc8695a/1e896678e403994dad0f1f1bcfc8695a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770476.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/602/200c3c2d39dd310500adcf2eec027602/200c3c2d39dd310500adcf2eec027602.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770481.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7ef/409d7f17b593b4c65f03c39c0907e7ef/409d7f17b593b4c65f03c39c0907e7ef.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770486.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/272/a5852d390b5c9eec512e1d8d5bb75272/a5852d390b5c9eec512e1d8d5bb75272.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770491.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/0f3/f1e2dd88211a58833c496871a786e0f3/f1e2dd88211a58833c496871a786e0f3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770496.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/1a6/c82233504ba41c9c0963c32d96cdf1a6/c82233504ba41c9c0963c32d96cdf1a6.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_chexor test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_chexor ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_x_account_headers_with_fewer_account_replicas test.unit.proxy.test_server.TestContainerController.test_PUT_x_account_headers_with_fewer_account_replicas ... ok test.unit.proxy.test_server.TestContainerController.test_PUT_x_account_headers_with_more_account_replicas test.unit.proxy.test_server.TestContainerController.test_PUT_x_account_headers_with_more_account_replicas ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_create_broker test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_create_broker ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_creation test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_creation ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_db_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_db_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_delete_db_does_not_clear_particular_sharding_meta test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_delete_db_does_not_clear_particular_sharding_meta ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object_multiple_encoded_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object_multiple_encoded_timestamps_using_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_delete_object test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_delete_object ... ok test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txc24cff7139d347c6a47f9-0068c57095) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:2002/sdc (txn: txc24cff7139d347c6a47f9-0068c57095) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:2000/sda (txn: txc24cff7139d347c6a47f9-0068c57095) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: txc24cff7139d347c6a47f9-0068c57095) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to PUT /a/c/: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx51773f56ad8d427ab5266-0068c57095) test ERROR: ERROR 503 Trying to PUT /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx51773f56ad8d427ab5266-0068c57095) test ERROR: ERROR 503 Trying to PUT /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx51773f56ad8d427ab5266-0068c57095) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: tx51773f56ad8d427ab5266-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: txa3baa043a6994454b3658-0068c57095) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txd81491457f234ef091859-0068c57095) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txd81491457f234ef091859-0068c57095) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txd81491457f234ef091859-0068c57095) test ERROR: Account HEAD returning 503 for [] (txn: txd81491457f234ef091859-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx023cd08ae95449f8a9d5b-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx023cd08ae95449f8a9d5b-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx023cd08ae95449f8a9d5b-0068c57095) test ERROR: Account HEAD returning 503 for [] (txn: tx023cd08ae95449f8a9d5b-0068c57095) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: txa9b4009b126648249b11a-0068c57095) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx65c3f6ddd56a4ae7b3b62-0068c57095) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx65c3f6ddd56a4ae7b3b62-0068c57095) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx65c3f6ddd56a4ae7b3b62-0068c57095)test.unit.proxy.test_server.TestContainerController.test_acc_missing_returns_404 test.unit.proxy.test_server.TestContainerController.test_acc_missing_returns_404 ... ok test.unit.proxy.test_server.TestContainerController.test_authorized_requests_when_account_not_found test.unit.proxy.test_server.TestContainerController.test_authorized_requests_when_account_not_found ... ok test.unit.proxy.test_server.TestContainerController.test_convert_index_to_name test.unit.proxy.test_server.TestContainerController.test_convert_index_to_name ... ok test.unit.proxy.test_server.TestContainerController.test_convert_policy_to_index test.unit.proxy.test_server.TestContainerController.test_convert_policy_to_index ... ok test.unit.proxy.test_server.TestContainerController.test_error_convert_index_to_name test.unit.proxy.test_server.TestContainerController.test_error_convert_index_to_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_double_check_trailing_delimiter test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_double_check_trailing_delimiter ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object_multiple_encoded_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object_multiple_encoded_timestamps_using_memory ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_double_check_trailing_delimiter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_double_check_trailing_delimiter_non_slash ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reverse_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_reverse_prefix_delim ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object_multiple_explicit_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object_multiple_explicit_timestamps_using_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_root_account_container_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object_multiple_explicit_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_put_object_multiple_explicit_timestamps_using_memory ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_save_and_load_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_save_and_load_record_from_pending_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reclaim ... ok test ERROR: Account HEAD returning 503 for [] (txn: tx65c3f6ddd56a4ae7b3b62-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx0ef506f00e0c4c209de2f-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx0ef506f00e0c4c209de2f-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx0ef506f00e0c4c209de2f-0068c57095) test ERROR: Account HEAD returning 503 for [] (txn: tx0ef506f00e0c4c209de2f-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: tx5f6b45a7d2f24f409b3ec-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: Could not translate X-Backend-Storage-Policy-Index ('-1') from '/a' to policy (txn: tx8606204adca34625b9801-0068c57095) test ERROR: Could not translate X-Backend-Storage-Policy-Index ('-1') from '/a/c' to policy (txn: tx8606204adca34625b9801-0068c57095) test INFO: Client disconnected on read of '/a/c' (txn: tx8606204adca34625b9801-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: tx2596ea0d17a947f08cec0-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: txde08780fdbe2465fa18ea-0068c57095) test INFO: Client disconnected on read of '/a/c' (txn: txde08780fdbe2465fa18ea-0068c57095) test INFO: Client disconnected on read of '/a/c/' (txn: txde08780fdbe2465fa18ea-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: tx2ccba75cfa0f48eea0b79-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx2ccba75cfa0f48eea0b79-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx2ccba75cfa0f48eea0b79-0068c57095) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx2ccba75cfa0f48eea0b79-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: tx53a8f3a0ed0841dcad345-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx53a8f3a0ed0841dcad345-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx53a8f3a0ed0841dcad345-0068c57095) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx53a8f3a0ed0841dcad345-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: txcbf62160ddbd40ada24eb-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: txcbf62160ddbd40ada24eb-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: txcbf62160ddbd40ada24eb-0068c57095) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: txcbf62160ddbd40ada24eb-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: txb4badee394fe4becb885a-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: txb4badee394fe4becb885a-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: txb4badee394fe4becb885a-0068c57095) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: txb4badee394fe4becb885a-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: tx41cb49cd1e284e1c8fa3d-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx41cb49cd1e284e1c8fa3d-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx41cb49cd1e284e1c8fa3d-0068c57095) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx41cb49cd1e284e1c8fa3d-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: tx07f84d37b8934d6987f49-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx07f84d37b8934d6987f49-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx07f84d37b8934d6987f49-0068c57095) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx07f84d37b8934d6987f49-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: tx604f442e05a84eb9aed97-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx604f442e05a84eb9aed97-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx604f442e05a84eb9aed97-0068c57095) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx604f442e05a84eb9aed97-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: tx89bf7b640c2b4df9af2a2-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx89bf7b640c2b4df9af2a2-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx89bf7b640c2b4df9af2a2-0068c57095) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx89bf7b640c2b4df9af2a2-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: txe33c2c02be72453d8690a-0068c57095) test ERROR: Node will be error limited for 60.00s: 10.0.0.0:2000/sda (txn: txe33c2c02be72453d8690a-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txe33c2c02be72453d8690a-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: txe33c2c02be72453d8690a-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: txe33c2c02be72453d8690a-0068c57095) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: txe33c2c02be72453d8690a-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx3e291bc353784cdd86a32-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx3e291bc353784cdd86a32-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx3e291bc353784cdd86a32-0068c57095) test ERROR: Container GET returning 503 for [503, 503] (txn: tx3e291bc353784cdd86a32-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx81f77d4129e44e82967f1-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx81f77d4129e44e82967f1-0068c57095) test ERROR: Node will be error limited for 60.00s: 10.0.0.1:2001/sdb (txn: tx81f77d4129e44e82967f1-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx81f77d4129e44e82967f1-0068c57095) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx81f77d4129e44e82967f1-0068c57095) test ERROR: Node will be error limited for 60.00s: 10.0.0.2:2002/sdc (txn: tx81f77d4129e44e82967f1-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx81f77d4129e44e82967f1-0068c57095) test ERROR: Container GET returning 503 for [503, 503] (txn: tx81f77d4129e44e82967f1-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx987e5d901a9242c482e91-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx987e5d901a9242c482e91-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx987e5d901a9242c482e91-0068c57095) test ERROR: Container GET returning 503 for [] (txn: tx987e5d901a9242c482e91-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx976b6705c1d242a398641-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx976b6705c1d242a398641-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx976b6705c1d242a398641-0068c57095) test ERROR: Container GET returning 503 for [] (txn: tx976b6705c1d242a398641-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx6f8754e55dc54fe489bfa-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx6f8754e55dc54fe489bfa-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx6f8754e55dc54fe489bfa-0068c57095) test ERROR: Container GET returning 503 for [] (txn: tx6f8754e55dc54fe489bfa-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx75a13f7a940145098fa29-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx75a13f7a940145098fa29-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx75a13f7a940145098fa29-0068c57095) test ERROR: Container GET returning 503 for [] (txn: tx75a13f7a940145098fa29-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txaea4bdda858b4c7db9346-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txaea4bdda858b4c7db9346-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txaea4bdda858b4c7db9346-0068c57095) test ERROR: Container GET returning 503 for [] (txn: txaea4bdda858b4c7db9346-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx4b689d80608e43d1a964b-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx4b689d80608e43d1a964b-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx4b689d80608e43d1a964b-0068c57095) test ERROR: Container GET returning 503 for [] (txn: tx4b689d80608e43d1a964b-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txc25dfff1f19246b4a285a-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txc25dfff1f19246b4a285a-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txc25dfff1f19246b4a285a-0068c57095) test ERROR: Container GET returning 503 for [] (txn: txc25dfff1f19246b4a285a-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txb5c2b6fbfc1742e69e6df-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txb5c2b6fbfc1742e69e6df-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txb5c2b6fbfc1742e69e6df-0068c57095) test ERROR: Container GET returning 503 for [] (txn: txb5c2b6fbfc1742e69e6df-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx7bbcfffdd4c74a4cbaa8d-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx7bbcfffdd4c74a4cbaa8d-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx7bbcfffdd4c74a4cbaa8d-0068c57095) test ERROR: Container GET returning 503 for [] (txn: tx7bbcfffdd4c74a4cbaa8d-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txbb0836b05a6142c58de07-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txbb0836b05a6142c58de07-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txbb0836b05a6142c58de07-0068c57095) test ERROR: Container GET returning 503 for [] (txn: txbb0836b05a6142c58de07-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txd46c09e0e50742d796cab-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txd46c09e0e50742d796cab-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txd46c09e0e50742d796cab-0068c57095) test ERROR: Container GET returning 503 for [] (txn: txd46c09e0e50742d796cab-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx863ce4ed4d9a4f2abf5c2-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx863ce4ed4d9a4f2abf5c2-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx863ce4ed4d9a4f2abf5c2-0068c57095) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: tx863ce4ed4d9a4f2abf5c2-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txe93556605eee48699cdba-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txe93556605eee48699cdba-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txe93556605eee48699cdba-0068c57095) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: txe93556605eee48699cdba-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx2e249755277945cfb0045-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx2e249755277945cfb0045-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx2e249755277945cfb0045-0068c57095) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: tx2e249755277945cfb0045-0068c57095) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx05356338feae4790abb94-0068c57095) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx05356338feae4790abb94-0068c57095) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx05356338feae4790abb94-0068c57095) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: tx05356338feae4790abb94-0068c57095) test INFO: Client disconnected on read of '/a/c' (txn: tx154443b9c8954c5187bf2-0068c57095) test INFO: Client disconnected on read of '/a/c/' (txn: tx154443b9c8954c5187bf2-0068c57095) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txe68615533bc544328ce6f-0068c57095) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txe68615533bc544328ce6f-0068c57095) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txe68615533bc544328ce6f-0068c57095) test ERROR: Account HEAD returning 503 for [] (txn: txe68615533bc544328ce6f-0068c57095) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx31d9436f168f4506b307b-0068c57095)test.unit.proxy.test_server.TestContainerController.test_error_limiting test.unit.proxy.test_server.TestContainerController.test_error_limiting ... ok test.unit.proxy.test_server.TestContainerController.test_no_convert_index_to_name_when_container_not_found test.unit.proxy.test_server.TestContainerController.test_no_convert_index_to_name_when_container_not_found ... ok test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: GET listing from 3 shards for: /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c_sub_juice', lower='ham', upper='juice') a/c_sub_juice with {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Get listing from /v1/a/c_sub_juice?format=json&limit=9960&marker=h&end_marker=juice%00 {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Getting listing part 1 from shard Namespace(name='a/c_sub_lemon', lower='juice', upper='lemon') a/c_sub_lemon with {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Get listing from /v1/a/c_sub_lemon?format=json&limit=9958&marker=j&end_marker=lemon%00 {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Found 2 objects in shard (state=unsharded), total = 4 (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_pie', lower='lemon', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'object'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9956&marker=l&end_marker=pie%00 {'X-Backend-Record-Type': 'object'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Found 4 objects in shard (state=sharding), total = 8 (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Found 8 objects in shard (state=sharding), total = 48 (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Setting object count to 1072 (txn: tx0c439ff2d127418bbb224-0068c57092) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txa8ee2d53b9ac4bff93b47-0068c57093) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'auto'} (txn: txa8ee2d53b9ac4bff93b47-0068c57093) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=10000&marker=&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: txa8ee2d53b9ac4bff93b47-0068c57093) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_b?format=json&limit=10000&marker=&end_marker=b%00&states=listing: 404 (txn: txa8ee2d53b9ac4bff93b47-0068c57093) test ERROR: Aborting listing from shards due to bad response: [404] (txn: txa8ee2d53b9ac4bff93b47-0068c57093) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 5 shards for: /v1/a/c?delimiter=%2F&format=json&states=listing (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ha-ppy', lower='', upper='ha/ppy') .shards_a/c_ha-ppy with {'X-Backend-Record-Type': 'auto'} (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Get listing from /v1/.shards_a/c_ha-ppy?delimiter=%2F&format=json&limit=10000&marker=&end_marker=ha%2Fppy%00 {'X-Backend-Record-Type': 'auto'} (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_ham', lower='ha/ptic', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Get listing from /v1/.shards_a/c_ham?delimiter=%2F&format=json&limit=9998&marker=ha%2F&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Found 0 objects in shard (state=unsharded), total = 2 (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Get listing from /v1/.shards_a/c_pie?delimiter=%2F&format=json&limit=9998&marker=ha%2F&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Found 0 objects in shard (state=unsharded), total = 2 (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Get listing from /v1/.shards_a/c_?delimiter=%2F&format=json&limit=9998&marker=ha%2F&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Found 1 objects in shard (state=unsharded), total = 3 (txn: tx728a04a8168b478f92771-0068c57094) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 6 shards for: /v1/a/c?delimiter=%2F&reverse=on&format=json&states=listing (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Get listing from /v1/.shards_a/c_?delimiter=%2F&reverse=on&format=json&limit=10000&marker=&end_marker=pie {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Found 1 objects in shard (state=unsharded), total = 1 (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095)test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_delimiter_reverse_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_delimiter_reverse_no_memcache ... ok test.unit.obj.test_ssync.TestSsyncReplication.test_no_longer_expired_object_syncs_meta test.unit.obj.test_ssync.TestSsyncReplication.test_no_longer_expired_object_syncs_meta ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_empty test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_empty ... ok test.unit.proxy.test_server.TestContainerController.test_node_read_timeout_no_retry_to_container test.unit.proxy.test_server.TestContainerController.test_node_read_timeout_no_retry_to_container ... ok fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift INFO: - - 13/Sep/2025/13/24/10 GET /cont/obj HTTP/1.0 200 - some_agent - - 19 - - - 0.0003 - - 1757769850.453584909 1757769850.453884602 - - fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift INFO: - - 13/Sep/2025/13/24/10 GET /cont/obj HTTP/1.0 503 - some_agent - - 19 - - - 0.0002 - - 1757769850.464083195 1757769850.464312553 - - fake-swift INFO: - - 13/Sep/2025/13/24/10 GET /cont/obj HTTP/1.0 503 - some_agent - - 19 - - - 0.0002 - - 1757769850.464962244 1757769850.465119600 - - fake-swift INFO: - - 13/Sep/2025/13/24/10 GET /cont/obj HTTP/1.0 503 - some_agent - - 19 - - - 0.0001 - - 1757769850.465485334 1757769850.465609789 - - test DEBUG: Before request test DEBUG: Inside of request (txn: foo) test DEBUG: After request fake-swift DEBUG: Labeled statsd mode: disabled (fake-swift) fake-swift INFO: - - 13/Sep/2025/13/24/10 DELETE /container HTTP/1.0 409 - some_agent - - 19 - - - 0.0001 - - 1757769850.478384972 1757769850.478480577 - - user quit No .MockServer object at 0xffffadfbacf0> running .MockServerFactory.MockServer object at 0xffffae434ad0> (1) appears to have stopped No .MockServerFactory.MockServer object at 0xffffae00a350> running No .MockServerFactory.MockServer object at 0xffffb15bead0> running Waited 15 seconds for .MockServerFactory.MockServer object at 0xffffadfd1a70> to die; giving up Waited 15 seconds for .MockServerFactory.MockServer object at 0xffffae434d70> to die; killing Signal .MockServerFactory.MockServer object at 0xffffae434d70> pid: None signal: 9 Waited 15 seconds for .MockServerFactory.MockServer object at 0xffffae00ad50> to die; killing Signal .MockServerFactory.MockServer object at 0xffffae00ad50> pid: None signal: 9 Waited 15 seconds for .MockServerFactory.MockServer object at 0xffffb15bead0> to die; killing Signal .MockServerFactory.MockServer object at 0xffffb15bead0> pid: None signal: 9 test WARNING: boom test INFO: Begin container audit "once" mode test DEBUG: Audit passed for /tmp/tmp0b8a9_a5/sda/containers/0/0/0/test.db test INFO: Container audit "once" mode completed: 0.01s test ERROR: Problem finding shard upper in '/tmp/tmpx7mbgw1a/test_container.db': : LockTimeout (Nones) test ERROR: Problem finding shard upper in '/tmp/tmpx7mbgw1a/test_container.db': : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2498, in find_shard_ranges next_shard_upper = sub_broker._get_next_shard_range_upper( shard_size, last_shard_upper) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect sqlite3.OperationalError test DEBUG: Unlinked retiring db '/tmp/tmptiz2ru2_/containers/part/suffix/hash/container.db' test WARNING: Unexpected db files will be ignored: ['/tmp/tmptiz2ru2_/containers/part/suffix/hash/container.db'] Container 'a/c' cannot be set to sharded state while in unsharded state Container 'a/c' cannot be set to sharding state: missing epoch test.unit.proxy.test_server.TestContainerController.test_response_get_accept_ranges_header test.unit.proxy.test_server.TestContainerController.test_response_get_accept_ranges_header ... ok Container 'a/c' cannot be set to sharding state while in sharding state sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770501.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ca0/327a2bdad82055d011350528dda62ca0/327a2bdad82055d011350528dda62ca0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770506.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/1f2/2350dba591b57dfe3366e1e48e0951f2/2350dba591b57dfe3366e1e48e0951f2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770511.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/df7/2327b15e58c69b71da0422a34777bdf7/2327b15e58c69b71da0422a34777bdf7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770516.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/0b4/39597c3b239e3e8f67cec929404430b4/39597c3b239e3e8f67cec929404430b4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770521.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e52/a3e501e49d56c5f8470106b92b825e52/a3e501e49d56c5f8470106b92b825e52.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770526.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/3db/91ab9d20ff4dbc6a5eebcc98a8c813db/91ab9d20ff4dbc6a5eebcc98a8c813db.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770531.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/18e/8eb3450da06d921e7b2c128f28a7c18e/8eb3450da06d921e7b2c128f28a7c18e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770536.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ae0/579603b4cf791f384dbc3476b5a79ae0/579603b4cf791f384dbc3476b5a79ae0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770541.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7c0/ba9cc9f4c165416a2e6e40dd833fb7c0/ba9cc9f4c165416a2e6e40dd833fb7c0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770546.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/218/8b5027b46dc064dff0241f2c17c31218/8b5027b46dc064dff0241f2c17c31218.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770551.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/4b8/0acfe1a1ef7b4b5fd759e8b9e22f94b8/0acfe1a1ef7b4b5fd759e8b9e22f94b8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770556.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/913/6815be54308236c2796acf9980f1e913/6815be54308236c2796acf9980f1e913.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770561.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/fde/6c520a9e851a492bfac04c8ee97a1fde/6c520a9e851a492bfac04c8ee97a1fde.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770566.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/3d6/a8031d7dd179bb37d66863a1e57b83d6/a8031d7dd179bb37d66863a1e57b83d6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770571.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/252/62afa42cd1b7bce1bec7f3cf75724252/62afa42cd1b7bce1bec7f3cf75724252.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770576.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/6f3/e7f0bb3be6eb06ca99772578eb84b6f3/e7f0bb3be6eb06ca99772578eb84b6f3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770581.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/bd1/77f781e41cec0571a79b560654097bd1/77f781e41cec0571a79b560654097bd1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770586.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/4f2/9bf4db91773c51c3cbb08fdd2f77f4f2/9bf4db91773c51c3cbb08fdd2f77f4f2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770591.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/179/2ca7adfa44bbab3716f500c44d26b179/2ca7adfa44bbab3716f500c44d26b179.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770596.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/81d/1a6a53fef5ebaabbb01777de1816981d/1a6a53fef5ebaabbb01777de1816981d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770601.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/645/8967ba46f952108a5894f9a726cc6645/8967ba46f952108a5894f9a726cc6645.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770606.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d14/5a5c98b1cddbf2e0d5bcedf931dacd14/5a5c98b1cddbf2e0d5bcedf931dacd14.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770611.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/c3d/9cb6693a33e249a947308d99d748bc3d/9cb6693a33e249a947308d99d748bc3d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770616.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/117/a471e820577802a49ac344c6d73b1117/a471e820577802a49ac344c6d73b1117.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770621.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/dca/df6a30d2b7f1514bea59ac6591616dca/df6a30d2b7f1514bea59ac6591616dca.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770626.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/208/41fb9151aa8f00967d7d3b0627d32208/41fb9151aa8f00967d7d3b0627d32208.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770631.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/1fe/31b863ceed5ffb4f59bd68976cc8a1fe/31b863ceed5ffb4f59bd68976cc8a1fe.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770636.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/715/df2589f96c32f11da23f070352d3e715/df2589f96c32f11da23f070352d3e715.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770641.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/0cc/7331956a41c021fd4e9f81c60d98f0cc/7331956a41c021fd4e9f81c60d98f0cc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770646.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e03/7445cc1ad6e942590fe7fdbe05be7e03/7445cc1ad6e942590fe7fdbe05be7e03.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770651.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/101/0a7b31f3347176395b0f249035c55101/0a7b31f3347176395b0f249035c55101.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770656.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/db2/5adf917c6f87c59c4f6f59642c2eadb2/5adf917c6f87c59c4f6f59642c2eadb2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770661.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/467/4d8b23eaded9c9d2f18cb4019a3d5467/4d8b23eaded9c9d2f18cb4019a3d5467.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770666.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/4df/efc5b898828a42fa49c5eee9045c54df/efc5b898828a42fa49c5eee9045c54df.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770671.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/23c/c6fcffa014d134a1c62cc761a9db123c/c6fcffa014d134a1c62cc761a9db123c.dbContainer 'a/c' cannot be set to sharded state while in sharded state test.unit.proxy.test_server.TestContainerController.test_response_head_accept_ranges_header test.unit.proxy.test_server.TestContainerController.test_response_head_accept_ranges_header ... ok test.unit.proxy.test_server.TestContainerController.test_transfer_headers test.unit.proxy.test_server.TestContainerController.test_transfer_headers ... ok test.unit.obj.test_ssync.TestSsyncReplication.test_nothing_to_sync test.unit.obj.test_ssync.TestSsyncReplication.test_nothing_to_sync ... ok test.unit.proxy.test_server.TestContainerController.test_unauthorized_requests_when_account_not_found test.unit.proxy.test_server.TestContainerController.test_unauthorized_requests_when_account_not_found ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_empty_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_empty_old_style_shard_container ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_default_proxy_config test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_default_proxy_config ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_db_states test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_db_states ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_log_name test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_log_name ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_bad_section_name test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_bad_section_name ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_equality test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_equality ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_inherits_defaults test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_inherits_defaults ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_sharded_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_sharded_state_errors ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_invalid_read_affinity_value test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_invalid_read_affinity_value ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_empty_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_empty_shard_container ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_invalid_sorting_method_value test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_invalid_sorting_method_value ... ok test.unit.obj.test_ssync.TestSsyncReplication.test_sync test.unit.obj.test_ssync.TestSsyncReplication.test_sync ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_enable_sharding test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_enable_sharding ... ok test.unit.obj.test_updater.TestObjectUpdaterFunctions.test_split_update_path test.unit.obj.test_updater.TestObjectUpdaterFunctions.test_split_update_path ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_invalid_write_affinity_node_count_value test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_invalid_write_affinity_node_count_value ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_exception test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_exception ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_cache_not_available test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_cache_not_available ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_invalid_write_affinity_value test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_invalid_write_affinity_value ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_cache_reading test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_cache_reading ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_cache_recheck_time_zero test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_cache_recheck_time_zero ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_cache_writing test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_cache_writing ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_sharding_state test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_sharding_state ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_empty_body test.unit.proxy.controllers.test_obj.TestGetUpdateShard.test_get_update_shard_empty_body ... ok test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx31d9436f168f4506b307b-0068c57095) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx31d9436f168f4506b307b-0068c57095) test ERROR: Account HEAD returning 503 for [] (txn: tx31d9436f168f4506b307b-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: tx07244f8ab9cc4bdf81813-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: tx7b7f4cbcfa62477680f81-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: txff307ea94e0a4153ad381-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 1}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': 3, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=100', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': 3, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_none_configured test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_none_configured ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_one_configured test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_one_configured ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_overrides_default_affinity test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_overrides_default_affinity ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_overrides_default_concurrency_settings test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_overrides_default_concurrency_settings ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_overrides_default_sorting_method test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_overrides_default_sorting_method ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_section_name_inherits_from_app_section_name test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_section_name_inherits_from_app_section_name ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_sets_timing_sorting_method test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_sets_timing_sorting_method ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_warns_about_sorting_method_mismatch test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_warns_about_sorting_method_mismatch ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_sharding_state_deleted test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_sharding_state_deleted ... ok test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:36] "SSYNC /dev/9 HTTP/1.1" 200 317 0.119224 test-ssync-receiver INFO: (1824514) wsgi starting up on http://127.0.0.1:37799 test-ssync-receiver INFO: (1824514) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 52768) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:36] "SSYNC /dev/9 HTTP/1.1" 200 314 0.118440 test-ssync-receiver INFO: (1824514) wsgi starting up on http://127.0.0.1:40615 test-ssync-receiver INFO: (1824514) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 42894) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 8, available: 8, sent: 6, deletable: 8 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:37] "SSYNC /dev/9 HTTP/1.1" 200 498 0.161154 test-ssync-receiver INFO: (1824514) wsgi starting up on http://127.0.0.1:45493 test-ssync-receiver INFO: (1824514) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 39204) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:37] "SSYNC /dev/9 HTTP/1.1" 200 317 0.098593 test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 39206) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:37] "SSYNC /dev/9 HTTP/1.1" 200 316 0.100424 test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 39214) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:37] "SSYNC /dev/9 HTTP/1.1" 200 316 0.115618 test-ssync-receiver INFO: (1824514) wsgi starting up on http://127.0.0.1:56785 test-ssync-receiver INFO: (1824514) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 47144) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:37] "SSYNC /dev/9 HTTP/1.1" 200 316 0.102461 test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 47150) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:37] "SSYNC /dev/9 HTTP/1.1" 200 316 0.097884 test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 47158) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:37] "SSYNC /dev/9 HTTP/1.1" 200 316 0.113706 test-ssync-receiver INFO: (1824514) wsgi starting up on http://127.0.0.1:52609 test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 45710) test-ssync-receiver INFO: (1824514) wsgi exited, is_accepting=True test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 0, sent: 0, deletable: 0 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:37] "SSYNC /dev/9 HTTP/1.1" 200 276 0.107439 test-ssync-receiver INFO: (1824514) wsgi starting up on http://127.0.0.1:56159 test-ssync-receiver INFO: (1824514) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: (1824514) accepted ('127.0.0.1', 53398) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 7, available: 7, sent: 5, deletable: 7 proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:38] "SSYNC /dev/9 HTTP/1.1" 200 465 0.121590 test-ssync-receiver INFO: (1824514) wsgi exited, is_accepting=True proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=x1_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx34fe26196b03474698168-0068c57096) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Problem with container shard listing response from /v1/a/c?format=json&states=updating: JSONDecodeError('Expecting value: line 1 column 1 (char 0)') (txn: txf7c6a649ed53455aace1e-0068c57096) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_cache_not_available test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_cache_not_available ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_cache_reading test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_cache_reading ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_cache_recheck_time_zero test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_cache_recheck_time_zero ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_cache_writing test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_cache_writing ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_empty_body test.unit.proxy.controllers.test_obj.TestGetUpdateShardUTF8.test_get_update_shard_empty_body ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770676.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f8c/5a5ef3ac2516e8cad6459bc8b0191f8c/5a5ef3ac2516e8cad6459bc8b0191f8c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770681.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/46b/ac7f974d42559cad2efb9200c0a3946b/ac7f974d42559cad2efb9200c0a3946b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770686.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/607/44d0ecc0855dbb91f3009fbe72b29607/44d0ecc0855dbb91f3009fbe72b29607.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770691.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a9f/c18499be67f6a5800226bc8b8e346a9f/c18499be67f6a5800226bc8b8e346a9f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770696.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/762/d787dc1295eabdd41f9eec07195fe762/d787dc1295eabdd41f9eec07195fe762.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770701.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/8d7/c397e8c84a771e9e1658bce1496dd8d7/c397e8c84a771e9e1658bce1496dd8d7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770706.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/48d/d40ddf25084d44d9cabf66487b64a48d/d40ddf25084d44d9cabf66487b64a48d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770711.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/dd6/5642b45105b809e7485a1ad22aaf4dd6/5642b45105b809e7485a1ad22aaf4dd6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770716.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ec3/74d0c4c4ded3f89ca1448253bf65bec3/74d0c4c4ded3f89ca1448253bf65bec3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770721.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a8d/b652d3e513050aa0b46afec71e506a8d/b652d3e513050aa0b46afec71e506a8d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770726.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/28f/d48e402c0a51e3148dd9263620c3528f/d48e402c0a51e3148dd9263620c3528f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770731.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7f1/f4777d9b6f374026c3e4e588da9537f1/f4777d9b6f374026c3e4e588da9537f1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770736.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/925/1d786f11471002c35e5680158fcf8925/1d786f11471002c35e5680158fcf8925.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770741.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e88/3456e7dc6ba7d383863713af41308e88/3456e7dc6ba7d383863713af41308e88.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770746.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/9c3/4297547afe9ee70245520dbc474909c3/4297547afe9ee70245520dbc474909c3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770751.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/df2/dc2d930c342567af440f8fb2a8c78df2/dc2d930c342567af440f8fb2a8c78df2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770756.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e36/2d57d9856a21c8553dc3fbf46e02fe36/2d57d9856a21c8553dc3fbf46e02fe36.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770761.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/10c/ea89ab45c1c262822a76f3b3fe68610c/ea89ab45c1c262822a76f3b3fe68610c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770766.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/de5/4caf30a65af22ae4bf812912022b4de5/4caf30a65af22ae4bf812912022b4de5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770771.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f76/3f3f529011037a073afb31b4da739f76/3f3f529011037a073afb31b4da739f76.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770776.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/20d/f1c641878d4ea8e0ad70b00ae062620d/f1c641878d4ea8e0ad70b00ae062620d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770781.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/8ab/ac54b191dcb66ffd9fc54125f156d8ab/ac54b191dcb66ffd9fc54125f156d8ab.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770786.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f32/eb9994d1a6d5781fb73bd593e204cf32/eb9994d1a6d5781fb73bd593e204cf32.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770791.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/4e2/2f4dcb10e1f5446e836f1e91fdce84e2/2f4dcb10e1f5446e836f1e91fdce84e2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770796.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/fd6/9afbcfe91366b1eebb870932b5acefd6/9afbcfe91366b1eebb870932b5acefd6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770801.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7b0/fbbd8da18e93e60cd75ab130aa1297b0/fbbd8da18e93e60cd75ab130aa1297b0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770806.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f81/5fb9f5266f07744860b3c3a7ae525f81/5fb9f5266f07744860b3c3a7ae525f81.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770811.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/86c/cae3c53210803730e644ac82faa3886c/cae3c53210803730e644ac82faa3886c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770816.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7cb/006f9a01b1280e915be1b9e4756477cb/006f9a01b1280e915be1b9e4756477cb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770821.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/37b/8c383556313a1b1c3e0c7bf06124037b/8c383556313a1b1c3e0c7bf06124037b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770826.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/467/dcfd0c85144e1183bda6fa811be24467/dcfd0c85144e1183bda6fa811be24467.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770831.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/822/1d603cd6d6592e6fa56c5df5afed2822/1d603cd6d6592e6fa56c5df5afed2822.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770836.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/fae/5bfa840ad3d70abf6e4fd609286a9fae/5bfa840ad3d70abf6e4fd609286a9fae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770841.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/253/372430ae35c92581ab143e0170f1d253/372430ae35c92581ab143e0170f1d253.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770846.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e24/9834ec1dae3034c125c5af4f6e2f3e24/9834ec1dae3034c125c5af4f6e2f3e24.db test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=100', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': 4, 'rebalance_missing_suppression_count': 2, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=10', 'write_affinity': 'r2', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': 2, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=100', 'write_affinity': 'r1', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': 3, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': 'r3', 'write_affinity_node_count': '4', 'write_affinity_handoff_delete_count': 4, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': True, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.6, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': True, 'concurrency_timeout': 0.3, 'concurrent_ec_extra_requests': 1}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=100', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r2=10', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r1=100', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test WARNING: sorting_method is set to 'timing', not 'affinity'; (default) read_affinity setting will have no effect. test WARNING: sorting_method is set to 'timing', not 'affinity'; policy 0 (nulo) read_affinity setting will have no effect. test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=10', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r2=10', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_warns_override_sorting_method_mismatch test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_warns_override_sorting_method_mismatch ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_with_DEFAULT_options test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_with_DEFAULT_options ... ok test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_with_unknown_policy test.unit.proxy.test_server.TestProxyServerConfigStringLoading.test_per_policy_conf_with_unknown_policy ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_find_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_find_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_find_shard_ranges_errors test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_find_shard_ranges_errors ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_find_shard_ranges_with_misplaced_objects test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_find_shard_ranges_with_misplaced_objects ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_sharding_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_sharding_state_errors ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_sharded_shard_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_sharded_shard_with_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_brokers test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_brokers ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_db_state test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_db_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_storage_policy_index test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_storage_policy_index ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info_is_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info_no_stale_reads test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info_no_stale_reads ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_storage_policy_index_empty test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_storage_policy_index_empty ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info_sharding_states test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info_sharding_states ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=%E1%88%B41_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx3617daaf4994461daa121-0068c57096) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Problem with container shard listing response from /v1/a/c?format=json&states=updating: JSONDecodeError('Expecting value: line 1 column 1 (char 0)') (txn: tx312f0eba56154a36932a1-0068c57096) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmp8tmtxifj/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp8tmtxifj/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmp8tmtxifj/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp8tmtxifj/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a" 201 - "-" "test" "-" 0.0029 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a" 201 - "-" "test" "-" 0.0943 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a1" 201 - "-" "test" "-" 0.0026 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a1" 201 - "-" "test" "-" 0.0026 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa5796bf5ef7f44d985e90-0068c57096" "proxy-server 1824514" 0.0011 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://127.0.0.1:40479/sdb1/0/a/c" "txa5796bf5ef7f44d985e90-0068c57096" "container-server 1824514" 0.0010 "-" 1824514 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://127.0.0.1:59237/sda1/0/a/c" "txa5796bf5ef7f44d985e90-0068c57096" "container-server 1824514" 0.0011 "-" 1824514 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://localhost/v1/a/c" "txa5796bf5ef7f44d985e90-0068c57096" "proxy-server 1824514" 0.0125 "-" 1824514 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://localhost/v1/a/c" "txa5796bf5ef7f44d985e90-0068c57096" "proxy-server 1824514" 0.0088 "-" 1824514 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/c HTTP/1.0 201 - - t - - - txa5796bf5ef7f44d985e90-0068c57096 - 0.0200 - - 1757769878.320505619 1757769878.340516329 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sda1/0/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx874f13dd670241209d58f-0068c57096" "proxy-server 1824514" 0.0011 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a1/c1" 201 - "PUT http://127.0.0.1:59237/sda1/2/a1/c1" "tx874f13dd670241209d58f-0068c57096" "container-server 1824514" 0.0011 "-" 1824514 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a1/c1" 201 - "PUT http://127.0.0.1:40479/sdb1/2/a1/c1" "tx874f13dd670241209d58f-0068c57096" "container-server 1824514" 0.0010 "-" 1824514 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx874f13dd670241209d58f-0068c57096" "proxy-server 1824514" 0.0078 "-" 1824514 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx874f13dd670241209d58f-0068c57096" "proxy-server 1824514" 0.0125 "-" 1824514 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx874f13dd670241209d58f-0068c57096 - 0.0198 - - 1757769878.341837645 1757769878.361634016 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7d31e316a48e4a76b289d-0068c57096" "proxy-server 1824514" 0.0018 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://127.0.0.1:40479/sdb1/0/a/c1" "tx7d31e316a48e4a76b289d-0068c57096" "container-server 1824514" 0.0016 "-" 1824514 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://127.0.0.1:59237/sda1/0/a/c1" "tx7d31e316a48e4a76b289d-0068c57096" "container-server 1824514" 0.0013 "-" 1824514 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx7d31e316a48e4a76b289d-0068c57096" "proxy-server 1824514" 0.0153 "-" 1824514 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx7d31e316a48e4a76b289d-0068c57096" "proxy-server 1824514" 0.0120 "-" 1824514 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx7d31e316a48e4a76b289d-0068c57096 - 0.0238 - - 1757769878.363049984 1757769878.386813402 1 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7851851301b64f289f393-0068c57096" "proxy-server 1824514" 0.0019 "-" 1824514 -test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info_stale_read_ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_info_stale_read_ok ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_x_syncs test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_set_x_syncs ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770851.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/b8b/984a94a2931696510655d5f02cc44b8b/984a94a2931696510655d5f02cc44b8b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770856.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a43/bacd03102854b611938ade58aa5c7a43/bacd03102854b611938ade58aa5c7a43.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770861.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/231/4466ee2f2835f3542aed0e85a59ce231/4466ee2f2835f3542aed0e85a59ce231.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770866.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/67f/23522bb7f7993261ad47f62ebdd2c67f/23522bb7f7993261ad47f62ebdd2c67f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770871.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/239/00b67bd171d65b4041e812a112b8d239/00b67bd171d65b4041e812a112b8d239.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770876.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/15a/91dc478fa231b7d716b817d1d5ce515a/91dc478fa231b7d716b817d1d5ce515a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770881.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/2d5/3d93166f075614498816ac1837c1b2d5/3d93166f075614498816ac1837c1b2d5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770886.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/4ea/d25b87099126305b05a0d984a7ab54ea/d25b87099126305b05a0d984a7ab54ea.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770891.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/633/060c4de3a5821fbd6378d99e079a0633/060c4de3a5821fbd6378d99e079a0633.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770896.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/e84/1aff2195b028b97033606d3efd7a6e84/1aff2195b028b97033606d3efd7a6e84.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770901.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d39/4928d6706a2894748c491c427f5d6d39/4928d6706a2894748c491c427f5d6d39.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770906.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/2ec/99e46c557056c75f510479d3e0ad72ec/99e46c557056c75f510479d3e0ad72ec.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770911.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7e8/cc24d05c145e782f6228716f174aa7e8/cc24d05c145e782f6228716f174aa7e8.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770916.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/8e5/4ddfc1bc6ee169d37f361e218e15f8e5/4ddfc1bc6ee169d37f361e218e15f8e5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770921.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/93b/400ef350c7028c1c297cda297fa2293b/400ef350c7028c1c297cda297fa2293b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770926.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/04c/33576de24b9f2054d8f4f31db03c504c/33576de24b9f2054d8f4f31db03c504c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770931.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/88a/97c26d329eb8bd93fe0cb81f83bec88a/97c26d329eb8bd93fe0cb81f83bec88a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770936.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/cc2/8dbfa3b86e9a19feb31d6c0635080cc2/8dbfa3b86e9a19feb31d6c0635080cc2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770941.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/767/9767e34ff1159817ff7bfe3dd7a90767/9767e34ff1159817ff7bfe3dd7a90767.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770946.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ea3/d1bdf27be4c7ee60feba91da50887ea3/d1bdf27be4c7ee60feba91da50887ea3.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770951.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/f6c/845ff5fc1a553d2fe1f0de4092d4af6c/845ff5fc1a553d2fe1f0de4092d4af6c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770956.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ca9/871058a6dda9564b8b0f8f4779d0dca9/871058a6dda9564b8b0f8f4779d0dca9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770961.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/2c4/6d19c6183b7ef602c35990ddd14fc2c4/6d19c6183b7ef602c35990ddd14fc2c4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770966.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ae0/adb22564293d61eed1dc531ee22bbae0/adb22564293d61eed1dc531ee22bbae0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770971.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/cc2/c8cf3cec074548734e24f46544eb8cc2/c8cf3cec074548734e24f46544eb8cc2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770976.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d42/9518efd74a3ef40033332ecc8d7efd42/9518efd74a3ef40033332ecc8d7efd42.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770981.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/852/b77fae20d17d45c0694992da797a3852/b77fae20d17d45c0694992da797a3852.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770986.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/299/62524544e5e8786571c1401d0acba299/62524544e5e8786571c1401d0acba299.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770991.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a8e/c3d8829acd4b2e8c50a12d8b0f9e9a8e/c3d8829acd4b2e8c50a12d8b0f9e9a8e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770996.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/ebc/985eee817acf084b9c8c48f871823ebc/985eee817acf084b9c8c48f871823ebc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771001.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/962/e025465395e4131510e9489aaeb71962/e025465395e4131510e9489aaeb71962.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771006.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/1c5/793b1321c38ea5e46e53dda9a96ee1c5/793b1321c38ea5e46e53dda9a96ee1c5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771011.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/575/bcd0332badd360ee07c0a399006c4575/bcd0332badd360ee07c0a399006c4575.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771016.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d29/4ef76b6a514f8718ed7c5fbfde86fd29/4ef76b6a514f8718ed7c5fbfde86fd29.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771021.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/998/4746a5e08b00fd203039a4a225218998/4746a5e08b00fd203039a4a225218998.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_items_since test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_items_since ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_namespaces test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_namespaces ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_namespaces_root_container_fill_gap test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_namespaces_root_container_fill_gap ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_namespaces_state_filtering test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_namespaces_state_filtering ... ok test WARNING: sorting_method is set to 'timing', not 'affinity'; policy 0 (nulo) read_affinity setting will have no effect. test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': 'r1=100', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (nulo): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=100', 'write_affinity': 'r2', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0=100', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test WARNING: sorting_method is set to 'shuffle', not 'affinity'; (default) read_affinity setting will have no effect. test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=10', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_objects test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_objects ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_server.TestObjectDisconnectCleanup.test_ec_chunked_transfer_disconnect_cleans_up test.unit.proxy.test_server.TestObjectDisconnectCleanup.test_ec_chunked_transfer_disconnect_cleans_up ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_objects_since_row test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_objects_since_row ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_sharding_initiated_and_required test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_sharding_initiated_and_required ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_own_shard_range test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_own_shard_range ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_policy_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_policy_info ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_sharding_state_is_not_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_sharding_state_is_not_reclaimable ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_not_merged_not_cleaving test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_not_merged_not_cleaving ... ok test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_sharding_sysmeta test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_sharding_sysmeta ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_replication_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_replication_info ... ok test.unit.proxy.test_server.TestObjectDisconnectCleanup.test_ec_disconnect_cleans_up test.unit.proxy.test_server.TestObjectDisconnectCleanup.test_ec_disconnect_cleans_up ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_report_info test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_report_info ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_range_rows_with_limit test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_range_rows_with_limit ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_ranges_includes test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_ranges_includes ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_ranges_with_sharding_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_ranges_with_sharding_overlaps ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_ranges_with_shrinking_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_ranges_with_shrinking_overlaps ... ok test DEBUG: Get listing from /v1/.shards_a/c_pie?delimiter=%2F&reverse=on&format=json&limit=9999&marker=pumpkin&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Found 0 objects in shard (state=unsharded), total = 1 (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_ham', lower='ha/ptic', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Get listing from /v1/.shards_a/c_ham?delimiter=%2F&reverse=on&format=json&limit=9999&marker=pumpkin&end_marker=ha%2Fptic {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Found 1 objects in shard (state=unsharded), total = 2 (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_ha-ppy', lower='ha.d', upper='ha/ppy') .shards_a/c_ha-ppy with {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Get listing from /v1/.shards_a/c_ha-ppy?delimiter=%2F&reverse=on&format=json&limit=9998&marker=ha%2F&end_marker=ha.d {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Found 1 objects in shard (state=unsharded), total = 3 (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Getting listing part 5 from shard Namespace(name='.shards_a/c_ha.d', lower='', upper='ha.d') .shards_a/c_ha.d with {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Get listing from /v1/.shards_a/c_ha.d?delimiter=%2F&reverse=on&format=json&limit=9997&marker=ha.ggle&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Found 1 objects in shard (state=unsharded), total = 4 (txn: tx3b2f39927cce4c879bb17-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: tx57048cfc2950423ab63c2-0068c57096) test DEBUG: Setting object count to 3120 (txn: tx57048cfc2950423ab63c2-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: tx5c1b8df504044a588445f-0068c57096) test DEBUG: Setting object count to 3120 (txn: tx5c1b8df504044a588445f-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096)test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_usage test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_get_shard_usage ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_has_multiple_policies test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_has_multiple_policies ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://127.0.0.1:59237/sda1/2/a/c2" "tx7851851301b64f289f393-0068c57096" "container-server 1824514" 0.0010 "-" 1824514 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://127.0.0.1:40479/sdb1/2/a/c2" "tx7851851301b64f289f393-0068c57096" "container-server 1824514" 0.0016 "-" 1824514 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/2/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx7851851301b64f289f393-0068c57096" "proxy-server 1824514" 0.0188 "-" 1824514 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/2/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx7851851301b64f289f393-0068c57096" "proxy-server 1824514" 0.0223 "-" 1824514 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - tx7851851301b64f289f393-0068c57096 - 0.0434 - - 1757769878.388114929 1757769878.431466341 2 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost:43553/v1/a?format=json" "txd76ddd9c3f6845f49327e-0068c57096" "proxy-server 1824514" 0.0022 "-" 1824514 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/ec-disconnect-test" 201 - "PUT http://127.0.0.1:59237/sda1/1/a/ec-disconnect-test" "txd76ddd9c3f6845f49327e-0068c57096" "container-server 1824514" 0.0018 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/ec-disconnect-test" 201 - "PUT http://127.0.0.1:40479/sdb1/1/a/ec-disconnect-test" "txd76ddd9c3f6845f49327e-0068c57096" "container-server 1824514" 0.0009 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/1/a/ec-disconnect-test" 201 - "PUT http://localhost:43553/v1/a/ec-disconnect-test" "txd76ddd9c3f6845f49327e-0068c57096" "proxy-server 1824514" 0.0086 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/1/a/ec-disconnect-test" 201 - "PUT http://localhost:43553/v1/a/ec-disconnect-test" "txd76ddd9c3f6845f49327e-0068c57096" "proxy-server 1824514" 0.0131 "-" 1824514 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/ec-disconnect-test HTTP/1.0 201 - - - - - - txd76ddd9c3f6845f49327e-0068c57096 - 0.0223 - - 1757769878.433964491 1757769878.456268072 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost:43553/v1/a?format=json" "tx70ed855c323144eea3c04-0068c57096" "proxy-server 1824514" 0.0018 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sdb1/1/a/ec-disconnect-test" 204 - "HEAD http://localhost:43553/v1/a/ec-disconnect-test" "txc7475934e99a44c993d02-0068c57096" "proxy-server 1824514" 0.0012 "-" 1824514 3 proxy WARNING: Client disconnected without sending last chunk (txn: txc7860a55fea94c23b4cd6-0068c57096) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/ec-disconnect-test/disconnect-data HTTP/1.0 499 - - - 196608 89 - txc7860a55fea94c23b4cd6-0068c57096 - 0.0174 - - 1757769878.457994699 1757769878.475396633 3 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdg1/0/a/ec-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/ec-disconnect-test/disconnect-data" "txc7860a55fea94c23b4cd6-0068c57096" "proxy-server 1824514" 0.0045 "-" 1824514 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdi1/0/a/ec-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/ec-disconnect-test/disconnect-data" "txc7860a55fea94c23b4cd6-0068c57096" "proxy-server 1824514" 0.0072 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdh1/0/a/ec-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/ec-disconnect-test/disconnect-data" "txc7860a55fea94c23b4cd6-0068c57096" "proxy-server 1824514" 0.0071 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost:43553/v1/a?format=json" "tx7cb4ce98f4a24a77a708b-0068c57096" "proxy-server 1824514" 0.0042 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/ec-disconnect-test" 201 - "PUT http://127.0.0.1:40479/sdb1/1/a/ec-disconnect-test" "tx7cb4ce98f4a24a77a708b-0068c57096" "container-server 1824514" 0.0016 "-" 1824514 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/ec-disconnect-test" 201 - "PUT http://127.0.0.1:59237/sda1/1/a/ec-disconnect-test" "tx7cb4ce98f4a24a77a708b-0068c57096" "container-server 1824514" 0.0009 "-" 1824514 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/1/a/ec-disconnect-test" 202 - "PUT http://localhost:43553/v1/a/ec-disconnect-test" "tx7cb4ce98f4a24a77a708b-0068c57096" "proxy-server 1824514" 0.0092 "-" 1824514 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/1/a/ec-disconnect-test" 202 - "PUT http://localhost:43553/v1/a/ec-disconnect-test" "tx7cb4ce98f4a24a77a708b-0068c57096" "proxy-server 1824514" 0.0076 "-" 1824514 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/ec-disconnect-test HTTP/1.0 202 - - - - 76 - tx7cb4ce98f4a24a77a708b-0068c57096 - 0.0205 - - 1757769878.565773010 1757769878.586306810 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost:43553/v1/a?format=json" "tx759addfa78c344bb9e95f-0068c57096" "proxy-server 1824514" 0.0021 "-" 1824514 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sdb1/1/a/ec-disconnect-test" 204 - "HEAD http://localhost:43553/v1/a/ec-disconnect-test" "txa5408b3824da4aabae79e-0068c57096" "proxy-server 1824514" 0.0013 "-" 1824514 3 proxy WARNING: Client disconnected without sending enough data (txn: tx4a25629a686241c4b8c2c-0068c57096) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/ec-disconnect-test/disconnect-data HTTP/1.0 499 - - - 196608 89 - tx4a25629a686241c4b8c2c-0068c57096 - 0.0170 - - 1757769878.588083982 1757769878.605060816 3 - obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdi1/0/a/ec-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/ec-disconnect-test/disconnect-data" "tx4a25629a686241c4b8c2c-0068c57096" "proxy-server 1824514" 0.0056 "-" 1824514 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdh1/0/a/ec-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/ec-disconnect-test/disconnect-data" "tx4a25629a686241c4b8c2c-0068c57096" "proxy-server 1824514" 0.0055 "-" 1824514 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdg1/0/a/ec-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/ec-disconnect-test/disconnect-data" "tx4a25629a686241c4b8c2c-0068c57096" "proxy-server 1824514" 0.0056 "-" 1824514 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost:43553/v1/a?format=json" "tx64a32b25bb9143b2b1654-0068c57096" "proxy-server 1824514" 0.0028 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/zero-disconnect-test" 201 - "PUT http://127.0.0.1:59237/sda1/0/a/zero-disconnect-test" "tx64a32b25bb9143b2b1654-0068c57096" "container-server 1824514" 0.0010 "-" 1824514 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/zero-disconnect-test" 201 - "PUT http://127.0.0.1:40479/sdb1/0/a/zero-disconnect-test" "tx64a32b25bb9143b2b1654-0068c57096" "container-server 1824514" 0.0017 "-" 1824514 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/zero-disconnect-test" 201 - "PUT http://localhost:43553/v1/a/zero-disconnect-test" "tx64a32b25bb9143b2b1654-0068c57096" "proxy-server 1824514" 0.0126 "-" 1824514 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/zero-disconnect-test" 201 - "PUT http://localhost:43553/v1/a/zero-disconnect-test" "tx64a32b25bb9143b2b1654-0068c57096" "proxy-server 1824514" 0.0093 "-" 1824514 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/zero-disconnect-test HTTP/1.0 201 - - - - - - tx64a32b25bb9143b2b1654-0068c57096 - 0.0222 - - 1757769878.692155123 1757769878.714336157 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost:43553/v1/a?format=json" "txe1f27aa01c9c4e299221d-0068c57096" "proxy-server 1824514" 0.0059 "-" 1824514 -test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_storage_policy_property test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_storage_policy_property ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_has_other_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_has_other_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_initialize_container_broker_in_default test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_initialize_container_broker_in_default ... ok test.unit.proxy.test_server.TestObjectDisconnectCleanup.test_repl_chunked_transfer_disconnect_cleans_up test.unit.proxy.test_server.TestObjectDisconnectCleanup.test_repl_chunked_transfer_disconnect_cleans_up ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771026.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/0d9/71753fe96a0c7c23a5f7fbf3b5fdd0d9/71753fe96a0c7c23a5f7fbf3b5fdd0d9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771031.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/7b7/d9380713c78e6152919fa488fdbde7b7/d9380713c78e6152919fa488fdbde7b7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771036.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/6f9/de36e127df4750060f2942982df916f9/de36e127df4750060f2942982df916f9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771041.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/65e/f011c10bbc7ba1907fd2d7bc239ac65e/f011c10bbc7ba1907fd2d7bc239ac65e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771046.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/fb2/c799d957005cee6642ace40b97cc1fb2/c799d957005cee6642ace40b97cc1fb2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771051.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/c10/27fbe984f6c52a394405c07751b1bc10/27fbe984f6c52a394405c07751b1bc10.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771056.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/bf5/38dd43b40daa3ce84310b78cd98d0bf5/38dd43b40daa3ce84310b78cd98d0bf5.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771061.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/0cd/f8b90cfbcf9c1a9cf76bc08dc31da0cd/f8b90cfbcf9c1a9cf76bc08dc31da0cd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771066.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/39c/435c6e0bb6b8bcfca630b0528504839c/435c6e0bb6b8bcfca630b0528504839c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771071.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/b32/cbff83cebaa98a2d0ba9459c47535b32/cbff83cebaa98a2d0ba9459c47535b32.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771076.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/3fd/b287ff64209201fb0e0d977e046bd3fd/b287ff64209201fb0e0d977e046bd3fd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771081.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/fd4/4f0f70ec01fa703b77ebf7a0553a4fd4/4f0f70ec01fa703b77ebf7a0553a4fd4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771086.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/673/b4149d9d8a42946b2b14e507eeeff673/b4149d9d8a42946b2b14e507eeeff673.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771091.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/4eb/45f612000cd2705822d5badf8c2774eb/45f612000cd2705822d5badf8c2774eb.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771096.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/399/9f123af2a87e43a64a6c5b1142dad399/9f123af2a87e43a64a6c5b1142dad399.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771101.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/384/a28b45cf19c8f894ebdd4e1a924ac384/a28b45cf19c8f894ebdd4e1a924ac384.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771106.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/62d/699ba336155ff2d46ccee7a9b2ab962d/699ba336155ff2d46ccee7a9b2ab962d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771111.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/613/e39606998ae38f2062969c7533fbc613/e39606998ae38f2062969c7533fbc613.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771116.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/a22/549ef60f603b72528cccd3cc0e176a22/549ef60f603b72528cccd3cc0e176a22.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771121.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/c73/8816e286dca57cbf4ecb7a0f0e186c73/8816e286dca57cbf4ecb7a0f0e186c73.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771126.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/afd/259170b2dcb081bff3638ceaf792fafd/259170b2dcb081bff3638ceaf792fafd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771131.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/637/ebbc7ce6348ab7bf075f37d3fca18637/ebbc7ce6348ab7bf075f37d3fca18637.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771136.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/fac/41638668f7891aaee3710ccc4b9fbfac/41638668f7891aaee3710ccc4b9fbfac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771141.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/6dc/c15c7a0c526a494f28daaef75b4626dc/c15c7a0c526a494f28daaef75b4626dc.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771146.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/c4f/f017a9288490b0ca227e75036de95c4f/f017a9288490b0ca227e75036de95c4f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771151.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/dbd/08efbf5596608505e6f21eea59412dbd/08efbf5596608505e6f21eea59412dbd.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757771156.00000-0, db: /tmp/tmpwj5k0yui/sda/containers/0/d4e/b04d5df0883540320030523d5836bd4e/b04d5df0883540320030523d5836bd4e.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/a01/ebadf156143425e35151d39dfad37a01/ebadf156143425e35151d39dfad37a01.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769882.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/a01/ebadf156143425e35151d39dfad37a01/ebadf156143425e35151d39dfad37a01_1757769882.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f_1757769886.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/3b2/3765e01d751df8f49be93d964108c3b2/3765e01d751df8f49be93d964108c3b2.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769890.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/3b2/3765e01d751df8f49be93d964108c3b2/3765e01d751df8f49be93d964108c3b2_1757769890.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769894.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f_1757769894.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d.db'test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_sync_merging test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_sync_merging ... ok test.unit.container.test_replicator.TestReplicatorSync.test_clean_up_after_deleted_brokers test.unit.container.test_replicator.TestReplicatorSync.test_clean_up_after_deleted_brokers ... ok test.unit.container.test_replicator.TestReplicatorSync.test_cleanup_post_replicate test.unit.container.test_replicator.TestReplicatorSync.test_cleanup_post_replicate ... ok test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test DEBUG: Setting object count to 3120 (txn: tx3fa9d1cfa5ea44319aa6d-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Getting listing part 2 from shard Namespace(name='a/c', lower='pie', upper='') a/c with {'X-Backend-Record-Type': 'object'} (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Get listing from /v1/a/c?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'object'} (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Found 3072 objects in shard (state=sharded), total = 3120 (txn: txe741a2a5c3724a87bd863-0068c57096) test DEBUG: Setting object count to 3120 (txn: txe741a2a5c3724a87bd863-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: GET listing from 5 shards for: /v1/a/c?reverse=true&limit=&format=json&states=listing (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_?reverse=true&limit=10000&format=json&marker=&end_marker=%F0%9F%8C%B4 {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1024 (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?reverse=true&limit=8976&format=json&marker=%F0%9F%8C%B5&end_marker=%E2%98%83 {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2048 (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?reverse=true&limit=7952&format=json&marker=%E2%98%84&end_marker=pie {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3072 (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_pie?reverse=true&limit=6928&format=json&marker=q&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Found 8 objects in shard (state=unsharded), total = 3080 (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_ham?reverse=true&limit=6920&format=json&marker=i&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Found 40 objects in shard (state=unsharded), total = 3120 (txn: txe2fc7795421e43e2bc2ab-0068c57096) test DEBUG: Setting object count to 3120 (txn: txe2fc7795421e43e2bc2ab-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test DEBUG: GET listing from 5 shards for: /v1/a/c?limit=49&format=json&states=listing (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_ham?limit=49&format=json&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_pie?limit=9&format=json&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx0ddc142acbb940c3bcb0c-0068c57096)test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_is_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_is_old_enough_to_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_is_old_enough_to_reclaim ... ok test ERROR: Failed to unlink '/tmp/tmpmdlvc6eu/containers/part/suffix/hash/container.db': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2235, in set_sharded_state os.unlink(retiring_file) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: 1 test DEBUG: Unlinked retiring db '/tmp/tmpmdlvc6eu/containers/part/suffix/hash/container_1757769878.00000.db' test WARNING: Still have multiple db files after unlinking '/tmp/tmpmdlvc6eu/containers/part/suffix/hash/container_1757769878.00000.db': ['/tmp/tmpmdlvc6eu/containers/part/suffix/hash/container.db', '/tmp/tmpmdlvc6eu/containers/part/suffix/hash/container_1757769879.00000.db'] test WARNING: Refusing to delete db file for 'a/c': no fresher db file found in ['/tmp/tmpmdlvc6eu/containers/part/suffix/hash/container_1757769879.00000.db']. test ERROR: Failed to set the ROWID of the fresh database for a/c: test ERROR: Failed to sync the container_stat table/view with the fresh database for a/c: test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00028 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpl1ubnugs/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00425 seconds (235.03533/s) test INFO: Removed 1 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test DEBUG: Successfully deleted db /tmp/tmpjcdvni9e/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db test DEBUG: Not deleting db /tmp/tmpjcdvni9e/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db (2/3 success) test DEBUG: Not deleting db /tmp/tmpjcdvni9e/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db (requires sharding, state unsharded) test DEBUG: Not deleting db /tmp/tmpjcdvni9e/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769878.86725.db (requires sharding, state sharding) test DEBUG: Not deleting db /tmp/tmpjcdvni9e/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769878.86725.db (2/3 success) test DEBUG: Successfully deleted db /tmp/tmpjcdvni9e/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769878.86725.db test DEBUG: Successfully deleted db /tmp/tmpjcdvni9e/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpoaha2vi0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (51, '70c66fe374eb66f269a6c49fda187b47', '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda', '1757769878.88427', '1757769878.00000', '0', '', '1757769878.00000', 51, 0) test DEBUG: /tmp/tmpoaha2vi0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'o0', 'created_at': '1757769879.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 2, 'name': 'o1', 'created_at': '1757769880.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 3, 'name': 'o2', 'created_at': '1757769881.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 4, 'name': 'o3', 'created_at': '1757769882.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 5, 'name': 'o4', 'created_at': '1757769883.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 6, 'name': 'o5', 'created_at': '1757769884.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 7, 'name': 'o6', 'created_at': '1757769885.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 8, 'name': 'o7', 'created_at': '1757769886.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 9, 'name': 'o8', 'created_at': '1757769887.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 10, 'name': 'o9', 'created_at': '1757769888.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 11, 'name': 'o10', 'created_at': '1757769889.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 12, 'name': 'o11', 'created_at': '1757769890.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 13, 'name': 'o12', 'created_at': '1757769891.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 14, 'name': 'o13', 'created_at': '1757769892.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 15, 'name': 'o14', 'created_at': '1757769893.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 16, 'name': 'o15', 'created_at': '1757769894.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 17, 'name': 'o16', 'created_at': '1757769895.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 18, 'name': 'o17', 'created_at': '1757769896.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 19, 'name': 'o18', 'created_at': '1757769897.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 20, 'name': 'o19', 'created_at': '1757769898.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 21, 'name': 'o20', 'created_at': '1757769899.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 22, 'name': 'o21', 'created_at': '1757769900.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 23, 'name': 'o22', 'created_at': '1757769901.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 24, 'name': 'o23', 'created_at': '1757769902.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 25, 'name': 'o24', 'created_at': '1757769903.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 26, 'name': 'o25', 'created_at': '1757769904.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 27, 'name': 'o26', 'created_at': '1757769905.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 28, 'name': 'o27', 'created_at': '1757769906.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 29, 'name': 'o28', 'created_at': '1757769907.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 30, 'name': 'o29', 'created_at': '1757769908.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda')test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_is_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_is_reclaimable ... ok test.unit.container.test_replicator.TestReplicatorSync.test_diff_capped_sync test.unit.container.test_replicator.TestReplicatorSync.test_diff_capped_sync ... ok test.unit.container.test_replicator.TestReplicatorSync.test_find_local_handoff_for_part test.unit.container.test_replicator.TestReplicatorSync.test_find_local_handoff_for_part ... ok test.unit.proxy.test_server.TestObjectDisconnectCleanup.test_repl_disconnect_cleans_up test.unit.proxy.test_server.TestObjectDisconnectCleanup.test_repl_disconnect_cleans_up ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_last_modified_time test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_last_modified_time ... ok test.unit.container.test_replicator.TestReplicatorSync.test_local_ids test.unit.container.test_replicator.TestReplicatorSync.test_local_ids ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_legacy_pending_files test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_legacy_pending_files ... ok test DEBUG: /tmp/tmpoaha2vi0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 30 (0.0166285s) test DEBUG: Synchronization for /tmp/tmpoaha2vi0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db has fallen more than 30 rows behind; moving on and will try again next pass. REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (51, '70c66fe374eb66f269a6c49fda187b47', '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda', '1757769878.88427', '1757769878.00000', '0', '', '1757769878.00000', 51, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.04469 seconds (22.37709/s) test INFO: Removed 0 dbs test INFO: 1 successes, 1 failures test INFO: diff:1 diff_capped:1 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpoaha2vi0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (51, '70c66fe374eb66f269a6c49fda187b47', '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda', '1757769878.88427', '1757769878.00000', '0', '', '1757769878.00000', 51, 0) test DEBUG: /tmp/tmpoaha2vi0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row 30 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 31, 'name': 'o30', 'created_at': '1757769909.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 32, 'name': 'o31', 'created_at': '1757769910.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 33, 'name': 'o32', 'created_at': '1757769911.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 34, 'name': 'o33', 'created_at': '1757769912.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 35, 'name': 'o34', 'created_at': '1757769913.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 36, 'name': 'o35', 'created_at': '1757769914.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 37, 'name': 'o36', 'created_at': '1757769915.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 38, 'name': 'o37', 'created_at': '1757769916.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 39, 'name': 'o38', 'created_at': '1757769917.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 40, 'name': 'o39', 'created_at': '1757769918.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 41, 'name': 'o40', 'created_at': '1757769919.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 42, 'name': 'o41', 'created_at': '1757769920.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 43, 'name': 'o42', 'created_at': '1757769921.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 44, 'name': 'o43', 'created_at': '1757769922.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 45, 'name': 'o44', 'created_at': '1757769923.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 46, 'name': 'o45', 'created_at': '1757769924.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 47, 'name': 'o46', 'created_at': '1757769925.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 48, 'name': 'o47', 'created_at': '1757769926.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 49, 'name': 'o48', 'created_at': '1757769927.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 50, 'name': 'o49', 'created_at': '1757769928.00000', 'size': 0, 'content_type': 'content-type-old', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 51, 'name': 'o101', 'created_at': '1757770029.00000', 'size': 0, 'content_type': 'content-type-new', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda') test DEBUG: /tmp/tmpoaha2vi0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 51 (0.0157719s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (51, '70c66fe374eb66f269a6c49fda187b47', '3cb4a55c-c915-4e4f-b176-8f1d68ca4ae5-sda', '1757769878.88427', '1757769878.00000', '0', '', '1757769878.00000', 51, 0) test DEBUG: /tmp/tmpoaha2vi0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.2:1002/sdc, nothing to do test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02896 seconds (34.52857/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:0 ts_repl:0 test WARNING: Could not find a non-zero weight device for handoff partition 0, falling back device sdb test WARNING: Could not find a non-zero weight device for handoff partition 0, falling back device sdb test WARNING: Could not find a non-zero weight device for handoff partition 0, falling back device sdb test WARNING: Could not find a non-zero weight device for handoff partition 0, falling back device sdc test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00444 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00026 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test INFO: Replication run OVER test INFO: Attempted to replicate 0 dbs in 0.00020 seconds (0.00000/s) test INFO: Removed 0 dbs test INFO: 0 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpehhiyy6g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (2, '60d2876bbecd595a50de2666c09ea3ce', 'cd29d003-661f-41e2-85d7-5d3f450bcf7f-sda', '1757769879.00521', '1757768400.00000', '0', '', '1757768400.00000', 0, 1) test DEBUG: /tmp/tmpehhiyy6g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1test.unit.container.test_replicator.TestReplicatorSync.test_misplaced_rows_replicate_and_enqueue test.unit.container.test_replicator.TestReplicatorSync.test_misplaced_rows_replicate_and_enqueue ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter ... ok test.unit.container.test_replicator.TestReplicatorSync.test_misplaced_rows_replicate_and_enqueue_from_old_style_shard test.unit.container.test_replicator.TestReplicatorSync.test_misplaced_rows_replicate_and_enqueue_from_old_style_shard ... ok test DEBUG: Found 1 objects in shard (state=sharded), total = 1 (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Found 1 objects in shard (state=sharded), total = 34 (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='b', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'object'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9966&marker=b&end_marker= {'X-Backend-Record-Type': 'object'} (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1058 (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Setting object count to 1058 (txn: txdb42e0b97a854376b7d0e-0068c57094) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 1 shards for: /v1/a/c?format=json&states=listing (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=10000&marker=&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: GET listing from 1 shards for: /v1/.shards_a/c_?format=json&limit=10000&marker=&end_marker=&states=listing (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c', lower='', upper='') a/c with {'X-Backend-Record-Type': 'object'} (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: Get listing from /v1/a/c?format=json&limit=10000&marker=&end_marker= {'X-Backend-Record-Type': 'object'} (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: Found 1024 objects in shard (state=sharded), total = 1024 (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: Setting object count to 1024 (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: Found 1024 objects in shard (state=sharding), total = 1024 (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: Setting object count to 1024 (txn: tx9f4db27af58a471794fb1-0068c57095) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/.shards_a/c_pie (3 namespaces) (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: GET listing from 3 shards for: /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c_sub_juice', lower='ham', upper='juice') a/c_sub_juice with {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Get listing from /v1/a/c_sub_juice?format=json&limit=9960&marker=h&end_marker=juice%00 {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='a/c_sub_lemon', lower='juice', upper='lemon') a/c_sub_lemon with {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Get listing from /v1/a/c_sub_lemon?format=json&limit=9958&marker=j&end_marker=lemon%00 {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Found 2 objects in shard (state=unsharded), total = 4 (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Getting listing part 2 from shard Namespace(name='a/c_sub_pie', lower='lemon', upper='') a/c_sub_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Get listing from /v1/a/c_sub_pie?format=json&limit=9956&marker=l&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Found 4 objects in shard (state=unsharded), total = 8 (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Found 8 objects in shard (state=sharded), total = 48 (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Setting object count to 1072 (txn: tx63b99670aa0f453083f8a-0068c57096) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: GET listing from 3 shards for: /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c_sub_juice', lower='ham', upper='juice') a/c_sub_juice with {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Get listing from /v1/a/c_sub_juice?format=json&limit=9960&marker=h&end_marker=juice%00 {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097)test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_sharding_shard_mixed_policies test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_sharding_shard_mixed_policies ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769898.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d_1757769898.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/02d/4f83ea50dc672752a1fa5b1e466ac02d/4f83ea50dc672752a1fa5b1e466ac02d.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769902.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/02d/4f83ea50dc672752a1fa5b1e466ac02d/4f83ea50dc672752a1fa5b1e466ac02d_1757769902.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/41c/036de6688bc7eeac874c629324f6041c/036de6688bc7eeac874c629324f6041c.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769906.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/41c/036de6688bc7eeac874c629324f6041c/036de6688bc7eeac874c629324f6041c_1757769906.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769910.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1_1757769910.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/b38/a72ab5118ff841acbf588e313d52eb38/a72ab5118ff841acbf588e313d52eb38.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769914.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/b38/a72ab5118ff841acbf588e313d52eb38/a72ab5118ff841acbf588e313d52eb38_1757769914.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/20e/e0f61c6ff90bcc453f230bcccefe020e/e0f61c6ff90bcc453f230bcccefe020e.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769918.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/20e/e0f61c6ff90bcc453f230bcccefe020e/e0f61c6ff90bcc453f230bcccefe020e_1757769918.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769922.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a_1757769922.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/760/47f397e2962e064a251785aaf2e85760/47f397e2962e064a251785aaf2e85760.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769926.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/760/47f397e2962e064a251785aaf2e85760/47f397e2962e064a251785aaf2e85760_1757769926.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/ee3/acbc6ecb60e8573b25129fae97317ee3/acbc6ecb60e8573b25129fae97317ee3.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769930.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/ee3/acbc6ecb60e8573b25129fae97317ee3/acbc6ecb60e8573b25129fae97317ee3_1757769930.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769934.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04_1757769934.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/262/b41b1a0b53b772b9f980ea9cd30f6262/b41b1a0b53b772b9f980ea9cd30f6262.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769938.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/262/b41b1a0b53b772b9f980ea9cd30f6262/b41b1a0b53b772b9f980ea9cd30f6262_1757769938.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/f21/e285d1e95bb038f55a52f2302e351f21/e285d1e95bb038f55a52f2302e351f21.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769942.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/f21/e285d1e95bb038f55a52f2302e351f21/e285d1e95bb038f55a52f2302e351f21_1757769942.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94_1757769946.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/737/2acd3ee53ba709b6e23600ab299b7737/2acd3ee53ba709b6e23600ab299b7737.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769950.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/737/2acd3ee53ba709b6e23600ab299b7737/2acd3ee53ba709b6e23600ab299b7737_1757769950.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/76e/90cbcb19a6441f33163fd617552fb76e/90cbcb19a6441f33163fd617552fb76e.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769954.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/76e/90cbcb19a6441f33163fd617552fb76e/90cbcb19a6441f33163fd617552fb76e_1757769954.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769958.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f_1757769958.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/926/9e972780cfac694c2278e38887567926/9e972780cfac694c2278e38887567926.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769962.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/926/9e972780cfac694c2278e38887567926/9e972780cfac694c2278e38887567926_1757769962.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/a84/972206c5ddfbe3104eb36c180e751a84/972206c5ddfbe3104eb36c180e751a84.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769966.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/a84/972206c5ddfbe3104eb36c180e751a84/972206c5ddfbe3104eb36c180e751a84_1757769966.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769970.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702_1757769970.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/24b/42d708516f4a7c61801285ccf5cc124b/42d708516f4a7c61801285ccf5cc124b.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769974.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/24b/42d708516f4a7c61801285ccf5cc124b/42d708516f4a7c61801285ccf5cc124b_1757769974.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/ca2/0ceaff639804d55fbcb0ccf8f409dca2/0ceaff639804d55fbcb0ccf8f409dca2.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769978.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/ca2/0ceaff639804d55fbcb0ccf8f409dca2/0ceaff639804d55fbcb0ccf8f409dca2_1757769978.00000.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'o', 'created_at': '1757768402.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 2, 'name': 'o2', 'created_at': '1757768403.00000+186a0+186a0', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], 'cd29d003-661f-41e2-85d7-5d3f450bcf7f-sda') test DEBUG: /tmp/tmpehhiyy6g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 2 (0.00426292s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (2, '60d2876bbecd595a50de2666c09ea3ce', 'cd29d003-661f-41e2-85d7-5d3f450bcf7f-sda', '1757769879.00521', '1757768400.00000', '0', '', '1757768400.00000', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('cd29d003-661f-41e2-85d7-5d3f450bcf7f-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 2 objects to the reconciler at /tmp/tmpehhiyy6g/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.04355 seconds (22.96444/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpehhiyy6g/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (2, '668c65af2b1c012c62c031a0d7e6f683', '5b4a425a-ae16-4e14-b7e1-2c3659206006-sda', '1757769879.05280', '1757768400', '0', '', '1757768400', 2, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('5b4a425a-ae16-4e14-b7e1-2c3659206006-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (2, '668c65af2b1c012c62c031a0d7e6f683', '5b4a425a-ae16-4e14-b7e1-2c3659206006-sda', '1757769879.05280', '1757768400', '0', '', '1757768400', 2, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('5b4a425a-ae16-4e14-b7e1-2c3659206006-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmplxx556z6/sda/containers/0/df1/7d69a3daa789abb831fde54674123df1/7d69a3daa789abb831fde54674123df1.db REPLICATE: /sdb/0/7d69a3daa789abb831fde54674123df1, sync, (2, '60d2876bbecd595a50de2666c09ea3ce', 'c40b611c-e739-4ddd-8b4e-7c606263dcd2-sda', '1757769879.08560', '1757768400.00000', '0', '{"X-Container-Sysmeta-Shard-Root": ["a/c", "1757769879.08674"]}', '1757768400.00000', 0, 1) test DEBUG: /tmp/tmplxx556z6/sda/containers/0/df1/7d69a3daa789abb831fde54674123df1/7d69a3daa789abb831fde54674123df1.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/7d69a3daa789abb831fde54674123df1, merge_items, ([{'ROWID': 1, 'name': 'o', 'created_at': '1757768402.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 2, 'name': 'o2', 'created_at': '1757768403.00000+186a0+186a0', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], 'c40b611c-e739-4ddd-8b4e-7c606263dcd2-sda') test DEBUG: /tmp/tmplxx556z6/sda/containers/0/df1/7d69a3daa789abb831fde54674123df1/7d69a3daa789abb831fde54674123df1.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 2 (0.00419259s) REPLICATE: /sdb/0/7d69a3daa789abb831fde54674123df1, merge_syncs, ([],) REPLICATE: /sdc/0/7d69a3daa789abb831fde54674123df1, sync, (2, '60d2876bbecd595a50de2666c09ea3ce', 'c40b611c-e739-4ddd-8b4e-7c606263dcd2-sda', '1757769879.08560', '1757768400.00000', '0', '{"X-Container-Sysmeta-Shard-Root": ["a/c", "1757769879.08674"]}', '1757768400.00000', 0, 1) REPLICATE: /sdc/0/7d69a3daa789abb831fde54674123df1, complete_rsync, ('c40b611c-e739-4ddd-8b4e-7c606263dcd2-sda', '7d69a3daa789abb831fde54674123df1.db') test DEBUG: Adding 2 objects to the reconciler at /tmp/tmplxx556z6/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.03412 seconds (29.30550/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmplxx556z6/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (2, '668c65af2b1c012c62c031a0d7e6f683', '88c93b6c-6a86-406f-ab44-85c9d78cd145-sda', '1757769879.12534', '1757768400', '0', '', '1757768400', 2, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('88c93b6c-6a86-406f-ab44-85c9d78cd145-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (2, '668c65af2b1c012c62c031a0d7e6f683', '88c93b6c-6a86-406f-ab44-85c9d78cd145-sda', '1757769879.12534', '1757768400', '0', '', '1757768400', 2, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('88c93b6c-6a86-406f-ab44-85c9d78cd145-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpx47oxfif/sda/containers/0/df1/7d69a3daa789abb831fde54674123df1/7d69a3daa789abb831fde54674123df1.db REPLICATE: /sdb/0/7d69a3daa789abb831fde54674123df1, sync, (2, '60d2876bbecd595a50de2666c09ea3ce', 'cdc02392-e7f0-4b4d-8096-c6b2dcb65ae5-sda', '1757769879.15811', '1757768400.00000', '0', '{"X-Container-Sysmeta-Shard-Quoted-Root": ["a/c", "1757769879.16342"]}', '1757768400.00000', 0, 0) test DEBUG: /tmp/tmpx47oxfif/sda/containers/0/df1/7d69a3daa789abb831fde54674123df1/7d69a3daa789abb831fde54674123df1.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/7d69a3daa789abb831fde54674123df1, merge_items, ([{'ROWID': 1, 'name': 'o', 'created_at': '1757768402.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}, {'ROWID': 2, 'name': 'o2', 'created_at': '1757768403.00000+186a0+186a0', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], 'cdc02392-e7f0-4b4d-8096-c6b2dcb65ae5-sda') test DEBUG: /tmp/tmpx47oxfif/sda/containers/0/df1/7d69a3daa789abb831fde54674123df1/7d69a3daa789abb831fde54674123df1.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 2 (0.00533724s) REPLICATE: /sdb/0/7d69a3daa789abb831fde54674123df1, merge_syncs, ([],) REPLICATE: /sdc/0/7d69a3daa789abb831fde54674123df1, sync, (2, '60d2876bbecd595a50de2666c09ea3ce', 'cdc02392-e7f0-4b4d-8096-c6b2dcb65ae5-sda', '1757769879.15811', '1757768400.00000', '0', '{"X-Container-Sysmeta-Shard-Quoted-Root": ["a/c", "1757769879.16342"]}', '1757768400.00000', 0, 0) REPLICATE: /sdc/0/7d69a3daa789abb831fde54674123df1, complete_rsync, ('cdc02392-e7f0-4b4d-8096-c6b2dcb65ae5-sda', '7d69a3daa789abb831fde54674123df1.db') test DEBUG: Adding 2 objects to the reconciler at /tmp/tmpx47oxfif/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02249 seconds (44.47056/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpx47oxfif/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (2, '07f68f22e033e1aeb327bf47752a3490', '79cb7888-f4a2-4d59-8374-2bf71f2373c9-sda', '1757769879.18963', '1757768400', '0', '', '1757768400', 2, 0)test.unit.container.test_replicator.TestReplicatorSync.test_misplaced_rows_replicate_and_enqueue_from_shard test.unit.container.test_replicator.TestReplicatorSync.test_misplaced_rows_replicate_and_enqueue_from_shard ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter_non_slash ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter_order_and_reverse test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter_order_and_reverse ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter_prefix_delim ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter_with_reserved_name test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_list_objects_iter_with_reserved_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_load_old_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_load_old_record_from_pending_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_make_tuple_for_pickle test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_make_tuple_for_pickle ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items_is_green test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items_is_green ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sda1/0/a/zero-disconnect-test" 204 - "HEAD http://localhost:43553/v1/a/zero-disconnect-test" "tx70059e8a15e844b492d99-0068c57096" "proxy-server 1824514" 0.0011 "-" 1824514 0 proxy WARNING: Client disconnected without sending last chunk (txn: tx051aa4873f1d43dab3843-0068c57096) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/zero-disconnect-test/disconnect-data HTTP/1.0 499 - - - 196608 89 - tx051aa4873f1d43dab3843-0068c57096 - 0.0400 - - 1757769878.720016956 1757769878.759991884 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/1/a/zero-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/zero-disconnect-test/disconnect-data" "tx051aa4873f1d43dab3843-0068c57096" "proxy-server 1824514" 0.0141 "-" 1824514 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/1/a/zero-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/zero-disconnect-test/disconnect-data" "tx051aa4873f1d43dab3843-0068c57096" "proxy-server 1824514" 0.0162 "-" 1824514 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost:43553/v1/a?format=json" "tx06152152ba5541d194aad-0068c57096" "proxy-server 1824514" 0.0013 "-" 1824514 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/zero-disconnect-test" 201 - "PUT http://127.0.0.1:59237/sda1/0/a/zero-disconnect-test" "tx06152152ba5541d194aad-0068c57096" "container-server 1824514" 0.0011 "-" 1824514 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/zero-disconnect-test" 201 - "PUT http://127.0.0.1:40479/sdb1/0/a/zero-disconnect-test" "tx06152152ba5541d194aad-0068c57096" "container-server 1824514" 0.0016 "-" 1824514 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/0/a/zero-disconnect-test" 202 - "PUT http://localhost:43553/v1/a/zero-disconnect-test" "tx06152152ba5541d194aad-0068c57096" "proxy-server 1824514" 0.0215 "-" 1824514 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sdb1/0/a/zero-disconnect-test" 202 - "PUT http://localhost:43553/v1/a/zero-disconnect-test" "tx06152152ba5541d194aad-0068c57096" "proxy-server 1824514" 0.0157 "-" 1824514 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/zero-disconnect-test HTTP/1.0 202 - - - - 76 - tx06152152ba5541d194aad-0068c57096 - 0.0511 - - 1757769878.822030544 1757769878.873117685 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost:43553/v1/a?format=json" "tx93312496488e45eeaab6e-0068c57096" "proxy-server 1824514" 0.0021 "-" 1824514 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "HEAD /sda1/0/a/zero-disconnect-test" 204 - "HEAD http://localhost:43553/v1/a/zero-disconnect-test" "tx5fac22e53d5c4319b8b06-0068c57096" "proxy-server 1824514" 0.0094 "-" 1824514 0 proxy WARNING: Client disconnected without sending enough data (txn: tx778c7fa44834409caf82c-0068c57096) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/38 PUT /v1/a/zero-disconnect-test/disconnect-data HTTP/1.0 499 - - - 196608 89 - tx778c7fa44834409caf82c-0068c57096 - 0.1106 - - 1757769878.878056049 1757769878.988657475 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:38 +0000] "PUT /sda1/1/a/zero-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/zero-disconnect-test/disconnect-data" "tx778c7fa44834409caf82c-0068c57096" "proxy-server 1824514" 0.0945 "-" 1824514 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:39 +0000] "PUT /sdb1/1/a/zero-disconnect-test/disconnect-data" 499 89 "PUT http://localhost:43553/v1/a/zero-disconnect-test/disconnect-data" "tx778c7fa44834409caf82c-0068c57096" "proxy-server 1824514" 0.0626 "-" 1824514 0 test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items_overwrite test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items_overwrite ... ok REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('79cb7888-f4a2-4d59-8374-2bf71f2373c9-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (2, '07f68f22e033e1aeb327bf47752a3490', '79cb7888-f4a2-4d59-8374-2bf71f2373c9-sda', '1757769879.18963', '1757768400', '0', '', '1757768400', 2, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('79cb7888-f4a2-4d59-8374-2bf71f2373c9-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp6cd9kmfu/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (2, 'f2090b0b58ebd9abf455ab6a4ad2fa0b', '0818de8f-cb64-44c1-a7d0-f9025aa1bdf8-sda', '1757769879.22251', '1757769879.00000', '0', '', '1757769879.00000', 1, 1) test DEBUG: /tmp/tmp6cd9kmfu/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'o-unu', 'created_at': '1757769881.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}, {'ROWID': 2, 'name': 'o-nulo', 'created_at': '1757769882.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '0818de8f-cb64-44c1-a7d0-f9025aa1bdf8-sda') test DEBUG: /tmp/tmp6cd9kmfu/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 2 (0.00343966s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (2, 'f2090b0b58ebd9abf455ab6a4ad2fa0b', '0818de8f-cb64-44c1-a7d0-f9025aa1bdf8-sda', '1757769879.22251', '1757769879.00000', '0', '', '1757769879.00000', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('0818de8f-cb64-44c1-a7d0-f9025aa1bdf8-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmp6cd9kmfu/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.03519 seconds (28.41912/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmp6cd9kmfu/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'c769c2f8bc96ebcd4399c02efb04cce2', 'f1d8568c-2cbc-48d8-86be-57778178fd88-sda', '1757769879.26716', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('f1d8568c-2cbc-48d8-86be-57778178fd88-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'c769c2f8bc96ebcd4399c02efb04cce2', 'f1d8568c-2cbc-48d8-86be-57778178fd88-sda', '1757769879.26716', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('f1d8568c-2cbc-48d8-86be-57778178fd88-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp6cd9kmfu/sdb/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'c769c2f8bc96ebcd4399c02efb04cce2', '03ca6bf3-2af5-4077-9e9d-6d59d2a9ce0f-', '1757769879.26716', '1757768400', '0', '', '1757768400', 1, 0) test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db in sync with 10.0.0.2:1002/sdc, nothing to do REPLICATE: /sda/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'c769c2f8bc96ebcd4399c02efb04cce2', '03ca6bf3-2af5-4077-9e9d-6d59d2a9ce0f-', '1757769879.26716', '1757768400', '0', '', '1757768400', 1, 0) test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db in sync with 10.0.0.0:1000/sda, nothing to do test DEBUG: Replicating db /tmp/tmp6cd9kmfu/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (2, '9e417328b52bec504e78604975fbf2fe', '0e414a73-45f5-47fe-936c-c0022b20e3af-sdb', '1757769879.22251', '1757769880.00000', '0', '', '1757769880.00000', 1, 1) test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.2:1002/sdc, starting at row -1 REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'o-unu', 'created_at': '1757769883.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}, {'ROWID': 2, 'name': 'o-nulo', 'created_at': '1757769884.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '0e414a73-45f5-47fe-936c-c0022b20e3af-sdb') test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.2:1002/sdc, finished at row 2 (0.00282121s) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([{'remote_id': '0818de8f-cb64-44c1-a7d0-f9025aa1bdf8-sda', 'sync_point': 2}],) REPLICATE: /sda/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (2, '9e417328b52bec504e78604975fbf2fe', '0e414a73-45f5-47fe-936c-c0022b20e3af-sdb', '1757769879.22251', '1757769880.00000', '0', '', '1757769880.00000', 1, 1) test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.0:1000/sda, starting at row -1 REPLICATE: /sda/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'o-unu', 'created_at': '1757769883.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}, {'ROWID': 2, 'name': 'o-nulo', 'created_at': '1757769884.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '0e414a73-45f5-47fe-936c-c0022b20e3af-sdb') test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.0:1000/sda, finished at row 2 (0.00267863s) REPLICATE: /sda/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([{'remote_id': '0818de8f-cb64-44c1-a7d0-f9025aa1bdf8-sda', 'sync_point': 2}],) test DEBUG: Adding 1 objects to the reconciler at /tmp/tmp6cd9kmfu/sdb/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 2 dbs in 0.05121 seconds (39.05322/s) test INFO: Removed 0 dbs test INFO: 4 successes, 0 failures test INFO: diff:2 diff_capped:0 empty:0 hashmatch:0 no_change:2 remote_merge:0 rsync:0 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmp6cd9kmfu/sdb/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (2, 'e949d5b8a5af70600cecc6aa3d1f5d25', '03ca6bf3-2af5-4077-9e9d-6d59d2a9ce0f-', '1757769879.26716', '1757768400', '0', '', '1757768400', 1, 0) test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db usyncing chunks to 10.0.0.2:1002/sdc, starting at row 1 REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, merge_items, ([{'ROWID': 2, 'name': '0:/a/c/o-nulo', 'created_at': '1757769884.00000', 'size': 0, 'content_type': 'application/x-put', 'etag': '1757769884.00000', 'deleted': 0, 'storage_policy_index': 0}], '03ca6bf3-2af5-4077-9e9d-6d59d2a9ce0f-')test.unit.container.test_replicator.TestReplicatorSync.test_multiple_out_sync_reconciler_enqueue_normalize test.unit.container.test_replicator.TestReplicatorSync.test_multiple_out_sync_reconciler_enqueue_normalize ... ok test.unit.container.test_replicator.TestReplicatorSync.test_post_replicate_hook test.unit.container.test_replicator.TestReplicatorSync.test_post_replicate_hook ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items_overwrite_unicode test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items_overwrite_unicode ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items_post_overwrite_out_of_order test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_items_post_overwrite_out_of_order ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_missing test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_missing ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_shard_range_single_record test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_shard_range_single_record ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_shard_ranges_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_shard_ranges_deleted ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_sharded test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_sharded ... ok sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769982.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254_1757769982.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/00f/daeb4b33482ba0957987c36a50e7900f/daeb4b33482ba0957987c36a50e7900f.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769986.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/00f/daeb4b33482ba0957987c36a50e7900f/daeb4b33482ba0957987c36a50e7900f_1757769986.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/ba6/7a7a3414e9e1e5e6a5916a35e09daba6/7a7a3414e9e1e5e6a5916a35e09daba6.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769990.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/ba6/7a7a3414e9e1e5e6a5916a35e09daba6/7a7a3414e9e1e5e6a5916a35e09daba6_1757769990.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769994.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b_1757769994.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/e46/f02e8b95a9214e9d40fffb8230fb5e46/f02e8b95a9214e9d40fffb8230fb5e46.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769998.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/e46/f02e8b95a9214e9d40fffb8230fb5e46/f02e8b95a9214e9d40fffb8230fb5e46_1757769998.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/c12/76b71b6ec35a27b6c9fe4113a5440c12/76b71b6ec35a27b6c9fe4113a5440c12.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770002.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/c12/76b71b6ec35a27b6c9fe4113a5440c12/76b71b6ec35a27b6c9fe4113a5440c12_1757770002.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4_1757770006.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/017/92a291d966dba6c9b1089a086b63c017/92a291d966dba6c9b1089a086b63c017.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770010.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/017/92a291d966dba6c9b1089a086b63c017/92a291d966dba6c9b1089a086b63c017_1757770010.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/c25/85f577ea58bd766d7f752b9572505c25/85f577ea58bd766d7f752b9572505c25.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770014.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/c25/85f577ea58bd766d7f752b9572505c25/85f577ea58bd766d7f752b9572505c25_1757770014.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770018.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181_1757770018.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/fe3/49f7a23c2b83a7d5c9fd9c905970cfe3/49f7a23c2b83a7d5c9fd9c905970cfe3.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770022.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/fe3/49f7a23c2b83a7d5c9fd9c905970cfe3/49f7a23c2b83a7d5c9fd9c905970cfe3_1757770022.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/7d5/12afa896fd8019e512e47c77444f47d5/12afa896fd8019e512e47c77444f47d5.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770026.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/7d5/12afa896fd8019e512e47c77444f47d5/12afa896fd8019e512e47c77444f47d5_1757770026.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770030.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b_1757770030.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/a2a/5f96cad0418db7d73a3cdad013767a2a/5f96cad0418db7d73a3cdad013767a2a.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770034.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/a2a/5f96cad0418db7d73a3cdad013767a2a/5f96cad0418db7d73a3cdad013767a2a_1757770034.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/936/3bcfc3413edd64d9d5742bbefe8e3936/3bcfc3413edd64d9d5742bbefe8e3936.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770038.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/936/3bcfc3413edd64d9d5742bbefe8e3936/3bcfc3413edd64d9d5742bbefe8e3936_1757770038.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770042.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30_1757770042.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/fab/e0b9deaff7e8658d413d95e5b3ea1fab/e0b9deaff7e8658d413d95e5b3ea1fab.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770046.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/fab/e0b9deaff7e8658d413d95e5b3ea1fab/e0b9deaff7e8658d413d95e5b3ea1fab_1757770046.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/208/81f17a6a22245fa05b87b57422bac208/81f17a6a22245fa05b87b57422bac208.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770050.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/208/81f17a6a22245fa05b87b57422bac208/81f17a6a22245fa05b87b57422bac208_1757770050.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/c70/daf5a0eb378ef3de22b0d169999b0c70/daf5a0eb378ef3de22b0d169999b0c70.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770054.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/c70/daf5a0eb378ef3de22b0d169999b0c70/daf5a0eb378ef3de22b0d169999b0c70_1757770054.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/bc8/496c29c9e34f592e2351069dcb983bc8/496c29c9e34f592e2351069dcb983bc8.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770058.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/bc8/496c29c9e34f592e2351069dcb983bc8/496c29c9e34f592e2351069dcb983bc8_1757770058.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/572/c300fc77f99f60d8a3661473a89f5572/c300fc77f99f60d8a3661473a89f5572.db' test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db usyncing chunks to 10.0.0.2:1002/sdc, finished at row 2 (0.0147758s) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, merge_syncs, ([{'remote_id': 'f1d8568c-2cbc-48d8-86be-57778178fd88-sda', 'sync_point': 1}],) REPLICATE: /sda/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (2, 'e949d5b8a5af70600cecc6aa3d1f5d25', '03ca6bf3-2af5-4077-9e9d-6d59d2a9ce0f-', '1757769879.26716', '1757768400', '0', '', '1757768400', 1, 0) test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db usyncing chunks to 10.0.0.0:1000/sda, starting at row 1 REPLICATE: /sda/0/8a4aa9c52acd7ed2464b7d09774f9d0e, merge_items, ([{'ROWID': 2, 'name': '0:/a/c/o-nulo', 'created_at': '1757769884.00000', 'size': 0, 'content_type': 'application/x-put', 'etag': '1757769884.00000', 'deleted': 0, 'storage_policy_index': 0}], '03ca6bf3-2af5-4077-9e9d-6d59d2a9ce0f-') test DEBUG: /tmp/tmp6cd9kmfu/sdb/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db usyncing chunks to 10.0.0.0:1000/sda, finished at row 2 (0.00425267s) REPLICATE: /sda/0/8a4aa9c52acd7ed2464b7d09774f9d0e, merge_syncs, ([{'remote_id': 'f1d8568c-2cbc-48d8-86be-57778178fd88-sda', 'sync_point': 1}],) test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '8158d1b165b4ef96dc3bab8c877c3f69', '4be42b63-49f2-4e83-8b80-88c062be1efe-', '1757769879.38990', '1757769879.38808', '0', '', '1757769879.38808', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('4be42b63-49f2-4e83-8b80-88c062be1efe-', '5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.39122.db') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '8158d1b165b4ef96dc3bab8c877c3f69', '4be42b63-49f2-4e83-8b80-88c062be1efe-', '1757769879.38990', '1757769879.38808', '0', '', '1757769879.38808', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.39115', 'lower': '', 'upper': 'a', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769879.39115', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769879.39115', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.39135', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.39135', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.39122', 'epoch': '1757769879.39122', 'reported': 0, 'tombstones': -1}], '4be42b63-49f2-4e83-8b80-88c062be1efe-') test DEBUG: /tmp/tmp0ghi6mfu/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.39122.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp0ghi6mfu/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.39122.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (6, 'e11d247dd1bc0dec5ff91d1341a321d4', 'cf7f350e-75d3-4a11-9a39-c276f013188e-', '1757769879.43253', '1757769879.42993', '0', '', '1757769879.42993', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.44707', 'lower': '', 'upper': 'a', 'object_count': 101, 'bytes_used': 1010, 'meta_timestamp': '1757769879.44707', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769879.44707', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.44812', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.44812', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.43452', 'epoch': '1757769879.43452', 'reported': 0, 'tombstones': -1}], 'cf7f350e-75d3-4a11-9a39-c276f013188e-') test DEBUG: /tmp/tmp48dkvj9r/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.43452.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp48dkvj9r/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.43452.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (6, 'e11d247dd1bc0dec5ff91d1341a321d4', 'cf7f350e-75d3-4a11-9a39-c276f013188e-', '1757769879.43253', '1757769879.44411', '0', '', '1757769879.42993', 101, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.44707', 'lower': '', 'upper': 'a', 'object_count': 101, 'bytes_used': 1010, 'meta_timestamp': '1757769879.44707', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769879.44707', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.44812', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.44812', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.43452', 'epoch': '1757769879.43452', 'reported': 0, 'tombstones': -1}], 'cf7f350e-75d3-4a11-9a39-c276f013188e-') test DEBUG: /tmp/tmp48dkvj9r/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.43452.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp48dkvj9r/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.43452.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (6, 'e11d247dd1bc0dec5ff91d1341a321d4', '9819ac09-beff-4363-ae6b-95a6e8bb3daf-', '1757769879.49187', '1757769879.48991', '0', '', '1757769879.48991', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.50450', 'lower': '', 'upper': 'a', 'object_count': 101, 'bytes_used': 1010, 'meta_timestamp': '1757769879.50450', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769879.50450', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.51114', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.51114', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.49318', 'epoch': '1757769879.49318', 'reported': 0, 'tombstones': -1}], '9819ac09-beff-4363-ae6b-95a6e8bb3daf-') test DEBUG: /tmp/tmpjvpkg5_p/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.49318.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpjvpkg5_p/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.49318.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (6, 'e11d247dd1bc0dec5ff91d1341a321d4', '9819ac09-beff-4363-ae6b-95a6e8bb3daf-', '1757769879.49187', '1757769879.50138', '0', '', '1757769879.48991', 101, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.50450', 'lower': '', 'upper': 'a', 'object_count': 101, 'bytes_used': 1010, 'meta_timestamp': '1757769879.50450', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769879.50450', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.51114', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.51114', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.49318', 'epoch': '1757769879.49318', 'reported': 0, 'tombstones': -1}], '9819ac09-beff-4363-ae6b-95a6e8bb3daf-')test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_sharded_large_diff test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_sharded_large_diff ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_sharding test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_sharding ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_sharding_large_diff test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_sharding_large_diff ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reclaim_deadlock test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reclaim_deadlock ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reclaim_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reclaim_shard_ranges ... ok test DEBUG: /tmp/tmpjvpkg5_p/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.49318.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpjvpkg5_p/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.49318.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (5, '9bbcee888b9529ee80d6331001347b7f', '1f3a868f-7856-41d6-9c70-89ce070d4625-', '1757769879.58635', '1757769879.58454', '0', '', '1757769879.58454', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.61155', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.61155', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769879.61155', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.61329', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.61329', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.59181', 'epoch': '1757769879.59181', 'reported': 0, 'tombstones': -1}], '1f3a868f-7856-41d6-9c70-89ce070d4625-') test DEBUG: /tmp/tmpq4_9zort/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.59181.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpq4_9zort/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.59181.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (5, '9bbcee888b9529ee80d6331001347b7f', '1f3a868f-7856-41d6-9c70-89ce070d4625-', '1757769879.58635', '1757769879.60452', '0', '', '1757769879.58454', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.61155', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.61155', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769879.61155', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.61329', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.61329', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.59181', 'epoch': '1757769879.59181', 'reported': 0, 'tombstones': -1}], '1f3a868f-7856-41d6-9c70-89ce070d4625-') test DEBUG: /tmp/tmpq4_9zort/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.59181.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpq4_9zort/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.59181.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (5, '9bbcee888b9529ee80d6331001347b7f', 'eb998b35-296a-4396-8b1d-01660f9b8cce-', '1757769879.65773', '1757769879.65593', '0', '', '1757769879.65593', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.67137', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.67137', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769879.67137', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.67600', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.67600', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.65906', 'epoch': '1757769879.65906', 'reported': 0, 'tombstones': -1}], 'eb998b35-296a-4396-8b1d-01660f9b8cce-') test DEBUG: /tmp/tmpsvd6kjl7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.65906.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpsvd6kjl7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.65906.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (5, '9bbcee888b9529ee80d6331001347b7f', 'eb998b35-296a-4396-8b1d-01660f9b8cce-', '1757769879.65773', '1757769879.66851', '0', '', '1757769879.65593', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.67137', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.67137', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769879.67137', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.67600', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.67600', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.65906', 'epoch': '1757769879.65906', 'reported': 0, 'tombstones': -1}], 'eb998b35-296a-4396-8b1d-01660f9b8cce-') test DEBUG: /tmp/tmpsvd6kjl7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.65906.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpsvd6kjl7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.65906.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '8158d1b165b4ef96dc3bab8c877c3f69', '628990b0-acf3-4764-903c-33e4b6478fa0-', '1757769879.72031', '1757769879.71750', '0', '', '1757769879.71750', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.72155', 'lower': '', 'upper': 'a', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769879.72155', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769879.72155', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.72175', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.72175', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.72161', 'epoch': '1757769879.72161', 'reported': 0, 'tombstones': -1}], '628990b0-acf3-4764-903c-33e4b6478fa0-') test DEBUG: /tmp/tmpzm82k6lc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.72161.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpzm82k6lc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.72161.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '8158d1b165b4ef96dc3bab8c877c3f69', '628990b0-acf3-4764-903c-33e4b6478fa0-', '1757769879.72031', '1757769879.72975', '0', '', '1757769879.71750', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.72155', 'lower': '', 'upper': 'a', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769879.72155', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769879.72155', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.72175', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.72175', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.72161', 'epoch': '1757769879.72161', 'reported': 0, 'tombstones': -1}], '628990b0-acf3-4764-903c-33e4b6478fa0-')test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_unsharded test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_unsharded ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reclaim_with_duplicate_names test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reclaim_with_duplicate_names ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_unsharded_large_diff test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharded_remote_unsharded_large_diff ... ok test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?limit=1&format=json&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test DEBUG: Found 1 objects in shard (state=unsharded), total = 49 (txn: tx0ddc142acbb940c3bcb0c-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx5295117f5d8b47849957a-0068c57096) test DEBUG: GET listing from 2 shards for: /v1/a/c?marker=%E2%98%86&format=json&states=listing (txn: tx5295117f5d8b47849957a-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx5295117f5d8b47849957a-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%86&format=json&limit=10000&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx5295117f5d8b47849957a-0068c57096) test DEBUG: Found 1022 objects in shard (state=unsharded), total = 1022 (txn: tx5295117f5d8b47849957a-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx5295117f5d8b47849957a-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_?marker=%E2%A8%83&format=json&limit=8978&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx5295117f5d8b47849957a-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2046 (txn: tx5295117f5d8b47849957a-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: GET listing from 4 shards for: /v1/a/c?end_marker=%E2%98%8A&format=json&states=listing (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_ham?end_marker=ham%00&format=json&limit=10000&marker= {'X-Backend-Record-Type': 'auto'} (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_pie?end_marker=pie%00&format=json&limit=9960&marker=h {'X-Backend-Record-Type': 'auto'} (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?end_marker=%E2%98%83%00&format=json&limit=9952&marker=p {'X-Backend-Record-Type': 'auto'} (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?end_marker=%E2%98%8A&format=json&limit=8928&marker=%D1%B0 {'X-Backend-Record-Type': 'auto'} (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test DEBUG: Found 6 objects in shard (state=unsharded), total = 1078 (txn: txf3326bf9f69f4ad2bd90d-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx846beabdd90d4a7a9d600-0068c57096) test DEBUG: GET listing from 5 shards for: /v1/a/c?prefix=hat&format=json&states=listing (txn: tx846beabdd90d4a7a9d600-0068c57096) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx846beabdd90d4a7a9d600-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_pie?prefix=hat&format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx846beabdd90d4a7a9d600-0068c57096) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: tx846beabdd90d4a7a9d600-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: txc3b28a78a7bf4fa28ad4c-0068c57096) test DEBUG: GET listing from 1 shards for: /v1/a/c?marker=%E2%98%86&end_marker=%E2%98%8A&limit=2&format=json&states=listing (txn: txc3b28a78a7bf4fa28ad4c-0068c57096) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: txc3b28a78a7bf4fa28ad4c-0068c57096) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%86&end_marker=%E2%98%8A&limit=2&format=json {'X-Backend-Record-Type': 'auto'} (txn: txc3b28a78a7bf4fa28ad4c-0068c57096) test DEBUG: Found 4 objects in shard (state=unsharded), total = 4 (txn: txc3b28a78a7bf4fa28ad4c-0068c57096) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx15ce1d7dde0147aab961a-0068c57097) test DEBUG: GET listing from 1 shards for: /v1/a/c?marker=%E2%98%8A&end_marker=%E2%98%86&limit=2&reverse=true&format=json&states=listing (txn: tx15ce1d7dde0147aab961a-0068c57097) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx15ce1d7dde0147aab961a-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%8A&end_marker=%E2%98%86&limit=2&reverse=true&format=json {'X-Backend-Record-Type': 'auto'} (txn: tx15ce1d7dde0147aab961a-0068c57097) test DEBUG: Found 4 objects in shard (state=unsharded), total = 4 (txn: tx15ce1d7dde0147aab961a-0068c57097) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txfed39ec9b3d14d0f89dec-0068c57097) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'auto'} (txn: txfed39ec9b3d14d0f89dec-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=10000&marker=&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: txfed39ec9b3d14d0f89dec-0068c57097) test DEBUG: Found 1 objects in shard (state=unsharded), total = 1 (txn: txfed39ec9b3d14d0f89dec-0068c57097) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_c', lower='b', upper='c') .shards_a/c_c with {'X-Backend-Record-Type': 'auto'} (txn: txfed39ec9b3d14d0f89dec-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_c?format=json&limit=9999&marker=b&end_marker=c%00 {'X-Backend-Record-Type': 'auto'} (txn: txfed39ec9b3d14d0f89dec-0068c57097) test DEBUG: Found 1 objects in shard (state=unsharded), total = 2 (txn: txfed39ec9b3d14d0f89dec-0068c57097) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='c', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txfed39ec9b3d14d0f89dec-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9998&marker=c&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txfed39ec9b3d14d0f89dec-0068c57097) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_?format=json&limit=9998&marker=c&end_marker=&states=listing: 404 (txn: txfed39ec9b3d14d0f89dec-0068c57097)test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_mix_ok_and_deleted_shard test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_with_mix_ok_and_deleted_shard ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reconciler_sync test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reconciler_sync ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_missing test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_missing ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_missing_large_diff test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_missing_large_diff ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_presharding test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_presharding ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_shard_ranges_state test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_merge_shard_ranges_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_newid test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_newid ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_object_stats_old_style_root_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_object_stats_old_style_root_container ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_sharding_shard_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_sharding_shard_no_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_object_stats_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_object_stats_old_style_shard_container ... ok test DEBUG: /tmp/tmpzm82k6lc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.72161.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpzm82k6lc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.72161.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '8158d1b165b4ef96dc3bab8c877c3f69', 'a03032b3-ae9f-4408-aa40-ddae7186bdbe-', '1757769879.77513', '1757769879.76923', '0', '', '1757769879.76923', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.77638', 'lower': '', 'upper': 'a', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769879.77638', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769879.77638', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.77657', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.77657', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.77644', 'epoch': '1757769879.77644', 'reported': 0, 'tombstones': -1}], 'a03032b3-ae9f-4408-aa40-ddae7186bdbe-') test DEBUG: /tmp/tmp27p2cihm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.77644.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp27p2cihm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.77644.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '8158d1b165b4ef96dc3bab8c877c3f69', 'a03032b3-ae9f-4408-aa40-ddae7186bdbe-', '1757769879.77513', '1757769879.79663', '0', '', '1757769879.76923', 99, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.77638', 'lower': '', 'upper': 'a', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769879.77638', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769879.77638', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.77657', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.77657', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.77644', 'epoch': '1757769879.77644', 'reported': 0, 'tombstones': -1}], 'a03032b3-ae9f-4408-aa40-ddae7186bdbe-') test DEBUG: /tmp/tmp27p2cihm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.77644.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp27p2cihm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.77644.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (8, 'ad8aa27b5ff13a7b8b69fc882b67c8ef', '355104d7-d37b-4cc2-ab32-3baaeab35d78-', '1757769879.84068', '1757769879.83449', '0', '', '1757769879.83449', 2, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('355104d7-d37b-4cc2-ab32-3baaeab35d78-', '5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.84382.db') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (8, 'ad8aa27b5ff13a7b8b69fc882b67c8ef', '355104d7-d37b-4cc2-ab32-3baaeab35d78-', '1757769879.84068', '1757769879.83449', '0', '', '1757769879.83449', 2, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.84213', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.84213', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769879.84213', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.84402', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.84402', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.84382', 'epoch': '1757769879.84382', 'reported': 0, 'tombstones': -1}], '355104d7-d37b-4cc2-ab32-3baaeab35d78-') test DEBUG: /tmp/tmp_9ugtkfc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.84382.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp_9ugtkfc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.84382.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (8, 'ad8aa27b5ff13a7b8b69fc882b67c8ef', '3323ed89-493d-4165-ad6c-a2230953ce5e-', '1757769879.87635', '1757769879.87463', '0', '', '1757769879.87463', 2, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('3323ed89-493d-4165-ad6c-a2230953ce5e-', '5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.87922.db') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (8, 'ad8aa27b5ff13a7b8b69fc882b67c8ef', '3323ed89-493d-4165-ad6c-a2230953ce5e-', '1757769879.87635', '1757769879.87463', '0', '', '1757769879.87463', 2, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769879.87746', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.87746', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769879.87746', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769879.87939', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769879.87939', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769879.87922', 'epoch': '1757769879.87922', 'reported': 0, 'tombstones': -1}], '3323ed89-493d-4165-ad6c-a2230953ce5e-') test DEBUG: /tmp/tmp89tfy032/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.87922.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp89tfy032/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.87922.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, 'a2a78f878bd3f019b68e525166e9e114', '1f5f3933-33e8-41b4-af2f-6bb4b80e242b-', '1757769879.91559', '1757769879.91378', '0', '', '1757769879.91378', 3, 0) test WARNING: /tmp/tmpy_dsbcay/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.91776.db is unable to replicate shard ranges to peer 10.0.0.1:1001/sdb; peer may need upgrading test WARNING: /tmp/tmpy_dsbcay/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.91776.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, 'a2a78f878bd3f019b68e525166e9e114', '1f5f3933-33e8-41b4-af2f-6bb4b80e242b-', '1757769879.91559', '1757769879.92471', '0', '', '1757769879.91378', 3, 0) test WARNING: /tmp/tmpy_dsbcay/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.91776.db is unable to replicate shard ranges to peer 10.0.0.1:1001/sdb; peer may need upgrading test WARNING: /tmp/tmpy_dsbcay/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.91776.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, 'a2a78f878bd3f019b68e525166e9e114', '19b97f29-7237-4410-a2b6-ff5c511e460c-', '1757769879.95159', '1757769879.94969', '0', '', '1757769879.94969', 3, 0)test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_presharding_large_diff test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_presharding_large_diff ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770062.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/572/c300fc77f99f60d8a3661473a89f5572/c300fc77f99f60d8a3661473a89f5572_1757770062.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/f4a/8230badf84a278d302008f5674bb0f4a/8230badf84a278d302008f5674bb0f4a.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770066.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/f4a/8230badf84a278d302008f5674bb0f4a/8230badf84a278d302008f5674bb0f4a_1757770066.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/fbb/5ef6f7b7c542ba088408fe4a9610cfbb/5ef6f7b7c542ba088408fe4a9610cfbb.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770070.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/fbb/5ef6f7b7c542ba088408fe4a9610cfbb/5ef6f7b7c542ba088408fe4a9610cfbb_1757770070.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/283/0286fe4904518334b59e90de88cc2283/0286fe4904518334b59e90de88cc2283.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770074.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/283/0286fe4904518334b59e90de88cc2283/0286fe4904518334b59e90de88cc2283_1757770074.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/fcb/3aed9a234fff8c87412fc276ef733fcb/3aed9a234fff8c87412fc276ef733fcb.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770078.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/fcb/3aed9a234fff8c87412fc276ef733fcb/3aed9a234fff8c87412fc276ef733fcb_1757770078.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/ceb/0d06db2594b100745697da614b412ceb/0d06db2594b100745697da614b412ceb.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770082.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/ceb/0d06db2594b100745697da614b412ceb/0d06db2594b100745697da614b412ceb_1757770082.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/f1a/64edae903855c5b0f707ff871ed22f1a/64edae903855c5b0f707ff871ed22f1a.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770086.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/f1a/64edae903855c5b0f707ff871ed22f1a/64edae903855c5b0f707ff871ed22f1a_1757770086.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/3b6/b5e516de671d5a968c268b19d31ce3b6/b5e516de671d5a968c268b19d31ce3b6.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770090.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/3b6/b5e516de671d5a968c268b19d31ce3b6/b5e516de671d5a968c268b19d31ce3b6_1757770090.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/237/086f9986210d254e4f306346cc31b237/086f9986210d254e4f306346cc31b237.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770094.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/237/086f9986210d254e4f306346cc31b237/086f9986210d254e4f306346cc31b237_1757770094.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/d41/659bc26fbfaabefadba828e8e3629d41/659bc26fbfaabefadba828e8e3629d41.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770098.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/d41/659bc26fbfaabefadba828e8e3629d41/659bc26fbfaabefadba828e8e3629d41_1757770098.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/9f9/669435364d85b096d0ba452b348c69f9/669435364d85b096d0ba452b348c69f9.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770102.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/9f9/669435364d85b096d0ba452b348c69f9/669435364d85b096d0ba452b348c69f9_1757770102.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/0f3/0cac656fc49d06e2a7fdcc19989b10f3/0cac656fc49d06e2a7fdcc19989b10f3.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770106.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/0f3/0cac656fc49d06e2a7fdcc19989b10f3/0cac656fc49d06e2a7fdcc19989b10f3_1757770106.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/9ed/b8726b74e99249e0373d956be93e49ed/b8726b74e99249e0373d956be93e49ed.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770110.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/9ed/b8726b74e99249e0373d956be93e49ed/b8726b74e99249e0373d956be93e49ed_1757770110.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/219/e653153336ad25603277b84517e29219/e653153336ad25603277b84517e29219.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770114.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/219/e653153336ad25603277b84517e29219/e653153336ad25603277b84517e29219_1757770114.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/74e/761983bd37ed51999c0e938ef1d6c74e/761983bd37ed51999c0e938ef1d6c74e.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770118.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/74e/761983bd37ed51999c0e938ef1d6c74e/761983bd37ed51999c0e938ef1d6c74e_1757770118.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/1de/2e3edb6f95662afb0b233fc393c5f1de/2e3edb6f95662afb0b233fc393c5f1de.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770122.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/1de/2e3edb6f95662afb0b233fc393c5f1de/2e3edb6f95662afb0b233fc393c5f1de_1757770122.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/101/b00ee0542d4ea27c4704a4e08ac3e101/b00ee0542d4ea27c4704a4e08ac3e101.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770126.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/101/b00ee0542d4ea27c4704a4e08ac3e101/b00ee0542d4ea27c4704a4e08ac3e101_1757770126.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/023/3a85040ad044d17acf3a079392ea0023/3a85040ad044d17acf3a079392ea0023.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770130.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/023/3a85040ad044d17acf3a079392ea0023/3a85040ad044d17acf3a079392ea0023_1757770130.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/d74/6cad9100c10143c2cfcdb9f80962ed74/6cad9100c10143c2cfcdb9f80962ed74.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770134.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/d74/6cad9100c10143c2cfcdb9f80962ed74/6cad9100c10143c2cfcdb9f80962ed74_1757770134.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/fd5/47e4500bd0ab7872728bf920cf68ffd5/47e4500bd0ab7872728bf920cf68ffd5.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770138.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/fd5/47e4500bd0ab7872728bf920cf68ffd5/47e4500bd0ab7872728bf920cf68ffd5_1757770138.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/578/0b4fe9fd4a16f1c6ae651d2815aae578/0b4fe9fd4a16f1c6ae651d2815aae578.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770142.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/578/0b4fe9fd4a16f1c6ae651d2815aae578/0b4fe9fd4a16f1c6ae651d2815aae578_1757770142.00000.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_object_stats_root_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_object_stats_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_remove_objects test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_remove_objects ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_resolve_shard_range_states test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_resolve_shard_range_states ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_object_stats_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_object_stats_shard_container ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_sharding test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_sharding ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_old_style_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_old_style_root_account_container_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_overlap_shard_range_order test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_overlap_shard_range_order ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_path test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_pending_file_name test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_pending_file_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_policy_stat_tracking test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_policy_stat_tracking ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_misplaced_object_does_not_effect_container_stats test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_misplaced_object_does_not_effect_container_stats ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_sharding_large_diff test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_sharding_large_diff ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object_multiple_encoded_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object_multiple_encoded_timestamps_using_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reverse_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_reverse_prefix_delim ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object_multiple_encoded_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object_multiple_encoded_timestamps_using_memory ... ok test WARNING: /tmp/tmpk0r31z2h/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.95390.db is unable to replicate shard ranges to peer 10.0.0.1:1001/sdb; peer may need upgrading test WARNING: /tmp/tmpk0r31z2h/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.95390.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, 'a2a78f878bd3f019b68e525166e9e114', '19b97f29-7237-4410-a2b6-ff5c511e460c-', '1757769879.95159', '1757769879.96158', '0', '', '1757769879.94969', 3, 0) test WARNING: /tmp/tmpk0r31z2h/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.95390.db is unable to replicate shard ranges to peer 10.0.0.1:1001/sdb; peer may need upgrading test WARNING: /tmp/tmpk0r31z2h/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769879.95390.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (10, '55c741e44857587e65bce772318c4ef2', '93b87db9-90dc-455e-bb0d-8bcc523aa48f-', '1757769880.00286', '1757769879.99707', '0', '', '1757769879.99707', 5, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.01781', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.01781', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769880.01781', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.02401', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.02401', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.00581', 'epoch': '1757769880.00581', 'reported': 0, 'tombstones': -1}], '93b87db9-90dc-455e-bb0d-8bcc523aa48f-') test DEBUG: /tmp/tmpw14yn7_s/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.00581.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpw14yn7_s/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.00581.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (10, '55c741e44857587e65bce772318c4ef2', '93b87db9-90dc-455e-bb0d-8bcc523aa48f-', '1757769880.00286', '1757769880.01489', '0', '', '1757769879.99707', 5, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.01781', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.01781', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769880.01781', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.02401', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.02401', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.00581', 'epoch': '1757769880.00581', 'reported': 0, 'tombstones': -1}], '93b87db9-90dc-455e-bb0d-8bcc523aa48f-') test DEBUG: /tmp/tmpw14yn7_s/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.00581.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpw14yn7_s/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.00581.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (10, 'd01e481b0c23a2c5633566a7c5b9e60b', '5a0a47bf-195b-433b-b5f8-6a0b593b2c5e-', '1757769880.06934', '1757769880.06764', '0', '', '1757769880.06764', 5, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.08121', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.08121', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769880.08121', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.08265', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.08265', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.07161', 'epoch': '1757769880.07161', 'reported': 0, 'tombstones': -1}], '5a0a47bf-195b-433b-b5f8-6a0b593b2c5e-') test DEBUG: /tmp/tmp1ea1wz8g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.07161.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp1ea1wz8g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.07161.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (10, 'd01e481b0c23a2c5633566a7c5b9e60b', '5a0a47bf-195b-433b-b5f8-6a0b593b2c5e-', '1757769880.06934', '1757769880.07839', '0', '', '1757769880.06764', 5, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.08121', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.08121', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769880.08121', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.08265', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.08265', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.07161', 'epoch': '1757769880.07161', 'reported': 0, 'tombstones': -1}], '5a0a47bf-195b-433b-b5f8-6a0b593b2c5e-') test DEBUG: /tmp/tmp1ea1wz8g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.07161.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp1ea1wz8g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.07161.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, 'f17ea3dd2ca15b9161f5e792aed32a00', '554889ae-1c47-432b-af26-0be832c13b1f-', '1757769880.13529', '1757769880.13355', '0', '', '1757769880.13355', 3, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.13643', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.13643', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769880.13643', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.13978', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.13978', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.13960', 'epoch': '1757769880.13960', 'reported': 0, 'tombstones': -1}], '554889ae-1c47-432b-af26-0be832c13b1f-') test DEBUG: /tmp/tmp8rc5boif/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.13960.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp8rc5boif/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.13960.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, 'f17ea3dd2ca15b9161f5e792aed32a00', '554889ae-1c47-432b-af26-0be832c13b1f-', '1757769880.13529', '1757769880.14668', '0', '', '1757769880.13355', 3, 0)test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_unsharded test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_unsharded ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object_multiple_explicit_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object_multiple_explicit_timestamps_using_file ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_unsharded_large_diff test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_sharding_remote_unsharded_large_diff ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_root_account_container_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object_multiple_explicit_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_put_object_multiple_explicit_timestamps_using_memory ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_unsharded_remote_missing test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_unsharded_remote_missing ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_save_and_load_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_save_and_load_record_from_pending_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reclaim ... ok test ERROR: Timeout talking to memcached: 1.2.3.4:11211: with key_prefix shard-updating-v2/acc, method get, config_timeout 0.01, time_spent 1.0 test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix incr_key, method incr, time_spent 0.0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 518, in incr new_val = self._add(fp, sock, cmd, add_val, timeout) File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 483, in _add sock.sendall(b' '.join([ ~~~~~~~~~~~~^^^^^^^^^^^^ b'add', cmd.hash_key, b'0', str(timeout).encode('ascii'), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ str(len(add_val)).encode('ascii') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ]) + b'\r\n' + add_val + b'\r\n') ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_memcached.py", line 119, in sendall handler(*parts[1:]) ~~~~~~~^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_memcached.py", line 1317, in handle_add raise Exception('add failed') Exception: add failed test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix set_key, method set, time_spent 0.0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/memcached.py", line 415, in set sock.sendall(set_msg(cmd.hash_key, flags, timeout, value)) ~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_memcached.py", line 119, in sendall handler(*parts[1:]) ~~~~~~~^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/common/test_memcached.py", line 1345, in handle_set raise Exception('set failed') Exception: set failed test ERROR: Timeout talking to memcached: 1.2.3.4:11211: with key_prefix shard-updating-v2/acc, method set, config_timeout 0.01, time_spent 1.0 test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method set, time_spent 0.0, [Errno 32] Broken pipe test ERROR: Error talking to memcached: 1.2.3.5:11211: with key_prefix some_key, method get, time_spent 0.0, [Errno 32] Broken pipe test WARNING: Item size larger than warning threshold: 9 (9) >= 1 (1) test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix too-big, method set, time_spent 0.0, failed set: SERVER_ERROR object too large for cache test WARNING: Item size larger than warning threshold: 9 (9) >= 1 (1) test ERROR: Error talking to memcached: 1.2.3.4:11211: with key_prefix too-big, method set, time_spent 0.0, failed set: SERVER_ERROR object too large for cache test ERROR: Problem finding shard upper in '/tmp/tmpy0ejzkmg/test_container.db': : LockTimeout (Nones) test ERROR: Problem finding shard upper in '/tmp/tmpy0ejzkmg/test_container.db': : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2498, in find_shard_ranges next_shard_upper = sub_broker._get_next_shard_range_upper( shard_size, last_shard_upper) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect sqlite3.OperationalError test DEBUG: Unlinked retiring db '/tmp/tmp9hgirac_/containers/part/suffix/hash/container.db' test WARNING: Unexpected db files will be ignored: ['/tmp/tmp9hgirac_/containers/part/suffix/hash/container.db'] Container 'a/c' cannot be set to sharded state while in unsharded state Container 'a/c' cannot be set to sharding state: missing epoch test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_unsharded_remote_sharded test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_unsharded_remote_sharded ... ok Container 'a/c' cannot be set to sharding state while in sharding state Container 'a/c' cannot be set to sharded state while in sharded state sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/ab3/cd301fbc5feac7014d9b029c59741ab3/cd301fbc5feac7014d9b029c59741ab3.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770146.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/ab3/cd301fbc5feac7014d9b029c59741ab3/cd301fbc5feac7014d9b029c59741ab3_1757770146.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/091/52629b460b03ba2a8038cdb25777b091/52629b460b03ba2a8038cdb25777b091.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770150.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/091/52629b460b03ba2a8038cdb25777b091/52629b460b03ba2a8038cdb25777b091_1757770150.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/4fa/0a535714cce7dff0f12b7fe1dd1ae4fa/0a535714cce7dff0f12b7fe1dd1ae4fa.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770154.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/4fa/0a535714cce7dff0f12b7fe1dd1ae4fa/0a535714cce7dff0f12b7fe1dd1ae4fa_1757770154.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/7ce/e9ce500038394606f9073d2054c3c7ce/e9ce500038394606f9073d2054c3c7ce.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770158.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/7ce/e9ce500038394606f9073d2054c3c7ce/e9ce500038394606f9073d2054c3c7ce_1757770158.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/b86/b0f47ea4f2fcfdb40e52dd2279412b86/b0f47ea4f2fcfdb40e52dd2279412b86.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770162.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/b86/b0f47ea4f2fcfdb40e52dd2279412b86/b0f47ea4f2fcfdb40e52dd2279412b86_1757770162.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/f09/84656f98f1833c32dab85ec6facd5f09/84656f98f1833c32dab85ec6facd5f09.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770166.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/f09/84656f98f1833c32dab85ec6facd5f09/84656f98f1833c32dab85ec6facd5f09_1757770166.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/1b1/89dc0ae47738b58edcac9225d83a81b1/89dc0ae47738b58edcac9225d83a81b1.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770170.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/1b1/89dc0ae47738b58edcac9225d83a81b1/89dc0ae47738b58edcac9225d83a81b1_1757770170.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/4a7/70eba850a5238168636dcf2b4960f4a7/70eba850a5238168636dcf2b4960f4a7.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770174.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/4a7/70eba850a5238168636dcf2b4960f4a7/70eba850a5238168636dcf2b4960f4a7_1757770174.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/870/7bbe042e24079963d39162fb3fbc1870/7bbe042e24079963d39162fb3fbc1870.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770178.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/870/7bbe042e24079963d39162fb3fbc1870/7bbe042e24079963d39162fb3fbc1870_1757770178.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/d70/87a5134cbcab374a92f8123eb8595d70/87a5134cbcab374a92f8123eb8595d70.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770182.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/d70/87a5134cbcab374a92f8123eb8595d70/87a5134cbcab374a92f8123eb8595d70_1757770182.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/cc5/e7656707611f0a2c313964e70f3b8cc5/e7656707611f0a2c313964e70f3b8cc5.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770186.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/cc5/e7656707611f0a2c313964e70f3b8cc5/e7656707611f0a2c313964e70f3b8cc5_1757770186.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/2e9/c3d41112fbeed5fb37926f94f19712e9/c3d41112fbeed5fb37926f94f19712e9.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770190.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/2e9/c3d41112fbeed5fb37926f94f19712e9/c3d41112fbeed5fb37926f94f19712e9_1757770190.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/049/e36cffeda1c865a14c7c009dc0d3d049/e36cffeda1c865a14c7c009dc0d3d049.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770194.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/049/e36cffeda1c865a14c7c009dc0d3d049/e36cffeda1c865a14c7c009dc0d3d049_1757770194.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/97d/916cc73efbdf299bc0aee48c42b1997d/916cc73efbdf299bc0aee48c42b1997d.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770198.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/97d/916cc73efbdf299bc0aee48c42b1997d/916cc73efbdf299bc0aee48c42b1997d_1757770198.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/7f4/b5c9419d45b73beab3c66c3440d4f7f4/b5c9419d45b73beab3c66c3440d4f7f4.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770202.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/7f4/b5c9419d45b73beab3c66c3440d4f7f4/b5c9419d45b73beab3c66c3440d4f7f4_1757770202.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/a73/f542dec40ea7013817cb80b3250cba73/f542dec40ea7013817cb80b3250cba73.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770206.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/a73/f542dec40ea7013817cb80b3250cba73/f542dec40ea7013817cb80b3250cba73_1757770206.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/480/a0955c081f1750bd6cc079aa35183480/a0955c081f1750bd6cc079aa35183480.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770210.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/480/a0955c081f1750bd6cc079aa35183480/a0955c081f1750bd6cc079aa35183480_1757770210.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/9ed/92f6c6162e91a424e4c0d1c19c91d9ed/92f6c6162e91a424e4c0d1c19c91d9ed.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770214.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/9ed/92f6c6162e91a424e4c0d1c19c91d9ed/92f6c6162e91a424e4c0d1c19c91d9ed_1757770214.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/abc/d1d083ae135629c52c4edd714f46dabc/d1d083ae135629c52c4edd714f46dabc.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770218.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/abc/d1d083ae135629c52c4edd714f46dabc/d1d083ae135629c52c4edd714f46dabc_1757770218.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/b0b/2edc6a4024a4f98212982f4ae4bcab0b/2edc6a4024a4f98212982f4ae4bcab0b.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770222.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/b0b/2edc6a4024a4f98212982f4ae4bcab0b/2edc6a4024a4f98212982f4ae4bcab0b_1757770222.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/05d/1ca50b7e8f0be0e47cbd6af2bb64b05d/1ca50b7e8f0be0e47cbd6af2bb64b05d.db' REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.13643', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.13643', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769880.13643', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.13978', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.13978', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.13960', 'epoch': '1757769880.13960', 'reported': 0, 'tombstones': -1}], '554889ae-1c47-432b-af26-0be832c13b1f-') test DEBUG: /tmp/tmp8rc5boif/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.13960.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp8rc5boif/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.13960.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, 'f17ea3dd2ca15b9161f5e792aed32a00', 'eb92883d-fb25-4eed-b3fd-eba37497dbe6-', '1757769880.18395', '1757769880.18215', '0', '', '1757769880.18215', 3, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.18526', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.18526', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769880.18526', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.18644', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.18644', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.18627', 'epoch': '1757769880.18627', 'reported': 0, 'tombstones': -1}], 'eb92883d-fb25-4eed-b3fd-eba37497dbe6-') test DEBUG: /tmp/tmp4s3kubum/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.18627.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp4s3kubum/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.18627.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, 'f17ea3dd2ca15b9161f5e792aed32a00', 'eb92883d-fb25-4eed-b3fd-eba37497dbe6-', '1757769880.18395', '1757769880.19358', '0', '', '1757769880.18215', 3, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.18526', 'lower': '', 'upper': 'a', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.18526', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769880.18526', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.18644', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.18644', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.18627', 'epoch': '1757769880.18627', 'reported': 0, 'tombstones': -1}], 'eb92883d-fb25-4eed-b3fd-eba37497dbe6-') test DEBUG: /tmp/tmp4s3kubum/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.18627.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmp4s3kubum/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872_1757769880.18627.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '5700b00ff1ab77e4fc48ed376b81fc1f', '36cfbe26-890d-48da-bafa-a117120fcd2d-sda', '1757769880.22680', '1757769880.22494', '0', '', '1757769880.22494', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('36cfbe26-890d-48da-bafa-a117120fcd2d-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (6, '2220e98e3fa2b844f3ff17d14a2bd03d', '11c56cff-bd54-4703-b90e-b332602e9d05-sda', '1757769880.24345', '1757769880.24169', '0', '', '1757769880.24169', 6, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.24880', 'lower': '', 'upper': 'a', 'object_count': 101, 'bytes_used': 1010, 'meta_timestamp': '1757769880.24880', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769880.24880', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.25509', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.25509', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.25487', 'epoch': '1757769880.25487', 'reported': 0, 'tombstones': -1}], '11c56cff-bd54-4703-b90e-b332602e9d05-sda') test DEBUG: /tmp/tmplppqqz0a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmplppqqz0a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (6, '2220e98e3fa2b844f3ff17d14a2bd03d', '11c56cff-bd54-4703-b90e-b332602e9d05-sda', '1757769880.24345', '1757769880.24589', '0', '', '1757769880.24169', 6, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.24880', 'lower': '', 'upper': 'a', 'object_count': 101, 'bytes_used': 1010, 'meta_timestamp': '1757769880.24880', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769880.24880', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.25509', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.25509', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.25487', 'epoch': '1757769880.25487', 'reported': 0, 'tombstones': -1}], '11c56cff-bd54-4703-b90e-b332602e9d05-sda') test DEBUG: /tmp/tmplppqqz0a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmplppqqz0a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (6, '2220e98e3fa2b844f3ff17d14a2bd03d', 'fda93980-0e86-4fdd-a598-78e9b6367bbd-sda', '1757769880.33147', '1757769880.32968', '0', '', '1757769880.32968', 6, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.33701', 'lower': '', 'upper': 'a', 'object_count': 101, 'bytes_used': 1010, 'meta_timestamp': '1757769880.33701', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769880.33701', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.33802', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.33802', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.33786', 'epoch': '1757769880.33786', 'reported': 0, 'tombstones': -1}], 'fda93980-0e86-4fdd-a598-78e9b6367bbd-sda') test DEBUG: /tmp/tmppuv98ywj/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmppuv98ywj/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleavingtest.unit.container.test_replicator.TestReplicatorSync.test_replication_local_unsharded_remote_sharded_large_diff test.unit.container.test_replicator.TestReplicatorSync.test_replication_local_unsharded_remote_sharded_large_diff ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_rsync_then_merge_aborts_after_merge_sharded test.unit.container.test_replicator.TestReplicatorSync.test_replication_rsync_then_merge_aborts_after_merge_sharded ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_db_states test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_db_states ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_rsync_then_merge_aborts_after_merge_sharding test.unit.container.test_replicator.TestReplicatorSync.test_replication_rsync_then_merge_aborts_after_merge_sharding ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_sharded_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_sharded_state_errors ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_rsync_then_merge_aborts_before_merge_sharded test.unit.container.test_replicator.TestReplicatorSync.test_replication_rsync_then_merge_aborts_before_merge_sharded ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replication_rsync_then_merge_aborts_before_merge_sharding test.unit.container.test_replicator.TestReplicatorSync.test_replication_rsync_then_merge_aborts_before_merge_sharding ... ok test.unit.container.test_replicator.TestReplicatorSync.test_replicator_sync test.unit.container.test_replicator.TestReplicatorSync.test_replicator_sync ... ok test.unit.container.test_replicator.TestReplicatorSync.test_report_up_to_date test.unit.container.test_replicator.TestReplicatorSync.test_report_up_to_date ... ok test.unit.container.test_replicator.TestReplicatorSync.test_rsync_failure test.unit.container.test_replicator.TestReplicatorSync.test_rsync_failure ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_sharding_state test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_sharding_state ... ok test.unit.container.test_replicator.TestReplicatorSync.test_rsync_then_merge test.unit.container.test_replicator.TestReplicatorSync.test_rsync_then_merge ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_bogus_db_quarantines test.unit.container.test_replicator.TestReplicatorSync.test_sync_bogus_db_quarantines ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_sharding_state_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_sharding_state_deleted ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharding_container_gap_in_shards_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharding_container_gap_in_shards_with_memcache ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerMimePutter.test_PUT_error test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerMimePutter.test_PUT_error ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerMimePutter.test_PUT_with_body_and_footers test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerMimePutter.test_PUT_with_body_and_footers ... ok test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerMimePutter.test_PUT_with_no_body_and_footers test.unit.proxy.controllers.test_obj.TestReplicatedObjControllerMimePutter.test_PUT_with_no_body_and_footers ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_sharding_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_sharding_state_errors ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_storage_policy_index test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_storage_policy_index ... ok REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (6, '2220e98e3fa2b844f3ff17d14a2bd03d', 'fda93980-0e86-4fdd-a598-78e9b6367bbd-sda', '1757769880.33147', '1757769880.33408', '0', '', '1757769880.32968', 6, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.sharded_a/sr-a', 'timestamp': '1757769880.33701', 'lower': '', 'upper': 'a', 'object_count': 101, 'bytes_used': 1010, 'meta_timestamp': '1757769880.33701', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769880.33701', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769880.33802', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769880.33802', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769880.33786', 'epoch': '1757769880.33786', 'reported': 0, 'tombstones': -1}], 'fda93980-0e86-4fdd-a598-78e9b6367bbd-sda') test DEBUG: /tmp/tmppuv98ywj/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 2 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmppuv98ywj/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '418b0b301fd708cc4563e1789cdea9e5', 'f17fda8e-8319-446a-86d0-3bf512ed6ae5-sda', '1757769880.38209', '1757769880.38030', '0', '', '1757769880.38030', 3, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, rsync_then_merge, ('f17fda8e-8319-446a-86d0-3bf512ed6ae5-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Unlinked retiring db '/tmp/tmp10bmby9i/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '418b0b301fd708cc4563e1789cdea9e5', '6f8f1278-8fc9-4ae6-8227-a653110a97ad-sda', '1757769880.42375', '1757769880.42188', '0', '', '1757769880.42188', 3, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, rsync_then_merge, ('6f8f1278-8fc9-4ae6-8227-a653110a97ad-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '418b0b301fd708cc4563e1789cdea9e5', '1171533b-ce9d-4254-bcf4-d2d16f5fa6fb-sda', '1757769880.46826', '1757769880.46640', '0', '', '1757769880.46640', 3, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, rsync_then_merge, ('1171533b-ce9d-4254-bcf4-d2d16f5fa6fb-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Unlinked retiring db '/tmp/tmpyjh8pe8g/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db' REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (3, '418b0b301fd708cc4563e1789cdea9e5', 'd6f6ca3e-4b0c-4e1b-aa46-570255272157-sda', '1757769880.50000', '1757769880.49821', '0', '', '1757769880.49821', 3, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, rsync_then_merge, ('d6f6ca3e-4b0c-4e1b-aa46-570255272157-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '828987b1-8fcd-4f7c-aba2-4b3a6a817538-sda', '1757769880.55532', '1757769880.55353', '0', '', '1757769880.55353', 0, 0) test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpk66idlwc/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '49c20553-8623-441e-9f1f-7b3387610c01-sdb', '1757769880.57686', '1757769881.00000', '0', '', '1757769881.00000', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('49c20553-8623-441e-9f1f-7b3387610c01-sdb', '5267a50d4a8f6ea3ee1dbecb8592e872.db') REPLICATE: /sda/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '49c20553-8623-441e-9f1f-7b3387610c01-sdb', '1757769880.57686', '1757769881.00000', '0', '', '1757769881.00000', 0, 0) test ERROR: Quarantining DB /tmp/tmpk66idlwc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sda/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('49c20553-8623-441e-9f1f-7b3387610c01-sdb', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00956 seconds (104.63416/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:2 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpwweo9ozy/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '3802c68b-8e3d-4462-a8cb-b727367177ca-sda', '1757769880.59629', '1757769880', '0', '', '1757769880', 0, 1) test DEBUG: /tmp/tmpwweo9ozy/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '3802c68b-8e3d-4462-a8cb-b727367177ca-sda', '1757769880.59629', '1757769880', '0', '', '1757769880', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('3802c68b-8e3d-4462-a8cb-b727367177ca-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01042 seconds (96.01373/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp3llzu9qk/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '3fe11dac87162bcad9abf6f9500c71c8', '26684075-b452-401c-8279-0d5b097c9be8-sda', '1757769880.61933', '1757769880', '0', '', '1757769880', 1, 1) test DEBUG: /tmp/tmp3llzu9qk/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769882.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], '26684075-b452-401c-8279-0d5b097c9be8-sda') test DEBUG: /tmp/tmp3llzu9qk/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.0028131s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '3fe11dac87162bcad9abf6f9500c71c8', '26684075-b452-401c-8279-0d5b097c9be8-sda', '1757769880.61933', '1757769880', '0', '', '1757769880', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('26684075-b452-401c-8279-0d5b097c9be8-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01632 seconds (61.26164/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp3q2pss2u/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '6727bb89-60d4-4782-885f-0d993a4f4f09-sda', '1757769880.64642', '1757769880', '0', '', '1757769880', 0, 0) test DEBUG: /tmp/tmp3q2pss2u/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '6727bb89-60d4-4782-885f-0d993a4f4f09-sda', '1757769880.64642', '1757769880', '0', '', '1757769880', 0, 0)test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_create_policy_over_newer_remote_create test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_create_policy_over_newer_remote_create ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_storage_policy_index_empty test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_storage_policy_index_empty ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770226.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/05d/1ca50b7e8f0be0e47cbd6af2bb64b05d/1ca50b7e8f0be0e47cbd6af2bb64b05d_1757770226.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/9a8/66bb4ca9da5a9747510de6d6f19489a8/66bb4ca9da5a9747510de6d6f19489a8.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770230.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/9a8/66bb4ca9da5a9747510de6d6f19489a8/66bb4ca9da5a9747510de6d6f19489a8_1757770230.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/8c9/83aea67d329e47747af8b71ca36e88c9/83aea67d329e47747af8b71ca36e88c9.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770234.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/8c9/83aea67d329e47747af8b71ca36e88c9/83aea67d329e47747af8b71ca36e88c9_1757770234.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/90f/6d0541003bc40b968e0cefb3f816690f/6d0541003bc40b968e0cefb3f816690f.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770238.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/90f/6d0541003bc40b968e0cefb3f816690f/6d0541003bc40b968e0cefb3f816690f_1757770238.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/85e/51159821f0e6c8fd400a3e65e53ea85e/51159821f0e6c8fd400a3e65e53ea85e.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770242.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/85e/51159821f0e6c8fd400a3e65e53ea85e/51159821f0e6c8fd400a3e65e53ea85e_1757770242.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/33f/11275d8c4f282bce16d7e666d31e633f/11275d8c4f282bce16d7e666d31e633f.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770246.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/33f/11275d8c4f282bce16d7e666d31e633f/11275d8c4f282bce16d7e666d31e633f_1757770246.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/065/3d36162f9d23f595bf321990840d4065/3d36162f9d23f595bf321990840d4065.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770250.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/065/3d36162f9d23f595bf321990840d4065/3d36162f9d23f595bf321990840d4065_1757770250.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/d87/d67d5a366ae159472086b5503e471d87/d67d5a366ae159472086b5503e471d87.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770254.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/d87/d67d5a366ae159472086b5503e471d87/d67d5a366ae159472086b5503e471d87_1757770254.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/0d3/0a0028b983f81260733779acfc9000d3/0a0028b983f81260733779acfc9000d3.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770258.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/0d3/0a0028b983f81260733779acfc9000d3/0a0028b983f81260733779acfc9000d3_1757770258.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/98a/a326ba8ddb87791211af23a9a93f798a/a326ba8ddb87791211af23a9a93f798a.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770262.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/98a/a326ba8ddb87791211af23a9a93f798a/a326ba8ddb87791211af23a9a93f798a_1757770262.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/3a1/5ea151e8adbc495bb49b58ea5bf963a1/5ea151e8adbc495bb49b58ea5bf963a1.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770266.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/3a1/5ea151e8adbc495bb49b58ea5bf963a1/5ea151e8adbc495bb49b58ea5bf963a1_1757770266.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/4c1/45b7a670d1a1b250fff5ce1e26c5e4c1/45b7a670d1a1b250fff5ce1e26c5e4c1.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770270.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/4c1/45b7a670d1a1b250fff5ce1e26c5e4c1/45b7a670d1a1b250fff5ce1e26c5e4c1_1757770270.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/294/a86e7beb884ec81e8050fe08853ef294/a86e7beb884ec81e8050fe08853ef294.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770274.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/294/a86e7beb884ec81e8050fe08853ef294/a86e7beb884ec81e8050fe08853ef294_1757770274.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/c94/0503c3be66d1026a686f190f58974c94/0503c3be66d1026a686f190f58974c94.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770278.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/c94/0503c3be66d1026a686f190f58974c94/0503c3be66d1026a686f190f58974c94_1757770278.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/bb7/38fe92e93da2c0c3f7d2374d90104bb7/38fe92e93da2c0c3f7d2374d90104bb7.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770282.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/bb7/38fe92e93da2c0c3f7d2374d90104bb7/38fe92e93da2c0c3f7d2374d90104bb7_1757770282.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/ee4/876999b37f9a9212531ac17cc9a7fee4/876999b37f9a9212531ac17cc9a7fee4.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770286.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/ee4/876999b37f9a9212531ac17cc9a7fee4/876999b37f9a9212531ac17cc9a7fee4_1757770286.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/717/00df43f6604dc7aa336fa914c2fea717/00df43f6604dc7aa336fa914c2fea717.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770290.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/717/00df43f6604dc7aa336fa914c2fea717/00df43f6604dc7aa336fa914c2fea717_1757770290.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/6f3/9cd5a3c37fcf0f0965f51af4943016f3/9cd5a3c37fcf0f0965f51af4943016f3.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770294.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/6f3/9cd5a3c37fcf0f0965f51af4943016f3/9cd5a3c37fcf0f0965f51af4943016f3_1757770294.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/ad3/914e18ef20f5771fc2c39b3846399ad3/914e18ef20f5771fc2c39b3846399ad3.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770298.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/ad3/914e18ef20f5771fc2c39b3846399ad3/914e18ef20f5771fc2c39b3846399ad3_1757770298.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/01b/93c7cfae97410fe623c6700e9d6e701b/93c7cfae97410fe623c6700e9d6e701b.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770302.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/01b/93c7cfae97410fe623c6700e9d6e701b/93c7cfae97410fe623c6700e9d6e701b_1757770302.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/f03/ada859bf2f427ec91bcfdba66cc7af03/ada859bf2f427ec91bcfdba66cc7af03.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770306.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/f03/ada859bf2f427ec91bcfdba66cc7af03/ada859bf2f427ec91bcfdba66cc7af03_1757770306.00000.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_x_syncs test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_set_x_syncs ... ok test ERROR: Aborting listing from shards due to bad response: [200, 200, 404] (txn: txfed39ec9b3d14d0f89dec-0068c57097) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='onion', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Found 1 objects in shard (state=unsharded), total = 41 (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='rhubarb', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9959&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1065 (txn: txba994d021b254e979b55f-0068c57098) test DEBUG: Setting object count to 1065 (txn: txba994d021b254e979b55f-0068c57098) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.1:1001/sdb (txn: tx2c10e015ac714f088789d-0068c57098) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.0:1000/sda (txn: tx2c10e015ac714f088789d-0068c57098) proxy-server ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o From Object Server 10.0.0.2:1002/sdc (txn: tx2c10e015ac714f088789d-0068c57098) proxy-server ERROR: Object PUT returning 503 for [503, 503, 503] (txn: tx2c10e015ac714f088789d-0068c57098) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmphvragvxs/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmphvragvxs/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmphvragvxs/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmphvragvxs/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/0/a" 201 - "-" "test" "-" 0.0029 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/0/a" 201 - "-" "test" "-" 0.0027 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/0/a1" 201 - "-" "test" "-" 0.0025 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/0/a1" 201 - "-" "test" "-" 0.0025 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txaa79f7ad802f4bae8c02d-0068c57098" "proxy-server 1824498" 0.0010 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://127.0.0.1:39669/sda1/0/a/c" "txaa79f7ad802f4bae8c02d-0068c57098" "container-server 1824498" 0.0009 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://127.0.0.1:42627/sdb1/0/a/c" "txaa79f7ad802f4bae8c02d-0068c57098" "container-server 1824498" 0.0008 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://localhost/v1/a/c" "txaa79f7ad802f4bae8c02d-0068c57098" "proxy-server 1824498" 0.0112 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://localhost/v1/a/c" "txaa79f7ad802f4bae8c02d-0068c57098" "proxy-server 1824498" 0.0079 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/40 PUT /v1/a/c HTTP/1.0 201 - - t - - - txaa79f7ad802f4bae8c02d-0068c57098 - 0.0180 - - 1757769880.701955795 1757769880.719975471 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sdb1/0/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx59be9ac1fdd142caa871a-0068c57098" "proxy-server 1824498" 0.0010 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/0/a1/c1" 201 - "PUT http://127.0.0.1:42627/sdb1/2/a1/c1" "tx59be9ac1fdd142caa871a-0068c57098" "container-server 1824498" 0.0010 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/0/a1/c1" 201 - "PUT http://127.0.0.1:39669/sda1/2/a1/c1" "tx59be9ac1fdd142caa871a-0068c57098" "container-server 1824498" 0.0010 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx59be9ac1fdd142caa871a-0068c57098" "proxy-server 1824498" 0.0110 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx59be9ac1fdd142caa871a-0068c57098" "proxy-server 1824498" 0.0079 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/40 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx59be9ac1fdd142caa871a-0068c57098 - 0.0178 - - 1757769880.721211910 1757769880.738967180 0 -/usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_CORS_expose_headers test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_CORS_expose_headers ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_CORS_valid_non_strict test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_CORS_valid_non_strict ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_CORS_valid_strict test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_CORS_valid_strict ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_CORS_valid_with_obj_headers test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_CORS_valid_with_obj_headers ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_create_policy_over_newer_remote_delete test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_create_policy_over_newer_remote_delete ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_DELETE test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_DELETE ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_DELETE_x_container_headers_with_more_container_replicas test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_DELETE_x_container_headers_with_more_container_replicas ... ok test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Getting listing part 1 from shard Namespace(name='a/c_sub_lemon', lower='juice', upper='lemon') a/c_sub_lemon with {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Get listing from /v1/a/c_sub_lemon?format=json&limit=9958&marker=j&end_marker=lemon%00 {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Found 2 objects in shard (state=unsharded), total = 4 (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_pie', lower='lemon', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'object'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9956&marker=l&end_marker=pie%00 {'X-Backend-Record-Type': 'object'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Found 4 objects in shard (state=sharding), total = 8 (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Found 8 objects in shard (state=sharding), total = 48 (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Setting object count to 1072 (txn: tx33bd61a62e3d45f78f925-0068c57097) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: GET listing from 3 shards for: /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c_sub_juice', lower='ham', upper='juice') a/c_sub_juice with {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Get listing from /v1/a/c_sub_juice?format=json&limit=9960&marker=h&end_marker=juice%00 {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Getting listing part 1 from shard Namespace(name='a/c_sub_lemon', lower='juice', upper='lemon') a/c_sub_lemon with {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Get listing from /v1/a/c_sub_lemon?format=json&limit=9958&marker=j&end_marker=lemon%00 {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Found 2 objects in shard (state=unsharded), total = 4 (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_pie', lower='lemon', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'object'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9956&marker=l&end_marker=pie%00 {'X-Backend-Record-Type': 'object'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Found 4 objects in shard (state=sharding), total = 8 (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Found 8 objects in shard (state=sharding), total = 48 (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Setting object count to 1072 (txn: tx41fce0ab68494e3a82a65-0068c57097) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: GET listing from 3 shards for: /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00&states=listing (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Getting listing part 0 from shard Namespace(name='a/c_sub_juice', lower='ham', upper='juice') a/c_sub_juice with {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Get listing from /v1/a/c_sub_juice?format=json&limit=9960&marker=h&end_marker=juice%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Getting listing part 1 from shard Namespace(name='a/c_sub_lemon', lower='juice', upper='lemon') a/c_sub_lemon with {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Get listing from /v1/a/c_sub_lemon?format=json&limit=9958&marker=j&end_marker=lemon%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Found 2 objects in shard (state=unsharded), total = 4 (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_pie', lower='lemon', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'object'} (txn: tx7530bc46c688496ca420c-0068c57098)test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_sharding_shard_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_sharding_shard_with_memcache ... ok REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('6727bb89-60d4-4782-885f-0d993a4f4f09-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01887 seconds (52.98687/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpj3smrwca/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '3fe11dac87162bcad9abf6f9500c71c8', '1440e50b-9234-4e0c-b19c-46857ef5aa5b-sda', '1757769880.67728', '1757769880', '0', '', '1757769880', 1, 0) test DEBUG: /tmp/tmpj3smrwca/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '3fe11dac87162bcad9abf6f9500c71c8', '1440e50b-9234-4e0c-b19c-46857ef5aa5b-sda', '1757769880.67728', '1757769880', '0', '', '1757769880', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('1440e50b-9234-4e0c-b19c-46857ef5aa5b-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01692 seconds (59.10932/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp9qp3rm9g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '37ebf350-c3f0-4c83-9a5e-c563dcf64500-sda', '1757769880.71292', '1757769880', '0', '', '1757769880', 0, 1) test DEBUG: /tmp/tmp9qp3rm9g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '37ebf350-c3f0-4c83-9a5e-c563dcf64500-sda', '1757769880.71292', '1757769880', '0', '', '1757769880', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('37ebf350-c3f0-4c83-9a5e-c563dcf64500-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01345 seconds (74.32437/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp0mc058by/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', '4283fdbd-5f31-4e15-905a-bf6fd5363d9d-sda', '1757769880.73642', '1757769880', '0', '', '1757769880', 1, 1) test DEBUG: /tmp/tmp0mc058by/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769883.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], '4283fdbd-5f31-4e15-905a-bf6fd5363d9d-sda') test DEBUG: /tmp/tmp0mc058by/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00277209s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', '4283fdbd-5f31-4e15-905a-bf6fd5363d9d-sda', '1757769880.73642', '1757769880', '0', '', '1757769880', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('4283fdbd-5f31-4e15-905a-bf6fd5363d9d-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01777 seconds (56.28924/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp78ix1u7x/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'c96cdd10-cac2-44b5-9696-bbf627ca1c7f-sda', '1757769880.76495', '1757769880', '0', '', '1757769880', 0, 0) test DEBUG: /tmp/tmp78ix1u7x/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'c96cdd10-cac2-44b5-9696-bbf627ca1c7f-sda', '1757769880.76495', '1757769880', '0', '', '1757769880', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('c96cdd10-cac2-44b5-9696-bbf627ca1c7f-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01112 seconds (89.94202/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpyfdieao4/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', '6175ad39-03fb-457a-b405-0d5957d880c2-sda', '1757769880.78652', '1757769880', '0', '', '1757769880', 1, 1) test DEBUG: /tmp/tmpyfdieao4/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', '6175ad39-03fb-457a-b405-0d5957d880c2-sda', '1757769880.78652', '1757769880', '0', '', '1757769880', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('6175ad39-03fb-457a-b405-0d5957d880c2-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02474 seconds (40.42063/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpu2s4763q/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'e084a13a-4886-407e-b4f9-7b0f743203ac-sda', '1757769880.82647', '1757769882', '0', '', '1757769882', 0, 1) test DEBUG: /tmp/tmpu2s4763q/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'e084a13a-4886-407e-b4f9-7b0f743203ac-sda', '1757769880.82647', '1757769882', '0', '', '1757769882', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('e084a13a-4886-407e-b4f9-7b0f743203ac-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01010 seconds (98.99600/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp9dpeh1im/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', 'f64db7d4-a493-4a7b-afcb-2058b5353557-sda', '1757769880.84722', '1757769882', '0', '', '1757769882', 1, 0)test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_create_policy_over_older_remote_delete test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_create_policy_over_older_remote_delete ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_sharding_initiated_and_required test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_sharding_initiated_and_required ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_bad_range_zero_byte test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_bad_range_zero_byte ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_half_delete_policy_over_newer_remote_create test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_half_delete_policy_over_newer_remote_create ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_sharding_state_is_not_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_sharding_state_is_not_reclaimable ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx739f11d4cc9642178d9c8-0068c57098" "proxy-server 1824498" 0.0058 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://127.0.0.1:39669/sda1/0/a/c1" "tx739f11d4cc9642178d9c8-0068c57098" "container-server 1824498" 0.0015 "-" 1824498 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://127.0.0.1:42627/sdb1/0/a/c1" "tx739f11d4cc9642178d9c8-0068c57098" "container-server 1824498" 0.0009 "-" 1824498 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx739f11d4cc9642178d9c8-0068c57098" "proxy-server 1824498" 0.0146 "-" 1824498 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx739f11d4cc9642178d9c8-0068c57098" "proxy-server 1824498" 0.0091 "-" 1824498 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/40 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx739f11d4cc9642178d9c8-0068c57098 - 0.0263 - - 1757769880.743798494 1757769880.770073414 1 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd9f01efac23e44e4b4fd5-0068c57098" "proxy-server 1824498" 0.0016 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://127.0.0.1:39669/sda1/2/a/c2" "txd9f01efac23e44e4b4fd5-0068c57098" "container-server 1824498" 0.0014 "-" 1824498 2 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://127.0.0.1:42627/sdb1/2/a/c2" "txd9f01efac23e44e4b4fd5-0068c57098" "container-server 1824498" 0.0008 "-" 1824498 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/2/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txd9f01efac23e44e4b4fd5-0068c57098" "proxy-server 1824498" 0.0077 "-" 1824498 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/2/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txd9f01efac23e44e4b4fd5-0068c57098" "proxy-server 1824498" 0.0121 "-" 1824498 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/40 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txd9f01efac23e44e4b4fd5-0068c57098 - 0.0190 - - 1757769880.771274567 1757769880.790288448 2 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 500 Trying to DELETE /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txcc4c09bdc7344454bc2a3-0068c57098) proxy-ut ERROR: ERROR 500 Trying to DELETE /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx24b541b7e4b340a4bc5ea-0068c57098) proxy-ut ERROR: ERROR 500 Trying to DELETE /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx24b541b7e4b340a4bc5ea-0068c57098) proxy-ut ERROR: Object DELETE returning 503 for (204, 503, 503) (txn: tx24b541b7e4b340a4bc5ea-0068c57098) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9034cb6a7dcd42b2b126f-0068c57098" "proxy-server 1824498" 0.0018 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx5686f38abc8b43fab902f-0068c57098" "proxy-server 1824498" 0.0012 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/0/a/c/o.zerobyte" 201 - "PUT http://localhost/sdb1/3/a/c/o.zerobyte" "tx00fe7e1101594d4cb4a2e-0068c57098" "object-server 1824498" 0.0004 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/0/a/c/o.zerobyte" 201 - "PUT http://localhost/sda1/3/a/c/o.zerobyte" "tx00fe7e1101594d4cb4a2e-0068c57098" "object-server 1824498" 0.0003 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sdb1/3/a/c/o.zerobyte" 201 - "PUT http://localhost/v1/a/c/o.zerobyte" "tx00fe7e1101594d4cb4a2e-0068c57098" "proxy-server 1824498" 0.0045 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "PUT /sda1/3/a/c/o.zerobyte" 201 - "PUT http://localhost/v1/a/c/o.zerobyte" "tx00fe7e1101594d4cb4a2e-0068c57098" "proxy-server 1824498" 0.0056 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/40 PUT /v1/a/c/o.zerobyte HTTP/1.0 201 - - t - - - tx00fe7e1101594d4cb4a2e-0068c57098 - 0.0168 - - 1757769880.846653461 1757769880.863436699 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1729ca5635814e30a3b70-0068c57098" "proxy-server 1824498" 0.0018 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txc0a1994b1a4f404387338-0068c57098" "proxy-server 1824498" 0.0286 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "GET /sdb1/3/a/c/o.zerobyte" 200 - "GET http://localhost/v1/a/c/o.zerobyte" "tx730f8075a8cc413e8bbe8-0068c57098" "proxy-server 1824498" 0.0003 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx08bba53af42d4db98c070-0068c57098" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx2a9111517a9844fe8af0b-0068c57098" "proxy-server 1824498" 0.0023 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "GET /sda1/3/a/c/o.zerobyte" 200 - "GET http://localhost/v1/a/c/o.zerobyte" "tx43b5c979436f45ecbb4cf-0068c57098" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_calls_authorize test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_calls_authorize ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_sharding_sysmeta test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_sharding_sysmeta ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_newest test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_newest ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_newest_large_file test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_newest_large_file ... ok test DEBUG: /tmp/tmp9dpeh1im/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769883.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], 'f64db7d4-a493-4a7b-afcb-2058b5353557-sda') test DEBUG: /tmp/tmp9dpeh1im/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00896549s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', 'f64db7d4-a493-4a7b-afcb-2058b5353557-sda', '1757769880.84722', '1757769882', '0', '', '1757769882', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('f64db7d4-a493-4a7b-afcb-2058b5353557-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.03157 seconds (31.67223/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpf5ofafq8/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', '4d805556-043e-4af4-9120-ecfe5f394ade-sda', '1757769880.88604', '1757769880', '1757769881', '', '1757769881', 1, 0) test DEBUG: /tmp/tmpf5ofafq8/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769883.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '4d805556-043e-4af4-9120-ecfe5f394ade-sda') test DEBUG: /tmp/tmpf5ofafq8/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00238395s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', '4d805556-043e-4af4-9120-ecfe5f394ade-sda', '1757769880.88604', '1757769880', '1757769881', '', '1757769881', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('4d805556-043e-4af4-9120-ecfe5f394ade-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01576 seconds (63.45448/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpiwyikv35/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', 'aeaae5d7-0b83-4558-b75d-0094af2aa1ad-sda', '1757769880.91165', '1757769880', '1757769881', '', '1757769881', 1, 1) test DEBUG: /tmp/tmpiwyikv35/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', 'aeaae5d7-0b83-4558-b75d-0094af2aa1ad-sda', '1757769880.91165', '1757769880', '1757769881', '', '1757769881', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('aeaae5d7-0b83-4558-b75d-0094af2aa1ad-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01625 seconds (61.52765/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpfwr7qcez/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '62930ba1-b5d2-4ba9-abe5-89e8ab9e78ff-sda', '1757769880.93914', '1757769882', '1757769881', '', '1757769882', 0, 0) test DEBUG: /tmp/tmpfwr7qcez/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '62930ba1-b5d2-4ba9-abe5-89e8ab9e78ff-sda', '1757769880.93914', '1757769882', '1757769881', '', '1757769882', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('62930ba1-b5d2-4ba9-abe5-89e8ab9e78ff-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01345 seconds (74.35995/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp0_dn8bmg/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '759443733b6ac223f6df20a8deb0fc4f', 'f7b188ff-79fe-4d7f-be0c-37d3b17b17c3-sda', '1757769880.96314', '1757769882', '1757769881', '', '1757769882', 1, 0) test DEBUG: /tmp/tmp0_dn8bmg/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769884.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], 'f7b188ff-79fe-4d7f-be0c-37d3b17b17c3-sda') test DEBUG: /tmp/tmp0_dn8bmg/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00279808s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '759443733b6ac223f6df20a8deb0fc4f', 'f7b188ff-79fe-4d7f-be0c-37d3b17b17c3-sda', '1757769880.96314', '1757769882', '1757769881', '', '1757769882', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('f7b188ff-79fe-4d7f-be0c-37d3b17b17c3-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01780 seconds (56.18067/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpefh7fanv/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '9a579f98-6d47-4fd8-a9fd-417ba2237e99-sda', '1757769880.99209', '1757769882', '1757769881', '', '1757769882', 0, 0) test DEBUG: /tmp/tmpefh7fanv/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '9a579f98-6d47-4fd8-a9fd-417ba2237e99-sda', '1757769880.99209', '1757769882', '1757769881', '', '1757769882', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('9a579f98-6d47-4fd8-a9fd-417ba2237e99-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01093 seconds (91.48397/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failurestest.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_newer_remote_create test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_newer_remote_create ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_storage_policy_property test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_storage_policy_property ... ok sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/7de/b594f128ab84cb1cda0d5ff33ed297de/b594f128ab84cb1cda0d5ff33ed297de.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770310.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/7de/b594f128ab84cb1cda0d5ff33ed297de/b594f128ab84cb1cda0d5ff33ed297de_1757770310.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/d2a/9dee34c264012907ce7aef2d4437bd2a/9dee34c264012907ce7aef2d4437bd2a.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770314.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/d2a/9dee34c264012907ce7aef2d4437bd2a/9dee34c264012907ce7aef2d4437bd2a_1757770314.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/8da/e12343aabc3571931b9bcf7320ea18da/e12343aabc3571931b9bcf7320ea18da.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770318.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/8da/e12343aabc3571931b9bcf7320ea18da/e12343aabc3571931b9bcf7320ea18da_1757770318.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/cc2/3c107f6b691ca748e4ac2384614c1cc2/3c107f6b691ca748e4ac2384614c1cc2.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770322.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/cc2/3c107f6b691ca748e4ac2384614c1cc2/3c107f6b691ca748e4ac2384614c1cc2_1757770322.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/5e9/765e3edc372f40b7685783935b6ca5e9/765e3edc372f40b7685783935b6ca5e9.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770326.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/5e9/765e3edc372f40b7685783935b6ca5e9/765e3edc372f40b7685783935b6ca5e9_1757770326.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/0f3/d4ff5436a71d6ab389321461b6d210f3/d4ff5436a71d6ab389321461b6d210f3.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770330.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/0f3/d4ff5436a71d6ab389321461b6d210f3/d4ff5436a71d6ab389321461b6d210f3_1757770330.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/b2c/c2a05accc5ee796e916289068181db2c/c2a05accc5ee796e916289068181db2c.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770334.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/b2c/c2a05accc5ee796e916289068181db2c/c2a05accc5ee796e916289068181db2c_1757770334.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/f8d/39c2f0c15eef15ff4f4b68488df6bf8d/39c2f0c15eef15ff4f4b68488df6bf8d.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770338.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/f8d/39c2f0c15eef15ff4f4b68488df6bf8d/39c2f0c15eef15ff4f4b68488df6bf8d_1757770338.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/e2f/f644ca241ac0eec9ef5106e6db759e2f/f644ca241ac0eec9ef5106e6db759e2f.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770342.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/e2f/f644ca241ac0eec9ef5106e6db759e2f/f644ca241ac0eec9ef5106e6db759e2f_1757770342.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/a9c/f8cda812c747d2a7074c1bb185fc4a9c/f8cda812c747d2a7074c1bb185fc4a9c.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770346.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/a9c/f8cda812c747d2a7074c1bb185fc4a9c/f8cda812c747d2a7074c1bb185fc4a9c_1757770346.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/7da/10d0cf61f6846021db212f078a84f7da/10d0cf61f6846021db212f078a84f7da.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770350.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/7da/10d0cf61f6846021db212f078a84f7da/10d0cf61f6846021db212f078a84f7da_1757770350.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/500/bbdeae957ddb754641f7e40a850a2500/bbdeae957ddb754641f7e40a850a2500.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770354.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/500/bbdeae957ddb754641f7e40a850a2500/bbdeae957ddb754641f7e40a850a2500_1757770354.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/9f0/f7a6add618955a7e60655a3a15a159f0/f7a6add618955a7e60655a3a15a159f0.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770358.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/9f0/f7a6add618955a7e60655a3a15a159f0/f7a6add618955a7e60655a3a15a159f0_1757770358.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/d36/f7735e8e38fbbed767e86fbd5ffd5d36/f7735e8e38fbbed767e86fbd5ffd5d36.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770362.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/d36/f7735e8e38fbbed767e86fbd5ffd5d36/f7735e8e38fbbed767e86fbd5ffd5d36_1757770362.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/442/472fca8c5eaab35e9902d595d7189442/472fca8c5eaab35e9902d595d7189442.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770366.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/442/472fca8c5eaab35e9902d595d7189442/472fca8c5eaab35e9902d595d7189442_1757770366.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/5da/c771121af3cc3736cc9cdac4948db5da/c771121af3cc3736cc9cdac4948db5da.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770370.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/5da/c771121af3cc3736cc9cdac4948db5da/c771121af3cc3736cc9cdac4948db5da_1757770370.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/553/f8c54f051ed8fd958dd80bf89c062553/f8c54f051ed8fd958dd80bf89c062553.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770374.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/553/f8c54f051ed8fd958dd80bf89c062553/f8c54f051ed8fd958dd80bf89c062553_1757770374.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/1dc/654f98b51bea88c07eb9e07f4c7d41dc/654f98b51bea88c07eb9e07f4c7d41dc.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770378.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/1dc/654f98b51bea88c07eb9e07f4c7d41dc/654f98b51bea88c07eb9e07f4c7d41dc_1757770378.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/888/6fb6c20ba84a014288a520e9546d3888/6fb6c20ba84a014288a520e9546d3888.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770382.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/888/6fb6c20ba84a014288a520e9546d3888/6fb6c20ba84a014288a520e9546d3888_1757770382.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/75a/f4a47e2915dc1e82535f926634bab75a/f4a47e2915dc1e82535f926634bab75a.db' sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770386.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/75a/f4a47e2915dc1e82535f926634bab75a/f4a47e2915dc1e82535f926634bab75a_1757770386.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp833y8q7n/sda/containers/0/871/cab6fc803bb4bb332e40e3d3fdacc871/cab6fc803bb4bb332e40e3d3fdacc871.db'test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_not_merged_once_sharded test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_not_merged_once_sharded ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_sync_merging test.unit.container.test_backend.TestContainerBrokerBeforeShardRanges.test_sync_merging ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_overlap_not_merged_while_cleaving_1 test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_overlap_not_merged_while_cleaving_1 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_batch_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_batch_reclaim ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_newer_remote_delete test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_newer_remote_delete ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_overlap_not_merged_while_cleaving_2 test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_overlap_not_merged_while_cleaving_2 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_chexor test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_chexor ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_replace_existing_while_cleaving test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_replace_existing_while_cleaving ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_create_broker test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_create_broker ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_creation test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_creation ... ok test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpv1lo_z3r/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0fa19a071f3d8d8bc0be3c6980d37811', 'ac274462-86e9-41de-b49d-b382d0b46de8-sda', '1757769881.02252', '1757769883', '1757769882', '', '1757769883', 1, 1) test DEBUG: /tmp/tmpv1lo_z3r/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0fa19a071f3d8d8bc0be3c6980d37811', 'ac274462-86e9-41de-b49d-b382d0b46de8-sda', '1757769881.02252', '1757769883', '1757769882', '', '1757769883', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('ac274462-86e9-41de-b49d-b382d0b46de8-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02058 seconds (48.58431/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpk6x2a6e8/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'f0afbb53-56cb-4b03-a2df-2c95d2df3888-sda', '1757769881.06319', '1757769884', '1757769883', '', '1757769884', 0, 0) test DEBUG: /tmp/tmpk6x2a6e8/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'f0afbb53-56cb-4b03-a2df-2c95d2df3888-sda', '1757769881.06319', '1757769884', '1757769883', '', '1757769884', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('f0afbb53-56cb-4b03-a2df-2c95d2df3888-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00980 seconds (102.06257/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpxnz4yak4/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '20905e76-14bc-410f-a42c-851d26b0ce5d-sda', '1757769881.08389', '1757769884', '1757769883', '', '1757769884', 1, 1) test DEBUG: /tmp/tmpxnz4yak4/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769886.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], '20905e76-14bc-410f-a42c-851d26b0ce5d-sda') test DEBUG: /tmp/tmpxnz4yak4/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00702167s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '20905e76-14bc-410f-a42c-851d26b0ce5d-sda', '1757769881.08389', '1757769884', '1757769883', '', '1757769884', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('20905e76-14bc-410f-a42c-851d26b0ce5d-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02354 seconds (42.48368/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpi9i6hyer/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '947170f5-c08e-46dd-a868-a6169ff570f9-sda', '1757769881.11816', '1757769884', '1757769883', '', '1757769884', 0, 0) test DEBUG: /tmp/tmpi9i6hyer/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '947170f5-c08e-46dd-a868-a6169ff570f9-sda', '1757769881.11816', '1757769884', '1757769883', '', '1757769884', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('947170f5-c08e-46dd-a868-a6169ff570f9-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00995 seconds (100.45896/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpmt61k_qd/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', 'e632419c-9898-4046-9aa3-8899dc0097bc-sda', '1757769881.14164', '1757769884', '1757769883', '', '1757769884', 1, 1) test DEBUG: /tmp/tmpmt61k_qd/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', 'e632419c-9898-4046-9aa3-8899dc0097bc-sda', '1757769881.14164', '1757769884', '1757769883', '', '1757769884', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('e632419c-9898-4046-9aa3-8899dc0097bc-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01202 seconds (83.20477/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpe6r_j1yx/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '8b135c54-5763-48ec-91e5-453b70de9772-sda', '1757769881.16909', '1757769884', '1757769883', '', '1757769884', 0, 1) test DEBUG: /tmp/tmpe6r_j1yx/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '8b135c54-5763-48ec-91e5-453b70de9772-sda', '1757769881.16909', '1757769884', '1757769883', '', '1757769884', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('8b135c54-5763-48ec-91e5-453b70de9772-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01139 seconds (87.75903/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp050d1xie/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0fa19a071f3d8d8bc0be3c6980d37811', '1208b83d-d5f8-4e1e-8ee3-a2ab7fc7f839-sda', '1757769881.19054', '1757769884', '1757769883', '', '1757769884', 1, 1) test DEBUG: /tmp/tmp050d1xie/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_supplement_deleted_while_cleaving test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_supplement_deleted_while_cleaving ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_db_file test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_db_file ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_older_remote_create test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_older_remote_create ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_delete_db_does_not_clear_particular_sharding_meta test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_delete_db_does_not_clear_particular_sharding_meta ... ok sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770390.00000-0, db: /tmp/tmp833y8q7n/sda/containers/0/871/cab6fc803bb4bb332e40e3d3fdacc871/cab6fc803bb4bb332e40e3d3fdacc871_1757770390.00000.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769884.00000-0, db: /tmp/tmpk1arly0l/sda/containers/0/3c6/797cf0ee8c1a86f97f7ec42f0f9b43c6/797cf0ee8c1a86f97f7ec42f0f9b43c6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769888.00000-0, db: /tmp/tmpk1arly0l/sda/containers/0/14e/06aae6d6b588a59c64f6528cb463a14e/06aae6d6b588a59c64f6528cb463a14e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769892.00000-0, db: /tmp/tmpk1arly0l/sda/containers/0/932/3156e29d34d555a1864eda78508fe932/3156e29d34d555a1864eda78508fe932.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769896.00000-0, db: /tmp/tmpk1arly0l/sda/containers/0/2e2/37c67cb6218d509e6fe1642f40a122e2/37c67cb6218d509e6fe1642f40a122e2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmp1kf57i0d/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769888.00000-0, db: /tmp/tmp1kf57i0d/sda/containers/0/14e/06aae6d6b588a59c64f6528cb463a14e/06aae6d6b588a59c64f6528cb463a14e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmp1kf57i0d/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769894.00000-0, db: /tmp/tmp1kf57i0d/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating 1 children shard ranges from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441.db sharder-test DEBUG: Updating 1 children shard ranges from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769893.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/615/77569f03a8aef55e1d9ce139c71d4615/77569f03a8aef55e1d9ce139c71d4615.db sharder-test DEBUG: Updating 1 children shard ranges from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769893.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/615/77569f03a8aef55e1d9ce139c71d4615/77569f03a8aef55e1d9ce139c71d4615.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769893.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/615/77569f03a8aef55e1d9ce139c71d4615/77569f03a8aef55e1d9ce139c71d4615.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769897.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/6d0/cb77bd015829c04863e9d2518065f6d0/cb77bd015829c04863e9d2518065f6d0.db sharder-test DEBUG: Updating 1 children shard ranges from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769897.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/6d0/cb77bd015829c04863e9d2518065f6d0/cb77bd015829c04863e9d2518065f6d0.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769897.00000-0, db: /tmp/tmpbhvaw9lq/sda/containers/0/6d0/cb77bd015829c04863e9d2518065f6d0/cb77bd015829c04863e9d2518065f6d0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmpq27e5jf9/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmpq27e5jf9/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769888.00000-0, db: /tmp/tmpq27e5jf9/sda/containers/0/14e/06aae6d6b588a59c64f6528cb463a14e/06aae6d6b588a59c64f6528cb463a14e.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769888.00000-0, db: /tmp/tmpq27e5jf9/sda/containers/0/14e/06aae6d6b588a59c64f6528cb463a14e/06aae6d6b588a59c64f6528cb463a14e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmpq27e5jf9/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmpq27e5jf9/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769894.00000-0, db: /tmp/tmpq27e5jf9/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f.db sharder-test DEBUG: Updating 2 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769894.00000-0, db: /tmp/tmpq27e5jf9/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmp7m7hywrx/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmp7m7hywrx/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769888.00000-0, db: /tmp/tmp7m7hywrx/sda/containers/0/14e/06aae6d6b588a59c64f6528cb463a14e/06aae6d6b588a59c64f6528cb463a14e.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769888.00000-0, db: /tmp/tmp7m7hywrx/sda/containers/0/14e/06aae6d6b588a59c64f6528cb463a14e/06aae6d6b588a59c64f6528cb463a14e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmp7m7hywrx/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.dbtest.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_supplement_existing_while_cleaving test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_supplement_existing_while_cleaving ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_with_gap_not_merged_while_cleaving test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_with_gap_not_merged_while_cleaving ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_delete_object test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_delete_object ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_double_check_trailing_delimiter test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_double_check_trailing_delimiter ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_double_check_trailing_delimiter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_double_check_trailing_delimiter_non_slash ... ok REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769885.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], '1208b83d-d5f8-4e1e-8ee3-a2ab7fc7f839-sda') test DEBUG: /tmp/tmp050d1xie/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00284386s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0fa19a071f3d8d8bc0be3c6980d37811', '1208b83d-d5f8-4e1e-8ee3-a2ab7fc7f839-sda', '1757769881.19054', '1757769884', '1757769883', '', '1757769884', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('1208b83d-d5f8-4e1e-8ee3-a2ab7fc7f839-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02086 seconds (47.92755/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpxs0x5k0c/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '432f9919-2580-4eb0-9fcf-9bdb433d0bfc-sda', '1757769881.22974', '1757769884', '1757769883', '', '1757769884', 0, 1) test DEBUG: /tmp/tmpxs0x5k0c/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '432f9919-2580-4eb0-9fcf-9bdb433d0bfc-sda', '1757769881.22974', '1757769884', '1757769883', '', '1757769884', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('432f9919-2580-4eb0-9fcf-9bdb433d0bfc-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01077 seconds (92.87155/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpqug_x7ej/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0fa19a071f3d8d8bc0be3c6980d37811', '6fe56a5b-a0f9-4c63-88a0-48d11cfde4d3-sda', '1757769881.25738', '1757769884', '1757769883', '', '1757769884', 1, 0) test DEBUG: /tmp/tmpqug_x7ej/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0fa19a071f3d8d8bc0be3c6980d37811', '6fe56a5b-a0f9-4c63-88a0-48d11cfde4d3-sda', '1757769881.25738', '1757769884', '1757769883', '', '1757769884', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('6fe56a5b-a0f9-4c63-88a0-48d11cfde4d3-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01134 seconds (88.19082/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpuwmfb__w/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '2d8e5b90-e10f-4dc7-96d9-c563ae95fb09-sda', '1757769881.28011', '1757769885', '1757769884', '', '1757769885', 0, 1) test DEBUG: /tmp/tmpuwmfb__w/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '2d8e5b90-e10f-4dc7-96d9-c563ae95fb09-sda', '1757769881.28011', '1757769885', '1757769884', '', '1757769885', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('2d8e5b90-e10f-4dc7-96d9-c563ae95fb09-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00947 seconds (105.59566/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp7ug56bg7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '96c1889a-a750-44f8-b980-3108c485638a-sda', '1757769881.30011', '1757769885', '1757769884', '', '1757769885', 1, 1) test DEBUG: /tmp/tmp7ug56bg7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769886.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], '96c1889a-a750-44f8-b980-3108c485638a-sda') test DEBUG: /tmp/tmp7ug56bg7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00501776s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '96c1889a-a750-44f8-b980-3108c485638a-sda', '1757769881.30011', '1757769885', '1757769884', '', '1757769885', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('96c1889a-a750-44f8-b980-3108c485638a-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01685 seconds (59.36113/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpas3rkm9g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'f53c96b1-8b6c-4399-976d-9164628b0ef0-sda', '1757769881.32737', '1757769885', '1757769884', '', '1757769885', 0, 0) test DEBUG: /tmp/tmpas3rkm9g/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'f53c96b1-8b6c-4399-976d-9164628b0ef0-sda', '1757769881.32737', '1757769885', '1757769884', '', '1757769885', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('f53c96b1-8b6c-4399-976d-9164628b0ef0-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01012 seconds (98.78848/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpf35_cbq3/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', 'adb9eee2-6ff2-44f0-b497-6714dff1cb04-sda', '1757769881.34789', '1757769885', '1757769884', '', '1757769885', 1, 0) test DEBUG: /tmp/tmpf35_cbq3/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', 'adb9eee2-6ff2-44f0-b497-6714dff1cb04-sda', '1757769881.34789', '1757769885', '1757769884', '', '1757769885', 1, 0)test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_older_remote_delete test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_older_remote_delete ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_pipeline test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_pipeline ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx768bc44c4efc4c27a81ee-0068c57098) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx3cc13f565fd44add8aff8-0068c57098) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txe9a48bbec02f486993c7b-0068c57098) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txbfb2644aedc847f7a59fd-0068c57098) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx70c7c8a1a04545de9ef5e-0068c57098) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx51ae80d7625744dfac6c3-0068c57098) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:40 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe42694822dd943c4ac2bf-0068c57098" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx6f0a13b65873433f96f9b-0068c57098" "proxy-server 1824498" 0.0013 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/0/a/c/o.large" 201 - "PUT http://localhost/sda1/1/a/c/o.large" "txeedaa43fcba440e6abc3d-0068c57099" "object-server 1824498" 0.0005 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/0/a/c/o.large" 201 - "PUT http://localhost/sdb1/1/a/c/o.large" "txeedaa43fcba440e6abc3d-0068c57099" "object-server 1824498" 0.0004 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/1/a/c/o.large" 201 - "PUT http://localhost/v1/a/c/o.large" "txeedaa43fcba440e6abc3d-0068c57099" "proxy-server 1824498" 0.0158 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/1/a/c/o.large" 201 - "PUT http://localhost/v1/a/c/o.large" "txeedaa43fcba440e6abc3d-0068c57099" "proxy-server 1824498" 0.0158 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/41 PUT /v1/a/c/o.large HTTP/1.0 201 - - t 1048576 - - txeedaa43fcba440e6abc3d-0068c57099 - 0.0276 - - 1757769880.994713545 1757769881.022298813 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6f1c15321f99416a83376-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx49492042234f4f32a5f5b-0068c57099" "proxy-server 1824498" 0.0023 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sda1/1/a/c/o.large" 200 1048576 "GET http://localhost/v1/a/c/o.large" "tx3ede43407e234216b704e-0068c57099" "proxy-server 1824498" 0.0003 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sdb1/1/a/c/o.large" 200 1048576 "GET http://localhost/v1/a/c/o.large" "tx3ede43407e234216b704e-0068c57099" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: (1824498) wsgi starting up on http://127.0.0.1:42481 proxy DEBUG: (1824498) accepted ('127.0.0.1', 51930) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txff19baa097bb4d98baa4f-0068c57099" "proxy-server 1824498" 0.0012 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/0/a/zero" 201 - "PUT http://127.0.0.1:39669/sda1/2/a/zero" "txff19baa097bb4d98baa4f-0068c57099" "container-server 1824498" 0.0010 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/0/a/zero" 201 - "PUT http://127.0.0.1:42627/sdb1/2/a/zero" "txff19baa097bb4d98baa4f-0068c57099" "container-server 1824498" 0.0009 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/2/a/zero" 201 - "PUT http://localhost/v1/a/zero" "txff19baa097bb4d98baa4f-0068c57099" "proxy-server 1824498" 0.0075 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/2/a/zero" 201 - "PUT http://localhost/v1/a/zero" "txff19baa097bb4d98baa4f-0068c57099" "proxy-server 1824498" 0.0129 "-" 1824498 0 proxy INFO: 127.0.0.1 - - [13/Sep/2025 13:24:41] "PUT /v1/a/zero HTTP/1.1" 201 174 0.020270 (txn: txff19baa097bb4d98baa4f-0068c57099) proxy DEBUG: (1824498) accepted ('127.0.0.1', 51940) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfd14b33b900c429ab2f95-0068c57099" "proxy-server 1824498" 0.0018 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/2/a/zero" 204 - "HEAD http://localhost/v1/a/zero" "tx95f4d0749d3949b792c52-0068c57099" "proxy-server 1824498" 0.0019 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/2/a/zero/go-get-it" 201 - "PUT http://localhost/sdb1/3/a/zero/go-get-it" "txfa703b1242354188a47da-0068c57099" "object-server 1824498" 0.0004 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/2/a/zero/go-get-it" 201 - "PUT http://localhost/sda1/3/a/zero/go-get-it" "txfa703b1242354188a47da-0068c57099" "object-server 1824498" 0.0004 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/3/a/zero/go-get-it" 201 - "PUT http://localhost/v1/a/zero/go-get-it" "txfa703b1242354188a47da-0068c57099" "proxy-server 1824498" 0.0083 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/3/a/zero/go-get-it" 201 - "PUT http://localhost/v1/a/zero/go-get-it" "txfa703b1242354188a47da-0068c57099" "proxy-server 1824498" 0.0094 "-" 1824498 0 proxy INFO: 127.0.0.1 - - [13/Sep/2025 13:24:41] "PUT /v1/a/zero/go-get-it HTTP/1.1" 201 206 0.021531 (txn: txfa703b1242354188a47da-0068c57099) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa80787039ad44564aa383-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/2/a/zero" 204 - "HEAD http://localhost/v1/a/zero" "txb1dd817e39d547d593718-0068c57099" "proxy-server 1824498" 0.0046 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sdb1/3/a/zero/go-get-it" 200 1309 "GET http://localhost/v1/a/zero/go-get-it" "tx988c434007d647cfaf527-0068c57099" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 - - [13/Sep/2025 13:24:41] "GET /v1/a/zero/go-get-it HTTP/1.1" 200 1729 0.014460 (txn: tx988c434007d647cfaf527-0068c57099) proxy DEBUG: (1824498) timed out ('127.0.0.1', 51940) (txn: tx988c434007d647cfaf527-0068c57099) proxy INFO: (1824498) wsgi exited, is_accepting=True proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmp7m7hywrx/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769894.00000-0, db: /tmp/tmp7m7hywrx/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769894.00000-0, db: /tmp/tmp7m7hywrx/sda/containers/0/70f/900e993527932465b20e55940208770f/900e993527932465b20e55940208770f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769885.00000-0, db: /tmp/tmpimrdhpbt/sda/containers/0/3ac/9fad4abf49ed3b1d1d2210d269f643ac/9fad4abf49ed3b1d1d2210d269f643ac.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769887.00000-0, db: /tmp/tmpimrdhpbt/sda/containers/0/c4e/6ca47e6a490852386f4a08f6d3049c4e/6ca47e6a490852386f4a08f6d3049c4e.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmpimrdhpbt/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769891.00000-0, db: /tmp/tmpimrdhpbt/sda/containers/0/aa4/5ea7f16815081f0ad2185d99aced9aa4/5ea7f16815081f0ad2185d99aced9aa4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769886.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/29f/a4f1502281f7d127ca1b93786f54129f/a4f1502281f7d127ca1b93786f54129f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769889.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/441/f982b3dd131f645ff0ba425c9f428441/f982b3dd131f645ff0ba425c9f428441.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769892.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/932/3156e29d34d555a1864eda78508fe932/3156e29d34d555a1864eda78508fe932.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769892.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/932/3156e29d34d555a1864eda78508fe932/3156e29d34d555a1864eda78508fe932.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769895.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/f23/ee518d315de13f098b3e3dc1cecbbf23/ee518d315de13f098b3e3dc1cecbbf23.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769895.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/f23/ee518d315de13f098b3e3dc1cecbbf23/ee518d315de13f098b3e3dc1cecbbf23.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769898.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769898.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/06d/da94d5e3af454359c318802d151a006d/da94d5e3af454359c318802d151a006d.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769901.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/774/7747f025f0720db7ac5c8ba9faa84774/7747f025f0720db7ac5c8ba9faa84774.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769901.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/774/7747f025f0720db7ac5c8ba9faa84774/7747f025f0720db7ac5c8ba9faa84774.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769904.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/50c/f03c7d0afda28f03f1aaf9cc97d7650c/f03c7d0afda28f03f1aaf9cc97d7650c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769904.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/50c/f03c7d0afda28f03f1aaf9cc97d7650c/f03c7d0afda28f03f1aaf9cc97d7650c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769907.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/ea2/3330e89568ca8f797c0453f18faa0ea2/3330e89568ca8f797c0453f18faa0ea2.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769907.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/ea2/3330e89568ca8f797c0453f18faa0ea2/3330e89568ca8f797c0453f18faa0ea2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769910.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769910.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/1e1/96aa5af942b85d51802968b18deff1e1/96aa5af942b85d51802968b18deff1e1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769913.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/e78/654282fb44cb0ccca86097f6a5abae78/654282fb44cb0ccca86097f6a5abae78.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769913.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/e78/654282fb44cb0ccca86097f6a5abae78/654282fb44cb0ccca86097f6a5abae78.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769916.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/7be/53bd02c37d4dca9b69bcc559deec27be/53bd02c37d4dca9b69bcc559deec27be.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769916.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/7be/53bd02c37d4dca9b69bcc559deec27be/53bd02c37d4dca9b69bcc559deec27be.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769919.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/02f/3d3793b06830504df1ee74ae88ae202f/3d3793b06830504df1ee74ae88ae202f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769919.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/02f/3d3793b06830504df1ee74ae88ae202f/3d3793b06830504df1ee74ae88ae202f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769922.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769922.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/54a/9fe8f3e410888a2db90b2cd07efd754a/9fe8f3e410888a2db90b2cd07efd754a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769925.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/e07/afde046acf5ff4350c667ee65cd90e07/afde046acf5ff4350c667ee65cd90e07.dbtest.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_older_remote_recreate test.unit.container.test_replicator.TestReplicatorSync.test_sync_local_recreate_policy_over_older_remote_recreate ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_ranges test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_ranges ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_merge_timestamps test.unit.container.test_replicator.TestReplicatorSync.test_sync_merge_timestamps ... ok REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('adb9eee2-6ff2-44f0-b497-6714dff1cb04-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01313 seconds (76.13353/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmplhxst6bx/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '8f634cf6-488a-4723-8878-5b8bdd14e993-sda', '1757769881.38794', '1757769886', '1757769885', '', '1757769886', 0, 0) test DEBUG: /tmp/tmplhxst6bx/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '8f634cf6-488a-4723-8878-5b8bdd14e993-sda', '1757769881.38794', '1757769886', '1757769885', '', '1757769886', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('8f634cf6-488a-4723-8878-5b8bdd14e993-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01138 seconds (87.90986/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmptzxo589a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'f5de30d5-a38f-4c34-81af-e756973f187c-sda', '1757769881.41176', '1757769886', '1757769885', '', '1757769886', 1, 1) test DEBUG: /tmp/tmptzxo589a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769887.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], 'f5de30d5-a38f-4c34-81af-e756973f187c-sda') test DEBUG: /tmp/tmptzxo589a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00248098s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'f5de30d5-a38f-4c34-81af-e756973f187c-sda', '1757769881.41176', '1757769886', '1757769885', '', '1757769886', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('f5de30d5-a38f-4c34-81af-e756973f187c-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01439 seconds (69.49802/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp88r30_7y/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'a72f35d5-c7b0-4401-87c5-0610cbc56f9f-sda', '1757769881.43705', '1757769886', '1757769885', '', '1757769886', 0, 0) test DEBUG: /tmp/tmp88r30_7y/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'a72f35d5-c7b0-4401-87c5-0610cbc56f9f-sda', '1757769881.43705', '1757769886', '1757769885', '', '1757769886', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('a72f35d5-c7b0-4401-87c5-0610cbc56f9f-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02418 seconds (41.35276/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpp5yrsams/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', '8f1cc0ed-bad6-409c-968b-fb91d88356b9-sda', '1757769881.48051', '1757769886', '1757769885', '', '1757769886', 1, 0) test DEBUG: /tmp/tmpp5yrsams/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', '8f1cc0ed-bad6-409c-968b-fb91d88356b9-sda', '1757769881.48051', '1757769886', '1757769885', '', '1757769886', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('8f1cc0ed-bad6-409c-968b-fb91d88356b9-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02927 seconds (34.16686/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '8d7ea3c5-c033-4982-b099-098d8cdd02b0-sda', '1757769881.53202', '1757769881.00000', '0', '', '1757769881.00000', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '8d7ea3c5-c033-4982-b099-098d8cdd02b0-sda', '1757769881.53202', '1757769882.00000', '0', '', '1757769881.00000', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, '0816c7111610b4e0880bdf8b9aa3ff31', '017d2273-4296-407d-a51d-55f7e1240d98-sda', '1757769881.56140', '1757769881.55956', '0', '', '1757769881.55956', 11, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'o_0', 'created_at': '1757769881.56540', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 2, 'name': 'o_1', 'created_at': '1757769881.56606', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 3, 'name': 'o_2', 'created_at': '1757769881.56616', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 4, 'name': 'o_3', 'created_at': '1757769881.56623', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 5, 'name': 'o_4', 'created_at': '1757769881.56630', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 6, 'name': 'o_5', 'created_at': '1757769881.56637', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 7, 'name': 'o_6', 'created_at': '1757769881.56643', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 8, 'name': 'o_7', 'created_at': '1757769881.56650', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 9, 'name': 'o_8', 'created_at': '1757769881.56657', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 10, 'name': 'o_9', 'created_at': '1757769881.56666', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 11, 'name': '/a/c/o_missing_0', 'created_at': '1757769881.56680', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8e0faa26d7c84f7eae9a2-0068c57099" "proxy-server 1824498" 0.0061 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx28b68d8850d14855aa4d1-0068c57099" "proxy-server 1824498" 0.0024 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/0/a/c/o.beans" 201 - "PUT http://localhost/sdb1/2/a/c/o.beans" "tx134acd088c474004b292d-0068c57099" "object-server 1824498" 0.0005 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/0/a/c/o.beans" 201 - "PUT http://localhost/sda1/2/a/c/o.beans" "tx134acd088c474004b292d-0068c57099" "object-server 1824498" 0.0004 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/2/a/c/o.beans" 201 - "PUT http://localhost/v1/a/c/o.beans" "tx134acd088c474004b292d-0068c57099" "proxy-server 1824498" 0.0132 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/2/a/c/o.beans" 201 - "PUT http://localhost/v1/a/c/o.beans" "tx134acd088c474004b292d-0068c57099" "proxy-server 1824498" 0.0144 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/41 PUT /v1/a/c/o.beans HTTP/1.0 201 - - t 5800 - - tx134acd088c474004b292d-0068c57099 - 0.0401 - - 1757769881.436516047 1757769881.476633310 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbdb9ece51fb948a7b4d5f-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx02e49ef276c445cbba082-0068c57099" "proxy-server 1824498" 0.0072 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sda1/2/a/c/o.beans" 206 191 "GET http://localhost/v1/a/c/o.beans" "tx4de45f098e0741f580be1-0068c57099" "proxy-server 1824498" 0.0004 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe680fecca87b44dd9a1b3-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txb4dd9f1bae79447c88201-0068c57099" "proxy-server 1824498" 0.0014 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sdb1/2/a/c/o.beans" 200 5800 "GET http://localhost/v1/a/c/o.beans" "tx751da95f9c274cc38f725-0068c57099" "proxy-server 1824498" 0.0003 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txde8a436cad1841a5abed6-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx6d15f4703cab4a0aa0cc2-0068c57099" "proxy-server 1824498" 0.0024 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sdb1/2/a/c/o.beans" 206 1076 "GET http://localhost/v1/a/c/o.beans" "txe819fd95c62a4bb1a06db-0068c57099" "proxy-server 1824498" 0.0004 "-" 1824498 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx48b0b5dd2003442eb5c18-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx42aff139e2894226b341e-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/0/a/c/o.smurfs" 201 - "PUT http://localhost/sda1/1/a/c/o.smurfs" "tx47611cd31d724a998e387-0068c57099" "object-server 1824498" 0.0005 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/0/a/c/o.smurfs" 201 - "PUT http://localhost/sdb1/1/a/c/o.smurfs" "tx47611cd31d724a998e387-0068c57099" "object-server 1824498" 0.0004 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sdb1/1/a/c/o.smurfs" 201 - "PUT http://localhost/v1/a/c/o.smurfs" "tx47611cd31d724a998e387-0068c57099" "proxy-server 1824498" 0.0057 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "PUT /sda1/1/a/c/o.smurfs" 201 - "PUT http://localhost/v1/a/c/o.smurfs" "tx47611cd31d724a998e387-0068c57099" "proxy-server 1824498" 0.0070 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/41 PUT /v1/a/c/o.smurfs HTTP/1.0 201 - - t 53000 - - tx47611cd31d724a998e387-0068c57099 - 0.0219 - - 1757769881.536578655 1757769881.558438540 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf1b296fd5c4e4770a19ea-0068c57099" "proxy-server 1824498" 0.0014 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx0ab428625c5e4e7f9a309-0068c57099" "proxy-server 1824498" 0.0034 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sdb1/1/a/c/o.smurfs" 206 501 "GET http://localhost/v1/a/c/o.smurfs" "txa8bc74d1ff3c4330b8920-0068c57099" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy ERROR: Trying to read object during GET (retrying) 127.0.0.1:56291/sdb1 (txn: txa8bc74d1ff3c4330b8920-0068c57099) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sda1/1/a/c/o.smurfs" 206 201 "GET http://localhost/v1/a/c/o.smurfs" "txa8bc74d1ff3c4330b8920-0068c57099" "proxy-server 1824498" 0.0003 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfe1e12210e7d4d82b7379-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txf13fc6160cba4d5ea6556-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sdb1/1/a/c/o.smurfs" 206 1898 "GET http://localhost/v1/a/c/o.smurfs" "tx89c6bfe74d8b47529e12b-0068c57099" "proxy-server 1824498" 0.0004 "-" 1824498 0 proxy ERROR: Trying to read object during GET (retrying) 127.0.0.1:56291/sdb1 (txn: tx89c6bfe74d8b47529e12b-0068c57099) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sda1/1/a/c/o.smurfs" 206 1081 "GET http://localhost/v1/a/c/o.smurfs" "tx89c6bfe74d8b47529e12b-0068c57099" "proxy-server 1824498" 0.0004 "-" 1824498 0 proxy ERROR: Trying to read next part of object multi-part GET (retrying) 127.0.0.1:54727/sda1 (txn: tx89c6bfe74d8b47529e12b-0068c57099) proxy INFO: Client disconnected on read of '/a/c/o.smurfs' (txn: tx89c6bfe74d8b47529e12b-0068c57099) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx632078953b2d4caca7419-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx11b8697e68d64ddbb716d-0068c57099" "proxy-server 1824498" 0.0026 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sda1/1/a/c/o.smurfs" 206 1898 "GET http://localhost/v1/a/c/o.smurfs" "tx11dcca900e114e658d04e-0068c57099" "proxy-server 1824498" 0.0004 "-" 1824498 0 proxy ERROR: Trying to read object during GET (retrying) 127.0.0.1:54727/sda1 (txn: tx11dcca900e114e658d04e-0068c57099) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sdb1/1/a/c/o.smurfs" 206 1600 "GET http://localhost/v1/a/c/o.smurfs" "tx11dcca900e114e658d04e-0068c57099" "proxy-server 1824498" 0.0003 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1cc155229a36480986e3a-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 -test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_ranges_resuming test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_ranges_resuming ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_deleted_shard test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_deleted_shard ... ok sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769925.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/e07/afde046acf5ff4350c667ee65cd90e07/afde046acf5ff4350c667ee65cd90e07.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769928.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/960/08f47547171eaa7a4da5ac3c1753b960/08f47547171eaa7a4da5ac3c1753b960.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769928.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/960/08f47547171eaa7a4da5ac3c1753b960/08f47547171eaa7a4da5ac3c1753b960.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769931.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/14c/4047d06a80ae92b9efae76c95e23914c/4047d06a80ae92b9efae76c95e23914c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769931.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/14c/4047d06a80ae92b9efae76c95e23914c/4047d06a80ae92b9efae76c95e23914c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769934.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769934.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/f04/4563805e26ff2922c6cc9b7383584f04/4563805e26ff2922c6cc9b7383584f04.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769937.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/31a/f5aa84e6e0d1b5fe1d656e023d2fb31a/f5aa84e6e0d1b5fe1d656e023d2fb31a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769937.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/31a/f5aa84e6e0d1b5fe1d656e023d2fb31a/f5aa84e6e0d1b5fe1d656e023d2fb31a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769940.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/023/9d538d68ba3454eb7472997c4a7d7023/9d538d68ba3454eb7472997c4a7d7023.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769940.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/023/9d538d68ba3454eb7472997c4a7d7023/9d538d68ba3454eb7472997c4a7d7023.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769943.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/83a/4bb00f1b19de9160959911b5d5f2583a/4bb00f1b19de9160959911b5d5f2583a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769943.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/83a/4bb00f1b19de9160959911b5d5f2583a/4bb00f1b19de9160959911b5d5f2583a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769946.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/a94/de92a914b05976a539ba3d5834388a94/de92a914b05976a539ba3d5834388a94.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769949.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/38f/ebc7f8f4906eab8327849aea9930738f/ebc7f8f4906eab8327849aea9930738f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769949.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/38f/ebc7f8f4906eab8327849aea9930738f/ebc7f8f4906eab8327849aea9930738f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769952.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/5d9/fc39ec9a5176e852feae41e327ed75d9/fc39ec9a5176e852feae41e327ed75d9.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769952.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/5d9/fc39ec9a5176e852feae41e327ed75d9/fc39ec9a5176e852feae41e327ed75d9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769955.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/4c7/3417d997fde47f3ab723fae8a62354c7/3417d997fde47f3ab723fae8a62354c7.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769955.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/4c7/3417d997fde47f3ab723fae8a62354c7/3417d997fde47f3ab723fae8a62354c7.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769958.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769958.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/37f/39133588cbb16a61e1068f30e55fa37f/39133588cbb16a61e1068f30e55fa37f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769961.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/cc2/414f8a41641642191e055adb2dd3ecc2/414f8a41641642191e055adb2dd3ecc2.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769961.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/cc2/414f8a41641642191e055adb2dd3ecc2/414f8a41641642191e055adb2dd3ecc2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769964.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/798/f3e090e1e2c81b5177c09e83643ff798/f3e090e1e2c81b5177c09e83643ff798.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769964.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/798/f3e090e1e2c81b5177c09e83643ff798/f3e090e1e2c81b5177c09e83643ff798.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769967.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/00b/2703965338dfecd5a001019c06a4c00b/2703965338dfecd5a001019c06a4c00b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769967.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/00b/2703965338dfecd5a001019c06a4c00b/2703965338dfecd5a001019c06a4c00b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769970.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769970.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/702/4fa750409276c743b2012ceb28a7f702/4fa750409276c743b2012ceb28a7f702.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769973.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/a76/a64672d48006c8a3676f03b69c3d6a76/a64672d48006c8a3676f03b69c3d6a76.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769973.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/a76/a64672d48006c8a3676f03b69c3d6a76/a64672d48006c8a3676f03b69c3d6a76.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769976.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/171/3440bebe2d880ff654d5218a4faf5171/3440bebe2d880ff654d5218a4faf5171.dbtest.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_can_not_keep_up test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_can_not_keep_up ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_respects_read_affinity test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_respects_read_affinity ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_short_read test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_short_read ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_short_read_resuming test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_GET_short_read_resuming ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx604c1d3d5a5c48d4a4ae2-0068c57099" "proxy-server 1824498" 0.0012 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sdb1/1/a/c/o.smurfs" 206 1898 "GET http://localhost/v1/a/c/o.smurfs" "tx4413bb629e774b3c9531c-0068c57099" "proxy-server 1824498" 0.0043 "-" 1824498 0 proxy ERROR: Trying to read next part of object multi-part GET (retrying) 127.0.0.1:56291/sdb1 (txn: tx4413bb629e774b3c9531c-0068c57099) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sda1/1/a/c/o.smurfs" 206 1280 "GET http://localhost/v1/a/c/o.smurfs" "tx4413bb629e774b3c9531c-0068c57099" "proxy-server 1824498" 0.0010 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx53146021b6f043ebb2e2f-0068c57099" "proxy-server 1824498" 0.0012 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx8fd0809fda5b42ffb8feb-0068c57099" "proxy-server 1824498" 0.0012 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sdb1/1/a/c/o.smurfs" 206 1898 "GET http://localhost/v1/a/c/o.smurfs" "txffab685138ea4db0a9a15-0068c57099" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy ERROR: Trying to read object during GET (retrying) 127.0.0.1:56291/sdb1 (txn: txffab685138ea4db0a9a15-0068c57099) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "GET /sda1/1/a/c/o.smurfs" 206 1031 "GET http://localhost/v1/a/c/o.smurfs" "txffab685138ea4db0a9a15-0068c57099" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0z2=1, r1=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o.jpg' (txn: txa4a6c85c0bf841aa8477a-0068c57099) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1z1=1, r0z2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0z2=1, r0z0=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o.jpg' (txn: txbecf00ece1274b0c8cb90-0068c57099) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1z1=1, r0z2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0z2=1, r0z0=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o.jpg' (txn: tx32eb9c7b80b14c068ab12-0068c57099) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1z1=1, r0z2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0z2=1, r0=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o.jpg' (txn: txb7608e13824246278acaf-0068c57099) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 500 b'' Trying to HEAD /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx4820565528ec4e87b29e3-0068c57099) proxy-ut ERROR: ERROR 500 b'' Trying to HEAD /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx05f51d21761c435c9df60-0068c57099) proxy-ut ERROR: ERROR 500 b'' Trying to HEAD /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx05f51d21761c435c9df60-0068c57099) proxy-ut ERROR: ERROR 500 b'' Trying to HEAD /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx05f51d21761c435c9df60-0068c57099) proxy-ut ERROR: Object HEAD returning 503 for [500, 500, 500] (txn: tx05f51d21761c435c9df60-0068c57099) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Trying to HEAD /v1/a/c/o: Timeout (Nones) (txn: tx0b963c52993f41aaa5270-0068c57099) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Trying to HEAD /v1/a/c/o: Timeout (Nones) (txn: tx0b963c52993f41aaa5270-0068c57099) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Trying to HEAD /v1/a/c/o: Timeout (Nones) (txn: tx0b963c52993f41aaa5270-0068c57099)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_HEAD test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_HEAD ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_HEAD_absolute_uri test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_HEAD_absolute_uri ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_HEAD_calls_authorize test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_HEAD_calls_authorize ... ok REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 12, 'name': '/a/c/o_missing_1', 'created_at': '1757769881.58047', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 13, 'name': '/a/c/o_missing_2', 'created_at': '1757769881.58708', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 14, 'name': '/a/c/o_missing_3', 'created_at': '1757769881.59176', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 15, 'name': '/a/c/o_missing_4', 'created_at': '1757769881.59959', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 16, 'name': '/a/c/o_missing_5', 'created_at': '1757769881.60780', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 17, 'name': '/a/c/o_missing_6', 'created_at': '1757769881.61893', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 18, 'name': '/a/c/o_missing_7', 'created_at': '1757769881.62216', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 19, 'name': '/a/c/o_missing_8', 'created_at': '1757769881.62768', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 20, 'name': '/a/c/o_missing_9', 'created_at': '1757769881.63492', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (21, 'c931fc14f2cc94f93dc8574e6ffbbe28', '017d2273-4296-407d-a51d-55f7e1240d98-sda', '1757769881.56140', '1757769881.55956', '0', '', '1757769881.55956', 21, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 21, 'name': '/a/c/o_missing_10', 'created_at': '1757769881.64692', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '017d2273-4296-407d-a51d-55f7e1240d98-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp1qywdfbs/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'c29618ec-34bf-4af9-bb42-2d48e8a88eb7-sda', '1757769881.67093', '1757769882', '0', '', '1757769882', 0, 1) test DEBUG: /tmp/tmp1qywdfbs/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'c29618ec-34bf-4af9-bb42-2d48e8a88eb7-sda', '1757769881.67093', '1757769882', '0', '', '1757769882', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('c29618ec-34bf-4af9-bb42-2d48e8a88eb7-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01070 seconds (93.43428/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpok59tgft/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', '992fa44b-ffbc-417c-b72e-3e068059cf53-sda', '1757769881.69001', '1757769882', '0', '', '1757769882', 1, 1) test DEBUG: /tmp/tmpok59tgft/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769883.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], '992fa44b-ffbc-417c-b72e-3e068059cf53-sda') test DEBUG: /tmp/tmpok59tgft/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00303912s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', '992fa44b-ffbc-417c-b72e-3e068059cf53-sda', '1757769881.69001', '1757769882', '0', '', '1757769882', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('992fa44b-ffbc-417c-b72e-3e068059cf53-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmpok59tgft/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.03693 seconds (27.08039/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpok59tgft/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'aa204fcc4c8ed639297208969e106d02', '8775b8b3-728a-495f-b20b-0dbe24a3dc42-sda', '1757769881.72508', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('8775b8b3-728a-495f-b20b-0dbe24a3dc42-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'aa204fcc4c8ed639297208969e106d02', '8775b8b3-728a-495f-b20b-0dbe24a3dc42-sda', '1757769881.72508', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('8775b8b3-728a-495f-b20b-0dbe24a3dc42-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp32xhipz8/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '28627216-2d27-4dfa-93b7-cb9d77f755d3-sda', '1757769881.75152', '1757769882', '0', '', '1757769882', 0, 1) test DEBUG: /tmp/tmp32xhipz8/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '28627216-2d27-4dfa-93b7-cb9d77f755d3-sda', '1757769881.75152', '1757769882', '0', '', '1757769882', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('28627216-2d27-4dfa-93b7-cb9d77f755d3-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01105 seconds (90.51461/s)test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_create_policy_over_newer_local_create test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_create_policy_over_newer_local_create ... ok sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769976.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/171/3440bebe2d880ff654d5218a4faf5171/3440bebe2d880ff654d5218a4faf5171.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769979.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/f1f/44023a11ce20df5bd9315c384ba4df1f/44023a11ce20df5bd9315c384ba4df1f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769979.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/f1f/44023a11ce20df5bd9315c384ba4df1f/44023a11ce20df5bd9315c384ba4df1f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769982.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769982.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/254/1c018ca5af3b7ea00f4288904d860254/1c018ca5af3b7ea00f4288904d860254.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769985.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/fa0/15f48c8b39539b4fee51730ed04e3fa0/15f48c8b39539b4fee51730ed04e3fa0.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769985.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/fa0/15f48c8b39539b4fee51730ed04e3fa0/15f48c8b39539b4fee51730ed04e3fa0.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769988.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/cae/c53213b4f1951028909d2cd9b4389cae/c53213b4f1951028909d2cd9b4389cae.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769988.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/cae/c53213b4f1951028909d2cd9b4389cae/c53213b4f1951028909d2cd9b4389cae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769991.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/c06/fcf5ad9577f95d312d25b6c4e66bfc06/fcf5ad9577f95d312d25b6c4e66bfc06.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769991.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/c06/fcf5ad9577f95d312d25b6c4e66bfc06/fcf5ad9577f95d312d25b6c4e66bfc06.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769994.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769994.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/23b/92071960f40ad6687317c4c5278b823b/92071960f40ad6687317c4c5278b823b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769997.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/b0f/4e49e2ece244e508344191944078ab0f/4e49e2ece244e508344191944078ab0f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757769997.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/b0f/4e49e2ece244e508344191944078ab0f/4e49e2ece244e508344191944078ab0f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770000.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/d31/bf0292701ed7e66dce6ab38a4377fd31/bf0292701ed7e66dce6ab38a4377fd31.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770000.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/d31/bf0292701ed7e66dce6ab38a4377fd31/bf0292701ed7e66dce6ab38a4377fd31.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770003.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/ac6/131211a9c882d251ad06f43c98680ac6/131211a9c882d251ad06f43c98680ac6.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770003.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/ac6/131211a9c882d251ad06f43c98680ac6/131211a9c882d251ad06f43c98680ac6.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770006.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/7b4/c99622c1d94d217152ee2d62ca2407b4/c99622c1d94d217152ee2d62ca2407b4.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770009.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/0a1/4ac7dd5a0e83dc1f23572945104a60a1/4ac7dd5a0e83dc1f23572945104a60a1.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770009.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/0a1/4ac7dd5a0e83dc1f23572945104a60a1/4ac7dd5a0e83dc1f23572945104a60a1.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770012.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/5ae/5695b6b21bf519ffcf9f2185cc8525ae/5695b6b21bf519ffcf9f2185cc8525ae.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770012.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/5ae/5695b6b21bf519ffcf9f2185cc8525ae/5695b6b21bf519ffcf9f2185cc8525ae.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770015.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/63c/97bb8688e4f53a863a50169f18f6263c/97bb8688e4f53a863a50169f18f6263c.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770015.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/63c/97bb8688e4f53a863a50169f18f6263c/97bb8688e4f53a863a50169f18f6263c.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770018.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770018.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/181/1fc6e476468c64d29dc255d1bf9bb181/1fc6e476468c64d29dc255d1bf9bb181.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770021.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/391/ff29e588b25ff3499d245fee7e673391/ff29e588b25ff3499d245fee7e673391.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770021.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/391/ff29e588b25ff3499d245fee7e673391/ff29e588b25ff3499d245fee7e673391.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770024.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/671/3f60a0256ff770d09fd664a741862671/3f60a0256ff770d09fd664a741862671.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770024.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/671/3f60a0256ff770d09fd664a741862671/3f60a0256ff770d09fd664a741862671.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770027.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/f52/f308a86bbc68a6cff9ed9a6407f9ff52/f308a86bbc68a6cff9ed9a6407f9ff52.dbtest.unit.proxy.test_mem_server.TestReplicatedObjectController.test_HEAD_newest test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_HEAD_newest ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_OPTIONS test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_OPTIONS ... ok test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_with_own_merged_while_shrinking test.unit.container.test_sharder.TestSharder.test_audit_shard_root_ranges_with_own_merged_while_shrinking ... ok test.unit.container.test_sharder.TestSharder.test_check_node test.unit.container.test_sharder.TestSharder.test_check_node ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_backend_headers test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_backend_headers ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_calls_authorize test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_calls_authorize ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_converts_delete_after_to_delete_at test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_converts_delete_after_to_delete_at ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_authorize test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_authorize ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_count test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_count ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_key_len test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_key_len ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_size test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_size ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_val_len test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_meta_val_len ... ok sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770027.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/f52/f308a86bbc68a6cff9ed9a6407f9ff52/f308a86bbc68a6cff9ed9a6407f9ff52.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770030.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770030.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/82b/82ab787f87d0794d6ed2dec6d904182b/82ab787f87d0794d6ed2dec6d904182b.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770033.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/2e2/51fdb6672a9b63d2cbcb179e54ae02e2/51fdb6672a9b63d2cbcb179e54ae02e2.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770033.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/2e2/51fdb6672a9b63d2cbcb179e54ae02e2/51fdb6672a9b63d2cbcb179e54ae02e2.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770036.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/08a/0bac0223be629936f85e27e7da2aa08a/0bac0223be629936f85e27e7da2aa08a.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770036.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/08a/0bac0223be629936f85e27e7da2aa08a/0bac0223be629936f85e27e7da2aa08a.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770039.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/56f/cedb083397b56cd7fb9c11d24b99d56f/cedb083397b56cd7fb9c11d24b99d56f.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770039.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/56f/cedb083397b56cd7fb9c11d24b99d56f/cedb083397b56cd7fb9c11d24b99d56f.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770042.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770042.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/a30/62042653eaaffc1b2f8010f0a5f0fa30/62042653eaaffc1b2f8010f0a5f0fa30.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770045.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770045.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9/5fd0041c3fdcbfcf43e80f6291c6a3c9.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770048.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/717/c9bbcef45e3501beb9e338079dd86717/c9bbcef45e3501beb9e338079dd86717.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770048.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/717/c9bbcef45e3501beb9e338079dd86717/c9bbcef45e3501beb9e338079dd86717.db sharder-test DEBUG: Updating own shard range from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770051.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/523/1990b221902d604fa1229244eead0523/1990b221902d604fa1229244eead0523.db sharder-test DEBUG: Updating 1 other shard range(s) from root, path: .shards_a/c-4a8a08f09d37b73795649038408b5f33-1757770051.00000-0, db: /tmp/tmpj9dc_65c/sda/containers/0/523/1990b221902d604fa1229244eead0523/1990b221902d604fa1229244eead0523.db sharder-test WARNING: Skipping d100 as it is not mounted sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: got 5 rows (deleted=False) in 0.00015473365783691406s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.5367431640625e-05s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test WARNING: Failed to sufficiently replicate cleaved shard .shards_a/c_obj004_0 in state cleaved: 1 successes, 2 required, shard db: /tmp/tmp2zv3uuua/sda/containers/0/b85/9d7a328814f4e99b3c0e6a0597883b85/9d7a328814f4e99b3c0e6a0597883b85.db, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpo80n5dqt/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', 'c57b3b46-d6eb-443e-8348-079ca4257da0-sda', '1757769881.77637', '1757769882', '0', '', '1757769882', 1, 1) test DEBUG: /tmp/tmpo80n5dqt/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0e1f40549bfa9eaa1cb1d8f3aed9c049', 'c57b3b46-d6eb-443e-8348-079ca4257da0-sda', '1757769881.77637', '1757769882', '0', '', '1757769882', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('c57b3b46-d6eb-443e-8348-079ca4257da0-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmpo80n5dqt/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01492 seconds (67.03548/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpo80n5dqt/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'aa204fcc4c8ed639297208969e106d02', 'faa8faa3-e067-4b82-84a2-9e613a0b43c4-sda', '1757769881.79108', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('faa8faa3-e067-4b82-84a2-9e613a0b43c4-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'aa204fcc4c8ed639297208969e106d02', 'faa8faa3-e067-4b82-84a2-9e613a0b43c4-sda', '1757769881.79108', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('faa8faa3-e067-4b82-84a2-9e613a0b43c4-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpjse9viu0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'e58d5302-e052-4d87-9c53-fda72c972bbd-sda', '1757769881.81547', '1757769882', '1757769883', '', '1757769883', 0, 0) test DEBUG: /tmp/tmpjse9viu0/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'e58d5302-e052-4d87-9c53-fda72c972bbd-sda', '1757769881.81547', '1757769882', '1757769883', '', '1757769883', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('e58d5302-e052-4d87-9c53-fda72c972bbd-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01192 seconds (83.87531/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp2j3oj1zq/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '759443733b6ac223f6df20a8deb0fc4f', '09e51afb-451a-460a-9499-b4b5a06c86bc-sda', '1757769881.83756', '1757769882', '1757769883', '', '1757769883', 1, 0) test DEBUG: /tmp/tmp2j3oj1zq/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769884.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '09e51afb-451a-460a-9499-b4b5a06c86bc-sda') test DEBUG: /tmp/tmp2j3oj1zq/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00242639s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '759443733b6ac223f6df20a8deb0fc4f', '09e51afb-451a-460a-9499-b4b5a06c86bc-sda', '1757769881.83756', '1757769882', '1757769883', '', '1757769883', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('09e51afb-451a-460a-9499-b4b5a06c86bc-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmp2j3oj1zq/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01974 seconds (50.65926/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmp2j3oj1zq/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '0340c91941c97efd82627593481b234e', '3ece38f9-55cc-4793-98ae-6f46e7874be0-sda', '1757769881.85705', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('3ece38f9-55cc-4793-98ae-6f46e7874be0-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '0340c91941c97efd82627593481b234e', '3ece38f9-55cc-4793-98ae-6f46e7874be0-sda', '1757769881.85705', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('3ece38f9-55cc-4793-98ae-6f46e7874be0-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpi7a0ohbx/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '553de2c3-c8ed-4832-b886-dbcd418e76da-sda', '1757769881.87293', '1757769882', '1757769883', '', '1757769883', 0, 1) test DEBUG: /tmp/tmpi7a0ohbx/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '553de2c3-c8ed-4832-b886-dbcd418e76da-sda', '1757769881.87293', '1757769882', '1757769883', '', '1757769883', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('553de2c3-c8ed-4832-b886-dbcd418e76da-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01336 seconds (74.83225/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp4q_v6uxq/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '759443733b6ac223f6df20a8deb0fc4f', '735ed8de-461f-4de7-96a4-87393549d8fc-sda', '1757769881.89771', '1757769882', '1757769883', '', '1757769883', 1, 0) test DEBUG: /tmp/tmp4q_v6uxq/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to dotest.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_create_policy_over_newer_local_delete test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_create_policy_over_newer_local_delete ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_x_container_headers_with_more_container_replicas test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_POST_x_container_headers_with_more_container_replicas ... ok test.unit.container.test_sharder.TestSharder.test_cleave_insufficient_replication test.unit.container.test_sharder.TestSharder.test_cleave_insufficient_replication ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_create_policy_over_older_local_delete test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_create_policy_over_older_local_delete ... ok proxy-ut ERROR: Object HEAD returning 503 for [] (txn: tx0b963c52993f41aaa5270-0068c57099) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc470532b81f342fdb97db-0068c57099" "proxy-server 1824498" 0.0054 "-" 1824498 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/41 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - - t - - - txc470532b81f342fdb97db-0068c57099 - 0.0080 - - 1757769881.733022690 1757769881.741062880 - - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:41 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe1b705872ead4f22b9f84-0068c57099" "proxy-server 1824498" 0.0013 "-" 1824498 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/41 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - - t - - - txe1b705872ead4f22b9f84-0068c57099 - 0.0079 - - 1757769881.742097378 1757769881.750007629 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txecf3b1a0ddb747eba80a0-0068c57099) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx739f1dd8319f46ea831a0-0068c57099) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx739f1dd8319f46ea831a0-0068c57099) proxy-ut ERROR: Object POST returning 503 for (202, 503, 503) (txn: tx739f1dd8319f46ea831a0-0068c57099) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx0d616388d482423fa794f-0068c57099) proxy-ut ERROR: Object POST returning 503 for (202, 404, 503) (txn: tx0d616388d482423fa794f-0068c57099) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx75db20c6bec8463ba8c16-0068c57099) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx75db20c6bec8463ba8c16-0068c57099) proxy-ut ERROR: Object POST returning 503 for (404, 503, 503) (txn: tx75db20c6bec8463ba8c16-0068c57099) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 500 b'' Trying to GET /v1/a/c/o.jpg From Object Server 10.0.0.1:3001/sdb (txn: txaf96140b27464fd2af677-0068c57099) proxy-ut ERROR: ERROR 500 b'' Trying to GET /v1/a/c/o.jpg From Object Server 10.0.0.2:3002/sdc (txn: tx43a72610af55470a9360f-0068c57099) proxy-ut ERROR: Object PUT returning 503 for [204, 500, 404] (txn: tx43a72610af55470a9360f-0068c57099) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_GET_unicode_metadata test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_GET_unicode_metadata ... ok sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Cleaving ShardRange - shard db already in sync, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test INFO: Cleaved ShardRange in 0.003s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'obj004' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: got 5 rows (deleted=False) in 0.0001571178436279297s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010538101196289062s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__1 for ShardRange, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test WARNING: Failed to sufficiently replicate cleaved shard .shards_a/c__1 in state cleaved: 1 successes, 2 required, shard db: /tmp/tmp2zv3uuua/sda/containers/0/069/5a8214a697fa9e61b996df73488a7069/5a8214a697fa9e61b996df73488a7069.db, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: misplaced object source bounds [('', 'obj004')], path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00011944770812988281s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.581710815429688e-05s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011658668518066406s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Placed 1 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Continuing to cleave (1 done, 1 todo), path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'obj004' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: got 5 rows (deleted=False) in 0.00015974044799804688s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.799003601074219e-05s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__1 for ShardRange, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test INFO: Cleaved ShardRange<'obj004' to MaxBound as of 1757769836.07887, (5, 5) as of 1757769881.97693, cleaved as of 1757769836.07887> in 0.006s, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Finished processing, state sharded, path: a/c, db: /tmp/tmp2zv3uuua/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.84891.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.dbtest.unit.container.test_sharder.TestSharder.test_cleave_multiple_storage_policies test.unit.container.test_sharder.TestSharder.test_cleave_multiple_storage_policies ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reclaim_deadlock test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reclaim_deadlock ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_half_delete_policy_over_newer_local_create test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_half_delete_policy_over_newer_local_create ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reclaim_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reclaim_shard_ranges ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_in_sync test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_in_sync ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reclaim_with_duplicate_names test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reclaim_with_duplicate_names ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reconciler_sync test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reconciler_sync ... ok sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj_004_0 for ShardRange, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00015616416931152344s, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=True) in 0.000110626220703125s, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj_004_0 for ShardRange, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test INFO: Cleaved ShardRange in 0.009s, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'obj_004' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001983642578125s, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=True) in 0.00012230873107910156s, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__1 for ShardRange, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test INFO: Cleaved ShardRange<'obj_004' to MaxBound as of 1757769836.07887, (1, 6144) as of 1757769882.05216, cleaved as of 1757769836.07887> in 0.007s, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: Finished processing, state sharded, path: a/c, db: /tmp/tmpcvphfs2u/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769881.99748.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Kick off container cleaving, own shard range in state 'sharding', path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: got 5 rows (deleted=False) in 0.00017333030700683594s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.560585021972656e-05s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Cleaved ShardRange in 0.007s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'obj004' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '759443733b6ac223f6df20a8deb0fc4f', '735ed8de-461f-4de7-96a4-87393549d8fc-sda', '1757769881.89771', '1757769882', '1757769883', '', '1757769883', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('735ed8de-461f-4de7-96a4-87393549d8fc-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmp4q_v6uxq/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.03542 seconds (28.23393/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmp4q_v6uxq/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '0340c91941c97efd82627593481b234e', 'f9d79244-8aea-4836-8c72-16ef728d68cf-sda', '1757769881.92786', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('f9d79244-8aea-4836-8c72-16ef728d68cf-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '0340c91941c97efd82627593481b234e', 'f9d79244-8aea-4836-8c72-16ef728d68cf-sda', '1757769881.92786', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('f9d79244-8aea-4836-8c72-16ef728d68cf-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpgzwel16a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'f5581575-9751-4bcc-aba3-575ec5232bc6-sda', '1757769881.95744', '1757769881', '1757769882', '', '1757769882', 0, 1) test DEBUG: /tmp/tmpgzwel16a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'f5581575-9751-4bcc-aba3-575ec5232bc6-sda', '1757769881.95744', '1757769881', '1757769882', '', '1757769882', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('f5581575-9751-4bcc-aba3-575ec5232bc6-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00915 seconds (109.31372/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmph_pooyh4/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '8e0d4586-1cd2-440f-82c9-aa5494cb381c-sda', '1757769881.97807', '1757769881', '1757769882', '', '1757769882', 0, 1) test DEBUG: /tmp/tmph_pooyh4/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '8e0d4586-1cd2-440f-82c9-aa5494cb381c-sda', '1757769881.97807', '1757769881', '1757769882', '', '1757769882', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('8e0d4586-1cd2-440f-82c9-aa5494cb381c-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02423 seconds (41.26935/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpthxi4f01/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '6aabbe16-a6f3-47f6-80f5-d4233bccccb7-sda', '1757769882.01927', '1757769884', '0', '', '1757769884', 0, 1) test DEBUG: /tmp/tmpthxi4f01/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '6aabbe16-a6f3-47f6-80f5-d4233bccccb7-sda', '1757769882.01927', '1757769884', '0', '', '1757769884', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('6aabbe16-a6f3-47f6-80f5-d4233bccccb7-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02152 seconds (46.46840/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpu0f3tsl5/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0fa19a071f3d8d8bc0be3c6980d37811', '32b8e66a-7b48-4e1c-acc9-ad497f1f524f-sda', '1757769882.05651', '1757769884', '0', '', '1757769884', 1, 0) test DEBUG: /tmp/tmpu0f3tsl5/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '0fa19a071f3d8d8bc0be3c6980d37811', '32b8e66a-7b48-4e1c-acc9-ad497f1f524f-sda', '1757769882.05651', '1757769884', '0', '', '1757769884', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('32b8e66a-7b48-4e1c-acc9-ad497f1f524f-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmpu0f3tsl5/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01816 seconds (55.05968/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpu0f3tsl5/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'c6ea3dc494898097fe231b4fa1e24254', '88fcdbca-19af-4b31-9e60-52e2f879ef95-sda', '1757769882.08077', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('88fcdbca-19af-4b31-9e60-52e2f879ef95-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'c6ea3dc494898097fe231b4fa1e24254', '88fcdbca-19af-4b31-9e60-52e2f879ef95-sda', '1757769882.08077', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('88fcdbca-19af-4b31-9e60-52e2f879ef95-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication REPLICATE: /sda/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'e2267b74-b733-4ca3-b15c-0957441db448-sda', '1757769882.09776', '1757769882.09601', '0', '', '1757769882.09601', 0, 0) test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpd6v9keje/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'c5bed456-c1f4-4923-ba34-ea24a1d378e4-sda', '1757769882.11298', '1757769882.11106', '0', '', '1757769882.11106', 0, 0)test.unit.container.test_sharder.TestSharder.test_cleave_repeated test.unit.container.test_sharder.TestSharder.test_cleave_repeated ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_missing test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_missing ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_missing_most_rows test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_missing_most_rows ... ok sharder-test DEBUG: got 6 rows (deleted=False) in 0.00015401840209960938s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.512901306152344e-05s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__1 for ShardRange, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Cleaved ShardRange<'obj004' to MaxBound as of 1757769836.07887, (6, 6) as of 1757769882.10921, cleaved as of 1757769836.07887> in 0.006s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test WARNING: Repeat cleaving required, context: {'ref': 'e0039984-b2ed-429d-afe5-84f364d0b053-sda', 'cursor': '', 'max_row': 12, 'cleave_to_row': 10, 'last_cleave_to_row': None, 'cleaving_done': True, 'misplaced_done': True, 'ranges_done': 2, 'ranges_todo': 0}, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Completed cleaving, DB remaining in sharding state, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Cleaving from row 10 into .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001423358917236328s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.083747863769531e-05s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Cleaved ShardRange in 0.005s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Cleaving from row 10 into .shards_a/c__1 for ShardRange<'obj004' to MaxBound as of 1757769836.07887, (6, 6) as of 1757769882.10921, cleaved as of 1757769836.07887>, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00013947486877441406s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.083747863769531e-05s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__1 for ShardRange, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test INFO: Cleaved ShardRange<'obj004' to MaxBound as of 1757769836.07887, (6, 6) as of 1757769882.10921, cleaved as of 1757769836.07887> in 0.005s, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Finished processing, state sharded, path: a/c, db: /tmp/tmp06we8d7e/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.06726.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting to cleave (0 todo), path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_missing_one_rows test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_missing_one_rows ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_empty test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_empty ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_remove_objects test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_remove_objects ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_resolve_shard_range_states test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_resolve_shard_range_states ... ok sharder-test INFO: Starting to cleave (4 todo), path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Stopped cleave at unready ShardRange, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Starting to cleave (4 todo), path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaving from row None into .shards_a/c_here_0 for ShardRange, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.0001823902130126953s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010514259338378906s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_here_0 for ShardRange, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaved ShardRange in 0.006s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Stopped cleave at unready ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, found as of 1757769836.07887>, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Continuing to cleave (1 done, 3 todo), path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaving from row None into .shards_a/c_there_1 for ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00016427040100097656s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010991096496582031s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_there_1 for ShardRange, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test WARNING: Failed to sufficiently replicate cleaved shard .shards_a/c_there_1 in state cleaved: 1 successes, 2 required, shard db: /tmp/tmpyghf130k/sda/containers/0/7a6/40d00a528944ce0468e507db329647a6/40d00a528944ce0468e507db329647a6.db, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Continuing to cleave (1 done, 3 todo), path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaving from row None into .shards_a/c_there_1 for ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Cleaving ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887> - shard db already in sync, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Replicating new shard container .shards_a/c_there_1 for ShardRange, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaved ShardRange<'here' to 'there' as of 1757769836.07887, (3, 6) as of 1757769882.23532, cleaved as of 1757769836.07887> in 0.003s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaving from row None into .shards_a/c_where_2 for ShardRange<'there' to 'where' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00015783309936523438s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.846687316894531e-05s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_where_2 for ShardRange, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaved ShardRange<'there' to 'where' as of 1757769836.07887, (1, 100) as of 1757769882.24582, cleaved as of 1757769836.07887> in 0.006s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Continuing to cleave (3 done, 1 todo), path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaving from row None into .shards_a/c_yonder_3 for ShardRange<'where' to 'yonder' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00014925003051757812s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_sharder.TestSharder.test_cleave_root test.unit.container.test_sharder.TestSharder.test_cleave_root ... ok REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('c5bed456-c1f4-4923-ba34-ea24a1d378e4-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'c5bed456-c1f4-4923-ba34-ea24a1d378e4-sda', '1757769882.11298', '1757769882.11106', '0', '', '1757769882.11106', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('c5bed456-c1f4-4923-ba34-ea24a1d378e4-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01336 seconds (74.84159/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:2 ts_repl:0 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '075b4a44e7d253405afdf2834d1b5010', '4b24b913-03aa-4485-bef5-91515d71320f-sda', '1757769882.13694', '1757769882.13514', '0', '', '1757769882.13514', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, rsync_then_merge, ('4b24b913-03aa-4485-bef5-91515d71320f-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (11, '9c910c1f118fbf78c3bfa18d70c0161e', 'e3653be1-10b2-4eea-a373-596bca457ba2-sda', '1757769882.18597', '1757769882.18413', '0', '', '1757769882.18413', 11, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o_0', 'created_at': '1757769882.19080', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 2, 'name': '/a/c/o_1', 'created_at': '1757769882.19149', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 3, 'name': '/a/c/o_2', 'created_at': '1757769882.19159', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 4, 'name': '/a/c/o_3', 'created_at': '1757769882.19166', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 5, 'name': '/a/c/o_4', 'created_at': '1757769882.19173', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 6, 'name': '/a/c/o_5', 'created_at': '1757769882.19179', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 7, 'name': '/a/c/o_6', 'created_at': '1757769882.19186', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 8, 'name': '/a/c/o_7', 'created_at': '1757769882.19192', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 9, 'name': '/a/c/o_8', 'created_at': '1757769882.19199', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 10, 'name': '/a/c/o_9', 'created_at': '1757769882.19205', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 11, 'name': '/a/c/o_missing', 'created_at': '1757769882.19212', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], 'e3653be1-10b2-4eea-a373-596bca457ba2-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpiw2f0f9y/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '95e6d982-6e7d-4798-b1b1-e1639309ad3c-sda', '1757769882.21308', '1757769885', '0', '', '1757769885', 0, 0) test DEBUG: /tmp/tmpiw2f0f9y/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '95e6d982-6e7d-4798-b1b1-e1639309ad3c-sda', '1757769882.21308', '1757769885', '0', '', '1757769885', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('95e6d982-6e7d-4798-b1b1-e1639309ad3c-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00962 seconds (103.91350/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpp0v9ug9l/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '006ce072-2b81-44dd-8d5e-a43ad8a8d9b1-sda', '1757769882.23622', '1757769885', '0', '', '1757769885', 1, 1) test DEBUG: /tmp/tmpp0v9ug9l/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769886.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], '006ce072-2b81-44dd-8d5e-a43ad8a8d9b1-sda') test DEBUG: /tmp/tmpp0v9ug9l/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00258946s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '006ce072-2b81-44dd-8d5e-a43ad8a8d9b1-sda', '1757769882.23622', '1757769885', '0', '', '1757769885', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('006ce072-2b81-44dd-8d5e-a43ad8a8d9b1-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmpp0v9ug9l/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01919 seconds (52.11583/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpp0v9ug9l/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '2bff9cd2ba2ffa6fb58d55ef03013299', 'd9c55276-2132-4172-a427-256088f593cb-sda', '1757769882.25476', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('d9c55276-2132-4172-a427-256088f593cb-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '2bff9cd2ba2ffa6fb58d55ef03013299', 'd9c55276-2132-4172-a427-256088f593cb-sda', '1757769882.25476', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('d9c55276-2132-4172-a427-256088f593cb-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmprzztbec2/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '1897e40e-7d59-435d-bb06-361e70d1bba5-sda', '1757769882.27518', '1757769885', '0', '', '1757769885', 0, 1) test DEBUG: /tmp/tmprzztbec2/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '1897e40e-7d59-435d-bb06-361e70d1bba5-sda', '1757769882.27518', '1757769885', '0', '', '1757769885', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('1897e40e-7d59-435d-bb06-361e70d1bba5-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db')test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_newer_local_create test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_newer_local_create ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reverse_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_reverse_prefix_delim ... ok test.unit.container.test_sharder.TestSharder.test_cleave_root_empty_db_with_pre_existing_shard_db_handoff test.unit.container.test_sharder.TestSharder.test_cleave_root_empty_db_with_pre_existing_shard_db_handoff ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_root_account_container_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_save_and_load_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_save_and_load_record_from_pending_file ... ok test ERROR: Failed to unlink '/tmp/tmpk4bcv3tf/containers/part/suffix/hash/container.db': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2235, in set_sharded_state os.unlink(retiring_file) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: 1 test DEBUG: Unlinked retiring db '/tmp/tmpk4bcv3tf/containers/part/suffix/hash/container_1757769877.00000.db' test WARNING: Still have multiple db files after unlinking '/tmp/tmpk4bcv3tf/containers/part/suffix/hash/container_1757769877.00000.db': ['/tmp/tmpk4bcv3tf/containers/part/suffix/hash/container.db', '/tmp/tmpk4bcv3tf/containers/part/suffix/hash/container_1757769878.00000.db'] test WARNING: Refusing to delete db file for 'a/c': no fresher db file found in ['/tmp/tmpk4bcv3tf/containers/part/suffix/hash/container_1757769878.00000.db']. test ERROR: Failed to set the ROWID of the fresh database for a/c: test ERROR: Failed to sync the container_stat table/view with the fresh database for a/c: test ERROR: Problem finding shard upper in '/tmp/tmpqnk7ylme/test_container.db': : LockTimeout (Nones) test ERROR: Problem finding shard upper in '/tmp/tmpqnk7ylme/test_container.db': : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2498, in find_shard_ranges next_shard_upper = sub_broker._get_next_shard_range_upper( shard_size, last_shard_upper) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect sqlite3.OperationalError test DEBUG: Unlinked retiring db '/tmp/tmp_tox2gf7/containers/part/suffix/hash/container.db' test WARNING: Unexpected db files will be ignored: ['/tmp/tmp_tox2gf7/containers/part/suffix/hash/container.db'] Container 'a/c' cannot be set to sharded state while in unsharded state Container 'a/c' cannot be set to sharding state: missing epoch Container 'a/c' cannot be set to sharding state while in sharding state Container 'a/c' cannot be set to sharded state while in sharded state test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_db_states test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_db_states ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_sharded_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_sharded_state_errors ... ok sharder-test DEBUG: got 1 rows (deleted=True) in 0.0001499652862548828s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_yonder_3 for ShardRange, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaved ShardRange<'where' to 'yonder' as of 1757769836.07887, (1, 1000) as of 1757769882.27394, cleaved as of 1757769836.07887> in 0.013s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Continuing to cleave (4 done, 0 todo), path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Continuing to cleave (4 done, 1 todo), path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaving from row None into .shards_a/c__4 for ShardRange<'yonder' to MaxBound as of 1757769836.07887, (2, 15) as of 1757769882.29754, active as of 1757769836.07887>, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001900196075439453s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011682510375976562s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__4 for ShardRange, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test INFO: Cleaved ShardRange<'yonder' to MaxBound as of 1757769836.07887, (2, 15) as of 1757769882.29754, active as of 1757769836.07887> in 0.006s, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Cleaving already complete for container, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Passing over already sharded container, path: a/c, db: /tmp/tmpyghf130k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.16040.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test INFO: Starting to cleave (3 todo), path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test INFO: Cleaving from row None into .shards_a/c_d_0 for ShardRange, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00014448165893554688s, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.870529174804688e-05s, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Cleaving ShardRange - zero objects found, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test INFO: Replicating new shard container .shards_a/c_d_0 for ShardRange, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test INFO: Cleaved ShardRange in 0.005s, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmpymn0y2qe/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.32680.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test INFO: Starting to cleave (3 todo), path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test INFO: Cleaving from row None into .shards_a/c_d_0 for ShardRange, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00015115737915039062s, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.441375732421875e-05s, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Cleaving ShardRange - zero objects found, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.dbtest.unit.container.test_sharder.TestSharder.test_cleave_root_empty_db_with_ranges test.unit.container.test_sharder.TestSharder.test_cleave_root_empty_db_with_ranges ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_delimiter_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_delimiter_no_memcache ... ok test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01458 seconds (68.60116/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpkboi9tzt/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '1095ad55-251f-4a85-952a-86b4f384e77e-sda', '1757769882.29989', '1757769885', '0', '', '1757769885', 1, 1) test DEBUG: /tmp/tmpkboi9tzt/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '1095ad55-251f-4a85-952a-86b4f384e77e-sda', '1757769882.29989', '1757769885', '0', '', '1757769885', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('1095ad55-251f-4a85-952a-86b4f384e77e-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmpkboi9tzt/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01845 seconds (54.20579/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpkboi9tzt/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '2bff9cd2ba2ffa6fb58d55ef03013299', 'ffc601f2-fa73-4b43-8b4f-215ec714e2f8-sda', '1757769882.31779', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('ffc601f2-fa73-4b43-8b4f-215ec714e2f8-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '2bff9cd2ba2ffa6fb58d55ef03013299', 'ffc601f2-fa73-4b43-8b4f-215ec714e2f8-sda', '1757769882.31779', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('ffc601f2-fa73-4b43-8b4f-215ec714e2f8-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpamm_7icc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'f4bd6246-42c3-42d0-81e2-0f0b24bd943c-sda', '1757769882.33336', '1757769882', '1757769886', '', '1757769886', 0, 0) test DEBUG: /tmp/tmpamm_7icc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'f4bd6246-42c3-42d0-81e2-0f0b24bd943c-sda', '1757769882.33336', '1757769882', '1757769886', '', '1757769886', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('f4bd6246-42c3-42d0-81e2-0f0b24bd943c-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01147 seconds (87.16810/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmppyalrsem/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'd2159468-78d0-4a35-a506-fa7207323cc1-sda', '1757769882.35522', '1757769882', '1757769886', '', '1757769886', 1, 1) test DEBUG: /tmp/tmppyalrsem/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769887.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], 'd2159468-78d0-4a35-a506-fa7207323cc1-sda') test DEBUG: /tmp/tmppyalrsem/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00253797s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'd2159468-78d0-4a35-a506-fa7207323cc1-sda', '1757769882.35522', '1757769882', '1757769886', '', '1757769886', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('d2159468-78d0-4a35-a506-fa7207323cc1-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmppyalrsem/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01885 seconds (53.04450/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmppyalrsem/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'ee1baef1fae0032df3dbe4122ab86018', '7a00d4f3-3eca-47fb-859a-533f3e7213a7-sda', '1757769882.37745', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('7a00d4f3-3eca-47fb-859a-533f3e7213a7-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'ee1baef1fae0032df3dbe4122ab86018', '7a00d4f3-3eca-47fb-859a-533f3e7213a7-sda', '1757769882.37745', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('7a00d4f3-3eca-47fb-859a-533f3e7213a7-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpnyy231e_/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '077ca5cf-b2b0-40f3-b4a1-b4400881f0b6-sda', '1757769882.39444', '1757769882', '1757769886', '', '1757769886', 0, 1) test DEBUG: /tmp/tmpnyy231e_/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '077ca5cf-b2b0-40f3-b4a1-b4400881f0b6-sda', '1757769882.39444', '1757769882', '1757769886', '', '1757769886', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('077ca5cf-b2b0-40f3-b4a1-b4400881f0b6-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00990 seconds (100.99840/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmphdwwzfnc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'a02f1f32-2bfd-4b52-b289-2dca76b61645-sda', '1757769882.41492', '1757769882', '1757769886', '', '1757769886', 1, 0) test DEBUG: /tmp/tmphdwwzfnc/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to dotest.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_newer_local_delete test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_newer_local_delete ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_sharding_state test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_sharding_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_sharding_state_deleted test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_sharding_state_deleted ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_sharding_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_sharding_state_errors ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_storage_policy_index test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_storage_policy_index ... ok sharder-test INFO: Cleaving from row None into .shards_a/c_x_1 for ShardRange<'d' to 'x' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001385211944580078s, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.7738037109375e-05s, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Cleaving ShardRange<'d' to 'x' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887> - zero objects found, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test INFO: Cleaving from row None into .shards_a/c__2 for ShardRange<'x' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.000133514404296875s, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.916854858398438e-05s, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Cleaving ShardRange<'x' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887> - zero objects found, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpgnz2gr0j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.36178.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting to cleave (0 todo), path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting to cleave (4 todo), path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Stopped cleave at unready ShardRange, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Starting to cleave (4 todo), path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaving from row None into .shards_a/c_here_0 for ShardRange, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00014925003051757812s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00010704994201660156s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=False) in 5.054473876953125e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.703636169433594e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_here_0 for ShardRange, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaved ShardRange in 0.011s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Stopped cleave at unready ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, found as of 1757769836.07887>, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Continuing to cleave (1 done, 3 todo), path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaving from row None into .shards_a/c_there_1 for ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00018787384033203125s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 6.246566772460938e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 6.222724914550781e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=False) in 5.412101745605469e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.560585021972656e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_there_1 for ShardRange, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test WARNING: Failed to sufficiently replicate cleaved shard .shards_a/c_there_1 in state cleaved: 1 successes, 2 required, shard db: /tmp/tmp647ovc01/sda/containers/0/7a6/40d00a528944ce0468e507db329647a6/40d00a528944ce0468e507db329647a6.db, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.dbtest.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_storage_policy_index_empty test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_storage_policy_index_empty ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_x_syncs test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_set_x_syncs ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_sharding_initiated_and_required test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_sharding_initiated_and_required ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_sharding_state_is_not_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_sharding_state_is_not_reclaimable ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_sharding_sysmeta test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_sharding_sysmeta ... ok REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'a02f1f32-2bfd-4b52-b289-2dca76b61645-sda', '1757769882.41492', '1757769882', '1757769886', '', '1757769886', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('a02f1f32-2bfd-4b52-b289-2dca76b61645-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmphdwwzfnc/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02558 seconds (39.09591/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmphdwwzfnc/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'cd041e7c578cffafef784a14ddf6eadd', '772674f2-3711-4e03-9514-162aa5f744c9-sda', '1757769882.44387', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('772674f2-3711-4e03-9514-162aa5f744c9-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'cd041e7c578cffafef784a14ddf6eadd', '772674f2-3711-4e03-9514-162aa5f744c9-sda', '1757769882.44387', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('772674f2-3711-4e03-9514-162aa5f744c9-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpbwsbowra/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '55e29aba-c055-434a-ad54-01d3a37602b8-sda', '1757769882.47336', '1757769882', '0', '', '1757769882', 0, 1) test DEBUG: /tmp/tmpbwsbowra/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '55e29aba-c055-434a-ad54-01d3a37602b8-sda', '1757769882.47336', '1757769882', '0', '', '1757769882', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('55e29aba-c055-434a-ad54-01d3a37602b8-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00960 seconds (104.15606/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpplksz8q7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', 'f1c10d95-34c4-4a42-aaa1-3bd8c20f7bd2-sda', '1757769882.49658', '1757769882', '0', '', '1757769882', 1, 0) test DEBUG: /tmp/tmpplksz8q7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769886.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], 'f1c10d95-34c4-4a42-aaa1-3bd8c20f7bd2-sda') test DEBUG: /tmp/tmpplksz8q7/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00252366s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', 'f1c10d95-34c4-4a42-aaa1-3bd8c20f7bd2-sda', '1757769882.49658', '1757769882', '0', '', '1757769882', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('f1c10d95-34c4-4a42-aaa1-3bd8c20f7bd2-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmpplksz8q7/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02117 seconds (47.24463/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpplksz8q7/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '23c0e06c31c15d61e829187a19f96af5', '857d5b90-1afb-48d3-bea5-b2ebdb958392-sda', '1757769882.52059', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('857d5b90-1afb-48d3-bea5-b2ebdb958392-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '23c0e06c31c15d61e829187a19f96af5', '857d5b90-1afb-48d3-bea5-b2ebdb958392-sda', '1757769882.52059', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('857d5b90-1afb-48d3-bea5-b2ebdb958392-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmphmx1f1ut/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'dddf9505-4cba-4372-bb61-74be2be63e4b-sda', '1757769882.53592', '1757769882', '0', '', '1757769882', 0, 0) test DEBUG: /tmp/tmphmx1f1ut/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'dddf9505-4cba-4372-bb61-74be2be63e4b-sda', '1757769882.53592', '1757769882', '0', '', '1757769882', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('dddf9505-4cba-4372-bb61-74be2be63e4b-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.03274 seconds (30.54081/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp6rdb9x58/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '983d4dc7-3778-4120-8a49-f195b3c209e7-sda', '1757769882.58010', '1757769882', '0', '', '1757769882', 1, 0) test DEBUG: /tmp/tmp6rdb9x58/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '1a2689e3b460baa24c6116460c820593', '983d4dc7-3778-4120-8a49-f195b3c209e7-sda', '1757769882.58010', '1757769882', '0', '', '1757769882', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('983d4dc7-3778-4120-8a49-f195b3c209e7-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmp6rdb9x58/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01930 seconds (51.81389/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_older_local_create test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_older_local_create ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_storage_policy_property test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_storage_policy_property ... ok sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Continuing to cleave (1 done, 3 todo), path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaving from row None into .shards_a/c_there_1 for ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Cleaving ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887> - shard db already in sync, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Replicating new shard container .shards_a/c_there_1 for ShardRange, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaved ShardRange<'here' to 'there' as of 1757769836.07887, (3, 6) as of 1757769882.54229, cleaved as of 1757769836.07887> in 0.003s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaving from row None into .shards_a/c_where_2 for ShardRange<'there' to 'where' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00014591217041015625s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=False) in 5.53131103515625e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.799003601074219e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_where_2 for ShardRange, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaved ShardRange<'there' to 'where' as of 1757769836.07887, (1, 100) as of 1757769882.55394, cleaved as of 1757769836.07887> in 0.007s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Continuing to cleave (3 done, 1 todo), path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaving from row None into .shards_a/c_yonder_3 for ShardRange<'where' to 'yonder' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001609325408935547s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=False) in 5.316734313964844e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00010538101196289062s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 5.316734313964844e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_yonder_3 for ShardRange, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaved ShardRange<'where' to 'yonder' as of 1757769836.07887, (1, 1000) as of 1757769882.58426, cleaved as of 1757769836.07887> in 0.014s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Continuing to cleave (4 done, 0 todo), path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Continuing to cleave (4 done, 1 todo), path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaving from row None into .shards_a/c__4 for ShardRange<'yonder' to MaxBound as of 1757769836.07887, (2, 15) as of 1757769882.59523, active as of 1757769836.07887>, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001456737518310547s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=False) in 5.078315734863281e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.703636169433594e-05s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__4 for ShardRange, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test INFO: Cleaved ShardRange<'yonder' to MaxBound as of 1757769836.07887, (2, 15) as of 1757769882.59523, active as of 1757769836.07887> in 0.006s, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Cleaving already complete for container, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Passing over already sharded container, path: a/c, db: /tmp/tmp647ovc01/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.44875.dbtest.unit.container.test_sharder.TestSharder.test_cleave_root_listing_limit_one test.unit.container.test_sharder.TestSharder.test_cleave_root_listing_limit_one ... ok test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_sync_merging test.unit.container.test_backend.TestContainerBrokerBeforeShardRangeTombstonesColumn.test_sync_merging ... ok test.unit.container.test_sharder.TestCleavingContext.test_cursor test.unit.container.test_sharder.TestCleavingContext.test_cursor ... ok test.unit.container.test_sharder.TestCleavingContext.test_delete test.unit.container.test_sharder.TestCleavingContext.test_delete ... ok test.unit.container.test_sharder.TestCleavingContext.test_done test.unit.container.test_sharder.TestCleavingContext.test_done ... ok test.unit.container.test_sharder.TestCleavingContext.test_init test.unit.container.test_sharder.TestCleavingContext.test_init ... ok test.unit.container.test_sharder.TestSharder.test_cleave_root_ranges_change test.unit.container.test_sharder.TestSharder.test_cleave_root_ranges_change ... ok test.unit.container.test_sharder.TestCleavingContext.test_iter test.unit.container.test_sharder.TestCleavingContext.test_iter ... ok test.unit.container.test_sharder.TestCleavingContext.test_load test.unit.container.test_sharder.TestCleavingContext.test_load ... ok test.unit.container.test_sharder.TestCleavingContext.test_load_all test.unit.container.test_sharder.TestCleavingContext.test_load_all ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_empty_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_empty_old_style_shard_container ... ok test.unit.container.test_sharder.TestCleavingContext.test_load_modify_store_load test.unit.container.test_sharder.TestCleavingContext.test_load_modify_store_load ... ok test.unit.container.test_sharder.TestCleavingContext.test_load_modify_store_load_old_style test.unit.container.test_sharder.TestCleavingContext.test_load_modify_store_load_old_style ... ok test.unit.container.test_sharder.TestCleavingContext.test_range_done test.unit.container.test_sharder.TestCleavingContext.test_range_done ... ok test.unit.container.test_sharder.TestCleavingContext.test_reset test.unit.container.test_sharder.TestCleavingContext.test_reset ... ok test.unit.container.test_sharder.TestCleavingContext.test_start test.unit.container.test_sharder.TestCleavingContext.test_start ... ok sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test INFO: Starting to cleave (3 todo), path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test INFO: Cleaving from row None into .shards_a/c_d_0 for ShardRange, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: got 4 rows (deleted=False) in 0.0001800060272216797s, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00012159347534179688s, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_d_0 for ShardRange, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test INFO: Cleaved ShardRange in 0.008s, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test INFO: Cleaving from row None into .shards_a/c_x_1 for ShardRange<'d' to 'x' as of 1757769836.07887, (500000, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.000152587890625s, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00011682510375976562s, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_x_1 for ShardRange, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test INFO: Cleaved ShardRange<'d' to 'x' as of 1757769836.07887, (2, 103) as of 1757769882.67542, cleaved as of 1757769836.07887> in 0.007s, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: Continuing to cleave (2 done, 1 todo), path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test INFO: Cleaving from row None into .shards_a/c__2 for ShardRange<'d' to MaxBound as of 1757769882.68588, (500000, 0) as of 1757769882.68588, created as of 1757769882.68588>, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00015592575073242188s, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00011849403381347656s, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__2 for ShardRange, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test INFO: Cleaved ShardRange<'d' to MaxBound as of 1757769882.68588, (3, 1103) as of 1757769882.70009, cleaved as of 1757769882.68588> in 0.007s, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmpq0h592sz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769882.63882.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0004124641418457031s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 1 rows (deleted=False) in 6.198883056640625e-05s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.942054748535156e-05s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test WARNING: Failed to sufficiently replicate misplaced objects shard .shards_a/c_here_0 in state active: 1 successes, 2 required (not removing objects), shard db: /tmp/tmp8geqic08/sda/containers/0/e19/9e88c3bdfd03a830d1fc09d35d671e19/9e88c3bdfd03a830d1fc09d35d671e19.db, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00012063980102539062s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.0001246929168701172s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=False) in 4.649162292480469e-05s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.dbtest.unit.container.test_sharder.TestCleavingContext.test_store test.unit.container.test_sharder.TestCleavingContext.test_store ... ok test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmp6rdb9x58/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '23c0e06c31c15d61e829187a19f96af5', '2e3da638-cb8e-472f-a46c-7b837f384d1b-sda', '1757769882.60258', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('2e3da638-cb8e-472f-a46c-7b837f384d1b-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '23c0e06c31c15d61e829187a19f96af5', '2e3da638-cb8e-472f-a46c-7b837f384d1b-sda', '1757769882.60258', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('2e3da638-cb8e-472f-a46c-7b837f384d1b-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpv98kpnh8/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'e8bfbaca-6342-43b0-8cd2-2ab675de9cf9-sda', '1757769882.63482', '1757769882', '1757769884', '', '1757769884', 0, 1) test DEBUG: /tmp/tmpv98kpnh8/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'e8bfbaca-6342-43b0-8cd2-2ab675de9cf9-sda', '1757769882.63482', '1757769882', '1757769884', '', '1757769884', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('e8bfbaca-6342-43b0-8cd2-2ab675de9cf9-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01046 seconds (95.57615/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmppiw89ng9/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'd99be015-524f-4ef0-a333-63c0d14a8171-sda', '1757769882.65934', '1757769882', '1757769884', '', '1757769884', 1, 1) test DEBUG: /tmp/tmppiw89ng9/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769887.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 1}], 'd99be015-524f-4ef0-a333-63c0d14a8171-sda') test DEBUG: /tmp/tmppiw89ng9/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00340366s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'd99be015-524f-4ef0-a333-63c0d14a8171-sda', '1757769882.65934', '1757769882', '1757769884', '', '1757769884', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('d99be015-524f-4ef0-a333-63c0d14a8171-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmppiw89ng9/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02643 seconds (37.84024/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmppiw89ng9/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'ee1baef1fae0032df3dbe4122ab86018', '81026377-c459-4049-a9c7-f069ddc5fa38-sda', '1757769882.68966', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('81026377-c459-4049-a9c7-f069ddc5fa38-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'ee1baef1fae0032df3dbe4122ab86018', '81026377-c459-4049-a9c7-f069ddc5fa38-sda', '1757769882.68966', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('81026377-c459-4049-a9c7-f069ddc5fa38-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp6nkl46ot/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '301ff493-226a-4731-bd81-9663afe92746-sda', '1757769882.70546', '1757769882', '1757769884', '', '1757769884', 0, 1) test DEBUG: /tmp/tmp6nkl46ot/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '301ff493-226a-4731-bd81-9663afe92746-sda', '1757769882.70546', '1757769882', '1757769884', '', '1757769884', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('301ff493-226a-4731-bd81-9663afe92746-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01386 seconds (72.12604/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp0u6dy716/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'a4443dc6-0a11-4016-aac9-ed3c7ac62094-sda', '1757769882.73072', '1757769882', '1757769884', '', '1757769884', 1, 0) test DEBUG: /tmp/tmp0u6dy716/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b2a8cb76bc648f70ad692299cbc01c32', 'a4443dc6-0a11-4016-aac9-ed3c7ac62094-sda', '1757769882.73072', '1757769882', '1757769884', '', '1757769884', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('a4443dc6-0a11-4016-aac9-ed3c7ac62094-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmp0u6dy716/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02025 seconds (49.38983/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmp0u6dy716/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'cd041e7c578cffafef784a14ddf6eadd', '27f161cc-d38d-41d7-ab3f-8bc4ba5df952-sda', '1757769882.75219', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('27f161cc-d38d-41d7-ab3f-8bc4ba5df952-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, 'cd041e7c578cffafef784a14ddf6eadd', '27f161cc-d38d-41d7-ab3f-8bc4ba5df952-sda', '1757769882.75219', '1757768400', '0', '', '1757768400', 1, 0)test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_older_local_delete test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_older_local_delete ... ok test.unit.container.test_sharder.TestCleavingContext.test_store_add_row_load test.unit.container.test_sharder.TestCleavingContext.test_store_add_row_load ... ok test.unit.container.test_sharder.TestSharder.test_cleave_shard test.unit.container.test_sharder.TestSharder.test_cleave_shard ... ok test.unit.container.test_sharder.TestCleavingContext.test_store_add_row_load_old_style test.unit.container.test_sharder.TestCleavingContext.test_store_add_row_load_old_style ... ok sharder-test DEBUG: got 1 rows (deleted=True) in 5.4836273193359375e-05s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test INFO: Cleaving from row None into .shards_a/c_there_0 for ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00015401840209960938s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010442733764648438s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Replicating new shard container .shards_a/c_there_0 for ShardRange<'here' to 'where' as of 1757769882.70883, (0, 0) as of 1757769882.70883, sharding as of 1757769882.70883>, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test INFO: Cleaved ShardRange<'here' to 'there' as of 1757769836.07887, (3, 6) as of 1757769882.76407, cleaved as of 1757769836.07887> in 0.009s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00027751922607421875s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 1 rows (deleted=False) in 6.198883056640625e-05s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.012222290039062e-05s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.821487426757812e-05s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.870529174804688e-05s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Placed 1 misplaced objects (0 unplaced), path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: Continuing to cleave (1 done, 1 todo), path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test INFO: Cleaving from row None into .shards_a/c_where_1 for ShardRange<'there' to 'where' as of 1757769836.07887, (2, 15) as of 1757769882.77209, cleaved as of 1757769836.07887>, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001590251922607422s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.226799011230469e-05s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Replicating new shard container .shards_a/c_where_1 for ShardRange<'here' to 'where' as of 1757769882.70883, (0, 0) as of 1757769882.70883, sharding as of 1757769882.70883>, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test INFO: Cleaved ShardRange<'there' to 'where' as of 1757769836.07887, (2, 15) as of 1757769882.77209, cleaved as of 1757769836.07887> in 0.005s, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/shard_c, db: /tmp/tmp8geqic08/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769882.70885.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmp34_s80rr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp34_s80rr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp34_s80rr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp34_s80rr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmp34_s80rr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to get own_shard_range, path: a/c, db: /tmp/tmp34_s80rr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmp34_s80rr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_sharder.TestSharder.test_cleave_shard_range_no_own_shard_range test.unit.container.test_sharder.TestSharder.test_cleave_shard_range_no_own_shard_range ... ok test.unit.container.test_sharder.TestCleavingContext.test_store_modify_db_id_load test.unit.container.test_sharder.TestCleavingContext.test_store_modify_db_id_load ... ok test.unit.container.test_sharder.TestCleavingContext.test_store_modify_db_id_load_old_style test.unit.container.test_sharder.TestCleavingContext.test_store_modify_db_id_load_old_style ... ok test.unit.container.test_sharder.TestCleavingContext.test_store_old_style test.unit.container.test_sharder.TestCleavingContext.test_store_old_style ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_older_local_recreate test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_recreate_policy_over_older_local_recreate ... ok test.unit.container.test_sharder.TestCleavingContext.test_store_reclaim_load test.unit.container.test_sharder.TestCleavingContext.test_store_reclaim_load ... ok test.unit.container.test_sharder.TestCleavingContext.test_store_reclaim_load_old_style test.unit.container.test_sharder.TestCleavingContext.test_store_reclaim_load_old_style ... ok test.unit.obj.test_expirer.TestExpirerHelpers.test_add_expirer_bytes_to_ctype test.unit.obj.test_expirer.TestExpirerHelpers.test_add_expirer_bytes_to_ctype ... ok test.unit.obj.test_expirer.TestExpirerHelpers.test_add_invalid_expirer_bytes_to_ctype test.unit.obj.test_expirer.TestExpirerHelpers.test_add_invalid_expirer_bytes_to_ctype ... ok test.unit.obj.test_expirer.TestExpirerHelpers.test_extract_expirer_bytes_from_ctype test.unit.obj.test_expirer.TestExpirerHelpers.test_extract_expirer_bytes_from_ctype ... ok test.unit.obj.test_expirer.TestExpirerHelpers.test_extract_missing_bytes_from_ctype test.unit.obj.test_expirer.TestExpirerHelpers.test_extract_missing_bytes_from_ctype ... ok test.unit.obj.test_expirer.TestExpirerHelpers.test_inverse_add_extract_bytes_from_ctype test.unit.obj.test_expirer.TestExpirerHelpers.test_inverse_add_extract_bytes_from_ctype ... ok REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('27f161cc-d38d-41d7-ab3f-8bc4ba5df952-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpzp0jo2fo/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'c719166f-f940-42cd-b9ae-9780a0629537-sda', '1757769882.78581', '1757769885', '1757769884', '', '1757769885', 0, 1) test DEBUG: /tmp/tmpzp0jo2fo/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'c719166f-f940-42cd-b9ae-9780a0629537-sda', '1757769882.78581', '1757769885', '1757769884', '', '1757769885', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('c719166f-f940-42cd-b9ae-9780a0629537-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.00916 seconds (109.21410/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpiacqgq3b/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'bfed0beb293d67f3c127cb678953ec36', '8fd64d7d-3f2f-4b45-8be3-4f80e3eb4231-sda', '1757769882.80606', '1757769885', '1757769884', '', '1757769885', 1, 0) test DEBUG: /tmp/tmpiacqgq3b/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': '/a/c/o', 'created_at': '1757769888.00000', 'size': 0, 'content_type': 'content-type', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '8fd64d7d-3f2f-4b45-8be3-4f80e3eb4231-sda') test DEBUG: /tmp/tmpiacqgq3b/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00268102s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'bfed0beb293d67f3c127cb678953ec36', '8fd64d7d-3f2f-4b45-8be3-4f80e3eb4231-sda', '1757769882.80606', '1757769885', '1757769884', '', '1757769885', 1, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('8fd64d7d-3f2f-4b45-8be3-4f80e3eb4231-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmpiacqgq3b/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01988 seconds (50.30202/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:1 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpiacqgq3b/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '72aef1c8ae96d250e2baa85157f2dddc', '3569d4c2-7d87-4e9c-a5d8-95bbbb06b222-sda', '1757769882.83249', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('3569d4c2-7d87-4e9c-a5d8-95bbbb06b222-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '72aef1c8ae96d250e2baa85157f2dddc', '3569d4c2-7d87-4e9c-a5d8-95bbbb06b222-sda', '1757769882.83249', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('3569d4c2-7d87-4e9c-a5d8-95bbbb06b222-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpktzfe2_i/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '819eff99-9378-43d3-8507-66cc4be82978-sda', '1757769882.85042', '1757769885', '1757769884', '', '1757769885', 0, 0) test DEBUG: /tmp/tmpktzfe2_i/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '819eff99-9378-43d3-8507-66cc4be82978-sda', '1757769882.85042', '1757769885', '1757769884', '', '1757769885', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('819eff99-9378-43d3-8507-66cc4be82978-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01054 seconds (94.83921/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmpobttj0_9/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'bfed0beb293d67f3c127cb678953ec36', '0b9927b9-bef5-49c2-bb15-f036b505b9b0-sda', '1757769882.87329', '1757769885', '1757769884', '', '1757769885', 1, 1) test DEBUG: /tmp/tmpobttj0_9/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'bfed0beb293d67f3c127cb678953ec36', '0b9927b9-bef5-49c2-bb15-f036b505b9b0-sda', '1757769882.87329', '1757769885', '1757769884', '', '1757769885', 1, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('0b9927b9-bef5-49c2-bb15-f036b505b9b0-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test DEBUG: Adding 1 objects to the reconciler at /tmp/tmpobttj0_9/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01917 seconds (52.16899/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Replicating 1 reconciler containers test DEBUG: Replicating db /tmp/tmpobttj0_9/sda/containers/0/d0e/8a4aa9c52acd7ed2464b7d09774f9d0e/8a4aa9c52acd7ed2464b7d09774f9d0e.db REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '922c006e5758ce060f0058f173e98873', '403878c3-4207-4d57-84ba-300ba8b93c39-sda', '1757769882.89617', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdb/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('403878c3-4207-4d57-84ba-300ba8b93c39-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, sync, (1, '922c006e5758ce060f0058f173e98873', '403878c3-4207-4d57-84ba-300ba8b93c39-sda', '1757769882.89617', '1757768400', '0', '', '1757768400', 1, 0) REPLICATE: /sdc/0/8a4aa9c52acd7ed2464b7d09774f9d0e, complete_rsync, ('403878c3-4207-4d57-84ba-300ba8b93c39-sda', '8a4aa9c52acd7ed2464b7d09774f9d0e.db') test INFO: Cleaning up 0 reconciler containers test INFO: Finished reconciler replication REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '759443733b6ac223f6df20a8deb0fc4f', '2bea5a41-5715-49f1-a18e-c5e3fb8eeb06-sda', '1757769882.91230', '1757769882.00000', '0', '{"x-container-meta-test": ["foo", "1757769882.00000"]}', '1757769882.00000', 1, 0) test DEBUG: replicator-rpc-sync time for info: 0.00s test DEBUG: replicator-rpc-sync time for update_metadata: 0.00s test DEBUG: replicator-rpc-sync time for merge_timestamps: 0.00stest.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_with_timings test.unit.container.test_replicator.TestReplicatorSync.test_sync_remote_with_timings ... ok sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82_1757769895.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82_1757769895.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82_1757769895.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00011134147644042969s, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82.db sharder-test DEBUG: got 0 rows (deleted=True) in 7.796287536621094e-05s, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.535385131835938e-05s, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.368492126464844e-05s, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82_1757769895.00000.db sharder-test INFO: Starting to cleave (1 todo), path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82_1757769895.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_1_ for ShardRange<'h' to MaxBound as of 1757769882.83863, (1000, 11111) as of 1757769882.83863, created as of 1757769882.83863>, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82_1757769895.00000.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00014662742614746094s, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.96453857421875e-05s, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_1_ for ShardRange<'h' to 'w' as of 1757769905.00000, (0, 0) as of 1757769894.00000, shrunk as of 1757769894.00000>, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82_1757769895.00000.db sharder-test INFO: Cleaved ShardRange<'h' to MaxBound as of 1757769882.83863, (1000, 11111) as of 1757769882.83863, created as of 1757769882.83863> in 0.006s, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82_1757769895.00000.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/donor_1, db: /tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82_1757769895.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4y32b_8f/sda/containers/0/f82/510f8d055bc4c497feaa044595034f82/510f8d055bc4c497feaa044595034f82.db' sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696_1757769922.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696_1757769922.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696_1757769922.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00012135505676269531s, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.322166442871094e-05s, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.749961853027344e-05s, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.059906005859375e-05s, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696_1757769922.00000.db sharder-test INFO: Starting to cleave (1 todo), path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696_1757769922.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_2_ for ShardRange<'h' to MaxBound as of 1757769882.87914, (1000, 11111) as of 1757769882.87914, cleaved as of 1757769882.87914>, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696_1757769922.00000.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00015020370483398438s, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.702278137207031e-05s, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_2_ for ShardRange<'h' to 'w' as of 1757769932.00000, (0, 0) as of 1757769921.00000, shrunk as of 1757769921.00000>, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696_1757769922.00000.db sharder-test INFO: Cleaved ShardRange<'h' to MaxBound as of 1757769882.87914, (1000, 11111) as of 1757769882.87914, cleaved as of 1757769882.87914> in 0.006s, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696_1757769922.00000.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/donor_2, db: /tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696_1757769922.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4y32b_8f/sda/containers/0/696/d08603253b97a4fc8389d8100b181696/d08603253b97a4fc8389d8100b181696.db' sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1_1757769949.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1_1757769949.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1_1757769949.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00012087821960449219s, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1.db test DEBUG: replicator-rpc-sync time for get_sync: 0.00s test DEBUG: replicator-rpc-sync time for merge_syncs: 0.00s REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b20ea2be7036ba0dea8d8d769961a8a6', '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda', '1757769882.92746', '1757769882.92575', '0', '', '1757769882.92575', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769882.93126', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769882.93126', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93126', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769882.93131', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769882.93131', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93131', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769882.93132', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769882.93132', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93132', 'epoch': None, 'reported': 0, 'tombstones': -1}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda') test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 3 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'obj', 'created_at': '1757769882.93265', 'size': 0, 'content_type': 'text/plain', 'etag': 'd41d8cd98f00b204e9800998ecf8427e', 'deleted': 0, 'storage_policy_index': 0}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda') test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.00263071s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b20ea2be7036ba0dea8d8d769961a8a6', '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda', '1757769882.92746', '1757769882.92575', '0', '', '1757769882.92575', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769882.93126', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769882.93126', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93126', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769882.93131', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769882.93131', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93131', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769882.93132', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769882.93132', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93132', 'epoch': None, 'reported': 0, 'tombstones': -1}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda') test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 3 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b20ea2be7036ba0dea8d8d769961a8a6', '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda', '1757769882.92746', '1757769882.92575', '0', '', '1757769882.92575', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769882.93126', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769882.93126', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93126', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769882.93131', 'lower': 'g', 'upper': 'r', 'object_count': 13, 'bytes_used': 123, 'meta_timestamp': '1757769882.95964', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93131', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769882.93132', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769882.93132', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93132', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769882.95936', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769882.95936', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769882.95926', 'epoch': '1757769882.95926', 'reported': 0, 'tombstones': -1}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda') test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b20ea2be7036ba0dea8d8d769961a8a6', '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda', '1757769882.92746', '1757769882.92575', '0', '', '1757769882.92575', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769882.93126', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769882.93126', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93126', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769882.93131', 'lower': 'g', 'upper': 'r', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769882.97186', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93131', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769882.93132', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769882.93132', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93132', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769882.95936', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769882.95936', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769882.95926', 'epoch': '1757769882.95926', 'reported': 0, 'tombstones': -1}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda') test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b20ea2be7036ba0dea8d8d769961a8a6', '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda', '1757769882.92746', '1757769882.92575', '0', '', '1757769882.92575', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769882.98121', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769882.98121', 'deleted': 1, 'state': 10, 'state_timestamp': '1757769882.98121', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769882.93131', 'lower': 'g', 'upper': 'r', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769882.97186', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93131', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769882.93132', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769882.93132', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93132', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769882.95936', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769882.95936', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769882.95926', 'epoch': '1757769882.95926', 'reported': 0, 'tombstones': -1}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda')test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges ... ok test.unit.obj.test_ssync.TestSsyncEC.test_fragment_sync test.unit.obj.test_ssync.TestSsyncEC.test_fragment_sync ... ok test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b20ea2be7036ba0dea8d8d769961a8a6', '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda', '1757769882.92746', '1757769882.92575', '0', '', '1757769882.92575', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769882.98121', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769882.98121', 'deleted': 1, 'state': 10, 'state_timestamp': '1757769882.98121', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769882.93131', 'lower': 'g', 'upper': 'r', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769882.97186', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93131', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769882.99314', 'lower': 'r', 'upper': '', 'object_count': 0, 'bytes_used': 30, 'meta_timestamp': '1757769882.99314', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.99314', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769882.95936', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769882.95936', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769882.95926', 'epoch': '1757769882.95926', 'reported': 0, 'tombstones': -1}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda') test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b20ea2be7036ba0dea8d8d769961a8a6', '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda', '1757769882.92746', '1757769882.92575', '0', '', '1757769882.92575', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769882.98121', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769882.98121', 'deleted': 1, 'state': 10, 'state_timestamp': '1757769882.98121', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769882.93131', 'lower': 'g', 'upper': 'r', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769882.97186', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93131', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769882.99314', 'lower': 'r', 'upper': '', 'object_count': 0, 'bytes_used': 2030, 'meta_timestamp': '1757769883.00298', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.99314', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769882.95936', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769882.95936', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769882.95926', 'epoch': '1757769882.95926', 'reported': 0, 'tombstones': -1}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda') test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b20ea2be7036ba0dea8d8d769961a8a6', '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda', '1757769882.92746', '1757769882.92575', '0', '', '1757769882.92575', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.01174', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769882.98121', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.98121', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769882.93131', 'lower': 'g', 'upper': 'r', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769882.97186', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93131', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769882.99314', 'lower': 'r', 'upper': '', 'object_count': 0, 'bytes_used': 2030, 'meta_timestamp': '1757769883.00298', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.99314', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769882.95936', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769882.95936', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769882.95926', 'epoch': '1757769882.95926', 'reported': 0, 'tombstones': -1}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda') test DEBUG: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmpui49_epm/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sda/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'b20ea2be7036ba0dea8d8d769961a8a6', '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda', '1757769882.92746', '1757769882.92575', '0', '', '1757769882.92575', 1, 0) REPLICATE: /sda/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sda/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.01174', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769882.98121', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.98121', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769882.93131', 'lower': 'g', 'upper': 'r', 'object_count': 99, 'bytes_used': 0, 'meta_timestamp': '1757769882.97186', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.93131', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769882.99314', 'lower': 'r', 'upper': '', 'object_count': 0, 'bytes_used': 2030, 'meta_timestamp': '1757769883.00298', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769882.99314', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769882.95936', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769882.95936', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769882.95926', 'epoch': '1757769882.95926', 'reported': 0, 'tombstones': -1}], '047a6e37-4f4d-4047-b4e6-09cb935cd128-sda') test DEBUG: /tmp/tmpui49_epm/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.0:1000/sda test WARNING: /tmp/tmpui49_epm/sdb/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.0:1000/sda; have shard ranges and will wait for cleaving REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, 'dfea11a1802391bb33cdbd94e452b933', '9f50f62b-4e0d-4240-a0a6-ce7bd72afc82-sda', '1757769883.03594', '1757769883.03422', '0', '', '1757769883.03422', 1, 0) sharder-test DEBUG: got 0 rows (deleted=True) in 7.605552673339844e-05s, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.130073547363281e-05s, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.441375732421875e-05s, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1_1757769949.00000.db sharder-test INFO: Starting to cleave (1 todo), path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1_1757769949.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_3_ for ShardRange<'h' to MaxBound as of 1757769882.92617, (1000, 11111) as of 1757769882.92617, active as of 1757769882.92617>, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1_1757769949.00000.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00019359588623046875s, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.894371032714844e-05s, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_3_ for ShardRange<'h' to 'w' as of 1757769959.00000, (0, 0) as of 1757769948.00000, shrunk as of 1757769948.00000>, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1_1757769949.00000.db sharder-test INFO: Cleaved ShardRange<'h' to MaxBound as of 1757769882.92617, (1000, 11111) as of 1757769882.92617, active as of 1757769882.92617> in 0.011s, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1_1757769949.00000.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/donor_3, db: /tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1_1757769949.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4y32b_8f/sda/containers/0/6c1/8156e3184a7f49e42b9074e4cb3516c1/8156e3184a7f49e42b9074e4cb3516c1.db' sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00011014938354492188s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.058547973632812e-05s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.559226989746094e-05s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.487701416015625e-05s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_4_k for ShardRange<'d' to 'k' as of 1757769882.97602, (1000, 11111) as of 1757769882.97602, created as of 1757769882.97602>, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001461505889892578s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.702278137207031e-05s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_4_k for ShardRange<'h' to 'w' as of 1757769975.00000, (0, 0) as of 1757769975.00000, shrinking as of 1757769975.00000>, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test INFO: Cleaved ShardRange<'d' to 'k' as of 1757769882.97602, (1000, 11111) as of 1757769882.97602, created as of 1757769882.97602> in 0.005s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_4_ for ShardRange<'k' to MaxBound as of 1757769882.97606, (1000, 11111) as of 1757769882.97606, created as of 1757769882.97606>, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00014328956604003906s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.273124694824219e-05s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_4_ for ShardRange<'h' to 'w' as of 1757769975.00000, (0, 0) as of 1757769975.00000, shrinking as of 1757769975.00000>, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test INFO: Cleaved ShardRange<'k' to MaxBound as of 1757769882.97606, (1000, 11111) as of 1757769882.97606, created as of 1757769882.97606> in 0.005s, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test DEBUG: Cleaved 2 shard ranges, path: .shards_a/donor_4, db: /tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff_1757769976.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4y32b_8f/sda/containers/0/4ff/7ab63f7c14211a36c77395c9374624ff/7ab63f7c14211a36c77395c9374624ff.db' sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.dbtest.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_error test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_error ... ok sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00011849403381347656s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.249282836914062e-05s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00014090538024902344s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.821487426757812e-05s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_5_k for ShardRange<'d' to 'k' as of 1757769883.02702, (1000, 11111) as of 1757769883.02702, cleaved as of 1757769883.02702>, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001380443572998047s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.630752563476562e-05s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_5_k for ShardRange<'h' to 'w' as of 1757770008.00000, (0, 0) as of 1757770008.00000, shrinking as of 1757770008.00000>, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test INFO: Cleaved ShardRange<'d' to 'k' as of 1757769883.02702, (1000, 11111) as of 1757769883.02702, cleaved as of 1757769883.02702> in 0.005s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_5_ for ShardRange<'k' to MaxBound as of 1757769883.02704, (1000, 11111) as of 1757769883.02704, cleaved as of 1757769883.02704>, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00013566017150878906s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.179115295410156e-05s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_5_ for ShardRange<'h' to 'w' as of 1757770008.00000, (0, 0) as of 1757770008.00000, shrinking as of 1757770008.00000>, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test INFO: Cleaved ShardRange<'k' to MaxBound as of 1757769883.02704, (1000, 11111) as of 1757769883.02704, cleaved as of 1757769883.02704> in 0.005s, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test DEBUG: Cleaved 2 shard ranges, path: .shards_a/donor_5, db: /tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c_1757770009.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4y32b_8f/sda/containers/0/e3c/3153d1a13e2a76238abc63bbf5347e3c/3153d1a13e2a76238abc63bbf5347e3c.db' sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.000125885009765625s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.082389831542969e-05s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.059906005859375e-05s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010561943054199219s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_6_k for ShardRange<'d' to 'k' as of 1757769883.08613, (1000, 11111) as of 1757769883.08613, active as of 1757769883.08613>, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00016355514526367188s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.000133514404296875s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_6_k for ShardRange<'h' to 'w' as of 1757770041.00000, (0, 0) as of 1757770041.00000, shrinking as of 1757770041.00000>, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test INFO: Cleaved ShardRange<'d' to 'k' as of 1757769883.08613, (1000, 11111) as of 1757769883.08613, active as of 1757769883.08613> in 0.006s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_6_ for ShardRange<'k' to MaxBound as of 1757769883.08616, (1000, 11111) as of 1757769883.08616, active as of 1757769883.08616>, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': 'a/c', 'timestamp': '1757769883.03996', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.03996', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769883.03981', 'epoch': '1757769883.03981', 'reported': 0, 'tombstones': -1}], '9f50f62b-4e0d-4240-a0a6-ce7bd72afc82-sda') test ERROR: ERROR Bad response 500 from 10.0.0.1 test DEBUG: /tmp/tmpn5l0bg1a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, starting at row -1 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'obj', 'created_at': '1757769883.03964', 'size': 0, 'content_type': 'text/plain', 'etag': 'd41d8cd98f00b204e9800998ecf8427e', 'deleted': 0, 'storage_policy_index': 0}], '9f50f62b-4e0d-4240-a0a6-ce7bd72afc82-sda') test DEBUG: /tmp/tmpn5l0bg1a/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db usyncing chunks to 10.0.0.1:1001/sdb, finished at row 1 (0.0127597s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'efc3a71c-1e0f-4e29-8d81-bd416f356fb9-sda', '1757769883.06780', '1757769883.06599', '0', '', '1757769883.06599', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.07199', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.07199', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.07199', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.07204', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.07204', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.07204', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.07205', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.07205', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.07205', 'epoch': None, 'reported': 0, 'tombstones': -1}], 'efc3a71c-1e0f-4e29-8d81-bd416f356fb9-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 3 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '98df15f9-7649-4cfd-bbd1-4b692846b270-sda', '1757769883.08460', '1757769883.08286', '0', '', '1757769883.08286', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.08858', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.08858', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.08858', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.08863', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.08863', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.08863', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.08864', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.08864', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.08864', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06578', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06578', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06578', 'epoch': None, 'reported': 0, 'tombstones': -1}], '98df15f9-7649-4cfd-bbd1-4b692846b270-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '7c93597f-da7c-4597-bd4e-8b92367e5307-sda', '1757769883.10528', '1757769883.10349', '0', '', '1757769883.10349', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.10927', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.10927', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.10927', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.10932', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.10932', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.10932', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.10933', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.10933', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.10933', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06578', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06578', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06578', 'epoch': None, 'reported': 0, 'tombstones': -1}], '7c93597f-da7c-4597-bd4e-8b92367e5307-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'f6731137-2dc3-43c3-b2af-5cabb67f6560-sda', '1757769883.12237', '1757769883.12070', '0', '', '1757769883.12070', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.12622', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.12622', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.12622', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.12626', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.12626', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.12626', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.12627', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.12627', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.12627', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06578', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06578', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06578', 'epoch': None, 'reported': 0, 'tombstones': -1}], 'f6731137-2dc3-43c3-b2af-5cabb67f6560-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to dotest.unit.obj.test_ssync.TestSsyncEC.test_handoff_fragment_only_missing_durable_state test.unit.obj.test_ssync.TestSsyncEC.test_handoff_fragment_only_missing_durable_state ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_empty_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_empty_shard_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_enable_sharding test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_enable_sharding ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_delimiter_reverse_no_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_delimiter_reverse_no_memcache ... ok sharder-test DEBUG: got 2 rows (deleted=False) in 0.00016832351684570312s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00014352798461914062s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_6_ for ShardRange<'h' to 'w' as of 1757770041.00000, (0, 0) as of 1757770041.00000, shrinking as of 1757770041.00000>, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test INFO: Cleaved ShardRange<'k' to MaxBound as of 1757769883.08616, (1000, 11111) as of 1757769883.08616, active as of 1757769883.08616> in 0.006s, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test DEBUG: Cleaved 2 shard ranges, path: .shards_a/donor_6, db: /tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9_1757770042.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4y32b_8f/sda/containers/0/3c9/127479cb150cd6d703c13aa1fec193c9/127479cb150cd6d703c13aa1fec193c9.db' sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001308917999267578s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010037422180175781s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.1552734375e-05s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.489059448242188e-05s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test INFO: Starting to cleave (3 todo), path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_7_k for ShardRange<'d' to 'k' as of 1757769883.15437, (1000, 11111) as of 1757769883.15437, cleaved as of 1757769883.15437>, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00015544891357421875s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010466575622558594s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_7_k for ShardRange<'h' to 'w' as of 1757770074.00000, (0, 0) as of 1757770074.00000, shrinking as of 1757770074.00000>, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test INFO: Cleaved ShardRange<'d' to 'k' as of 1757769883.15437, (1000, 11111) as of 1757769883.15437, cleaved as of 1757769883.15437> in 0.006s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_7_t for ShardRange<'k' to 't' as of 1757769883.15440, (1000, 11111) as of 1757769883.15440, cleaved as of 1757769883.15440>, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00015044212341308594s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010323524475097656s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_7_t for ShardRange<'h' to 'w' as of 1757770074.00000, (0, 0) as of 1757770074.00000, shrinking as of 1757770074.00000>, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test INFO: Cleaved ShardRange<'k' to 't' as of 1757769883.15440, (1000, 11111) as of 1757769883.15440, cleaved as of 1757769883.15440> in 0.006s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_7_ for ShardRange<'t' to MaxBound as of 1757769883.15441, (1000, 11111) as of 1757769883.15441, cleaved as of 1757769883.15441>, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00014853477478027344s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001323223114013672s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_7_ for ShardRange<'h' to 'w' as of 1757770074.00000, (0, 0) as of 1757770074.00000, shrinking as of 1757770074.00000>, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test INFO: Cleaved ShardRange<'t' to MaxBound as of 1757769883.15441, (1000, 11111) as of 1757769883.15441, cleaved as of 1757769883.15441> in 0.006s, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test DEBUG: Cleaved 3 shard ranges, path: .shards_a/donor_7, db: /tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175_1757770075.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4y32b_8f/sda/containers/0/175/be6981a6ebce34402af1287bbc13f175/be6981a6ebce34402af1287bbc13f175.db' sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.dbtest.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_exception test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_exception ... ok REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '1facd47d-a882-47d0-9130-d047feea6178-sda', '1757769883.13943', '1757769883.13773', '0', '', '1757769883.13773', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.14328', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.14328', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.14328', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.14332', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.14332', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.14332', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.14333', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.14333', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.14333', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06578', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06578', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06578', 'epoch': None, 'reported': 0, 'tombstones': -1}], '1facd47d-a882-47d0-9130-d047feea6178-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '8de64699-6251-4b72-97ee-9220c5d33d28-sda', '1757769883.16116', '1757769883.15940', '0', '', '1757769883.15940', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.16524', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.16524', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.16524', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.16529', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.16529', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.16529', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.16530', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.16530', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.16530', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06588', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06588', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06588', 'epoch': '1757769883.06589', 'reported': 0, 'tombstones': -1}], '8de64699-6251-4b72-97ee-9220c5d33d28-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '622fb66b-d0e2-49dd-a219-112ee60329b1-sda', '1757769883.17867', '1757769883.17699', '0', '', '1757769883.17699', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.18247', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.18247', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.18247', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.18252', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.18252', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.18252', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.18253', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.18253', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.18253', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06588', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06588', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06588', 'epoch': '1757769883.06589', 'reported': 0, 'tombstones': -1}], '622fb66b-d0e2-49dd-a219-112ee60329b1-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '21a45f2e-256a-43a3-9d7e-fbcd4a932efc-sda', '1757769883.19956', '1757769883.19781', '0', '', '1757769883.19781', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.20360', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.20360', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.20360', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.20365', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.20365', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.20365', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.20366', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.20366', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.20366', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06588', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06588', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06588', 'epoch': '1757769883.06589', 'reported': 0, 'tombstones': -1}], '21a45f2e-256a-43a3-9d7e-fbcd4a932efc-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'a5a71f1a-73ef-40ef-8813-8137bf2fdbdf-sda', '1757769883.22102', '1757769883.21664', '0', '', '1757769883.21664', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.22753', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.22753', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.22753', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.22757', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.22757', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.22757', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.22758', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.22758', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.22758', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06593', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06593', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06593', 'epoch': '1757769883.06594', 'reported': 0, 'tombstones': -1}], 'a5a71f1a-73ef-40ef-8813-8137bf2fdbdf-sda')test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_merge_remote_osr test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_merge_remote_osr ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_none_to_sync test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_none_to_sync ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx70709ac6e5ed47d88aa16-0068c5709a" "proxy-server 1824498" 0.0015 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx2fa7dc687a6e4bc08a5a9-0068c5709a" "proxy-server 1824498" 0.0053 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "PUT /sda1/0/a/c/o.zerobyte" 201 - "PUT http://localhost/sda1/3/a/c/o.zerobyte" "tx1c85b3b38c1f4103bb753-0068c5709a" "object-server 1824498" 0.0005 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "PUT /sdb1/0/a/c/o.zerobyte" 201 - "PUT http://localhost/sdb1/3/a/c/o.zerobyte" "tx1c85b3b38c1f4103bb753-0068c5709a" "object-server 1824498" 0.0004 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "PUT /sdb1/3/a/c/o.zerobyte" 201 - "PUT http://localhost/v1/a/c/o.zerobyte" "tx1c85b3b38c1f4103bb753-0068c5709a" "proxy-server 1824498" 0.0101 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "PUT /sda1/3/a/c/o.zerobyte" 201 - "PUT http://localhost/v1/a/c/o.zerobyte" "tx1c85b3b38c1f4103bb753-0068c5709a" "proxy-server 1824498" 0.0099 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/42 PUT /v1/a/c/o.zerobyte HTTP/1.0 201 - - t - - - tx1c85b3b38c1f4103bb753-0068c5709a - 0.0363 - - 1757769882.007787228 1757769882.044136286 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx85ab0f7e031445068812c-0068c5709a" "proxy-server 1824498" 0.0014 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx95ec24221c9d4ca4a6685-0068c5709a" "proxy-server 1824498" 0.0027 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "GET /sdb1/3/a/c/o.zerobyte" 200 - "GET http://localhost/v1/a/c/o.zerobyte" "tx8fa2846894304b3d86ec9-0068c5709a" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/42 GET /v1/a/c/o.zerobyte HTTP/1.0 200 - - t - - - tx8fa2846894304b3d86ec9-0068c5709a - 0.0170 - - 1757769882.045199633 1757769882.062195301 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd756f7a198b34c02816f5-0068c5709a" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx959baf531947477e9f2d0-0068c5709a" "proxy-server 1824498" 0.0013 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "PUT /sdb1/0/a/c/o.last_modified" 201 - "PUT http://localhost/sdb1/1/a/c/o.last_modified" "tx71fdb0b0280945fe91da8-0068c5709a" "object-server 1824498" 0.0005 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "PUT /sda1/0/a/c/o.last_modified" 201 - "PUT http://localhost/sda1/1/a/c/o.last_modified" "tx71fdb0b0280945fe91da8-0068c5709a" "object-server 1824498" 0.0003 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "PUT /sda1/1/a/c/o.last_modified" 201 - "PUT http://localhost/v1/a/c/o.last_modified" "tx71fdb0b0280945fe91da8-0068c5709a" "proxy-server 1824498" 0.0380 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "PUT /sdb1/1/a/c/o.last_modified" 201 - "PUT http://localhost/v1/a/c/o.last_modified" "tx71fdb0b0280945fe91da8-0068c5709a" "proxy-server 1824498" 0.0383 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/42 PUT /v1/a/c/o.last_modified HTTP/1.0 201 - - t - - - tx71fdb0b0280945fe91da8-0068c5709a - 0.0518 - - 1757769882.068539858 1757769882.120338678 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx33dc2ada69e5451897d29-0068c5709a" "proxy-server 1824498" 0.0014 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx8ce3c579990b4dd0be56d-0068c5709a" "proxy-server 1824498" 0.0046 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sda1/1/a/c/o.last_modified" 200 - "HEAD http://localhost/v1/a/c/o.last_modified" "tx6e6fd939a08c4e43821a0-0068c5709a" "proxy-server 1824498" 0.0002 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/42 HEAD /v1/a/c/o.last_modified HTTP/1.0 200 - - t - - - tx6e6fd939a08c4e43821a0-0068c5709a - 0.0188 - - 1757769882.121755123 1757769882.140512943 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4167e436c3d449338007a-0068c5709a" "proxy-server 1824498" 0.0014 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txfb28ba93b88a4b9a8fc4d-0068c5709a" "proxy-server 1824498" 0.0013 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "GET /sdb1/1/a/c/o.last_modified" 304 - "GET http://localhost/v1/a/c/o.last_modified" "tx5a0f936a026e4da1ad3a1-0068c5709a" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/42 GET /v1/a/c/o.last_modified HTTP/1.0 304 - - t - - - tx5a0f936a026e4da1ad3a1-0068c5709a - 0.0231 - - 1757769882.141903877 1757769882.164989710 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx64843e55f25849a9becf9-0068c5709a" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx3d1d46595fa04531a63a4-0068c5709a" "proxy-server 1824498" 0.0043 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:42 +0000] "GET /sdb1/1/a/c/o.last_modified" 200 - "GET http://localhost/v1/a/c/o.last_modified" "tx26da1596a3094c9e81fef-0068c5709a" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/42 GET /v1/a/c/o.last_modified HTTP/1.0 200 - - t - - - tx26da1596a3094c9e81fef-0068c5709a - 0.0225 - - 1757769882.166382790 1757769882.188922405 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0e60cdf09b7c403c98be5-0068c5709b" "proxy-server 1824498" 0.0015 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txb5093cc6f283432088fb6-0068c5709b" "proxy-server 1824498" 0.0015 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a/c/o.last_modified" 201 - "POST http://localhost/sda1/1/a/c/o.last_modified" "tx0fb455b5cc244a0d8d41a-0068c5709b" "object-server 1824498" 0.0005 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a/c/o.last_modified" 201 - "POST http://localhost/sdb1/1/a/c/o.last_modified" "tx0fb455b5cc244a0d8d41a-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "POST /sdb1/1/a/c/o.last_modified" 202 76 "POST http://localhost/v1/a/c/o.last_modified" "tx0fb455b5cc244a0d8d41a-0068c5709b" "proxy-server 1824498" 0.0058 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "POST /sda1/1/a/c/o.last_modified" 202 76 "POST http://localhost/v1/a/c/o.last_modified" "tx0fb455b5cc244a0d8d41a-0068c5709b" "proxy-server 1824498" 0.0056 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 POST /v1/a/c/o.last_modified HTTP/1.0 202 - - t - 76 - tx0fb455b5cc244a0d8d41a-0068c5709b - 0.0202 - - 1757769883.191747189 1757769883.211929560 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb266b3349bba4e53bc87f-0068c5709b" "proxy-server 1824498" 0.0014 "-" 1824498 -test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_POST_last_modified test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_POST_last_modified ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_POST_requires_container_exist test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_POST_requires_container_exist ... ok test.unit.obj.test_ssync.TestSsyncEC.test_handoff_fragment_revert test.unit.obj.test_ssync.TestSsyncEC.test_handoff_fragment_revert ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_timeout_in_fetch test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_timeout_in_fetch ... ok sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00014853477478027344s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.012222290039062e-05s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010418891906738281s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001246929168701172s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test INFO: Starting to cleave (3 todo), path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_8_k for ShardRange<'d' to 'k' as of 1757769883.24528, (1000, 11111) as of 1757769883.24528, created as of 1757769883.24528>, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001480579376220703s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010347366333007812s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_8_k for ShardRange<'h' to 'w' as of 1757770113.00000, (0, 0) as of 1757770113.00000, shrinking as of 1757770113.00000>, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test INFO: Cleaved ShardRange<'d' to 'k' as of 1757769883.24528, (1000, 11111) as of 1757769883.24528, created as of 1757769883.24528> in 0.006s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_8_t for ShardRange<'k' to 't' as of 1757769883.24532, (1000, 11111) as of 1757769883.24532, created as of 1757769883.24532>, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00016117095947265625s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010919570922851562s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_8_t for ShardRange<'h' to 'w' as of 1757770113.00000, (0, 0) as of 1757770113.00000, shrinking as of 1757770113.00000>, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test INFO: Cleaved ShardRange<'k' to 't' as of 1757769883.24532, (1000, 11111) as of 1757769883.24532, created as of 1757769883.24532> in 0.006s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_8_ for ShardRange<'t' to MaxBound as of 1757769883.24533, (1000, 11111) as of 1757769883.24533, created as of 1757769883.24533>, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00016379356384277344s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011134147644042969s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_8_ for ShardRange<'h' to 'w' as of 1757770113.00000, (0, 0) as of 1757770113.00000, shrinking as of 1757770113.00000>, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test INFO: Cleaved ShardRange<'t' to MaxBound as of 1757769883.24533, (1000, 11111) as of 1757769883.24533, created as of 1757769883.24533> in 0.006s, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test DEBUG: Cleaved 3 shard ranges, path: .shards_a/donor_8, db: /tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25_1757770114.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4y32b_8f/sda/containers/0/b25/cf40e8755399f5ee10bd8bdf3e03ab25/cf40e8755399f5ee10bd8bdf3e03ab25.db' sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001399517059326172s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.632110595703125e-05s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001220703125s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.679794311523438e-05s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test INFO: Starting to cleave (3 todo), path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_9_k for ShardRange<'d' to 'k' as of 1757769883.31704, (1000, 11111) as of 1757769883.31704, active as of 1757769883.31704>, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', 'efbb4e2e-eed4-4a59-be79-bc004a462476-sda', '1757769883.24493', '1757769883.24320', '0', '', '1757769883.24320', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.24923', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.24923', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.24923', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.24927', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.24927', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.24927', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.24928', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.24928', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.24928', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06588', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06588', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06588', 'epoch': '1757769883.06589', 'reported': 0, 'tombstones': -1}], 'efbb4e2e-eed4-4a59-be79-bc004a462476-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '7d504bd3-4702-490a-8992-99126a55020d-sda', '1757769883.26380', '1757769883.26194', '0', '', '1757769883.26194', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.26780', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.26780', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.26780', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.26784', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.26784', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.26784', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.26785', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.26785', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.26785', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06588', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06588', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06588', 'epoch': '1757769883.06589', 'reported': 0, 'tombstones': -1}], '7d504bd3-4702-490a-8992-99126a55020d-sda') test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '848b6421-1375-4a0d-a9aa-296a6df990bc-sda', '1757769883.28159', '1757769883.27995', '0', '', '1757769883.27995', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.28534', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.28534', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.28534', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.28539', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.28539', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.28539', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.28540', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.28540', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.28540', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.06597', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06578', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06578', 'epoch': None, 'reported': 0, 'tombstones': -1}], '848b6421-1375-4a0d-a9aa-296a6df990bc-sda') test WARNING: Ignoring remote osr w/o epoch, own_sr: {'name': 'a/c', 'timestamp': '1757769883.06588', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06588', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06588', 'epoch': '1757769883.06589', 'reported': 0, 'tombstones': -1}, remote_sr: {'name': 'a/c', 'timestamp': '1757769883.06597', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.06578', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769883.06578', 'epoch': None, 'reported': 0, 'tombstones': -1}, source: repl_req test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test DEBUG: /tmp/tmp74fye0qf/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '8fd29ed6fd6b863811e2880e559b5ac7', 'c02fc1d4-504a-4387-bf55-efdd97d20593-sda', '1757769883.30412', '1757769883.30233', '0', '', '1757769883.30233', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'obj', 'created_at': '1757769883.30828', 'size': 0, 'content_type': 'text/plain', 'etag': 'd41d8cd98f00b204e9800998ecf8427e', 'deleted': 0, 'storage_policy_index': 0}], 'c02fc1d4-504a-4387-bf55-efdd97d20593-sda') REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) test DEBUG: Replicating db /tmp/tmpy5kb13yy/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '4c4ca4b1-1daf-46b1-abf5-f0607da02a05-sda', '1757769883.32114', '1757769883.31933', '0', '', '1757769883.31933', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () test ERROR: ERROR syncing /tmp/tmpy5kb13yy/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db with node {'ip': '10.0.0.1', 'replication_ip': '10.0.0.1', 'port': 1001, 'replication_port': 1001, 'device': 'sdb', 'zone': 1, 'region': 1, 'id': 1, 'weight': 1, 'index': 1}: Timeout (0.001s) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (1, '739ddb100b71328e477e9a19e63fb6bc', 'b30f90c1-1cc8-4809-8163-3173fa202cb1-sda', '1757769883.33949', '1757769883.33681', '0', '', '1757769883.33681', 1, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_items, ([{'ROWID': 1, 'name': 'obj', 'created_at': '1757769883.34410', 'size': 0, 'content_type': 'text/plain', 'etag': 'd41d8cd98f00b204e9800998ecf8427e', 'deleted': 0, 'storage_policy_index': 0}], 'b30f90c1-1cc8-4809-8163-3173fa202cb1-sda')test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_trouble_receiving_so_none_to_sync test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_trouble_receiving_so_none_to_sync ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_with_rsync test.unit.container.test_replicator.TestReplicatorSync.test_sync_shard_ranges_with_rsync ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_status_change test.unit.container.test_replicator.TestReplicatorSync.test_sync_status_change ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx54ac4e6c50e445d592b12-0068c5709b" "proxy-server 1824498" 0.0068 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/1/a/c/o.last_modified" 200 - "HEAD http://localhost/v1/a/c/o.last_modified" "txfe87da63415745c9b6b5f-0068c5709b" "proxy-server 1824498" 0.0002 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 HEAD /v1/a/c/o.last_modified HTTP/1.0 200 - - t - - - txfe87da63415745c9b6b5f-0068c5709b - 0.0236 - - 1757769883.213760614 1757769883.237371922 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4ca90be6c26745cca0e5e-0068c5709b" "proxy-server 1824498" 0.0027 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txeab8ce1de52c4d61a07be-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "GET /sdb1/1/a/c/o.last_modified" 304 - "GET http://localhost/v1/a/c/o.last_modified" "txd538e88f0fc34c9ab414c-0068c5709b" "proxy-server 1824498" 0.0014 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 GET /v1/a/c/o.last_modified HTTP/1.0 304 - - t - - - txd538e88f0fc34c9ab414c-0068c5709b - 0.0300 - - 1757769883.239098787 1757769883.269143343 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx14031cfd3c9b43b684a89-0068c5709b" "proxy-server 1824498" 0.0024 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx42515fe0a3544ed885fad-0068c5709b" "proxy-server 1824498" 0.0013 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "GET /sdb1/1/a/c/o.last_modified" 200 - "GET http://localhost/v1/a/c/o.last_modified" "tx9ad3b8fd12e44448b184c-0068c5709b" "proxy-server 1824498" 0.0004 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 GET /v1/a/c/o.last_modified HTTP/1.0 200 - - t - - - tx9ad3b8fd12e44448b184c-0068c5709b - 0.0215 - - 1757769883.270512581 1757769883.292008400 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfe6aed9606f043409fdf5-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx8dd26c8cc66141e890617-0068c5709b" "proxy-server 1824498" 0.0013 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a/c/o.jpg" 201 - "PUT http://localhost/sdb1/1/a/c/o.jpg" "tx9f67dba5ddac4238bfae5-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a/c/o.jpg" 201 - "PUT http://localhost/sda1/1/a/c/o.jpg" "tx9f67dba5ddac4238bfae5-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/1/a/c/o.jpg" 201 - "PUT http://localhost/v1/a/c/o.jpg" "tx9f67dba5ddac4238bfae5-0068c5709b" "proxy-server 1824498" 0.0052 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/1/a/c/o.jpg" 201 - "PUT http://localhost/v1/a/c/o.jpg" "tx9f67dba5ddac4238bfae5-0068c5709b" "proxy-server 1824498" 0.0051 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.jpg HTTP/1.0 201 - - t - - - tx9f67dba5ddac4238bfae5-0068c5709b - 0.0199 - - 1757769883.322616100 1757769883.342489004 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx075d171a8e5b4e2b9ea27-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txbfd20da219ae4813b5831-0068c5709b" "proxy-server 1824498" 0.0032 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "GET /sdb1/1/a/c/o.jpg" 200 - "GET http://localhost/v1/a/c/o.jpg" "tx05a90570d09044f4a797d-0068c5709b" "proxy-server 1824498" 0.0004 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 GET /v1/a/c/o.jpg HTTP/1.0 200 - - t - - - tx05a90570d09044f4a797d-0068c5709b - 0.0127 - - 1757769883.343266487 1757769883.355952740 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx55b90917ccf84e19a798b-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx183b7ebd395142d5a4461-0068c5709b" "proxy-server 1824498" 0.0013 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a/c/o.html" 201 - "PUT http://localhost/sdb1/3/a/c/o.html" "tx1ea0a0972e3d40439d212-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a/c/o.html" 201 - "PUT http://localhost/sda1/3/a/c/o.html" "tx1ea0a0972e3d40439d212-0068c5709b" "object-server 1824498" 0.0005 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/3/a/c/o.html" 201 - "PUT http://localhost/v1/a/c/o.html" "tx1ea0a0972e3d40439d212-0068c5709b" "proxy-server 1824498" 0.0079 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/3/a/c/o.html" 201 - "PUT http://localhost/v1/a/c/o.html" "tx1ea0a0972e3d40439d212-0068c5709b" "proxy-server 1824498" 0.0080 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.html HTTP/1.0 201 - - t - - - tx1ea0a0972e3d40439d212-0068c5709b - 0.0198 - - 1757769883.357351065 1757769883.377141476 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb80b2fbe9cb845998f15e-0068c5709b" "proxy-server 1824498" 0.0014 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txc94d6272c7384c27b4980-0068c5709b" "proxy-server 1824498" 0.0038 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "GET /sdb1/3/a/c/o.html" 200 - "GET http://localhost/v1/a/c/o.html" "tx85eec7acf7b5442bba8cb-0068c5709b" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 GET /v1/a/c/o.html HTTP/1.0 200 - - t - - - tx85eec7acf7b5442bba8cb-0068c5709b - 0.0138 - - 1757769883.377949953 1757769883.391796827 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx99c0ae774ba3448991350-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx83126293c2ed421aa7157-0068c5709b" "proxy-server 1824498" 0.0013 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a/c/o.css" 201 - "PUT http://localhost/sdb1/1/a/c/o.css" "tx8dd37b8214f643e8b181d-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a/c/o.css" 201 - "PUT http://localhost/sda1/1/a/c/o.css" "tx8dd37b8214f643e8b181d-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/1/a/c/o.css" 201 - "PUT http://localhost/v1/a/c/o.css" "tx8dd37b8214f643e8b181d-0068c5709b" "proxy-server 1824498" 0.0048 "-" 1824498 0test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_auto_content_type test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_auto_content_type ... ok test.unit.obj.test_ssync.TestSsyncEC.test_handoff_non_durable_fragment test.unit.obj.test_ssync.TestSsyncEC.test_handoff_non_durable_fragment ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_autodetect_content_type test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_autodetect_content_type ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_bad_content_type test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_bad_content_type ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_bad_message_length test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_bad_message_length ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_calls_authorize test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_calls_authorize ... ok test.unit.container.test_replicator.TestReplicatorSync.test_sync_to_remote_with_misplaced test.unit.container.test_replicator.TestReplicatorSync.test_sync_to_remote_with_misplaced ... ok sharder-test DEBUG: got 1 rows (deleted=False) in 0.00016736984252929688s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010800361633300781s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_9_k for ShardRange<'h' to 'w' as of 1757770152.00000, (0, 0) as of 1757770152.00000, shrinking as of 1757770152.00000>, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test INFO: Cleaved ShardRange<'d' to 'k' as of 1757769883.31704, (1000, 11111) as of 1757769883.31704, active as of 1757769883.31704> in 0.006s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_9_t for ShardRange<'k' to 't' as of 1757769883.31708, (1000, 11111) as of 1757769883.31708, active as of 1757769883.31708>, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00015425682067871094s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010395050048828125s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_9_t for ShardRange<'h' to 'w' as of 1757770152.00000, (0, 0) as of 1757770152.00000, shrinking as of 1757770152.00000>, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test INFO: Cleaved ShardRange<'k' to 't' as of 1757769883.31708, (1000, 11111) as of 1757769883.31708, active as of 1757769883.31708> in 0.006s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_9_ for ShardRange<'t' to MaxBound as of 1757769883.31709, (1000, 11111) as of 1757769883.31709, active as of 1757769883.31709>, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00015354156494140625s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010943412780761719s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_9_ for ShardRange<'h' to 'w' as of 1757770152.00000, (0, 0) as of 1757770152.00000, shrinking as of 1757770152.00000>, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test INFO: Cleaved ShardRange<'t' to MaxBound as of 1757769883.31709, (1000, 11111) as of 1757769883.31709, active as of 1757769883.31709> in 0.006s, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test DEBUG: Cleaved 3 shard ranges, path: .shards_a/donor_9, db: /tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7_1757770153.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4y32b_8f/sda/containers/0/4a7/206c4587690950a47da43921490ac4a7/206c4587690950a47da43921490ac4a7.db' sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013113021850585938s, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011301040649414062s, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001010894775390625s, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010561943054199219s, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db sharder-test INFO: Starting to cleave (1 todo), path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_10_k for ShardRange<'d' to 'k' as of 1757769883.40680, (1000, 11111) as of 1757769883.40680, created as of 1757769883.40680>, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00020885467529296875s, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00012087821960449219s, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_10_k for ShardRange<'h' to 'w' as of 1757770191.00000, (0, 0) as of 1757770191.00000, shrinking as of 1757770191.00000>, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db sharder-test INFO: Cleaved ShardRange<'d' to 'k' as of 1757769883.40680, (1000, 11111) as of 1757769883.40680, created as of 1757769883.40680> in 0.006s, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '07281c11-c0c5-4f66-81fc-cec4ae70af2c-sda', 'cursor': 'k', 'max_row': 3, 'cleave_to_row': 3, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': True, 'ranges_done': 1, 'ranges_todo': 0}, path: .shards_a/donor_10, db: /tmp/tmp4y32b_8f/sda/containers/0/a44/457ca7b014f2e631df7ba91ed2de5a44/457ca7b014f2e631df7ba91ed2de5a44_1757770192.00000.db obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/1/a/c/o.css" 201 - "PUT http://localhost/v1/a/c/o.css" "tx8dd37b8214f643e8b181d-0068c5709b" "proxy-server 1824498" 0.0119 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.css HTTP/1.0 201 - - t - - - tx8dd37b8214f643e8b181d-0068c5709b - 0.0232 - - 1757769883.393229723 1757769883.416438103 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txeb48409c7b164fa3a7f0a-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txaca7a81ef440403f9d242-0068c5709b" "proxy-server 1824498" 0.0025 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "GET /sda1/1/a/c/o.css" 200 - "GET http://localhost/v1/a/c/o.css" "tx8d580de20dc1428794f1a-0068c5709b" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 GET /v1/a/c/o.css HTTP/1.0 200 - - t - - - tx8d580de20dc1428794f1a-0068c5709b - 0.0119 - - 1757769883.417386770 1757769883.429291248 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0de09b7baec24c9992c63-0068c5709b" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx1bfe576b7ac3418f982a8-0068c5709b" "proxy-server 1824498" 0.0035 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.chunked HTTP/1.0 400 - - t - 38 - txfb4756a9689e4a138ce7b-0068c5709b - 0.0107 - - 1757769883.449235439 1757769883.459917545 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx6be90fb527bc46c6b546b-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Timeout (Nones) (txn: tx5c0a1d7fc5e2436080d41-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception (txn: txee8ae372bde74d548b601-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Timeout (Nones) (txn: txc2b1fe2feed54fc0b680f-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1808, in _make_connection resp = conn.getexpect() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 840, in getexpect expect_status = self._status.get_expect_status() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 743, in get_expect_status raise expect_status Exception (txn: tx6049f3fcbd0b498ca7fff-0068c5709b)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_connect_exceptions test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_connect_exceptions ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_error_limiting test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_error_limiting ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_error_limiting_last_node test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_error_limiting_last_node ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_expect_header_nonzero_content_length test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_expect_header_nonzero_content_length ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_find_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_find_shard_ranges ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_expect_header_zero_content_length test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_expect_header_zero_content_length ... ok REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_syncs, ([],) test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmph_qxxg1l/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '285ffabc-6d97-41b9-b3d7-8af6eb3c84ac-sda', '1757769883.36184', '1757769883.36002', '0', '', '1757769883.36002', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('285ffabc-6d97-41b9-b3d7-8af6eb3c84ac-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '285ffabc-6d97-41b9-b3d7-8af6eb3c84ac-sda', '1757769883.36184', '1757769883.36002', '0', '', '1757769883.36002', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('285ffabc-6d97-41b9-b3d7-8af6eb3c84ac-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02047 seconds (48.84969/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:2 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmph_qxxg1l/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '285ffabc-6d97-41b9-b3d7-8af6eb3c84ac-sda', '1757769883.36184', '1757769883.36002', '0', '', '1757769883.36002', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.39296', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.39296', 'deleted': 1, 'state': 10, 'state_timestamp': '1757769883.39296', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.36323', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.36323', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.36323', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.36324', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.36324', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.36324', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.36337', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.36337', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769883.36325', 'epoch': '1757769883.36325', 'reported': 0, 'tombstones': -1}], '285ffabc-6d97-41b9-b3d7-8af6eb3c84ac-sda') test DEBUG: /tmp/tmph_qxxg1l/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.1:1001/sdb test WARNING: /tmp/tmph_qxxg1l/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.1:1001/sdb; have shard ranges and will wait for cleaving REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '285ffabc-6d97-41b9-b3d7-8af6eb3c84ac-sda', '1757769883.36184', '1757769883.36002', '0', '', '1757769883.36002', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, get_shard_ranges, () REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, merge_shard_ranges, ([{'name': '.shards_a/sr-g', 'timestamp': '1757769883.39296', 'lower': '', 'upper': 'g', 'object_count': 1, 'bytes_used': 10, 'meta_timestamp': '1757769883.39296', 'deleted': 1, 'state': 10, 'state_timestamp': '1757769883.39296', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-r', 'timestamp': '1757769883.36323', 'lower': 'g', 'upper': 'r', 'object_count': 2, 'bytes_used': 20, 'meta_timestamp': '1757769883.36323', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.36323', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/sr-', 'timestamp': '1757769883.36324', 'lower': 'r', 'upper': '', 'object_count': 3, 'bytes_used': 30, 'meta_timestamp': '1757769883.36324', 'deleted': 0, 'state': 10, 'state_timestamp': '1757769883.36324', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769883.36337', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769883.36337', 'deleted': 0, 'state': 60, 'state_timestamp': '1757769883.36325', 'epoch': '1757769883.36325', 'reported': 0, 'tombstones': -1}], '285ffabc-6d97-41b9-b3d7-8af6eb3c84ac-sda') test DEBUG: /tmp/tmph_qxxg1l/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db synced 4 shard ranges to 10.0.0.2:1002/sdc test WARNING: /tmp/tmph_qxxg1l/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db is able to shard -- refusing to replicate objects to peer 10.0.0.2:1002/sdc; have shard ranges and will wait for cleaving test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.01831 seconds (54.62442/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:0 ts_repl:0 REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '176a216a-9847-4235-9b38-04de7eebd57f-sda', '1757769883.42032', '1757769883.41862', '1757769883.42463', '', '1757769883.42463', 0, 0) test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp46qq9qlo/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '9dec50f1-bb90-4920-9d5f-13e87b26057c-sda', '1757769883.43272', '1757769883.00000', '0', '', '1757769883.00000', 0, 1) test DEBUG: /tmp/tmp46qq9qlo/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '9dec50f1-bb90-4920-9d5f-13e87b26057c-sda', '1757769883.43272', '1757769883.00000', '0', '', '1757769883.00000', 0, 1) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('9dec50f1-bb90-4920-9d5f-13e87b26057c-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 1 dbs in 0.02206 seconds (45.32990/s) test INFO: Removed 0 dbs test INFO: 2 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:1 remote_merge:0 rsync:1 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp1jgjhk24/sda/containers/0/27d/c48d89b33840539f9c5442ab3b10027d/c48d89b33840539f9c5442ab3b10027d.db REPLICATE: /sdb/0/c48d89b33840539f9c5442ab3b10027d, sync, (-1, '00000000000000000000000000000000', '80a87771-6174-4ea4-af57-5ed87184f951-sda', '1757769883.47561', '1757769884.00000', '0', '{"X-Container-Sync-To": ["a", "1757769885.00000"], "X-Container-Sync-Key": ["secret", "1757769886.00000"]}', '1757769884.00000', 0, 0) REPLICATE: /sdb/0/c48d89b33840539f9c5442ab3b10027d, complete_rsync, ('80a87771-6174-4ea4-af57-5ed87184f951-sda', 'c48d89b33840539f9c5442ab3b10027d.db') REPLICATE: /sdc/0/c48d89b33840539f9c5442ab3b10027d, sync, (-1, '00000000000000000000000000000000', '80a87771-6174-4ea4-af57-5ed87184f951-sda', '1757769883.47561', '1757769884.00000', '0', '{"X-Container-Sync-To": ["a", "1757769885.00000"], "X-Container-Sync-Key": ["secret", "1757769886.00000"]}', '1757769884.00000', 0, 0) REPLICATE: /sdc/0/c48d89b33840539f9c5442ab3b10027d, complete_rsync, ('80a87771-6174-4ea4-af57-5ed87184f951-sda', 'c48d89b33840539f9c5442ab3b10027d.db') test DEBUG: Replicating db /tmp/tmp1jgjhk24/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.dbtest.unit.container.test_replicator.TestReplicatorSync.test_sync_triggers_sync_store_update test.unit.container.test_replicator.TestReplicatorSync.test_sync_triggers_sync_store_update ... ok test.unit.container.test_replicator.TestReplicatorSync.test_update_sync_store test.unit.container.test_replicator.TestReplicatorSync.test_update_sync_store ... ok test.unit.container.test_replicator.TestReplicatorSync.test_update_sync_store_exception test.unit.container.test_replicator.TestReplicatorSync.test_update_sync_store_exception ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_auditor_hashdir_not_listable test.unit.obj.test_diskfile.TestSuffixHashes.test_auditor_hashdir_not_listable ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_drops_old_non_durable_data test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_drops_old_non_durable_data ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_find_shard_ranges_errors test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_find_shard_ranges_errors ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_drops_isolated_durable test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_drops_isolated_durable ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_hsh_path_enoent test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_hsh_path_enoent ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_hsh_path_other_oserror test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_hsh_path_other_oserror ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_ignore_orphaned_ts test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_ignore_orphaned_ts ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_isolated_meta_purge_old_ts test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_isolated_meta_purge_old_ts ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_meta_data_purge_ts test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_meta_data_purge_ts ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_meta_data_purge_ts_legacy_durable test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_meta_data_purge_ts_legacy_durable ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_one_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_one_meta ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_one_meta_legacy_durable test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_one_meta_legacy_durable ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_one_ts test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_one_ts ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_single_old_data test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keep_single_old_data ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keeps_one_datafile test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keeps_one_datafile ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keeps_one_datafile_and_legacy_durable test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_keeps_one_datafile_and_legacy_durable ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_multi_data_file test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_multi_data_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_find_shard_ranges_with_misplaced_objects test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_find_shard_ranges_with_misplaced_objects ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_older_remove_file_error test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_older_remove_file_error ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_only_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_only_meta ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_data_newer_ts test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_data_newer_ts ... ok sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013399124145507812s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.679794311523438e-05s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.202957153320312e-05s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.918212890625e-05s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_11_k for ShardRange<'d' to 'k' as of 1757769883.46248, (1000, 11111) as of 1757769883.46248, cleaved as of 1757769883.46248>, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00015234947204589844s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.751319885253906e-05s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_11_k for ShardRange<'h' to 'w' as of 1757770217.00000, (0, 0) as of 1757770217.00000, shrinking as of 1757770217.00000>, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test INFO: Cleaved ShardRange<'d' to 'k' as of 1757769883.46248, (1000, 11111) as of 1757769883.46248, cleaved as of 1757769883.46248> in 0.006s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_11_t for ShardRange<'k' to 't' as of 1757769883.46251, (1000, 11111) as of 1757769883.46251, cleaved as of 1757769883.46251>, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00015735626220703125s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010633468627929688s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_11_t for ShardRange<'h' to 'w' as of 1757770217.00000, (0, 0) as of 1757770217.00000, shrinking as of 1757770217.00000>, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test INFO: Cleaved ShardRange<'k' to 't' as of 1757769883.46251, (1000, 11111) as of 1757769883.46251, cleaved as of 1757769883.46251> in 0.006s, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test DEBUG: Cleaved 2 shard ranges, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': 'aa366102-9108-427f-a722-98e4f8169b16-sda', 'cursor': 't', 'max_row': 3, 'cleave_to_row': 3, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': True, 'ranges_done': 2, 'ranges_todo': 0}, path: .shards_a/donor_11, db: /tmp/tmp4y32b_8f/sda/containers/0/254/300bf0ec46a195b626429b8fc0a35254/300bf0ec46a195b626429b8fc0a35254_1757770218.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098_1757770250.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098_1757770250.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098_1757770250.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013637542724609375s, path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.34600830078125e-05s, path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010418891906738281s, path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.083747863769531e-05s, path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098_1757770250.00000.db sharder-test INFO: Starting to cleave (1 todo), path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098_1757770250.00000.db sharder-test INFO: Stopped cleave at gap: 'h' - 'k', path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098_1757770250.00000.db sharder-test DEBUG: Cleaved 0 shard ranges, path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098_1757770250.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': 'e315df09-dc6a-4dee-81aa-a9aef280eb04-sda', 'cursor': 'h', 'max_row': 3, 'cleave_to_row': 3, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': True, 'ranges_done': 0, 'ranges_todo': 1}, path: .shards_a/donor_12, db: /tmp/tmp4y32b_8f/sda/containers/0/098/d625ed53f61d107bf15bc92e1e76f098/d625ed53f61d107bf15bc92e1e76f098_1757770250.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c_1757770270.00000.dbtest.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_expired_ts test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_expired_ts ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_old_data_only test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_old_data_only ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_old_ts test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_old_ts ... ok test.unit.container.test_sharder.TestSharder.test_cleave_shard_shrinking test.unit.container.test_sharder.TestSharder.test_cleave_shard_shrinking ... ok proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Trying to get final status of PUT to /v1/a/c/o.jpg: Timeout (Nones) (txn: tx5f11c582c62945049720a-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Trying to get final status of PUT to /v1/a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 525, in _get_conn_response resp = putter.await_response( self.app.node_timeout, not final_phase) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1741, in await_response self.resp = self.conn.getresponse() ~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 834, in getresponse self.status = self._status.get_response_status() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 734, in get_response_status raise self.status Exception (txn: tx525bd21611bf4d3093cc5-0068c5709b) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.2:3002/sdc, error: ERROR Insufficient Storage (txn: tx3e3fe8ced91041289b2a2-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx7cd7cc4558a743c98b470-0068c5709b) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx7cd7cc4558a743c98b470-0068c5709b) proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: tx7cd7cc4558a743c98b470-0068c5709b) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx05761a1cbf3b457ba00a5-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx05761a1cbf3b457ba00a5-0068c5709b) proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: tx05761a1cbf3b457ba00a5-0068c5709b) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o From Object Server 10.0.0.0:3000/sda (txn: txbfa5679feedf4393ba657-0068c5709b) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx69e561bc6ac34cb18005a-0068c5709b) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txe493979abedd4eff96ed2-0068c5709b) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txf09313f00367404fa7940-0068c5709b) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx77cd2e53877f490c81a75-0068c5709b)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_getresponse_exceptions test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_getresponse_exceptions ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_max_size test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_max_size ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_too_large test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_too_large ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_unsup_xfr_encoding test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_unsup_xfr_encoding ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_older_ts test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_older_ts ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_ts_newer_data test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_ts_newer_data ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_ts_newer_data_and_legacy_durable test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purge_ts_newer_data_and_legacy_durable ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purges_single_old_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_purges_single_old_meta ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_reclaim_tombstone_remove_file_error test.unit.obj.test_diskfile.TestSuffixHashes.test_cleanup_ondisk_files_reclaim_tombstone_remove_file_error ... ok test.unit.obj.test_ssync.TestSsyncEC.test_revert_job_with_legacy_durable test.unit.obj.test_ssync.TestSsyncEC.test_revert_job_with_legacy_durable ... ok test.unit.obj.test_ssync.TestSsyncEC.test_send_invalid_frag_index test.unit.obj.test_ssync.TestSsyncEC.test_send_invalid_frag_index ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_consolidate_hashes_raises_exception test.unit.obj.test_diskfile.TestSuffixHashes.test_consolidate_hashes_raises_exception ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_bad_dev test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_bad_dev ... ok proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx93425602402b48cd96685-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx93425602402b48cd96685-0068c5709b) proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: tx93425602402b48cd96685-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx6ee38293912144da84f7e-0068c5709b) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o.jpg From Object Server 10.0.0.2:3002/sdc (txn: tx6ee38293912144da84f7e-0068c5709b) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o.jpg From Object Server 10.0.0.0:3000/sda (txn: tx6ee38293912144da84f7e-0068c5709b) proxy-ut ERROR: Object PUT returning 503 for [503, 503, 503] (txn: tx6ee38293912144da84f7e-0068c5709b) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0f888290dbb2476bbb5a2-0068c5709b" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx6af7d5c9d46c4b42b5e1b-0068c5709b" "proxy-server 1824498" 0.0015 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.chunked HTTP/1.0 413 - - t - 26 - txdb1da1f7369b42448f0cb-0068c5709b - 0.0096 - - 1757769883.587039232 1757769883.596648932 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx24d148b2f089419b9c59c-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx006bb2351af943b584c53-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.chunked HTTP/1.0 501 - - t - 78 - tx6b7b3d284f234d05b397c-0068c5709b - 0.0083 - - 1757769883.601651192 1757769883.609910965 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa10bcd504c4c46ab9ea61-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txcb77a966add840ba9bd1e-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a/c/o.chunked" 201 - "PUT http://localhost/sda1/2/a/c/o.chunked" "txbc2fe45a9e26416ba161e-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a/c/o.chunked" 201 - "PUT http://localhost/sdb1/2/a/c/o.chunked" "txbc2fe45a9e26416ba161e-0068c5709b" "object-server 1824498" 0.0024 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/2/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "txbc2fe45a9e26416ba161e-0068c5709b" "proxy-server 1824498" 0.0071 "-" 1824498 0test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_using_both test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_using_both ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_consolidates_suffix_rehash_once test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_consolidates_suffix_rehash_once ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_creates_pkl test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_creates_pkl ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_does_not_create_partition test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_does_not_create_partition ... ok sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c_1757770270.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c_1757770270.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00012493133544921875s, path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010013580322265625s, path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.131431579589844e-05s, path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011992454528808594s, path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c_1757770270.00000.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c_1757770270.00000.db sharder-test INFO: Stopped cleave at gap: 'h' - 'k', path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c_1757770270.00000.db sharder-test DEBUG: Cleaved 0 shard ranges, path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c_1757770270.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': 'a5ea439f-359c-4339-b41a-5b784ea2313b-sda', 'cursor': 'h', 'max_row': 3, 'cleave_to_row': 3, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': True, 'ranges_done': 0, 'ranges_todo': 2}, path: .shards_a/donor_13, db: /tmp/tmp4y32b_8f/sda/containers/0/d3c/f437419f67d9f0514f459e6a3f90ad3c/f437419f67d9f0514f459e6a3f90ad3c_1757770270.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'h'), ('w', '')], path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.000141143798828125s, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.584426879882812e-05s, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.775161743164062e-05s, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.751319885253906e-05s, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test INFO: Cleaving from row None into .shards_a/acceptor_14_k for ShardRange<'d' to 'k' as of 1757769883.59929, (1000, 11111) as of 1757769883.59929, cleaved as of 1757769883.59929>, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00015974044799804688s, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001068115234375s, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739.db sharder-test INFO: Replicating new shard container .shards_a/acceptor_14_k for ShardRange<'h' to 'w' as of 1757770289.00000, (0, 0) as of 1757770289.00000, shrinking as of 1757770289.00000>, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test INFO: Cleaved ShardRange<'d' to 'k' as of 1757769883.59929, (1000, 11111) as of 1757769883.59929, cleaved as of 1757769883.59929> in 0.006s, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test INFO: Stopped cleave at gap: 'k' - 't', path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '955dc7e0-73af-435b-b97d-9ba9ede63372-sda', 'cursor': 'k', 'max_row': 3, 'cleave_to_row': 3, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': True, 'ranges_done': 1, 'ranges_todo': 1}, path: .shards_a/donor_14, db: /tmp/tmp4y32b_8f/sda/containers/0/739/a9dfb0212010e3d1ecef4bf40179b739/a9dfb0212010e3d1ecef4bf40179b739_1757770290.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('there', '')], path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00012087821960449219s, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.320808410644531e-05s, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.036064147949219e-05s, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.369850158691406e-05s, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db test.unit.container.test_sharder.TestSharder.test_cleave_shrinking_to_active_acceptor_with_active_root_range test.unit.container.test_sharder.TestSharder.test_cleave_shrinking_to_active_acceptor_with_active_root_range ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_using_both_with_crazy_meta test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_using_both_with_crazy_meta ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_does_not_rehash_known_suffix_dirs test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_does_not_rehash_known_suffix_dirs ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_brokers test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_brokers ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_hash_suffix_enotdir test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_hash_suffix_enotdir ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_hash_suffix_other_oserror test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_hash_suffix_other_oserror ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_using_content_length test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_using_content_length ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_modified_recursive_retry test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_modified_recursive_retry ... ok test.unit.container.test_sharder.TestSharder.test_cleave_shrinking_to_active_acceptor_with_sharded_root_range test.unit.container.test_sharder.TestSharder.test_cleave_shrinking_to_active_acceptor_with_sharded_root_range ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_multi_file_multi_suffix test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_multi_file_multi_suffix ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_using_transfer_encoding test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_message_length_using_transfer_encoding ... ok test.unit.obj.test_ssync.TestSsyncEC.test_send_with_frag_index_none test.unit.obj.test_ssync.TestSsyncEC.test_send_with_frag_index_none ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_no_etag_fallocate test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_no_etag_fallocate ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_db_state test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_db_state ... ok test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_empty_body test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_empty_body ... ok REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '6d7a572a-d5d3-43cb-953a-9caede71a118-sda', '1757769883.47154', '1757769883.00000', '0', '', '1757769883.00000', 0, 0) REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('6d7a572a-d5d3-43cb-953a-9caede71a118-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '6d7a572a-d5d3-43cb-953a-9caede71a118-sda', '1757769883.47154', '1757769883.00000', '0', '', '1757769883.00000', 0, 0) REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, complete_rsync, ('6d7a572a-d5d3-43cb-953a-9caede71a118-sda', '5267a50d4a8f6ea3ee1dbecb8592e872.db') test INFO: Replication run OVER test INFO: Attempted to replicate 2 dbs in 0.02980 seconds (67.10810/s) test INFO: Removed 0 dbs test INFO: 4 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:0 remote_merge:0 rsync:4 ts_repl:0 test INFO: Beginning replication run test DEBUG: Replicating db /tmp/tmp1jgjhk24/sda/containers/0/27d/c48d89b33840539f9c5442ab3b10027d/c48d89b33840539f9c5442ab3b10027d.db REPLICATE: /sdb/0/c48d89b33840539f9c5442ab3b10027d, sync, (-1, '00000000000000000000000000000000', '80a87771-6174-4ea4-af57-5ed87184f951-sda', '1757769883.47561', '1757769884.00000', '0', '{"X-Container-Sync-To": ["", "1757769887.00000"], "X-Container-Sync-Key": ["secret", "1757769886.00000"]}', '1757769884.00000', 0, 0) test DEBUG: /tmp/tmp1jgjhk24/sda/containers/0/27d/c48d89b33840539f9c5442ab3b10027d/c48d89b33840539f9c5442ab3b10027d.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/c48d89b33840539f9c5442ab3b10027d, sync, (-1, '00000000000000000000000000000000', '80a87771-6174-4ea4-af57-5ed87184f951-sda', '1757769883.47561', '1757769884.00000', '0', '{"X-Container-Sync-To": ["", "1757769887.00000"], "X-Container-Sync-Key": ["secret", "1757769886.00000"]}', '1757769884.00000', 0, 0) test DEBUG: /tmp/tmp1jgjhk24/sda/containers/0/27d/c48d89b33840539f9c5442ab3b10027d/c48d89b33840539f9c5442ab3b10027d.db in sync with 10.0.0.2:1002/sdc, nothing to do test DEBUG: Replicating db /tmp/tmp1jgjhk24/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db REPLICATE: /sdb/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '6d7a572a-d5d3-43cb-953a-9caede71a118-sda', '1757769883.47154', '1757769883.00000', '0', '', '1757769883.00000', 0, 0) test DEBUG: /tmp/tmp1jgjhk24/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.1:1001/sdb, nothing to do REPLICATE: /sdc/0/5267a50d4a8f6ea3ee1dbecb8592e872, sync, (-1, '00000000000000000000000000000000', '6d7a572a-d5d3-43cb-953a-9caede71a118-sda', '1757769883.47154', '1757769883.00000', '0', '', '1757769883.00000', 0, 0) test DEBUG: /tmp/tmp1jgjhk24/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db in sync with 10.0.0.2:1002/sdc, nothing to do test INFO: Replication run OVER test INFO: Attempted to replicate 2 dbs in 0.03081 seconds (64.90700/s) test INFO: Removed 0 dbs test INFO: 4 successes, 0 failures test INFO: diff:0 diff_capped:0 empty:0 hashmatch:0 no_change:4 remote_merge:0 rsync:0 ts_repl:0 test ERROR: Failed to update sync_store /tmp/tmp28x1gazt/sda/containers/0/872/5267a50d4a8f6ea3ee1dbecb8592e872/5267a50d4a8f6ea3ee1dbecb8592e872.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/replicator.py", line 304, in _post_replicate_hook self.sync_store.update_sync_store(broker) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_replicator.py", line 1223, in update_sync_store raise OSError(1, '1') PermissionError: [Errno 1] 1 suffix-hash-test WARNING: Unable to read '/tmp/tmpvtptjiod/node/sda1/objects/0/hashes.pkl' Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1336, in __get_hashes orig_hashes = self.consolidate_hashes(partition_path) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception suffix-hash-test DEBUG: Run listdir on /tmp/tmpvtptjiod/node/sda1/objects/0 suffix-hash-test WARNING: Unable to read '/tmp/tmpvtptjiod/node/sda1/objects/0/hashes.pkl' Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1336, in __get_hashes orig_hashes = self.consolidate_hashes(partition_path) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception suffix-hash-test DEBUG: Run listdir on /tmp/tmpvtptjiod/node/sda1/objects/0 suffix-hash-test WARNING: Unable to read '/tmp/tmpvtptjiod/node/sda1/objects-1/0/hashes.pkl' Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1336, in __get_hashes orig_hashes = self.consolidate_hashes(partition_path) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception suffix-hash-test DEBUG: Run listdir on /tmp/tmpvtptjiod/node/sda1/objects-1/0 suffix-hash-test WARNING: Unable to read '/tmp/tmpvtptjiod/node/sda1/objects-1/0/hashes.pkl' Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1336, in __get_hashes orig_hashes = self.consolidate_hashes(partition_path) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception suffix-hash-test DEBUG: Run listdir on /tmp/tmpvtptjiod/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp413_ma_p/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp413_ma_p/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp5s0q1m1o/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp5s0q1m1o/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpgm6cd6e3/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpgm6cd6e3/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp80f75m22/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp80f75m22/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp16g3bsts/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp16g3bsts/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpe7bpaeqd/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpe7bpaeqd/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2_6otnc4/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2_6otnc4/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpe2lzfhfn/node/sda1/objects/0test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_new_pkl_finds_new_suffix_dirs test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_new_pkl_finds_new_suffix_dirs ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_new_pkl_finds_new_suffix_dirs_unicode test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_new_pkl_finds_new_suffix_dirs_unicode ... ok test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_invalid_shard_range test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_invalid_shard_range ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_new_pkl_lying_invalid_finds_new_suffix_dirs test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_new_pkl_lying_invalid_finds_new_suffix_dirs ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_new_pkl_missing_invalid_finds_new_suffix_dirs test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_new_pkl_missing_invalid_finds_new_suffix_dirs ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_old_pickle_does_not_find_new_suffix_dirs test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_old_pickle_does_not_find_new_suffix_dirs ... ok test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_key_missing test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_key_missing ... ok sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test INFO: Cleaving from row None into .shards/other for ShardRange<'here' to 'where' as of 1757769886.00000, (0, 0) as of 1757769886.00000, active as of 1757769886.00000>, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00016927719116210938s, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010609626770019531s, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Replicating new shard container .shards/other for ShardRange<'here' to 'there' as of 1757769883.69336, (0, 0) as of 1757769884.00000, shrunk as of 1757769884.00000>, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test INFO: Cleaved ShardRange<'here' to 'where' as of 1757769886.00000, (0, 0) as of 1757769886.00000, active as of 1757769886.00000> in 0.006s, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/shard_c, db: /tmp/tmpx4zaf81p/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('there', '')], path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00011420249938964844s, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.368492126464844e-05s, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.487701416015625e-05s, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 7.724761962890625e-05s, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test INFO: Cleaving from row None into .shards_a/shard_d for ShardRange<'here' to MaxBound as of 1757769886.00000, (0, 0) as of 1757769886.00000, active as of 1757769886.00000>, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001373291015625s, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.34600830078125e-05s, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Replicating new shard container .shards_a/shard_d for ShardRange<'here' to 'there' as of 1757769884.00000, (0, 0) as of 1757769884.00000, sharding as of 1757769884.00000>, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test INFO: Cleaved ShardRange<'here' to MaxBound as of 1757769886.00000, (0, 0) as of 1757769886.00000, active as of 1757769886.00000> in 0.005s, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/shard_c, db: /tmp/tmpvj0zh4i9/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('there', '')], path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00011682510375976562s, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.368492126464844e-05s, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.106231689453125e-05s, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.392333984375e-05s, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test INFO: Starting to cleave (1 todo), path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test INFO: Cleaving from row None into a/c for ShardRange, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001308917999267578s, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010848045349121094s, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Cleaving ShardRange - zero objects found, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.dbtest.unit.container.test_sharder.TestSharder.test_cleave_shrinking_to_active_root_range test.unit.container.test_sharder.TestSharder.test_cleave_shrinking_to_active_root_range ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_race_existing_partition test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_race_existing_partition ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/2/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "txbc2fe45a9e26416ba161e-0068c5709b" "proxy-server 1824498" 0.0083 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.chunked HTTP/1.0 201 - - t 33 - - txbc2fe45a9e26416ba161e-0068c5709b - 0.0202 - - 1757769883.615291357 1757769883.635527134 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx92313c04dacd463d9adbb-0068c5709b" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx4b507533ec5243eb944bf-0068c5709b" "proxy-server 1824498" 0.0058 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "GET /sda1/2/a/c/o.chunked" 200 33 "GET http://localhost/v1/a/c/o.chunked" "tx11c9f5fcf98b41cda99f9-0068c5709b" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 GET /v1/a/c/o.chunked HTTP/1.0 200 - - t - 33 - tx11c9f5fcf98b41cda99f9-0068c5709b - 0.0197 - - 1757769883.636370897 1757769883.656043053 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8bf614f79ff8418f86d2c-0068c5709b" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx30d3c217d22c4fbcada33-0068c5709b" "proxy-server 1824498" 0.0014 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a/c/o.chunked" 201 - "PUT http://localhost/sda1/2/a/c/o.chunked" "tx1240f01cac98422abcc07-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a/c/o.chunked" 201 - "PUT http://localhost/sdb1/2/a/c/o.chunked" "tx1240f01cac98422abcc07-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/2/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "tx1240f01cac98422abcc07-0068c5709b" "proxy-server 1824498" 0.0053 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/2/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "tx1240f01cac98422abcc07-0068c5709b" "proxy-server 1824498" 0.0064 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.chunked HTTP/1.0 201 - - t 33 - - tx1240f01cac98422abcc07-0068c5709b - 0.0200 - - 1757769883.665570974 1757769883.685580969 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx671ba3e1db3246a1bffa3-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx940ea3c5018743b3b954e-0068c5709b" "proxy-server 1824498" 0.0024 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "GET /sda1/2/a/c/o.chunked" 200 33 "GET http://localhost/v1/a/c/o.chunked" "txde67186f1ec446b3b1e32-0068c5709b" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 GET /v1/a/c/o.chunked HTTP/1.0 200 - - t - 33 - txde67186f1ec446b3b1e32-0068c5709b - 0.0119 - - 1757769883.686320543 1757769883.698196650 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfa0f5397c8ba42ada0ab6-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txb9a8bd2940d34986bacc7-0068c5709b" "proxy-server 1824498" 0.0012 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a/c/o.content-length" 201 - "PUT http://localhost/sdb1/0/a/c/o.content-length" "txad79c9f4d8a04173bb413-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a/c/o.content-length" 201 - "PUT http://localhost/sda1/0/a/c/o.content-length" "txad79c9f4d8a04173bb413-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a/c/o.content-length" 201 - "PUT http://localhost/v1/a/c/o.content-length" "txad79c9f4d8a04173bb413-0068c5709b" "proxy-server 1824498" 0.0078 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a/c/o.content-length" 201 - "PUT http://localhost/v1/a/c/o.content-length" "txad79c9f4d8a04173bb413-0068c5709b" "proxy-server 1824498" 0.0078 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.content-length HTTP/1.0 201 - - t 20 - - txad79c9f4d8a04173bb413-0068c5709b - 0.0192 - - 1757769883.703705072 1757769883.722934961 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx90094bc07518467aaac7e-0068c5709b" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txbda52916915243b3a119f-0068c5709b" "proxy-server 1824498" 0.0056 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a/c/o.chunked" 201 - "PUT http://localhost/sdb1/2/a/c/o.chunked" "tx93264e7898654949b1abb-0068c5709b" "object-server 1824498" 0.0045 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a/c/o.chunked" 201 - "PUT http://localhost/sda1/2/a/c/o.chunked" "tx93264e7898654949b1abb-0068c5709b" "object-server 1824498" 0.0004 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/2/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "tx93264e7898654949b1abb-0068c5709b" "proxy-server 1824498" 0.0092 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/2/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "tx93264e7898654949b1abb-0068c5709b" "proxy-server 1824498" 0.0103 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/43 PUT /v1/a/c/o.chunked HTTP/1.0 201 - - t 33 - - tx93264e7898654949b1abb-0068c5709b - 0.0302 - - 1757769883.728418589 1757769883.758605480 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_not_autodetect_content_type test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_not_autodetect_content_type ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_all_containers_error test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_all_containers_error ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_container_does_not_exist test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_container_does_not_exist ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_container_exist_on_handoff test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_container_exist_on_handoff ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_primary_containers_timeout test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_primary_containers_timeout ... ok test.unit.container.test_sharder.TestSharder.test_cleave_shrinking_to_active_root_range_with_active_acceptor test.unit.container.test_sharder.TestSharder.test_cleave_shrinking_to_active_root_range_with_active_acceptor ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_race_invalid_pickle test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_race_invalid_pickle ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_primary_timeout_container_exist test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_object_to_primary_timeout_container_exist ... ok test ERROR: Failed to unlink '/tmp/tmp54nfyxl8/containers/part/suffix/hash/container.db': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2235, in set_sharded_state os.unlink(retiring_file) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: 1 test DEBUG: Unlinked retiring db '/tmp/tmp54nfyxl8/containers/part/suffix/hash/container_1757769883.00000.db' test WARNING: Still have multiple db files after unlinking '/tmp/tmp54nfyxl8/containers/part/suffix/hash/container_1757769883.00000.db': ['/tmp/tmp54nfyxl8/containers/part/suffix/hash/container.db', '/tmp/tmp54nfyxl8/containers/part/suffix/hash/container_1757769884.00000.db'] test WARNING: Refusing to delete db file for 'a/c': no fresher db file found in ['/tmp/tmp54nfyxl8/containers/part/suffix/hash/container_1757769884.00000.db']. test ERROR: Failed to set the ROWID of the fresh database for a/c: test ERROR: Failed to sync the container_stat table/view with the fresh database for a/c: test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824522) wsgi starting up on http://127.0.0.1:50113 test-ssync-receiver DEBUG: (1824522) accepted ('127.0.0.1', 36136) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 5, available: 5, sent: 4, deletable: 5 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:43] "SSYNC /dev/9 HTTP/1.1" 200 428 0.120808 test-ssync-receiver INFO: (1824522) wsgi starting up on http://127.0.0.1:42561 test-ssync-receiver INFO: (1824522) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: (1824522) accepted ('127.0.0.1', 55538) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 4, available: 4, sent: 2, deletable: 4 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:43] "SSYNC /dev/9 HTTP/1.1" 200 354 0.106430 test-ssync-receiver INFO: (1824522) wsgi starting up on http://127.0.0.1:55711 test-ssync-receiver INFO: (1824522) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: (1824522) accepted ('127.0.0.1', 54052) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 5, available: 4, sent: 3, deletable: 4 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:43] "SSYNC /dev/9 HTTP/1.1" 200 391 0.112531 test-ssync-receiver INFO: (1824522) wsgi starting up on http://127.0.0.1:47481 test-ssync-receiver INFO: (1824522) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: (1824522) accepted ('127.0.0.1', 34042) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 3, available: 3, sent: 2, deletable: 3 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:43] "SSYNC /dev/9 HTTP/1.1" 200 354 0.101149 test-ssync-receiver INFO: (1824522) wsgi starting up on http://127.0.0.1:41421 test-ssync-receiver INFO: (1824522) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: (1824522) accepted ('127.0.0.1', 39966) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:43] "SSYNC /dev/9 HTTP/1.1" 200 317 0.098110 test-ssync-sender DEBUG: Run listdir on /tmp/tmp2u1bcang/tmp_test_ssync_sender/dev/objects/9 test-ssync-receiver DEBUG: Run listdir on /tmp/tmp2u1bcang/tmp_test_ssync_receiver/dev/objects/9 test-ssync-receiver DEBUG: (1824522) accepted ('127.0.0.1', 39976) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 0, deletable: 1 test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:43] "SSYNC /dev/9 HTTP/1.1" 200 276 0.098054 test-ssync-receiver INFO: (1824522) wsgi starting up on http://127.0.0.1:44657 test-ssync-receiver DEBUG: (1824522) accepted ('127.0.0.1', 34946) test-ssync-receiver INFO: (1824522) wsgi exited, is_accepting=True test-ssync-sender ERROR: 127.0.0.1:44657/dev/9 Expected status 200; got 400 (b"Invalid X-Backend-Ssync-Frag-Index 'Not a number'") test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824522) wsgi starting up on http://127.0.0.1:51933 test-ssync-receiver DEBUG: (1824522) accepted ('127.0.0.1', 57470) test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 1, available: 1, sent: 1, deletable: 1 proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=1_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:43] "SSYNC /dev/9 HTTP/1.1" 200 317 0.110380 test-ssync-receiver INFO: (1824522) wsgi exited, is_accepting=True proxy-server ERROR: Problem with container shard listing response from /v1/a/c?format=json&states=updating&includes=1_test: JSONDecodeError('Expecting value: line 1 column 1 (char 0)') (txn: txf1fc36fdc9ca4f8aab6a6-0068c5709b) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=1_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Failed to get namespaces from /v1/a/c/o: invalid data: ValueError("upper ('a') must be greater than or equal to lower ('z')") (txn: tx2a894e2236604b8aab0a3-0068c5709b) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=1_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Failed to get namespaces from /v1/a/c/o: invalid data: KeyError('name') (txn: txa4796595f96d4b9b9cc6b-0068c5709b) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_missing_record_type test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_missing_record_type ... ok test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_not_a_list test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_not_a_list ... ok test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_request_failed test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_request_failed ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_race_new_partition test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_race_new_partition ... ok test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_wrong_record_type test.unit.proxy.controllers.test_obj.TestGetUpdatingNamespacesErrors.test_get_namespaces_wrong_record_type ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_zero_bytes_pickle test.unit.obj.test_diskfile.TestSuffixHashes.test_get_hashes_zero_bytes_pickle ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_invalidations_race_get_hashes_same_suffix_existing test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_invalidations_race_get_hashes_same_suffix_existing ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_invalidations_race_get_hashes_same_suffix_new test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_invalidations_race_get_hashes_same_suffix_new ... ok suffix-hash-test DEBUG: Run listdir on /tmp/tmpe2lzfhfn/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2zji8du2/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2zji8du2/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp0lmdihw6/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp0lmdihw6/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp8z2enz3e/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp8z2enz3e/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp7x652dia/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp7x652dia/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp3sc8rz3x/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp3sc8rz3x/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpo04g9hqm/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpo04g9hqm/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpo04g9hqm/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpo04g9hqm/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpo04g9hqm/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpo04g9hqm/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpo04g9hqm/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpo04g9hqm/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpv5lekczs/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpv5lekczs/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpv5lekczs/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpv5lekczs/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpv5lekczs/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpv5lekczs/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpv5lekczs/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpv5lekczs/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpdvi3kfm2/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpdvi3kfm2/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpw4shqh4e/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpw4shqh4e/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpe_lnhjfd/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpe_lnhjfd/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpe_lnhjfd/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpe_lnhjfd/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpgrrt0r65/node/sda1/objects/0 Quarantined /tmp/tmpgrrt0r65/node/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c to /tmp/tmpgrrt0r65/node/sda1/quarantined/objects/ab4a8c0dec756ad76845d2920375f77c because it could not be listed suffix-hash-test DEBUG: Run listdir on /tmp/tmpgrrt0r65/node/sda1/objects-1/0 Quarantined /tmp/tmpgrrt0r65/node/sda1/objects-1/0/77c/ab4a8c0dec756ad76845d2920375f77c to /tmp/tmpgrrt0r65/node/sda1/quarantined/objects-1/ab4a8c0dec756ad76845d2920375f77c because it could not be listed test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_cleanup_ondisk_files_enodata_quarantined test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_cleanup_ondisk_files_enodata_quarantined ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info_is_deleted ... ok suffix-hash-test DEBUG: Run listdir on /tmp/tmp4l0awuhh/node/sda1/objects/0 Quarantined /tmp/tmp4l0awuhh/node/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c to /tmp/tmp4l0awuhh/node/sda1/quarantined/objects/ab4a8c0dec756ad76845d2920375f77c because it is not a directory suffix-hash-test DEBUG: Run listdir on /tmp/tmp4l0awuhh/node/sda1/objects-1/0 Quarantined /tmp/tmp4l0awuhh/node/sda1/objects-1/0/77c/ab4a8c0dec756ad76845d2920375f77c to /tmp/tmp4l0awuhh/node/sda1/quarantined/objects-1/ab4a8c0dec756ad76845d2920375f77c because it is not a directory test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_cleanup_ondisk_files_enotdir_quarantined test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_cleanup_ondisk_files_enotdir_quarantined ... ok suffix-hash-test DEBUG: Run listdir on /tmp/tmp8usid7t_/node/sda1/objects/0 Quarantined /tmp/tmp8usid7t_/node/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c to /tmp/tmp8usid7t_/node/sda1/quarantined/objects/ab4a8c0dec756ad76845d2920375f77c because it could not be listed suffix-hash-test DEBUG: Run listdir on /tmp/tmp8usid7t_/node/sda1/objects-1/0 Quarantined /tmp/tmp8usid7t_/node/sda1/objects-1/0/77c/ab4a8c0dec756ad76845d2920375f77c to /tmp/tmp8usid7t_/node/sda1/quarantined/objects-1/ab4a8c0dec756ad76845d2920375f77c because it could not be listed test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_cleanup_ondisk_files_euclean_quarantined test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_cleanup_ondisk_files_euclean_quarantined ... ok suffix-hash-test DEBUG: Run listdir on /tmp/tmpmgszha_e/node/sda1/objects/0 Error hashing suffix Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1374, in __get_hashes hashes[suffix] = self._hash_suffix( ~~~~~~~~~~~~~~~~~^ suffix_dir, policy=policy) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3908, in _hash_suffix hash_per_fi = self._hash_suffix_dir(path, policy) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1204, in _hash_suffix_dir ondisk_info = self.cleanup_ondisk_files( hsh_path, policy=policy) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1123, in cleanup_ondisk_files files = os.listdir(hsh_path) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 9078, in mock_os_listdir raise OSError(errno.EACCES, os.strerror(errno.EACCES)) PermissionError: [Errno 13] Permission denied suffix-hash-test DEBUG: Run listdir on /tmp/tmpmgszha_e/node/sda1/objects-1/0 Error hashing suffix Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1374, in __get_hashes hashes[suffix] = self._hash_suffix( ~~~~~~~~~~~~~~~~~^ suffix_dir, policy=policy) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 3202, in _hash_suffix hashes = self._hash_suffix_dir(path, policy) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1204, in _hash_suffix_dir ondisk_info = self.cleanup_ondisk_files( hsh_path, policy=policy) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1123, in cleanup_ondisk_files files = os.listdir(hsh_path) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_diskfile.py", line 9078, in mock_os_listdir raise OSError(errno.EACCES, os.strerror(errno.EACCES)) PermissionError: [Errno 13] Permission denied test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_cleanup_ondisk_files_other_oserror test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_cleanup_ondisk_files_other_oserror ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_listdir_enoent test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_listdir_enoent ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_listdir_enotdir test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_listdir_enotdir ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_multi_file_ends_in_tombstone test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_multi_file_ends_in_tombstone ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_multifile_ends_in_datafile test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_multifile_ends_in_datafile ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info_no_stale_reads test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info_no_stale_reads ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_multifile_ends_in_datafile_legacy_durable test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_multifile_ends_in_datafile_legacy_durable ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.2:1002/sdc (txn: tx4847f8803a7c46d9ab5db-0068c5709b) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.1:1001/sdb (txn: tx4847f8803a7c46d9ab5db-0068c5709b) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.0:1000/sda (txn: tx4847f8803a7c46d9ab5db-0068c5709b) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.3:1003/sda (txn: tx4847f8803a7c46d9ab5db-0068c5709b) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.4:1004/sda (txn: tx4847f8803a7c46d9ab5db-0068c5709b) proxy-ut ERROR: Container HEAD returning 503 for [503, 503, 503, 503, 503] (txn: tx4847f8803a7c46d9ab5db-0068c5709b) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx82fba07db0424c1db23d9-0068c5709b) proxy-ut ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx82fba07db0424c1db23d9-0068c5709b) proxy-ut ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx82fba07db0424c1db23d9-0068c5709b) proxy-ut ERROR: Container HEAD returning 503 for [] (txn: tx82fba07db0424c1db23d9-0068c5709b) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx4222a37f59c1432d87cd3-0068c5709b) proxy-ut ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx4222a37f59c1432d87cd3-0068c5709b) proxy-ut ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx4222a37f59c1432d87cd3-0068c5709b) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_respects_write_affinity test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_respects_write_affinity ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_respects_write_affinity_with_507s test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_respects_write_affinity_with_507s ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_datafile test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_datafile ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_reclaim_and_one_valid_tombstone test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_reclaim_and_one_valid_tombstone ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_reclaim_tombstone test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_reclaim_tombstone ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_reclaim_tombstone_and_one_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_reclaim_tombstone_and_one_meta ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_tombstone test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_tombstone ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_send_exceptions test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_send_exceptions ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_tombstone_and_one_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_one_tombstone_and_one_meta ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_removes_empty_hashdir_and_suffix test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_removes_empty_hashdir_and_suffix ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_equal_replicas test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_equal_replicas ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_removes_empty_hashdirs_in_valid_suffix test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_removes_empty_hashdirs_in_valid_suffix ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_rmdir_hsh_path_oserror test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_rmdir_hsh_path_oserror ... ok sharder-test DEBUG: Cleaved 0 shard ranges, path: .shards_a/shard_c, db: /tmp/tmpbw50ir9u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('there', '')], path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013065338134765625s, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.654594421386719e-05s, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010323524475097656s, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.726119995117188e-05s, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test INFO: Starting to cleave (2 todo), path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test INFO: Cleaving from row None into a/c for ShardRange, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00016832351684570312s, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.821487426757812e-05s, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b.db sharder-test INFO: Replicating new shard container a/c for ShardRange<'here' to 'there' as of 1757769883.85290, (0, 0) as of 1757769884.00000, shrunk as of 1757769884.00000>, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test INFO: Cleaved ShardRange in 0.016s, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: Cleaved 1 shard ranges, path: .shards_a/shard_c, db: /tmp/tmp9sgpm99u/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769885.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Starting to cleave (4 todo), path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Cleaving from row None into .shards_a/c_b_0 for ShardRange, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00015044212341308594s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.489059448242188e-05s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_b_0 for ShardRange, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Cleaved ShardRange in 0.023s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Cleaving from row None into .shards_a/c_d_2 for ShardRange<'b' to 'd' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.0001838207244873047s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.465217590332031e-05s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_d_2 for ShardRange, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Cleaved ShardRange<'b' to 'd' as of 1757769836.07887, (2, 3) as of 1757769883.96845, cleaved as of 1757769836.07887> in 0.019s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: Continuing to cleave (2 done, 2 todo), path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Cleaving from row None into .shards_a/c_f_3 for ShardRange<'d' to 'f' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00015544891357421875s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_fewer_container_replicas test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_fewer_container_replicas ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_rmdir_suffix_oserror test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_rmdir_suffix_oserror ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_ts_cleanup_after_invalidate_hash test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_ts_cleanup_after_invalidate_hash ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_ts_cleanup_after_recalc test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_ts_cleanup_after_recalc ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_many_object_replicas test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_many_object_replicas ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_obsolete_content_type_in_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_obsolete_content_type_in_meta ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_obsolete_content_type_in_older_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_obsolete_content_type_in_older_meta ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_older_content_type_in_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_older_content_type_in_meta ... ok test.unit.container.test_sharder.TestSharder.test_cleave_skips_shrinking_and_stops_at_found test.unit.container.test_sharder.TestSharder.test_cleave_skips_shrinking_and_stops_at_found ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_older_content_type_in_newer_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_older_content_type_in_newer_meta ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda, error: test proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txe1d6cc6a84fc488297b55-0068c5709b) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx3ec9fb432145436b85fdd-0068c5709b) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx714d2d79858f4a18b0a3f-0068c5709c) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx714d2d79858f4a18b0a3f-0068c5709c) proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: tx714d2d79858f4a18b0a3f-0068c5709c) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx10cebfe7c6d34f33b9fe8-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o.jpg From Object Server 10.0.0.1:3001/sdb (txn: tx10cebfe7c6d34f33b9fe8-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o.jpg From Object Server 10.0.0.2:3002/sdc (txn: tx10cebfe7c6d34f33b9fe8-0068c5709c) proxy-ut ERROR: Object PUT returning 503 for [503, 503, 503] (txn: tx10cebfe7c6d34f33b9fe8-0068c5709c) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_more_container_replicas test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_more_container_replicas ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_delete_at_with_fewer_container_replicas test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_delete_at_with_fewer_container_replicas ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_delete_at_with_more_container_replicas test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_PUT_x_delete_at_with_more_container_replicas ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_older_content_type_in_older_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_older_content_type_in_older_meta ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_same_age_content_type_in_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_same_age_content_type_in_meta ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info_sharding_states test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info_sharding_states ... ok proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=1_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Failed to get shard ranges from /v1/a/c/o: unexpected record type None (txn: tx12282c8e36e94ecba8459-0068c5709b) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=1_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Problem with container shard listing response from /v1/a/c?format=json&states=updating&includes=1_test: ValueError('not a list') (txn: tx49c96c38710846ed8c77e-0068c5709b) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=1_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=1_test: 404 (txn: tx564142463d894518b06e8-0068c5709b) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=1_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Failed to get shard ranges from /v1/a/c/o: unexpected record type 'object' (txn: tx1b3fc3a57d5b48e799036-0068c5709b) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmpiqx4vtjf/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpiqx4vtjf/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmpiqx4vtjf/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpiqx4vtjf/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/0/a" 201 - "-" "test" "-" 0.0082 "-" 1824522 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/0/a" 201 - "-" "test" "-" 0.0071 "-" 1824522 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0027 "-" 1824522 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0029 "-" 1824522 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:43 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfc00f98012ad43e488d10-0068c5709b" "proxy-server 1824522" 0.0058 "-" 1824522 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://127.0.0.1:55599/sdb1/3/a/c" "txfc00f98012ad43e488d10-0068c5709b" "container-server 1824522" 0.0012 "-" 1824522 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://127.0.0.1:59163/sda1/3/a/c" "txfc00f98012ad43e488d10-0068c5709b" "container-server 1824522" 0.0010 "-" 1824522 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "txfc00f98012ad43e488d10-0068c5709b" "proxy-server 1824522" 0.0211 "-" 1824522 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/3/a/c" 201 - "PUT http://localhost/v1/a/c" "txfc00f98012ad43e488d10-0068c5709b" "proxy-server 1824522" 0.0302 "-" 1824522 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 PUT /v1/a/c HTTP/1.0 201 - - t - - - txfc00f98012ad43e488d10-0068c5709b - 0.0456 - - 1757769883.984149456 1757769884.029742002 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "HEAD /sdb1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx0c9a90bf78194f2b9dcc6-0068c5709c" "proxy-server 1824522" 0.0011 "-" 1824522 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:55599/sdb1/0/a1/c1" "tx0c9a90bf78194f2b9dcc6-0068c5709c" "container-server 1824522" 0.0011 "-" 1824522 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:59163/sda1/0/a1/c1" "tx0c9a90bf78194f2b9dcc6-0068c5709c" "container-server 1824522" 0.0010 "-" 1824522 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx0c9a90bf78194f2b9dcc6-0068c5709c" "proxy-server 1824522" 0.0207 "-" 1824522 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/0/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx0c9a90bf78194f2b9dcc6-0068c5709c" "proxy-server 1824522" 0.0301 "-" 1824522 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx0c9a90bf78194f2b9dcc6-0068c5709c - 0.0415 - - 1757769884.035506010 1757769884.077051401 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2fd11f839dfe400db2a1e-0068c5709c" "proxy-server 1824522" 0.0060 "-" 1824522 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://127.0.0.1:59163/sda1/3/a/c1" "tx2fd11f839dfe400db2a1e-0068c5709c" "container-server 1824522" 0.0018 "-" 1824522 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://127.0.0.1:55599/sdb1/3/a/c1" "tx2fd11f839dfe400db2a1e-0068c5709c" "container-server 1824522" 0.0059 "-" 1824522 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx2fd11f839dfe400db2a1e-0068c5709c" "proxy-server 1824522" 0.0308 "-" 1824522 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/3/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx2fd11f839dfe400db2a1e-0068c5709c" "proxy-server 1824522" 0.0231 "-" 1824522 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx2fd11f839dfe400db2a1e-0068c5709c - 0.0526 - - 1757769884.078448057 1757769884.131058931 1 -test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_same_age_content_type_in_newer_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_same_age_content_type_in_newer_meta ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_acc_or_con_missing_returns_404 test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_acc_or_con_missing_returns_404 ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_same_age_content_type_in_older_meta test.unit.obj.test_diskfile.TestSuffixHashes.test_hash_suffix_with_same_age_content_type_in_older_meta ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_server.TestProxyServer.test_adds_transaction_id test.unit.proxy.test_server.TestProxyServer.test_adds_transaction_id ... ok test.unit.proxy.test_server.TestProxyServer.test_adds_transaction_id_length_limit test.unit.proxy.test_server.TestProxyServer.test_adds_transaction_id_length_limit ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_bad_pickle test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_bad_pickle ... ok test.unit.proxy.test_server.TestProxyServer.test_calls_authorize_allow test.unit.proxy.test_server.TestProxyServer.test_calls_authorize_allow ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info_stale_read_ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_info_stale_read_ok ... ok test.unit.proxy.test_server.TestProxyServer.test_calls_authorize_deny test.unit.proxy.test_server.TestProxyServer.test_calls_authorize_deny ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_cache_set_error test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_cache_set_error ... ok test.unit.proxy.test_server.TestProxyServer.test_check_response_200 test.unit.proxy.test_server.TestProxyServer.test_check_response_200 ... ok test.unit.proxy.test_server.TestProxyServer.test_check_response_503 test.unit.proxy.test_server.TestProxyServer.test_check_response_503 ... ok test.unit.proxy.test_server.TestProxyServer.test_check_response_507 test.unit.proxy.test_server.TestProxyServer.test_check_response_507 ... ok test.unit.proxy.test_server.TestProxyServer.test_denied_host_header test.unit.proxy.test_server.TestProxyServer.test_denied_host_header ... ok test.unit.proxy.test_server.TestProxyServer.test_error_limit_methods test.unit.proxy.test_server.TestProxyServer.test_error_limit_methods ... ok test.unit.proxy.test_server.TestProxyServer.test_error_occurred test.unit.proxy.test_server.TestProxyServer.test_error_occurred ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_consolidation test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_consolidation ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_items_since test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_items_since ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_empty_file_exists test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_empty_file_exists ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_file_does_not_exist test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_file_does_not_exist ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_file_not_truncated_when_empty test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_file_not_truncated_when_empty ... ok sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010418891906738281s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_f_3 for ShardRange, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Cleaved ShardRange<'d' to 'f' as of 1757769836.07887, (2, 103) as of 1757769884.04848, cleaved as of 1757769836.07887> in 0.024s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Stopped cleave at unready ShardRange<'f' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, found as of 1757769836.07887>, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: Continuing to cleave (3 done, 1 todo), path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Cleaving from row None into .shards_a/c__4 for ShardRange<'f' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769884.06108>, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00018978118896484375s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00010728836059570312s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__4 for ShardRange, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test INFO: Cleaved ShardRange<'f' to MaxBound as of 1757769836.07887, (1, 1000) as of 1757769884.12749, cleaved as of 1757769884.06108> in 0.038s, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmpk90cvstj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769883.86843.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj_004_0 for ShardRange, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.0001442432403564453s, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=True) in 0.00014853477478027344s, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj_004_0 for ShardRange, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test INFO: Cleaved ShardRange in 0.017s, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'obj_004' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00014853477478027344s, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=True) in 0.00011754035949707031s, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__1 for ShardRange, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test INFO: Cleaved ShardRange<'obj_004' to MaxBound as of 1757769836.07887, (1, 18432) as of 1757769884.28742, cleaved as of 1757769836.07887> in 0.018s, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.db sharder-test DEBUG: Finished processing, state sharded, path: a/c, db: /tmp/tmpyqakwo7v/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.17092.dbtest.unit.container.test_sharder.TestSharder.test_cleave_timing_metrics test.unit.container.test_sharder.TestSharder.test_cleave_timing_metrics ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_race_with_partition_delete test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_race_with_partition_delete ... ok test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9956&marker=l&end_marker=pie%00 {'X-Backend-Record-Type': 'object'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Found 4 objects in shard (state=sharding), total = 8 (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Found 8 objects in shard (state=sharding), total = 48 (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Setting object count to 1072 (txn: tx7530bc46c688496ca420c-0068c57098) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx8a37b05f4cc942a190465-0068c57099) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'auto'} (txn: tx8a37b05f4cc942a190465-0068c57099) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=10000&marker=&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: tx8a37b05f4cc942a190465-0068c57099) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_b?format=json&limit=10000&marker=&end_marker=b%00&states=listing: 404 (txn: tx8a37b05f4cc942a190465-0068c57099) test ERROR: Aborting listing from shards due to bad response: [404] (txn: tx8a37b05f4cc942a190465-0068c57099) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 5 shards for: /v1/a/c?delimiter=%2F&format=json&states=listing (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ha-ppy', lower='', upper='ha/ppy') .shards_a/c_ha-ppy with {'X-Backend-Record-Type': 'auto'} (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Get listing from /v1/.shards_a/c_ha-ppy?delimiter=%2F&format=json&limit=10000&marker=&end_marker=ha%2Fppy%00 {'X-Backend-Record-Type': 'auto'} (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Found 2 objects in shard (state=unsharded), total = 2 (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_ham', lower='ha/ptic', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Get listing from /v1/.shards_a/c_ham?delimiter=%2F&format=json&limit=9998&marker=ha%2F&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Found 0 objects in shard (state=unsharded), total = 2 (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Get listing from /v1/.shards_a/c_pie?delimiter=%2F&format=json&limit=9998&marker=ha%2F&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Found 0 objects in shard (state=unsharded), total = 2 (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Get listing from /v1/.shards_a/c_?delimiter=%2F&format=json&limit=9998&marker=ha%2F&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Found 1 objects in shard (state=unsharded), total = 3 (txn: tx26a2c2fa5c9a424b9734e-0068c5709a) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 6 shards for: /v1/a/c?delimiter=%2F&reverse=on&format=json&states=listing (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='pie', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Get listing from /v1/.shards_a/c_?delimiter=%2F&reverse=on&format=json&limit=10000&marker=&end_marker=pie {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Found 1 objects in shard (state=unsharded), total = 1 (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Get listing from /v1/.shards_a/c_pie?delimiter=%2F&reverse=on&format=json&limit=9999&marker=pumpkin&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Found 0 objects in shard (state=unsharded), total = 1 (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_ham', lower='ha/ptic', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Get listing from /v1/.shards_a/c_ham?delimiter=%2F&reverse=on&format=json&limit=9999&marker=pumpkin&end_marker=ha%2Fptic {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Found 1 objects in shard (state=unsharded), total = 2 (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_ha-ppy', lower='ha.d', upper='ha/ppy') .shards_a/c_ha-ppy with {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Get listing from /v1/.shards_a/c_ha-ppy?delimiter=%2F&reverse=on&format=json&limit=9998&marker=ha%2F&end_marker=ha.d {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Found 1 objects in shard (state=unsharded), total = 3 (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Getting listing part 5 from shard Namespace(name='.shards_a/c_ha.d', lower='', upper='ha.d') .shards_a/c_ha.d with {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Get listing from /v1/.shards_a/c_ha.d?delimiter=%2F&reverse=on&format=json&limit=9997&marker=ha.ggle&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Found 1 objects in shard (state=unsharded), total = 4 (txn: tx07960c3b2c694abcb5f3b-0068c5709b) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx19727c85ab234e75abcae-0068c5709c)test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_racing_get_hashes_diff_suffix_existing_part test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_racing_get_hashes_diff_suffix_existing_part ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut WARNING: expiring_objects_container_divisor is deprecated proxy-ut WARNING: expiring_objects_account_name is deprecated; you need to migrate to the standard .expiring_objects account proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.2:1002/sdc (txn: tx1f7c59aed8b64ab8b9c8f-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: tx286e64c259ae4ced9c373-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: tx286e64c259ae4ced9c373-0068c5709c) proxy-ut ERROR: Account HEAD returning 503 for [503, 503] (txn: tx286e64c259ae4ced9c373-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.2:1002/sdc (txn: tx633e91c3ad7a465eb0224-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: tx633e91c3ad7a465eb0224-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: tx633e91c3ad7a465eb0224-0068c5709c) proxy-ut ERROR: Account HEAD returning 503 for [503, 503, 503] (txn: tx633e91c3ad7a465eb0224-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account/container From Container Server 10.0.0.2:1002/sdc (txn: txbcd5232c49bd4e0e9c84e-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account/container From Container Server 10.0.0.1:1001/sdb (txn: txbcd5232c49bd4e0e9c84e-0068c5709c) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account/container From Container Server 10.0.0.0:1000/sda (txn: txbcd5232c49bd4e0e9c84e-0068c5709c) proxy-ut ERROR: Container HEAD returning 503 for [503, 503, 503] (txn: txbcd5232c49bd4e0e9c84e-0068c5709c) proxy-ut DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: txffc44c49f8ab4b48b1d9e-0068c5709c) proxy-ut DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: txffc44c49f8ab4b48b1d9e-0068c5709c) proxy-ut DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: txffc44c49f8ab4b48b1d9e-0068c5709c) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: txffc44c49f8ab4b48b1d9e-0068c5709c) proxy-ut DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx80922a19f22748c38e419-0068c5709c) proxy-ut DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx80922a19f22748c38e419-0068c5709c) proxy-ut DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx80922a19f22748c38e419-0068c5709c) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx80922a19f22748c38e419-0068c5709c) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txcd301dafda914dd981e66-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txab71825ed44e4e9d879b8-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txbbdb1107cd4247d6a9620-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txaa6860d36d174de2985e0-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx0d09633f86ab44ef8cc55-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txe26ecdd040aa4cf4bf58a-0068c5709c) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx21fd623579a34e83a2d68-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx21fd623579a34e83a2d68-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx277fc68cf1484755bd10c-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx277fc68cf1484755bd10c-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx5f5ef371c3e44c68a505e-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx5f5ef371c3e44c68a505e-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx3d03242eab2e4b28a25d3-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx3d03242eab2e4b28a25d3-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx6de65c9db3fb4a928de85-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx6de65c9db3fb4a928de85-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx838d4c7e59cf455ca0057-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx838d4c7e59cf455ca0057-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx3b117cb0e293438c9b546-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx3b117cb0e293438c9b546-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx1e05bec0f4024db096406-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx1e05bec0f4024db096406-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx6d56dd2041764f05867f7-0068c5709c)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_can_skip_cache test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_can_skip_cache ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_errors test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_errors ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_racing_get_hashes_diff_suffix_new_part test.unit.obj.test_diskfile.TestSuffixHashes.test_invalidate_hash_racing_get_hashes_diff_suffix_new_part ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_namespaces test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_namespaces ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_unpickle_error_and_get_hashes_failure_existing_part test.unit.obj.test_diskfile.TestSuffixHashes.test_unpickle_error_and_get_hashes_failure_existing_part ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_no_cache test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_no_cache ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_unpickle_error_and_get_hashes_failure_new_part test.unit.obj.test_diskfile.TestSuffixHashes.test_unpickle_error_and_get_hashes_failure_new_part ... ok test.unit.obj.test_diskfile.TestSuffixHashes.test_valid_suffix test.unit.obj.test_diskfile.TestSuffixHashes.test_valid_suffix ... ok test.unit.obj.test_replicator.TestMultiProcessReplicator.test_command_line_overrides test.unit.obj.test_replicator.TestMultiProcessReplicator.test_command_line_overrides ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx27ea52c193dd43148babc-0068c5709c" "proxy-server 1824522" 0.0101 "-" 1824522 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://127.0.0.1:59163/sda1/0/a/c2" "tx27ea52c193dd43148babc-0068c5709c" "container-server 1824522" 0.0018 "-" 1824522 2 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://127.0.0.1:55599/sdb1/0/a/c2" "tx27ea52c193dd43148babc-0068c5709c" "container-server 1824522" 0.0186 "-" 1824522 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx27ea52c193dd43148babc-0068c5709c" "proxy-server 1824522" 0.0426 "-" 1824522 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx27ea52c193dd43148babc-0068c5709c" "proxy-server 1824522" 0.0503 "-" 1824522 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - tx27ea52c193dd43148babc-0068c5709c - 0.0790 - - 1757769884.132569790 1757769884.211570024 2 - test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to PUT /v1/a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR 503 full Trying to GET /v1/a/c/o From Object Server 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage test DEBUG: Node is error limited: 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage test DEBUG: Node is error limited: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: test msg 10.0.0.0:1000/sda test ERROR: ERROR with test1 server 10.0.0.0:1000/sda re: test1 msg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1296, in test_error_limit_methods raise Exception('kaboom1!') Exception: kaboom1! test WARNING: ERROR with test2 server 10.0.0.0:1000/sda re: test2 msg Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1310, in test_error_limit_methods raise Exception('kaboom2!') Exception: kaboom2! test WARNING: ERROR with test3 server 10.0.0.0:1000/sda re: test3 msg Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1325, in test_error_limit_methods raise Exception('kaboom3!') Exception: kaboom3! test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1!test.unit.proxy.test_server.TestProxyServer.test_exception_occurred test.unit.proxy.test_server.TestProxyServer.test_exception_occurred ... ok test.unit.proxy.test_server.TestProxyServer.test_exception_occurred_replication_ip_port_logging test.unit.proxy.test_server.TestProxyServer.test_exception_occurred_replication_ip_port_logging ... ok test.unit.proxy.test_server.TestProxyServer.test_get_info_controller test.unit.proxy.test_server.TestProxyServer.test_get_info_controller ... ok test.unit.proxy.test_server.TestProxyServer.test_get_object_ring test.unit.proxy.test_server.TestProxyServer.test_get_object_ring ... ok test.unit.proxy.test_server.TestProxyServer.test_inexistent_method_request test.unit.proxy.test_server.TestProxyServer.test_inexistent_method_request ... ok test.unit.proxy.test_server.TestProxyServer.test_info_defaults test.unit.proxy.test_server.TestProxyServer.test_info_defaults ... ok test.unit.proxy.test_server.TestProxyServer.test_internal_method_request test.unit.proxy.test_server.TestProxyServer.test_internal_method_request ... ok test.unit.proxy.test_server.TestProxyServer.test_internal_reserved_name_request test.unit.proxy.test_server.TestProxyServer.test_internal_reserved_name_request ... ok test.unit.proxy.test_server.TestProxyServer.test_negative_content_length test.unit.proxy.test_server.TestProxyServer.test_negative_content_length ... ok test.unit.obj.test_replicator.TestMultiProcessReplicator.test_device_distribution test.unit.obj.test_replicator.TestMultiProcessReplicator.test_device_distribution ... ok test.unit.obj.test_replicator.TestMultiProcessReplicator.test_more_workers_than_disks test.unit.obj.test_replicator.TestMultiProcessReplicator.test_more_workers_than_disks ... ok test.unit.obj.test_replicator.TestMultiProcessReplicator.test_no_multiprocessing test.unit.obj.test_replicator.TestMultiProcessReplicator.test_no_multiprocessing ... ok test.unit.obj.test_replicator.TestMultiProcessReplicator.test_override_policies test.unit.obj.test_replicator.TestMultiProcessReplicator.test_override_policies ... ok test.unit.obj.test_replicator.TestMultiProcessReplicator.test_recon_run_forever test.unit.obj.test_replicator.TestMultiProcessReplicator.test_recon_run_forever ... ok test.unit.obj.test_replicator.TestMultiProcessReplicator.test_recon_run_once test.unit.obj.test_replicator.TestMultiProcessReplicator.test_recon_run_once ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_empty_cache test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_empty_cache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_namespaces_root_container_fill_gap test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_namespaces_root_container_fill_gap ... ok test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: tx19727c85ab234e75abcae-0068c5709c) test DEBUG: Setting object count to 3120 (txn: tx19727c85ab234e75abcae-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test DEBUG: Setting object count to 3120 (txn: txb19dd3a35c334d9a9ff43-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: GET listing from 5 shards for: /v1/a/c?format=json&states=listing (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?format=json&limit=9952&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?format=json&limit=8928&marker=%D1%B0&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2096 (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=7904&marker=%E2%A8%83&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3120 (txn: tx4cd714a8289b4bd289dc6-0068c5709c)suffix-hash-test DEBUG: Run listdir on /tmp/tmp2dze6vx1/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2dze6vx1/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpj4rgln_y/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpj4rgln_y/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpike8wo4s/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpike8wo4s/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp6o5n645e/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp6o5n645e/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpkzs7iko7/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp1xs54w2b/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp1xs54w2b/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmplqbjtp_b/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmplqbjtp_b/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp4lceyij6/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp4lceyij6/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmplelgl8dm/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpifouugzw/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpifouugzw/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp8wipfyom/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp8wipfyom/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmplbjge4qb/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmplbjge4qb/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpf4d0v5a0/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpf4d0v5a0/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpsxlhusg_/node/sda1/objects/0 suffix-hash-test DEBUG: Error cleaning up empty hash directory /tmp/tmpsxlhusg_/node/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c: suffix-hash-test DEBUG: Run listdir on /tmp/tmpsxlhusg_/node/sda1/objects-1/0 suffix-hash-test DEBUG: Error cleaning up empty hash directory /tmp/tmpsxlhusg_/node/sda1/objects-1/0/77c/ab4a8c0dec756ad76845d2920375f77c: suffix-hash-test DEBUG: Run listdir on /tmp/tmpj7tqepm0/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpj7tqepm0/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp58qm2zw_/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp58qm2zw_/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmprxt9gf0t/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmprxt9gf0t/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpchryklzy/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpchryklzy/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpchryklzy/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpchryklzy/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp9tnvrn52/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp9tnvrn52/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp9tnvrn52/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp9tnvrn52/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpb5ibawxc/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpb5ibawxc/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpb5ibawxc/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpb5ibawxc/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2q5a4ym3/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2q5a4ym3/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2q5a4ym3/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2q5a4ym3/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp8dlik3ek/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp8dlik3ek/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp8dlik3ek/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp8dlik3ek/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpnfmmma_p/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpnfmmma_p/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpnfmmma_p/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpnfmmma_p/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2_rln274/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2_rln274/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2_rln274/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp2_rln274/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp63vkbj0m/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp63vkbj0m/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp63vkbj0m/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp63vkbj0m/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpyuvcaw7f/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpyuvcaw7f/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpxo5a7sc7/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpxo5a7sc7/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpxo5a7sc7/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpxo5a7sc7/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmplok6h3rb/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmplok6h3rb/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpza5u7gro/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpza5u7gro/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpb6r49yu_/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpb6r49yu_/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpeunsh34n/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpeunsh34n/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpi3e536o2/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpi3e536o2/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp56g7w6oy/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp56g7w6oy/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp56g7w6oy/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmp56g7w6oy/node/sda1/objects-1/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpsfslf6ou/node/sda1/objects/0 suffix-hash-test DEBUG: Run listdir on /tmp/tmpsfslf6ou/node/sda1/objects-1/0 test-replicator INFO: [worker 1/2 pid=1824535] Running object replicator in script mode. test-replicator INFO: [worker 1/2 pid=1824535] Object replication complete (once). (2.00 minutes) test-replicator INFO: [worker 2/2 pid=1824535] Running object replicator in script mode. test-replicator INFO: [worker 2/2 pid=1824535] Object replication complete (once). (2.00 minutes) test-replicator INFO: [worker 1/3 pid=1824535] Running object replicator in script mode. test-replicator INFO: [worker 1/3 pid=1824535] Object replication complete (once). (2.00 minutes) test-replicator INFO: [worker 2/3 pid=1824535] Running object replicator in script mode. test-replicator INFO: [worker 2/3 pid=1824535] Object replication complete (once). (2.00 minutes) test-replicator INFO: [worker 3/3 pid=1824535] Running object replicator in script mode. test-replicator INFO: [worker 3/3 pid=1824535] Object replication complete (once). (2.00 minutes) test-replicator INFO: [worker 1/3 pid=1824535] Running object replicator in script mode. test-replicator INFO: [worker 1/3 pid=1824535] Object replication complete (once). (2.00 minutes) test-replicator INFO: [worker 1/3 pid=1824535] Running object replicator in script mode. test-replicator INFO: [worker 1/3 pid=1824535] Object replication complete (once). (2.00 minutes)test.unit.obj.test_replicator.TestMultiProcessReplicator.test_recon_skipped_with_overrides test.unit.obj.test_replicator.TestMultiProcessReplicator.test_recon_skipped_with_overrides ... ok test.unit.obj.test_replicator.TestMultiProcessReplicator.test_worker_logging test.unit.obj.test_replicator.TestMultiProcessReplicator.test_worker_logging ... ok REPLICATE: /sda/0/4a8a08f09d37b73795649038408b5f33, sync, (5, '648be825a7870c392812c3f253e97aba', '4c146130-9a0e-4acf-9b51-74f8dfa259ba-sdb', '1757769884.34094', '0000000000.00000', '0', '') REPLICATE: /sda/0/4a8a08f09d37b73795649038408b5f33, merge_items, ([{'ROWID': 1, 'name': 'obj002', 'created_at': '1757769886.00000', 'size': 1, 'content_type': 'text/plain', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 2, 'name': 'obj003', 'created_at': '1757769887.00000', 'size': 1, 'content_type': 'text/plain', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 3, 'name': 'obj004', 'created_at': '1757769888.00000', 'size': 1, 'content_type': 'text/plain', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 4, 'name': 'obj005', 'created_at': '1757769889.00000', 'size': 1, 'content_type': 'text/plain', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}, {'ROWID': 5, 'name': 'obj006', 'created_at': '1757769890.00000', 'size': 1, 'content_type': 'text/plain', 'etag': 'etag', 'deleted': 0, 'storage_policy_index': 0}], '4c146130-9a0e-4acf-9b51-74f8dfa259ba-sdb') REPLICATE: /sda/0/4a8a08f09d37b73795649038408b5f33, merge_syncs, ([],) sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: got 4 rows (deleted=False) in 0.00016689300537109375s, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010418891906738281s, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Cleaved ShardRange in 0.023s, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'obj004' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.0001583099365234375s, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001270771026611328s, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__1 for ShardRange, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Cleaved ShardRange<'obj004' to MaxBound as of 1757769836.07887, (3, 3) as of 1757769884.51337, cleaved as of 1757769836.07887> in 0.024s, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Finished processing, state sharded, path: a/c, db: /tmp/tmpt92bcbv1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db REPLICATE: /sdb/0/4a8a08f09d37b73795649038408b5f33, sync, (7, '00000000000000000000000000000000', '7188c0db-aca6-4405-a4d8-306530badbc4-', '1757769884.32556', '0000000000.00000', '0', '{"X-Container-Sysmeta-Shard-Context-204da205-b5ef-45b3-bb13-446979ab81db-sda": ["{\\"ref\\": \\"204da205-b5ef-45b3-bb13-446979ab81db-sda\\", \\"cursor\\": \\"\\", \\"max_row\\": 7, \\"cleave_to_row\\": 7, \\"last_cleave_to_row\\": null, \\"cleaving_done\\": true, \\"misplaced_done\\": true, \\"ranges_done\\": 2, \\"ranges_todo\\": 0}", "1757769884.51453"]}') REPLICATE: /sdb/0/4a8a08f09d37b73795649038408b5f33, merge_shard_ranges, ([{'name': '.shards_a/c_obj004_0', 'timestamp': '1757769836.07887', 'lower': '', 'upper': 'obj004', 'object_count': 4, 'bytes_used': 4, 'meta_timestamp': '1757769884.47643', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769836.07887', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': '.shards_a/c__1', 'timestamp': '1757769836.07887', 'lower': 'obj004', 'upper': '', 'object_count': 3, 'bytes_used': 3, 'meta_timestamp': '1757769884.51337', 'deleted': 0, 'state': 40, 'state_timestamp': '1757769836.07887', 'epoch': None, 'reported': 0, 'tombstones': -1}, {'name': 'a/c', 'timestamp': '1757769884.37856', 'lower': '', 'upper': '', 'object_count': 0, 'bytes_used': 0, 'meta_timestamp': '1757769884.52588', 'deleted': 0, 'state': 70, 'state_timestamp': '1757769884.37861', 'epoch': '1757769884.37861', 'reported': 0, 'tombstones': -1}], '7188c0db-aca6-4405-a4d8-306530badbc4-') sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_sharder.TestSharder.test_cleave_to_existing_shard_db test.unit.container.test_sharder.TestSharder.test_cleave_to_existing_shard_db ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_live_cache test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_live_cache ... ok test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_exception_during_rebuild test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_exception_during_rebuild ... ok test.unit.container.test_sharder.TestSharder.test_complete_sharding_missing_own_shard_range test.unit.container.test_sharder.TestSharder.test_complete_sharding_missing_own_shard_range ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_namespaces_state_filtering test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_namespaces_state_filtering ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_live_infocache test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_live_infocache ... ok test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_no_rebuilt_content test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_no_rebuilt_content ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_objects test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_objects ... ok proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx6d56dd2041764f05867f7-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx7dd559b6b8484a0899167-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx7dd559b6b8484a0899167-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txca2f13803b94474eaf1be-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txca2f13803b94474eaf1be-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txf689f41f75db45bb95d89-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txf689f41f75db45bb95d89-0068c5709c) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx64672e541c684319b0a14-0068c5709c) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: tx64672e541c684319b0a14-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txfb09b9be41744e0887bff-0068c5709c) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: txfb09b9be41744e0887bff-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txdb59db6d3947478c8bfd1-0068c5709c) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: txdb59db6d3947478c8bfd1-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txf947f929ddb842e2addf1-0068c5709c) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: txf947f929ddb842e2addf1-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx72d2562294b94b8cb4ef7-0068c5709c) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: tx72d2562294b94b8cb4ef7-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txf666cffa1aa848d989355-0068c5709c) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: txf666cffa1aa848d989355-0068c5709c) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx15abee0243b54510aa3df-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx78df40d642a341b9b0149-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx629850b36b9e40708e5b7-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx398ba49ebe544bf5b7b0f-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txfdfe6f20b58c4654a7551-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx0ada0c2290764044abda8-0068c5709c) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx2ec1d24ef9e04654a3e83-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx2ec1d24ef9e04654a3e83-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txba87a96683274735a8e23-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txba87a96683274735a8e23-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx375057f9550d4ec3a45af-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx375057f9550d4ec3a45af-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx27291a41c38f410aa6608-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx27291a41c38f410aa6608-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx5a4c9ecaee754c40bb6a0-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx5a4c9ecaee754c40bb6a0-0068c5709c) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txfb29500b497d43ba92635-0068c5709c) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txfb29500b497d43ba92635-0068c5709c) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_bad_metadata test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_bad_metadata ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_best_response_sets_etag test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_best_response_sets_etag ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_best_response_sets_headers test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_best_response_sets_headers ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_method test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_method ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_path test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_path ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_path_no_controller test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_path_no_controller ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_utf8 test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_utf8 ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_version test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_bad_version ... ok test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_no_responses test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_no_responses ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_objects_since_row test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_objects_since_row ... ok test.unit.container.test_sharder.TestSharder.test_complete_sharding_root test.unit.container.test_sharder.TestSharder.test_complete_sharding_root ... ok test DEBUG: Setting object count to 3120 (txn: tx4cd714a8289b4bd289dc6-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (3 namespaces) (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Getting listing part 2 from shard Namespace(name='a/c', lower='pie', upper='') a/c with {'X-Backend-Record-Type': 'object'} (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Get listing from /v1/a/c?format=json&limit=9952&marker=p&end_marker= {'X-Backend-Record-Type': 'object'} (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Found 3072 objects in shard (state=sharded), total = 3120 (txn: txc25625a844c1463b8fe73-0068c5709c) test DEBUG: Setting object count to 3120 (txn: txc25625a844c1463b8fe73-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: GET listing from 5 shards for: /v1/a/c?reverse=true&limit=&format=json&states=listing (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_?reverse=true&limit=10000&format=json&marker=&end_marker=%F0%9F%8C%B4 {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1024 (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?reverse=true&limit=8976&format=json&marker=%F0%9F%8C%B5&end_marker=%E2%98%83 {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2048 (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?reverse=true&limit=7952&format=json&marker=%E2%98%84&end_marker=pie {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 3072 (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_pie?reverse=true&limit=6928&format=json&marker=q&end_marker=ham {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Found 8 objects in shard (state=unsharded), total = 3080 (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Getting listing part 4 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_ham?reverse=true&limit=6920&format=json&marker=i&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Found 40 objects in shard (state=unsharded), total = 3120 (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test DEBUG: Setting object count to 3120 (txn: tx00504df1d09e4d8c9fcb4-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: GET listing from 5 shards for: /v1/a/c?limit=49&format=json&states=listing (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_ham?limit=49&format=json&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_pie?limit=9&format=json&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?limit=1&format=json&marker=p&end_marker=%E2%98%83%00 {'X-Backend-Record-Type': 'auto'} (txn: txff68b191910e44508376a-0068c5709c) test DEBUG: Found 1 objects in shard (state=unsharded), total = 49 (txn: txff68b191910e44508376a-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx4e110f1b8c554721a1a2d-0068c5709c) test DEBUG: GET listing from 2 shards for: /v1/a/c?marker=%E2%98%86&format=json&states=listing (txn: tx4e110f1b8c554721a1a2d-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx4e110f1b8c554721a1a2d-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%86&format=json&limit=10000&end_marker=%F0%9F%8C%B4%00 {'X-Backend-Record-Type': 'auto'} (txn: tx4e110f1b8c554721a1a2d-0068c5709c) test DEBUG: Found 1022 objects in shard (state=unsharded), total = 1022 (txn: tx4e110f1b8c554721a1a2d-0068c5709c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_', lower='🌴', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx4e110f1b8c554721a1a2d-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_?marker=%E2%A8%83&format=json&limit=8978&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx4e110f1b8c554721a1a2d-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 2046 (txn: tx4e110f1b8c554721a1a2d-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: GET listing from 4 shards for: /v1/a/c?end_marker=%E2%98%8A&format=json&states=listing (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_ham?end_marker=ham%00&format=json&limit=10000&marker= {'X-Backend-Record-Type': 'auto'} (txn: tx1deaecad272e45a3ba1ca-0068c5709c)test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_memcache ... ok test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_partial_rebuild test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_partial_rebuild ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_chunked_put test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_chunked_put ... ok sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Kick off container cleaving, own shard range in state 'sharded', path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00015687942504882812s, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.942054748535156e-05s, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_0 for ShardRange, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Cleaved ShardRange in 0.01s, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'obj004' to MaxBound as of 1757769836.07887, (3, 3) as of 1757769884.51337, active as of 1757769836.07887>, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00015974044799804688s, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010466575622558594s, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__1 for ShardRange, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test INFO: Cleaved ShardRange<'obj004' to MaxBound as of 1757769836.07887, (3, 3) as of 1757769884.51337, active as of 1757769836.07887> in 0.007s, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test DEBUG: Finished processing, state sharded, path: a/c, db: /tmp/tmpt92bcbv1/sdb/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.37861.db sharder-test WARNING: Failed to get own_shard_range, path: a/c, db: /tmp/tmp07bn04cb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '7377e3d1-47e0-4c78-9a91-7ee478223c79-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': None, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmpb0kah8gz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '7377e3d1-47e0-4c78-9a91-7ee478223c79-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': 1, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': True, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmpb0kah8gz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '7377e3d1-47e0-4c78-9a91-7ee478223c79-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': 1, 'last_cleave_to_row': None, 'cleaving_done': True, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmpb0kah8gz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '7377e3d1-47e0-4c78-9a91-7ee478223c79-sda', 'cursor': '', 'max_row': 2, 'cleave_to_row': 1, 'last_cleave_to_row': None, 'cleaving_done': True, 'misplaced_done': True, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmpb0kah8gz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '6356f7b7-faaf-4771-a9e0-5100ce1eaabb-sda', 'cursor': '', 'max_row': 2, 'cleave_to_row': None, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmpb0kah8gz/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769884.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': 'a2bdaa1a-ec90-4ba0-9b5a-1e4ce76745b5-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': None, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: .shards_/shard_c, db: /tmp/tmp_tjnd2qi/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': 'a2bdaa1a-ec90-4ba0-9b5a-1e4ce76745b5-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': 1, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': True, 'ranges_done': 0, 'ranges_todo': 0}, path: .shards_/shard_c, db: /tmp/tmp_tjnd2qi/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': 'a2bdaa1a-ec90-4ba0-9b5a-1e4ce76745b5-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': 1, 'last_cleave_to_row': None, 'cleaving_done': True, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: .shards_/shard_c, db: /tmp/tmp_tjnd2qi/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.dbtest.unit.container.test_sharder.TestSharder.test_complete_sharding_shard test.unit.container.test_sharder.TestSharder.test_complete_sharding_shard ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_head_account test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_head_account ... ok test.unit.container.test_sharder.TestSharder.test_fetch_shard_ranges_bad_data test.unit.container.test_sharder.TestSharder.test_fetch_shard_ranges_bad_data ... ok test.unit.container.test_sharder.TestSharder.test_fetch_shard_ranges_bad_record_type test.unit.container.test_sharder.TestSharder.test_fetch_shard_ranges_bad_record_type ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_unhandled_exception test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_unhandled_exception ... ok test.unit.container.test_sharder.TestSharder.test_fetch_shard_ranges_ok test.unit.container.test_sharder.TestSharder.test_fetch_shard_ranges_ok ... ok test.unit.container.test_sharder.TestSharder.test_fetch_shard_ranges_unexpected_response test.unit.container.test_sharder.TestSharder.test_fetch_shard_ranges_unexpected_response ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_own_shard_range test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_own_shard_range ... ok test.unit.container.test_sharder.TestSharder.test_find_and_enable_multiple_shrinking_candidates test.unit.container.test_sharder.TestSharder.test_find_and_enable_multiple_shrinking_candidates ... ok test.unit.container.test_sharder.TestSharder.test_find_and_enable_sharding_candidates test.unit.container.test_sharder.TestSharder.test_find_and_enable_sharding_candidates ... ok test.unit.container.test_sharder.TestSharder.test_find_and_enable_sharding_candidates_bootstrap test.unit.container.test_sharder.TestSharder.test_find_and_enable_sharding_candidates_bootstrap ... ok test-replicator INFO: [worker 1/3 pid=8804] Running object replicator in script mode. test-replicator DEBUG: [worker 1/3 pid=8804] debug message test-replicator INFO: [worker 1/3 pid=8804] info message test-replicator WARNING: [worker 1/3 pid=8804] warning message test-replicator ERROR: [worker 1/3 pid=8804] error message test-replicator INFO: [worker 1/3 pid=8804] Object replication complete (once). (0.00 minutes) test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824535) wsgi starting up on http://127.0.0.1:57509 test-ssync-receiver DEBUG: (1824535) accepted ('127.0.0.1', 51028) test-ssync-sender DEBUG: Reconstruct frag #0 with frag indexes [13, 12, 11, 10, 9, 8, 7, 6, 5, 4] test-ssync-sender ERROR: Error trying to rebuild /a/c/o1 policy#0 frag#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 734, in fragment_payload_iter fragment_payload = [fragment for fragment in pile] ^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenpool.py", line 229, in next return self._next() ~~~~~~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/greenpool.py", line 234, in _next return self.waiters.get().wait() ~~~~~~~~~~~~~~~~~~~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 232, in wait return self._exit_event.wait() ~~~~~~~~~~~~~~~~~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/event.py", line 124, in wait result = hub.switch() File "/usr/lib/python3/dist-packages/eventlet/hubs/hub.py", line 310, in switch return self.greenlet.switch() ~~~~~~~~~~~~~~~~~~~~^^ File "/usr/lib/python3/dist-packages/eventlet/greenthread.py", line 272, in main result = function(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 718, in _get_one_fragment chunk = resp.read(remaining_bytes) File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_ssync.py", line 879, in read raise self.data Exception: raised in response read method test-ssync-sender ERROR: 127.0.0.1:57509/dev/9 Sent data length does not match content-length test-ssync-receiver WARNING: ssync subrequest failed with 499: PUT /a/c/o1 (b'

Client Disconnect

The client was disconnected during request.

') test-ssync-receiver ERROR: 127.0.0.1/dev/9 read failed in ssync.Receiver: Early termination for PUT /a/c/o1 test-ssync-receiver INFO: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/wsgi.py", line 658, in handle_one_response write(b'') ~~~~~^^^^^ File "/usr/lib/python3/dist-packages/eventlet/wsgi.py", line 581, in write wfile.flush() ~~~~~~~~~~~^^ File "/usr/lib/python3.13/socket.py", line 737, in write return self._sock.send(b) ~~~~~~~~~~~~~~~^^^ File "/usr/lib/python3/dist-packages/eventlet/greenio/base.py", line 383, in send return self._send_loop(self.fd.send, data, flags) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenio/base.py", line 370, in _send_loop return send_method(data, *args) BrokenPipeError: [Errno 32] Broken pipe test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:44] "SSYNC /dev/9 HTTP/1.1" 200 306 0.061244 test-ssync-receiver INFO: (1824535) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824535) wsgi starting up on http://127.0.0.1:56163 test-ssync-receiver DEBUG: (1824535) accepted ('127.0.0.1', 49220) test-ssync-sender DEBUG: Reconstruct frag #0 with frag indexes [13, 12, 11, 10, 9, 8, 7, 6, 5, 4] test-ssync-sender ERROR: 127.0.0.1:56163/dev/9 Sent data length does not match content-length test-ssync-receiver WARNING: ssync subrequest failed with 499: PUT /a/c/o1 (b'

Client Disconnect

The client was disconnected during request.

') test-ssync-receiver ERROR: 127.0.0.1/dev/9 read failed in ssync.Receiver: Early termination for PUT /a/c/o1 test-ssync-receiver INFO: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/wsgi.py", line 658, in handle_one_response write(b'') ~~~~~^^^^^ File "/usr/lib/python3/dist-packages/eventlet/wsgi.py", line 581, in write wfile.flush() ~~~~~~~~~~~^^ File "/usr/lib/python3.13/socket.py", line 737, in write return self._sock.send(b) ~~~~~~~~~~~~~~~^^^ File "/usr/lib/python3/dist-packages/eventlet/greenio/base.py", line 383, in send return self._send_loop(self.fd.send, data, flags) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenio/base.py", line 370, in _send_loop return send_method(data, *args) BrokenPipeError: [Errno 32] Broken pipe test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:44] "SSYNC /dev/9 HTTP/1.1" 200 306 0.055478 test-ssync-receiver INFO: (1824535) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824535) wsgi starting up on http://127.0.0.1:49287 test-ssync-receiver DEBUG: (1824535) accepted ('127.0.0.1', 36518) test-ssync-sender ERROR: Unable to get enough responses (13 x unknown error responses) to reconstruct non-durable 127.0.0.1:49287/dev/9/a/c/o1 policy#0 frag#0 test-ssync-sender DEBUG: Reconstruct frag #0 with frag indexes [13, 12, 11, 10, 9, 8, 7, 6, 5, 4] test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 2, available: 2, sent: 2, deletable: 2 test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:44] "SSYNC /dev/9 HTTP/1.1" 200 354 0.102522 test-ssync-receiver INFO: (1824535) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824535) wsgi starting up on http://127.0.0.1:43057 test-ssync-receiver DEBUG: (1824535) accepted ('127.0.0.1', 38328) test-ssync-sender DEBUG: Reconstruct frag #0 with frag indexes [13, 12, 11, 10, 9, 8, 7, 6, 5, 4] test-ssync-sender ERROR: 127.0.0.1:43057/dev/9 Sent data length does not match content-length test-ssync-receiver WARNING: ssync subrequest failed with 499: PUT /a/c/o1 (b'

Client Disconnect

The client was disconnected during request.

') test-ssync-receiver ERROR: 127.0.0.1/dev/9 read failed in ssync.Receiver: Early termination for PUT /a/c/o1 test-ssync-receiver INFO: Traceback (most recent call last): File "/usr/lib/python3/dist-packages/eventlet/wsgi.py", line 658, in handle_one_response write(b'') ~~~~~^^^^^ File "/usr/lib/python3/dist-packages/eventlet/wsgi.py", line 581, in write wfile.flush() ~~~~~~~~~~~^^ File "/usr/lib/python3.13/socket.py", line 737, in write return self._sock.send(b) ~~~~~~~~~~~~~~~^^^ File "/usr/lib/python3/dist-packages/eventlet/greenio/base.py", line 383, in send return self._send_loop(self.fd.send, data, flags) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/eventlet/greenio/base.py", line 370, in _send_loop return send_method(data, *args) BrokenPipeError: [Errno 32] Broken pipe test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:44] "SSYNC /dev/9 HTTP/1.1" 200 306 0.052315 test-ssync-receiver INFO: (1824535) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824535) wsgi starting up on http://127.0.0.1:58347 test-ssync-receiver DEBUG: (1824535) accepted ('127.0.0.1', 46888) test-ssync-sender ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 127.0.0.1:58347/dev/9/a/c/o1 policy#0 frag#0 with ETag the etag and timestamp 1757768884.00000 test-ssync-sender ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 127.0.0.1:58347/dev/9/a/c/o1 policy#0 frag#0 test-ssync-sender WARNING: Quarantined object /tmp/tmpuamrjyhl/tmp_test_ssync_sender/dev/objects/9/a4f/7c89cdaa9eec93e11f15117a2fda0a4f/1757768884.00000#1#d.data: Solitary fragment #1test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_quarantines_lonely_frag test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_quarantines_lonely_frag ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_policy_info test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_policy_info ... ok test.unit.container.test_sharder.TestSharder.test_find_and_enable_shrinking_candidates test.unit.container.test_sharder.TestSharder.test_find_and_enable_shrinking_candidates ... ok sharder-test WARNING: Repeat cleaving required, context: {'ref': 'a2bdaa1a-ec90-4ba0-9b5a-1e4ce76745b5-sda', 'cursor': '', 'max_row': 2, 'cleave_to_row': 1, 'last_cleave_to_row': None, 'cleaving_done': True, 'misplaced_done': True, 'ranges_done': 0, 'ranges_todo': 0}, path: .shards_/shard_c, db: /tmp/tmp_tjnd2qi/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '462113ee-6978-4a9d-8fdc-125161f9e019-sda', 'cursor': '', 'max_row': 2, 'cleave_to_row': None, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: .shards_/shard_c, db: /tmp/tmp_tjnd2qi/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769884.00000.db sharder-test ERROR: Failed to get shard ranges from a/c: invalid data: TypeError('the JSON object must be str, bytes or bytearray, not dict'), path: a/c, db: /tmp/tmp8shl1e3q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to get shard ranges from a/c: invalid data: JSONDecodeError('Expecting value: line 1 column 1 (char 0)'), path: a/c, db: /tmp/tmp8shl1e3q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to get shard ranges from a/c: invalid data: ValueError('not a list'), path: a/c, db: /tmp/tmp8shl1e3q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to get shard ranges from a/c: invalid data: KeyError('name'), path: a/c, db: /tmp/tmp8shl1e3q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to get shard ranges from a/c: invalid data: KeyError('timestamp'), path: a/c, db: /tmp/tmp8shl1e3q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to get shard ranges from a/c: invalid data: KeyError('object_count'), path: a/c, db: /tmp/tmp8shl1e3q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to get shard ranges from a/c: unexpected record type None, path: a/c, db: /tmp/tmpw292io2s/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to get shard ranges from a/c: unexpected record type 'object', path: a/c, db: /tmp/tmpw292io2s/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to get shard ranges from a/c: unexpected record type 'disco', path: a/c, db: /tmp/tmpw292io2s/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to get shard ranges from a/c: Unexpected response: 404, path: a/c, db: /tmp/tmpakmst07b/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp44_p2h1q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Found 0 compactible sequences of length(s) [], path: a/c, db: /tmp/tmp44_p2h1q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: Found 2 compactible sequences of length(s) [2, 2], path: a/c, db: /tmp/tmp44_p2h1q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: shrinking 99999 objects from 1 shard ranges into ShardRange, path: a/c, db: /tmp/tmp44_p2h1q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: shrinking 99999 objects from 1 shard ranges into ShardRange<'c' to 'e' as of 1757769885.02055, (100000, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: a/c, db: /tmp/tmp44_p2h1q/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpixsniv1k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Identified 1 sharding candidates, path: a/c, db: /tmp/tmpixsniv1k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: Identified 1 sharding candidates, path: a/c, db: /tmp/tmpixsniv1k/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: Identified 1 sharding candidates, path: a/c, db: /tmp/tmprblrp940/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Found 0 compactible sequences of length(s) [], path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: Found 1 compactible sequences of length(s) [2], path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: shrinking 99998 objects from 1 shard ranges into ShardRange, path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: Found 1 compactible sequences of length(s) [2], path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: shrinking 99998 objects from 1 shard ranges into ShardRange, path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: Found 1 compactible sequences of length(s) [2], path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: shrinking 99998 objects from 1 shard ranges into ShardRange, path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: Found 1 compactible sequences of length(s) [2], path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: shrinking 0 objects from 1 shard ranges into ShardRange, path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: Found 1 compactible sequences of length(s) [2], path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test DEBUG: shrinking 0 objects from 1 shard ranges into ShardRange, path: a/c, db: /tmp/tmpv5yihwxy/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test INFO: Starting scan for shard ranges, path: a/c, db: /tmp/tmpdr_v1inj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_sharder.TestSharder.test_find_shard_ranges_finds_three_root test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_finds_three_root ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_replication_info test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_replication_info ... ok test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_finds_three_shard test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_finds_three_shard ... ok test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_finds_two_root test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_finds_two_root ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 LICK /v1/a HTTP/1.0 405 - - t - 91 - txcc1d54d58a1d458197e0b-0068c5709c - 0.0045 - - 1757769884.810519695 1757769884.815058470 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 GET invalid HTTP/1.0 404 - - - - 70 - - - 0.0002 - - 1757769884.824235439 1757769884.824465513 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 GET /v1 HTTP/1.0 412 - - t - 7 - - - 0.0002 - - 1757769884.833537102 1757769884.833749294 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 GET /v1/a%2580%3Fformat%3Djson HTTP/1.0 412 - - t - 29 - - - 0.0002 - - 1757769884.847012758 1757769884.847249269 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 GET /v0 HTTP/1.0 412 - - - - 7 - - - 0.0002 - - 1757769884.857330084 1757769884.857535601 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8c796a20b89144e280754-0068c5709c" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txde766346b63b43c28e3a7-0068c5709c" "proxy-server 1824498" 0.0052 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/0/a/c/o/chunky" 201 - "PUT http://localhost/sdb1/0/a/c/o/chunky" "tx11715a66ee214c3594692-0068c5709c" "object-server 1824498" 0.0005 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/0/a/c/o/chunky" 201 - "PUT http://localhost/sda1/0/a/c/o/chunky" "tx11715a66ee214c3594692-0068c5709c" "object-server 1824498" 0.0004 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sda1/0/a/c/o/chunky" 201 - "PUT http://localhost/v1/a/c/o/chunky" "tx11715a66ee214c3594692-0068c5709c" "proxy-server 1824498" 0.0296 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "PUT /sdb1/0/a/c/o/chunky" 201 - "PUT http://localhost/v1/a/c/o/chunky" "tx11715a66ee214c3594692-0068c5709c" "proxy-server 1824498" 0.0308 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 PUT /v1/a/c/o/chunky HTTP/1.0 201 - - t 21 - - tx11715a66ee214c3594692-0068c5709c - 0.0545 - - 1757769884.870700359 1757769884.925189018 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe6ae13ff6c744ad5b2659-0068c5709c" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "txf4563945314e453994ac7-0068c5709c" "proxy-server 1824498" 0.0023 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "GET /sda1/0/a/c/o/chunky" 200 21 "GET http://localhost/v1/a/c/o/chunky" "txccad2b863f504df6b439e-0068c5709c" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 GET /v1/a/c/o/chunky HTTP/1.0 200 - - t - 21 - txccad2b863f504df6b439e-0068c5709c - 0.0326 - - 1757769884.926448584 1757769884.959083796 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:44 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe8e871fb347c4a3da3608-0068c5709c" "proxy-server 1824498" 0.0055 "-" 1824498 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - - t - - - txe8e871fb347c4a3da3608-0068c5709c - 0.0081 - - 1757769884.968442202 1757769884.976559639 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/44 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 500 - - t - - - - - 0.0001 - - 1757769884.985960245 1757769884.986052036 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd1f316035db84375ae639-0068c5709d" "proxy-server 1824498" 0.0054 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/0/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://127.0.0.1:42627/sdb1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txd1f316035db84375ae639-0068c5709d" "container-server 1824498" 0.0010 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/0/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://127.0.0.1:39669/sda1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txd1f316035db84375ae639-0068c5709d" "container-server 1824498" 0.0009 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txd1f316035db84375ae639-0068c5709d" "proxy-server 1824498" 0.0247 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txd1f316035db84375ae639-0068c5709d" "proxy-server 1824498" 0.0171 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 PUT /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test HTTP/1.0 201 - - t - - - txd1f316035db84375ae639-0068c5709d - 0.0408 - - 1757769885.000545979 1757769885.041350126 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sdb1/0/a" 200 729 "GET http://localhost/v1/a?format=json" "tx8259261105e14386be960-0068c5709d" "proxy-server 1824498" 0.0021 "-" 1824498 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 GET /v1/a%3Fformat%3Djson HTTP/1.0 200 - - t - 87 - tx8259261105e14386be960-0068c5709d - 0.0134 - - 1757769885.042627096 1757769885.056034088 - - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sdb1/0/a" 200 729 "GET http://localhost/v1/a?format=json" "tx1c6bd51cfdeb423492a19-0068c5709d" "proxy-server 1824498" 0.0015 "-" 1824498 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 GET /v1/a%3Fformat%3Djson HTTP/1.0 200 - - t - 729 - tx1c6bd51cfdeb423492a19-0068c5709d - 0.0087 - - 1757769885.057597160 1757769885.066273451 - - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sda1/0/a" 200 729 "GET http://localhost/v1/a?format=json" "txcf911aea11f444989339c-0068c5709d" "proxy-server 1824498" 0.0137 "-" 1824498 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 GET /v1/a%3Fformat%3Djson HTTP/1.0 200 - - t - 963 - txcf911aea11f444989339c-0068c5709d - 0.0171 - - 1757769885.072028875 1757769885.089132309 - - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2aad801aab5d49cab33ec-0068c5709d" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 204 - "HEAD http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "tx26f5e8464f7b4a3eab3a8-0068c5709d" "proxy-server 1824498" 0.0012 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "tx7994df73d0e1416b9074d-0068c5709d" "object-server 1824498" 0.0005 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "tx7994df73d0e1416b9074d-0068c5709d" "object-server 1824498" 0.0005 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "tx7994df73d0e1416b9074d-0068c5709d" "proxy-server 1824498" 0.0099 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "tx7994df73d0e1416b9074d-0068c5709d" "proxy-server 1824498" 0.0153 "-" 1824498 0test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_finds_two_shard test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_finds_two_shard ... ok test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_rebuild_ok test.unit.obj.test_ssync.TestSsyncECReconstructorSyncJob.test_sync_reconstructor_rebuild_ok ... ok test.unit.obj.test_ssync_receiver.TestModuleMethods.test_decode_missing test.unit.obj.test_ssync_receiver.TestModuleMethods.test_decode_missing ... ok test.unit.obj.test_ssync_receiver.TestModuleMethods.test_encode_wanted test.unit.obj.test_ssync_receiver.TestModuleMethods.test_encode_wanted ... ok test.unit.obj.test_ssync_sender.TestModuleMethods.test_decode_wanted test.unit.obj.test_ssync_sender.TestModuleMethods.test_decode_wanted ... ok test.unit.obj.test_ssync_sender.TestModuleMethods.test_encode_missing test.unit.obj.test_ssync_sender.TestModuleMethods.test_encode_missing ... ok test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_deferral_multiple_buckets test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_deferral_multiple_buckets ... ok test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_none_found_root test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_none_found_root ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_report_info test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_report_info ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_utf8_all_the_way_down test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_chunked_put_utf8_all_the_way_down ... ok test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_deferral_single_bucket test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_deferral_single_bucket ... ok test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_none_found_shard test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_none_found_shard ... ok test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_init test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_init ... ok test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_iteration_ratelimited test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_iteration_ratelimited ... ok test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_iteration_unlimited test.unit.obj.test_updater.TestBucketizedUpdateSkippingLimiter.test_iteration_unlimited ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_account_acl_headers_translated_for_GET_HEAD test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_account_acl_headers_translated_for_GET_HEAD ... ok test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_with_minimum_size test.unit.container.test_sharder.TestSharder.test_find_shard_ranges_with_minimum_size ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 PUT /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test HTTP/1.0 201 - - t - - - tx7994df73d0e1416b9074d-0068c5709d - 0.0356 - - 1757769885.094940186 1757769885.130581617 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd21d19b0b1044f9a9a58a-0068c5709d" "proxy-server 1824498" 0.0055 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sda1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 200 328 "GET http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test?format=json&states=listing" "txd21d19b0b1044f9a9a58a-0068c5709d" "proxy-server 1824498" 0.0109 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 GET /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 74 - txd21d19b0b1044f9a9a58a-0068c5709d - 0.0223 - - 1757769885.136349440 1757769885.158612251 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx54d5958c2c7547b6978e2-0068c5709d" "proxy-server 1824498" 0.0054 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sda1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 200 328 "GET http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test?format=json&states=listing" "tx54d5958c2c7547b6978e2-0068c5709d" "proxy-server 1824498" 0.0062 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 GET /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 328 - tx54d5958c2c7547b6978e2-0068c5709d - 0.0175 - - 1757769885.164557219 1757769885.182046652 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx153df046cdb4461c87ed9-0068c5709d" "proxy-server 1824498" 0.0055 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sdb1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 200 328 "GET http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test?format=json&states=listing" "tx153df046cdb4461c87ed9-0068c5709d" "proxy-server 1824498" 0.0035 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 GET /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 417 - tx153df046cdb4461c87ed9-0068c5709d - 0.0157 - - 1757769885.188239813 1757769885.203895330 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa7ca25d713c54d89850eb-0068c5709d" "proxy-server 1824498" 0.0012 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/2/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 204 - "HEAD http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "tx58581d36f5b147fb90f77-0068c5709d" "proxy-server 1824498" 0.0012 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 200 - "GET http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "tx4fb9255236cf4d2ab5f90-0068c5709d" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 GET /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test HTTP/1.0 200 - - t - - - tx4fb9255236cf4d2ab5f90-0068c5709d - 0.0204 - - 1757769885.205611467 1757769885.225968838 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut WARNING: Client disconnected without sending enough data (txn: txc646a520f13e48a88d92d-0068c5709d)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_client_disconnect test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_client_disconnect ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_account_info_in_response_env test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_account_info_in_response_env ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_range_rows_with_limit test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_range_rows_with_limit ... ok test.unit.container.test_sharder.TestSharder.test_get_shard_broker_no_local_handoff_for_part test.unit.container.test_sharder.TestSharder.test_get_shard_broker_no_local_handoff_for_part ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_add_acls_impossible_cases test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_add_acls_impossible_cases ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_cache_key_impossible_cases test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_cache_key_impossible_cases ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_get_deleted_account test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_get_deleted_account ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_long_acct_names test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_long_acct_names ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_response_code_for_DELETE test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_response_code_for_DELETE ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_ranges ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_response_code_for_POST test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_response_code_for_POST ... ok sharder-test INFO: Completed scan for shard ranges: 2 found, path: a/c, db: /tmp/tmpdr_v1inj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: a/c, db: /tmp/tmpdr_v1inj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Completed scan for shard ranges: 1 found, path: a/c, db: /tmp/tmpdr_v1inj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Final shard range reached., path: a/c, db: /tmp/tmpdr_v1inj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Scan for shard ranges already completed, path: a/c, db: /tmp/tmpdr_v1inj/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: .shards_a/c_, db: /tmp/tmpxg05r8h7/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Completed scan for shard ranges: 2 found, path: .shards_a/c_, db: /tmp/tmpxg05r8h7/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Starting scan for shard ranges, path: .shards_a/c_, db: /tmp/tmpxg05r8h7/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Completed scan for shard ranges: 1 found, path: .shards_a/c_, db: /tmp/tmpxg05r8h7/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Final shard range reached., path: .shards_a/c_, db: /tmp/tmpxg05r8h7/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test DEBUG: Scan for shard ranges already completed, path: .shards_a/c_, db: /tmp/tmpxg05r8h7/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Starting scan for shard ranges, path: a/c, db: /tmp/tmpmq6ul7r8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Completed scan for shard ranges: 2 found, path: a/c, db: /tmp/tmpmq6ul7r8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Final shard range reached., path: a/c, db: /tmp/tmpmq6ul7r8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Scan for shard ranges already completed, path: a/c, db: /tmp/tmpmq6ul7r8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: .shards_a/c_, db: /tmp/tmpl7cugnhk/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Completed scan for shard ranges: 2 found, path: .shards_a/c_, db: /tmp/tmpl7cugnhk/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Final shard range reached., path: .shards_a/c_, db: /tmp/tmpl7cugnhk/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test DEBUG: Scan for shard ranges already completed, path: .shards_a/c_, db: /tmp/tmpl7cugnhk/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Starting scan for shard ranges, path: a/c, db: /tmp/tmpngfl3uww/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: No shard ranges found, path: a/c, db: /tmp/tmpngfl3uww/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: a/c, db: /tmp/tmpngfl3uww/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: No shard ranges found, path: a/c, db: /tmp/tmpngfl3uww/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: .shards_a/c, db: /tmp/tmpvekm3l5d/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: No shard ranges found, path: .shards_a/c, db: /tmp/tmpvekm3l5d/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: .shards_a/c, db: /tmp/tmpvekm3l5d/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: No shard ranges found, path: .shards_a/c, db: /tmp/tmpvekm3l5d/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: .shards_a/c_, db: /tmp/tmpwzh2e5sk/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Completed scan for shard ranges: 2 found, path: .shards_a/c_, db: /tmp/tmpwzh2e5sk/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Final shard range reached., path: .shards_a/c_, db: /tmp/tmpwzh2e5sk/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Since Sun Sep 14 03:24:45 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_ranges_includes test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_ranges_includes ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_response_code_for_PUT test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_response_code_for_PUT ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_stripping_swift_admin_headers test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_stripping_swift_admin_headers ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_swift_owner test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_swift_owner ... ok test.unit.proxy.test_server.TestProxyServer.test_node_concurrency test.unit.proxy.test_server.TestProxyServer.test_node_concurrency ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_ranges_with_sharding_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_ranges_with_sharding_overlaps ... ok test.unit.proxy.test_server.TestProxyServer.test_node_timing test.unit.proxy.test_server.TestProxyServer.test_node_timing ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_sys_meta_headers_POST test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_sys_meta_headers_POST ... ok test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_sys_meta_headers_PUT test.unit.proxy.controllers.test_account.TestAccountController4Replicas.test_sys_meta_headers_PUT ... ok test.unit.proxy.test_server.TestProxyServer.test_private_method_request test.unit.proxy.test_server.TestProxyServer.test_private_method_request ... ok test.unit.proxy.controllers.test_container.TestGetExplicitRecordTypeLegacy.test_GET_record_type_object_makes_no_cache_lookup test.unit.proxy.controllers.test_container.TestGetExplicitRecordTypeLegacy.test_GET_record_type_object_makes_no_cache_lookup ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_ranges_with_shrinking_overlaps test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_ranges_with_shrinking_overlaps ... ok test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy ... ok test.unit.container.test_sharder.TestSharder.test_identify_sharding_candidate test.unit.container.test_sharder.TestSharder.test_identify_sharding_candidate ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_usage test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_get_shard_usage ... ok test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_inherits test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_inherits ... ok test.unit.proxy.controllers.test_container.TestGetExplicitRecordTypeLegacy.test_GET_shard_ranges_no_cache_when_include_deleted_shards test.unit.proxy.controllers.test_container.TestGetExplicitRecordTypeLegacy.test_GET_shard_ranges_no_cache_when_include_deleted_shards ... ok test.unit.proxy.controllers.test_container.TestGetExplicitRecordTypeLegacy.test_GET_shard_ranges_no_cache_when_requesting_listing_shards test.unit.proxy.controllers.test_container.TestGetExplicitRecordTypeLegacy.test_GET_shard_ranges_no_cache_when_requesting_listing_shards ... ok test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:1000/sda (txn: txef32565645e44f338044a-0068c5709c) test INFO: Client disconnected on read of '/a/c' (txn: txef32565645e44f338044a-0068c5709c) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.1.0:1100/sda (txn: txff700e3063f440b28fd3b-0068c5709c) test INFO: Client disconnected on read of '/a/c' (txn: txff700e3063f440b28fd3b-0068c5709c) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to UPDATE /a/c: Network unreachable (txn: tx1a8de4cd103c4aa786f47-0068c5709d) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to UPDATE /a/c: Network unreachable (txn: tx1a8de4cd103c4aa786f47-0068c5709d) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to UPDATE /a/c: Network unreachable (txn: tx1a8de4cd103c4aa786f47-0068c5709d) test ERROR: Container UPDATE returning 503 for (503, 503, 503) (txn: tx1a8de4cd103c4aa786f47-0068c5709d) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r3=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r3=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r3=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': 'r0=0', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0=0', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_overrides test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_overrides ... ok test.unit.proxy.controllers.test_container.TestGetExplicitRecordTypeLegacy.test_GET_shard_ranges_no_cache_when_requesting_updating_shards test.unit.proxy.controllers.test_container.TestGetExplicitRecordTypeLegacy.test_GET_shard_ranges_no_cache_when_requesting_updating_shards ... ok test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_with_no_default test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_with_no_default ... ok test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_proxy_server_config test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_affinity_proxy_server_config ... ok test.unit.proxy.controllers.test_obj.TestECFragGetter.test_fragment_size test.unit.proxy.controllers.test_obj.TestECFragGetter.test_fragment_size ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_has_multiple_policies test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_has_multiple_policies ... ok test.unit.container.test_sharder.TestSharder.test_identify_sharding_old_style_candidate test.unit.container.test_sharder.TestSharder.test_identify_sharding_old_style_candidate ... ok test.unit.proxy.controllers.test_obj.TestECFragGetter.test_fragment_size_resuming test.unit.proxy.controllers.test_obj.TestECFragGetter.test_fragment_size_resuming ... ok test.unit.proxy.controllers.test_obj.TestECFragGetter.test_fragment_size_resuming_chunked test.unit.proxy.controllers.test_obj.TestECFragGetter.test_fragment_size_resuming_chunked ... ok test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_timing_per_policy test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_by_timing_per_policy ... ok test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_default test.unit.proxy.test_server.TestProxyServer.test_sort_nodes_default ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_client_timeout test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_client_timeout ... ok test.unit.proxy.controllers.test_obj.TestECFragGetter.test_init_node_timeout test.unit.proxy.controllers.test_obj.TestECFragGetter.test_init_node_timeout ... ok test.unit.proxy.controllers.test_obj.TestECFragGetter.test_iter_bytes_from_response_part test.unit.proxy.controllers.test_obj.TestECFragGetter.test_iter_bytes_from_response_part ... ok test.unit.proxy.test_server.TestProxyServer.test_statsd_prefix test.unit.proxy.test_server.TestProxyServer.test_statsd_prefix ... ok test.unit.proxy.controllers.test_obj.TestECFragGetter.test_iter_bytes_from_response_part_insufficient_bytes test.unit.proxy.controllers.test_obj.TestECFragGetter.test_iter_bytes_from_response_part_insufficient_bytes ... ok test.unit.proxy.test_server.TestProxyServer.test_unhandled_exception test.unit.proxy.test_server.TestProxyServer.test_unhandled_exception ... ok test.unit.proxy.controllers.test_obj.TestECFragGetter.test_iter_bytes_from_response_part_read_timeout test.unit.proxy.controllers.test_obj.TestECFragGetter.test_iter_bytes_from_response_part_read_timeout ... ok test.unit.proxy.controllers.test_obj.TestECFragGetter.test_iter_bytes_from_response_part_small_fragment_size test.unit.proxy.controllers.test_obj.TestECFragGetter.test_iter_bytes_from_response_part_small_fragment_size ... ok test.unit.container.test_sharder.TestSharder.test_incomplete_sharding_progress_warning_log test.unit.container.test_sharder.TestSharder.test_incomplete_sharding_progress_warning_log ... ok test.unit.proxy.test_server.TestProxyServer.test_valid_api_version test.unit.proxy.test_server.TestProxyServer.test_valid_api_version ... ok test.unit.container.test_sharder.TestSharder.test_incomplete_shrinking_progress_warning_log test.unit.container.test_sharder.TestSharder.test_incomplete_shrinking_progress_warning_log ... ok test.unit.container.test_sharder.TestSharder.test_increment_stats test.unit.container.test_sharder.TestSharder.test_increment_stats ... ok test.unit.container.test_sharder.TestSharder.test_increment_stats_with_statsd test.unit.container.test_sharder.TestSharder.test_increment_stats_with_statsd ... ok test.unit.container.test_sharder.TestSharder.test_init test.unit.container.test_sharder.TestSharder.test_init ... ok test-ssync-sender DEBUG: Reconstruct frag #0 with frag indexes [13, 12, 11, 10, 9, 8, 7, 6, 5, 4] test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 2, available: 2, sent: 2, deletable: 2 test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:45] "SSYNC /dev/9 HTTP/1.1" 200 354 0.107196 test-ssync-receiver INFO: (1824535) wsgi exited, is_accepting=True test-ssync-receiver DEBUG: Labeled statsd mode: disabled (test-ssync-receiver) test-ssync-receiver INFO: (1824535) wsgi starting up on http://127.0.0.1:39677 test-ssync-receiver DEBUG: (1824535) accepted ('127.0.0.1', 48042) test-ssync-sender DEBUG: Reconstruct frag #0 with frag indexes [13, 12, 11, 10, 9, 8, 7, 6, 5, 4] test-ssync-sender DEBUG: Reconstruct frag #0 with frag indexes [13, 12, 11, 10, 9, 8, 7, 6, 5, 4] test-ssync-sender DEBUG: ssync completed ok: dev: dev, part: 9, policy: 0, num suffixes: 2, available: 2, sent: 2, deletable: 2 test-ssync-receiver INFO: 127.0.0.1 - - [14/Sep/2025 03:24:45] "SSYNC /dev/9 HTTP/1.1" 200 354 0.110107 test-ssync-receiver INFO: (1824535) wsgi exited, is_accepting=True test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 1.2.3.4:6200/sda (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 1.2.3.4:6200/sda (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 1.2.3.4:6200/sda (txn: txn1) (client_ip: 127.0.0.2) proxy-server WARNING: Client disconnected on read of EC frag 'a/c/o' (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (client_ip: 127.0.0.2) cont1 DEBUG: Could not load '/tmp/tmpwo54ts0j/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpwo54ts0j/tmp_test_proxy_server_chunked/container-sync-realms.conf' (client_ip: 127.0.0.2) cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. (client_ip: 127.0.0.2) cont2 DEBUG: Could not load '/tmp/tmpwo54ts0j/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpwo54ts0j/tmp_test_proxy_server_chunked/container-sync-realms.conf' (client_ip: 127.0.0.2) cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. (client_ip: 127.0.0.2) obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0106 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0031 "-" 1824535 -test.unit.container.test_sharder.TestSharder.test_init_deprecated_options test.unit.container.test_sharder.TestSharder.test_init_deprecated_options ... ok test.unit.container.test_sharder.TestSharder.test_init_internal_client_conf_loading_error test.unit.container.test_sharder.TestSharder.test_init_internal_client_conf_loading_error ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_has_other_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_has_other_shard_ranges ... ok test.unit.container.test_sharder.TestSharder.test_init_internal_client_log_name test.unit.container.test_sharder.TestSharder.test_init_internal_client_log_name ... ok test.unit.container.test_sharder.TestSharder.test_log_broker test.unit.container.test_sharder.TestSharder.test_log_broker ... ok test.unit.container.test_sharder.TestSharder.test_log_broker_exception test.unit.container.test_sharder.TestSharder.test_log_broker_exception ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_initialize_container_broker_in_default test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_initialize_container_broker_in_default ... ok sharder-test INFO: Since Sun Sep 14 03:24:45 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:45 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test WARNING: Repeat cleaving required, context: {'ref': '360e10ea-195f-4d1a-a643-0187a6cf5f8c-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': None, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmp09mcug2j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test WARNING: Cleaving has not completed in 172801.00 seconds since 2025-09-13T13:24:45.000000. DB state: sharding, own_shard_range state: sharding, state count of shard ranges: {'found': 0, 'created': 0, 'cleaved': 2, 'active': 0}, path: a/c, db: /tmp/tmp09mcug2j/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.00000.db sharder-test WARNING: Cleaving has not completed in 172801.00 seconds since 2025-09-13T13:24:46.000000. DB state: sharding, own_shard_range state: shrinking, state count of shard ranges: {'found': 0, 'created': 0, 'cleaved': 0, 'active': 1}, path: .shards_a/shard_c, db: /tmp/tmpae8evr_n/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769886.00000.db sharder-test WARNING: shard_replication_quorum of 4 exceeds replica count 3, reducing to 3 sharder-test WARNING: existing_shard_replication_quorum of 4 exceeds replica count 3, reducing to 3 sharder-test DEBUG: bonjour mes amis, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test DEBUG: hello my friend%04ds, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test DEBUG: greetings friend%04ds, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test INFO: bonjour mes amis, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test INFO: hello my friend%04ds, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test INFO: greetings friend%04ds, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test WARNING: bonjour mes amis, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test WARNING: hello my friend%04ds, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test WARNING: greetings friend%04ds, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test ERROR: bonjour mes amis, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test ERROR: hello my friend%04ds, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test ERROR: greetings friend%04ds, path: a/c%40d, db: /tmp/tmpepfi5j08/sda/containers/0/3b6/58f9120a67d9f5f79bd06fc8a7bda3b6/58f9120a67d9f5f79bd06fc8a7bda3b6.db sharder-test ERROR: exception: test, path: a/c, db: /tmp/tmp8fssckfg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sharder.py", line 445, in test_log_broker_exception raise ValueError('test') ValueError: test sharder-test DEBUG: bonjour mes amis, path: , db: /tmp/tmpfbszcha1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: bonjour mes amis, path: a/c, db: test.unit.container.test_sharder.TestSharder.test_log_broker_exception_while_logging test.unit.container.test_sharder.TestSharder.test_log_broker_exception_while_logging ... ok test.unit.container.test_sharder.TestSharder.test_log_broker_levels test.unit.container.test_sharder.TestSharder.test_log_broker_levels ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut WARNING: ERROR Client read timeout (0.05s) (txn: tx72e1e9143e6245bb9247a-0068c5709d) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txca281153e6a84e318aa5d-0068c5709d" "proxy-server 1824498" 0.0013 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/0/a/ba6649c832324114b031c8b387592ba3" 201 - "PUT http://127.0.0.1:39669/sda1/2/a/ba6649c832324114b031c8b387592ba3" "txca281153e6a84e318aa5d-0068c5709d" "container-server 1824498" 0.0011 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/0/a/ba6649c832324114b031c8b387592ba3" 201 - "PUT http://127.0.0.1:42627/sdb1/2/a/ba6649c832324114b031c8b387592ba3" "txca281153e6a84e318aa5d-0068c5709d" "container-server 1824498" 0.0090 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/2/a/ba6649c832324114b031c8b387592ba3" 201 - "PUT http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txca281153e6a84e318aa5d-0068c5709d" "proxy-server 1824498" 0.0245 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/2/a/ba6649c832324114b031c8b387592ba3" 201 - "PUT http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txca281153e6a84e318aa5d-0068c5709d" "proxy-server 1824498" 0.0370 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 PUT /v1/a/ba6649c832324114b031c8b387592ba3 HTTP/1.0 201 - - t - - - txca281153e6a84e318aa5d-0068c5709d - 0.0607 - - 1757769885.720775604 1757769885.781456947 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0111e1b8862d47f7b8aed-0068c5709d" "proxy-server 1824498" 0.0019 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txef1eaf584f1b443fbc078-0068c5709d" "proxy-server 1824498" 0.0012 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/2/a/ba6649c832324114b031c8b387592ba3/conditionals" 201 - "PUT http://localhost/sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx05dbed98ee8f446a82c3b-0068c5709d" "object-server 1824498" 0.0005 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/2/a/ba6649c832324114b031c8b387592ba3/conditionals" 201 - "PUT http://localhost/sda1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx05dbed98ee8f446a82c3b-0068c5709d" "object-server 1824498" 0.0004 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 201 - "PUT http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx05dbed98ee8f446a82c3b-0068c5709d" "proxy-server 1824498" 0.0098 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 201 - "PUT http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx05dbed98ee8f446a82c3b-0068c5709d" "proxy-server 1824498" 0.0099 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 PUT /v1/a/ba6649c832324114b031c8b387592ba3/conditionals HTTP/1.0 201 - - t 52 - - tx05dbed98ee8f446a82c3b-0068c5709d - 0.0269 - - 1757769885.782805443 1757769885.809709549 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx148c437fb2fd417a928f6-0068c5709d" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "tx4ab7bc20bc174179943cc-0068c5709d" "proxy-server 1824498" 0.0021 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 200 52 "GET http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "txbbe454a38b0349d1a0d1e-0068c5709d" "proxy-server 1824498" 0.0003 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx463f777e31ff45418b2ee-0068c5709d" "proxy-server 1824498" 0.0060 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txa4a816e683de492ab6577-0068c5709d" "proxy-server 1824498" 0.0054 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sda1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 412 - "GET http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx6fe6f8af9a54476a866d3-0068c5709d" "proxy-server 1824498" 0.0003 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 412 - "GET http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx6fe6f8af9a54476a866d3-0068c5709d" "proxy-server 1824498" 0.0003 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx08fb738727a74e03a911b-0068c5709d" "proxy-server 1824498" 0.0053 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txf2183208373c48e0b315c-0068c5709d" "proxy-server 1824498" 0.0063 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 200 52 "GET http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx44735204a75b442e9cf17-0068c5709d" "proxy-server 1824498" 0.0031 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfc7990d4811347a8abd6c-0068c5709d" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txc700984dda0047ca90365-0068c5709d" "proxy-server 1824498" 0.0014 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sda1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 304 - "GET http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "txca3bd81be2db443cb06ea-0068c5709d" "proxy-server 1824498" 0.0003 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf72c7642882b4edab4514-0068c5709d" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txd829cef2b1124687b094b-0068c5709d" "proxy-server 1824498" 0.0014 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 200 52 "GET http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx6c81c411718a4b25a4050-0068c5709d" "proxy-server 1824498" 0.0003 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9fa24f98db5147f1ad88e-0068c5709d" "proxy-server 1824498" 0.0012 "-" 1824498 -/usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_mem_server.TestContainerController.test_CORS_valid test.unit.proxy.test_mem_server.TestContainerController.test_CORS_valid ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_conditional_GET_replication test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_conditional_GET_replication ... ok sharder-test INFO: bonjour mes amis, path: , db: /tmp/tmpfbszcha1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: bonjour mes amis, path: a/c, db: sharder-test WARNING: bonjour mes amis, path: , db: /tmp/tmpfbszcha1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: bonjour mes amis, path: a/c, db: sharder-test ERROR: bonjour mes amis, path: , db: /tmp/tmpfbszcha1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: bonjour mes amis, path: a/c, db: sharder-test DEBUG: Unlinked retiring db '/tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001926422119140625s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001595020294189453s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00016927719116210938s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00017786026000976562s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0002110004425048828s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001068115234375s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011515617370605469s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.72747802734375e-05s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 1 rows (deleted=True) in 9.655952453613281e-05s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00019168853759765625s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00016641616821289062s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to 'there' as of 1757769885.97044, (0, 0) as of 1757769885.97044, active as of 1757769885.97044>, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'there' to 'where' as of 1757769885.97045, (0, 0) as of 1757769885.97045, active as of 1757769885.97045>, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test WARNING: Refused to remove misplaced objects for dest .shards_a/there-where in state active, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to 'yonder' as of 1757769885.97046, (0, 0) as of 1757769885.97046, active as of 1757769885.97046>, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test WARNING: Refused to remove misplaced objects for dest .shards_a/where-yonder in state active, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: Placed 4 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00012040138244628906s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010728836059570312s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.107589721679688e-05s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.654594421386719e-05s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.202957153320312e-05s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00012183189392089844s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010561943054199219s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010395050048828125s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00010371208190917969s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010633468627929688s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.131431579589844e-05s, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'there' to 'where' as of 1757769885.97045, (0, 0) as of 1757769885.97045, active as of 1757769885.97045>, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.dbtest.unit.proxy.test_mem_server.TestContainerController.test_DELETE test.unit.proxy.test_mem_server.TestContainerController.test_DELETE ... ok test.unit.container.test_sharder.TestSharder.test_misplaced_objects_db_id_changed test.unit.container.test_sharder.TestSharder.test_misplaced_objects_db_id_changed ... ok test.unit.proxy.test_mem_server.TestContainerController.test_DELETE_backed_x_timestamp_header test.unit.proxy.test_mem_server.TestContainerController.test_DELETE_backed_x_timestamp_header ... ok test.unit.proxy.test_mem_server.TestContainerController.test_DELETE_x_account_headers_with_fewer_account_replicas test.unit.proxy.test_mem_server.TestContainerController.test_DELETE_x_account_headers_with_fewer_account_replicas ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0111 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0075 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txac27c8d2b8bb47d696da5-0068c5709d" "proxy-server 1824535" 0.0013 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:41621/sdb1/1/a/c" "txac27c8d2b8bb47d696da5-0068c5709d" "container-server 1824535" 0.0060 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:41559/sda1/1/a/c" "txac27c8d2b8bb47d696da5-0068c5709d" "container-server 1824535" 0.0010 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "txac27c8d2b8bb47d696da5-0068c5709d" "proxy-server 1824535" 0.0156 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "txac27c8d2b8bb47d696da5-0068c5709d" "proxy-server 1824535" 0.0253 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 PUT /v1/a/c HTTP/1.0 201 - - t - - - txac27c8d2b8bb47d696da5-0068c5709d - 0.0560 - - 1757769885.836598635 1757769885.892607450 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "txe3c935b6a323460aa8337-0068c5709d" "proxy-server 1824535" 0.0012 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:41559/sda1/1/a1/c1" "txe3c935b6a323460aa8337-0068c5709d" "container-server 1824535" 0.0009 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:41621/sdb1/1/a1/c1" "txe3c935b6a323460aa8337-0068c5709d" "container-server 1824535" 0.0010 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "txe3c935b6a323460aa8337-0068c5709d" "proxy-server 1824535" 0.0339 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "txe3c935b6a323460aa8337-0068c5709d" "proxy-server 1824535" 0.0250 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/45 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - txe3c935b6a323460aa8337-0068c5709d - 0.0475 - - 1757769885.899544477 1757769885.947075129 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx29217ab8803f4b498adf5-0068c5709d" "proxy-server 1824535" 0.0061 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:41621/sdb1/2/a/c1" "tx29217ab8803f4b498adf5-0068c5709d" "container-server 1824535" 0.0017 "-" 1824535 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:41559/sda1/2/a/c1" "tx29217ab8803f4b498adf5-0068c5709d" "container-server 1824535" 0.0010 "-" 1824535 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx29217ab8803f4b498adf5-0068c5709d" "proxy-server 1824535" 0.0196 "-" 1824535 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx29217ab8803f4b498adf5-0068c5709d" "proxy-server 1824535" 0.0474 "-" 1824535 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/46 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx29217ab8803f4b498adf5-0068c5709d - 0.0637 - - 1757769885.948295593 1757769886.011956453 1 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc4354869f47e406183312-0068c5709e" "proxy-server 1824535" 0.0019 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:41559/sda1/1/a/c2" "txc4354869f47e406183312-0068c5709e" "container-server 1824535" 0.0051 "-" 1824535 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:41621/sdb1/1/a/c2" "txc4354869f47e406183312-0068c5709e" "container-server 1824535" 0.0017 "-" 1824535 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txc4354869f47e406183312-0068c5709e" "proxy-server 1824535" 0.0231 "-" 1824535 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txc4354869f47e406183312-0068c5709e" "proxy-server 1824535" 0.0306 "-" 1824535 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/46 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txc4354869f47e406183312-0068c5709e - 0.0428 - - 1757769886.018660784 1757769886.061457157 2 - test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (client_ip: 127.0.0.2) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (client_ip: 127.0.0.2) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:2002/sdc (txn: txf302670cf7dc4655b18e1-0068c5709e) test ERROR: ERROR 503 Trying to DELETE /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx32c5ee8be90c4b55b7606-0068c5709e) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:2000/sda (txn: tx22637eb73c5c454eadba6-0068c5709e) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx22637eb73c5c454eadba6-0068c5709e) test ERROR: Container GET returning 503 for (204, 503, 503) (txn: tx22637eb73c5c454eadba6-0068c5709e) test ERROR: ERROR 503 Trying to DELETE /a/c/ From Container Server 10.0.0.0:2000/sda (txn: txee5fa3083870451486b6b-0068c5709e) test ERROR: ERROR 503 Trying to DELETE /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: txee5fa3083870451486b6b-0068c5709e) test ERROR: Container GET returning 503 for (204, 503, 503) (txn: txee5fa3083870451486b6b-0068c5709e) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:2001/sdb (txn: txd8aa19b2dc3c481bb5523-0068c5709e) test ERROR: Container GET returning 503 for (204, 404, 503) (txn: txd8aa19b2dc3c481bb5523-0068c5709e) test ERROR: ERROR 503 Trying to DELETE /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx6b42a1c2fa504baf82c60-0068c5709e) test ERROR: Container GET returning 503 for (204, 404, 503) (txn: tx6b42a1c2fa504baf82c60-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestContainerController.test_DELETE_x_account_headers_with_more_account_replicas test.unit.proxy.test_mem_server.TestContainerController.test_DELETE_x_account_headers_with_more_account_replicas ... ok test.unit.proxy.test_mem_server.TestContainerController.test_GET_account_non_existent test.unit.proxy.test_mem_server.TestContainerController.test_GET_account_non_existent ... ok test.unit.proxy.test_mem_server.TestContainerController.test_GET_auto_create_prefix_account_non_existent test.unit.proxy.test_mem_server.TestContainerController.test_GET_auto_create_prefix_account_non_existent ... ok test.unit.proxy.test_mem_server.TestContainerController.test_GET_calls_authorize test.unit.proxy.test_mem_server.TestContainerController.test_GET_calls_authorize ... ok test.unit.proxy.test_mem_server.TestContainerController.test_GET_no_content test.unit.proxy.test_mem_server.TestContainerController.test_GET_no_content ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "tx360d46732b8347c3ae92b-0068c5709d" "proxy-server 1824498" 0.0012 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "GET /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 304 - "GET http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx2790aa6d62b244ceb45fb-0068c5709d" "proxy-server 1824498" 0.0003 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2642ba2c29dd45b9891ca-0068c5709d" "proxy-server 1824498" 0.0173 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txb7d0d7893d664b42bc11f-0068c5709d" "proxy-server 1824498" 0.0054 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 200 52 "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "txaf918422166c481ea3859-0068c5709d" "proxy-server 1824498" 0.0002 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc3ad86c2e7694a55b1b5b-0068c5709d" "proxy-server 1824498" 0.0011 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "tx57daffd18a304a5db3ef4-0068c5709d" "proxy-server 1824498" 0.0012 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:45 +0000] "HEAD /sda1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 412 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "txbb218ac2728c43d5a0a68-0068c5709d" "proxy-server 1824498" 0.0003 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 412 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "txbb218ac2728c43d5a0a68-0068c5709d" "proxy-server 1824498" 0.0002 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5f2c7f79f2994150b64ca-0068c5709e" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sda1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txded28754e7084e9a91724-0068c5709e" "proxy-server 1824498" 0.0012 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 200 52 "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx8ce25515a45543349e990-0068c5709e" "proxy-server 1824498" 0.0002 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4c18e17d64d04c5aa14d2-0068c5709e" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sda1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txffd18182bb45456ca755c-0068c5709e" "proxy-server 1824498" 0.0012 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 304 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx391ddabf825749adb862f-0068c5709e" "proxy-server 1824498" 0.0002 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4e482338d7ee4eb9a91c5-0068c5709e" "proxy-server 1824498" 0.0012 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "tx9083d35b80a44287b2eea-0068c5709e" "proxy-server 1824498" 0.0012 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 200 52 "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx3969d06fabfa4cc68a075-0068c5709e" "proxy-server 1824498" 0.0002 "-" 1824498 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx15df3620e2484bdd8d907-0068c5709e" "proxy-server 1824498" 0.0127 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/2/a/ba6649c832324114b031c8b387592ba3" 204 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3" "txc81e98af69f5498cbf54b-0068c5709e" "proxy-server 1824498" 0.0013 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a/ba6649c832324114b031c8b387592ba3/conditionals" 304 - "HEAD http://localhost/v1/a/ba6649c832324114b031c8b387592ba3/conditionals" "tx9ef66849f27a46a79aa1b-0068c5709e" "proxy-server 1824498" 0.0002 "-" 1824498 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0350079c275f4fd0a1c7f-0068c5709e" "proxy-server 1824498" 0.0013 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/0/a/con" 201 - "PUT http://127.0.0.1:42627/sdb1/1/a/con" "tx0350079c275f4fd0a1c7f-0068c5709e" "container-server 1824498" 0.0043 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/0/a/con" 201 - "PUT http://127.0.0.1:39669/sda1/1/a/con" "tx0350079c275f4fd0a1c7f-0068c5709e" "container-server 1824498" 0.0009 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/1/a/con" 201 - "PUT http://localhost/v1/a/con" "tx0350079c275f4fd0a1c7f-0068c5709e" "proxy-server 1824498" 0.0232 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/1/a/con" 201 - "PUT http://localhost/v1/a/con" "tx0350079c275f4fd0a1c7f-0068c5709e" "proxy-server 1824498" 0.0197 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/46 PUT /v1/a/con HTTP/1.0 201 - - t - - - tx0350079c275f4fd0a1c7f-0068c5709e - 0.0494 - - 1757769886.121867180 1757769886.171228409 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx134431fb93644a8192a76-0068c5709e" "proxy-server 1824498" 0.0061 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sda1/1/a/con" 204 - "HEAD http://localhost/v1/a/con" "tx2b3bab4556fc45758746d-0068c5709e" "proxy-server 1824498" 0.0012 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/1/a/con/o" 201 - "PUT http://localhost/sda1/0/a/con/o" "txcda730afa1764b74bc994-0068c5709e" "object-server 1824498" 0.0004 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/1/a/con/o" 201 - "PUT http://localhost/sdb1/0/a/con/o" "txcda730afa1764b74bc994-0068c5709e" "object-server 1824498" 0.0004 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/0/a/con/o" 201 - "PUT http://localhost/v1/a/con/o" "txcda730afa1764b74bc994-0068c5709e" "proxy-server 1824498" 0.0137 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/0/a/con/o" 201 - "PUT http://localhost/v1/a/con/o" "txcda730afa1764b74bc994-0068c5709e" "proxy-server 1824498" 0.0137 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/46 PUT /v1/a/con/o HTTP/1.0 201 - - t 10 - - txcda730afa1764b74bc994-0068c5709e - 0.0407 - - 1757769886.172590733 1757769886.213293791 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx913c650b9bbf49958408b-0068c5709e" "proxy-server 1824498" 0.0019 "-" 1824498 -test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_conditional_range_get test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_conditional_range_get ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_custom_mime_types_files test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_custom_mime_types_files ... ok sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to 'yonder' as of 1757769885.97046, (0, 0) as of 1757769885.97046, active as of 1757769885.97046>, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpfltx2wb1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769885.98323.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00018739700317382812s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00016832351684570312s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00014829635620117188s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00018668174743652344s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00016736984252929688s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.0001583099365234375s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00010061264038085938s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00010824203491210938s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.632110595703125e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00012731552124023438s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.775161743164062e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013375282287597656s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=True) in 9.322166442871094e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.751319885253906e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=True) in 9.584426879882812e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.441375732421875e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=True) in 9.584426879882812e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.dbtest.unit.container.test_sharder.TestSharder.test_misplaced_objects_deleted_and_updated test.unit.container.test_sharder.TestSharder.test_misplaced_objects_deleted_and_updated ... ok test.unit.proxy.test_mem_server.TestContainerController.test_HEAD_GET test.unit.proxy.test_mem_server.TestContainerController.test_HEAD_GET ... ok test.unit.proxy.test_mem_server.TestContainerController.test_HEAD_calls_authorize test.unit.proxy.test_mem_server.TestContainerController.test_HEAD_calls_authorize ... ok test.unit.proxy.test_mem_server.TestContainerController.test_OPTIONS test.unit.proxy.test_mem_server.TestContainerController.test_OPTIONS ... ok test.unit.proxy.test_mem_server.TestContainerController.test_OPTIONS_get_info_drops_origin test.unit.proxy.test_mem_server.TestContainerController.test_OPTIONS_get_info_drops_origin ... ok test.unit.proxy.test_mem_server.TestContainerController.test_POST test.unit.proxy.test_mem_server.TestContainerController.test_POST ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/1/a/con" 204 - "HEAD http://localhost/v1/a/con" "tx131bc0893c2f4686b7d36-0068c5709e" "proxy-server 1824498" 0.0105 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "GET /sdb1/0/a/con/o" 304 - "GET http://localhost/v1/a/con/o" "tx62cec29e8ac44fcba1782-0068c5709e" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/46 GET /v1/a/con/o HTTP/1.0 304 - - t - - - tx62cec29e8ac44fcba1782-0068c5709e - 0.0371 - - 1757769886.214559793 1757769886.251681805 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txfc2e80bf5fcb4eada9d23-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx5d7b0fcf00544d0f919f3-0068c5709e) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx5d7b0fcf00544d0f919f3-0068c5709e) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx5d7b0fcf00544d0f919f3-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx0d40b27e6d78419abf207-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx0d40b27e6d78419abf207-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx0d40b27e6d78419abf207-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx0d40b27e6d78419abf207-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txc548546e9ba14a46bffd5-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txc548546e9ba14a46bffd5-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txc548546e9ba14a46bffd5-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txc548546e9ba14a46bffd5-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txb27019f570b0489dafa20-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txb27019f570b0489dafa20-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txb27019f570b0489dafa20-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txb27019f570b0489dafa20-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx73fa7a2cf1fd4843a2183-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx73fa7a2cf1fd4843a2183-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx73fa7a2cf1fd4843a2183-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx73fa7a2cf1fd4843a2183-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx09a94688526c4a3b99a7f-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx09a94688526c4a3b99a7f-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx09a94688526c4a3b99a7f-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx09a94688526c4a3b99a7f-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx118aaaade2b446c0a10e0-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx118aaaade2b446c0a10e0-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx118aaaade2b446c0a10e0-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx118aaaade2b446c0a10e0-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txdb04185a2e06411aad529-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txdb04185a2e06411aad529-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txdb04185a2e06411aad529-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txdb04185a2e06411aad529-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx70d090c3cac94c9aa326a-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx70d090c3cac94c9aa326a-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx70d090c3cac94c9aa326a-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx70d090c3cac94c9aa326a-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txf2e3e0b93abc4b69a843d-0068c5709e) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda (txn: txf2e3e0b93abc4b69a843d-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txf2e3e0b93abc4b69a843d-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txf2e3e0b93abc4b69a843d-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txf2e3e0b93abc4b69a843d-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txf2e3e0b93abc4b69a843d-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txcb22177d414e4263972a6-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txcb22177d414e4263972a6-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txcb22177d414e4263972a6-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503] (txn: txcb22177d414e4263972a6-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx3fe14b2cba5c49c3bb52d-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx3fe14b2cba5c49c3bb52d-0068c5709e) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.1:3001/sdb (txn: tx3fe14b2cba5c49c3bb52d-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx3fe14b2cba5c49c3bb52d-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx3fe14b2cba5c49c3bb52d-0068c5709e) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.2:3002/sdc (txn: tx3fe14b2cba5c49c3bb52d-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx3fe14b2cba5c49c3bb52d-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503] (txn: tx3fe14b2cba5c49c3bb52d-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx83e8b7b7fffa4cd18af76-0068c5709e) sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00012803077697753906s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00010728836059570312s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010347366333007812s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.1552734375e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.225440979003906e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Placed 1 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00012373924255371094s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.799003601074219e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010704994201660156s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.916854858398438e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.7738037109375e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Placed 1 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00011849403381347656s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00010013580322265625s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010633468627929688s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.322166442871094e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.821487426757812e-05s, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Placed 1 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpbnsb2wvc/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00017023086547851562s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00016069412231445312s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00014066696166992188s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.008354902267456055s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.dbtest.unit.container.test_sharder.TestSharder.test_misplaced_objects_insufficient_replication_2_replicas test.unit.container.test_sharder.TestSharder.test_misplaced_objects_insufficient_replication_2_replicas ... ok test.unit.container.test_sharder.TestSharder.test_misplaced_objects_insufficient_replication_3_replicas test.unit.container.test_sharder.TestSharder.test_misplaced_objects_insufficient_replication_3_replicas ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: tx819b472a4b664a0ba7564-0068c5709e) test INFO: Client disconnected on read of '/a/c' (txn: tx819b472a4b664a0ba7564-0068c5709e) test INFO: Client disconnected on read of '/a/c' (txn: tx181a087ccd4141b587250-0068c5709e) test INFO: Client disconnected on read of '/a/c' (txn: tx181a087ccd4141b587250-0068c5709e) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: txd5a69c5a84a442c9bfc1c-0068c5709e) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx098413dafedb4941b246d-0068c5709e) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx673e1c637fc242408dc20-0068c5709e) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: tx673e1c637fc242408dc20-0068c5709e) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx673e1c637fc242408dc20-0068c5709e) test ERROR: Container GET returning 503 for [500, 500, 500] (txn: tx673e1c637fc242408dc20-0068c5709e) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx1a136bd8e1574c559dafd-0068c5709e) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: tx1a136bd8e1574c559dafd-0068c5709e) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx1a136bd8e1574c559dafd-0068c5709e) test ERROR: Container GET returning 503 for [500, 500, 500] (txn: tx1a136bd8e1574c559dafd-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Network unreachable (txn: tx18bf84a4a26c4ce890278-0068c5709e) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/a: Network unreachable (txn: tx18bf84a4a26c4ce890278-0068c5709e) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a: Network unreachable (txn: tx18bf84a4a26c4ce890278-0068c5709e) test ERROR: Account HEAD returning 503 for [] (txn: tx18bf84a4a26c4ce890278-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 500 Trying to POST /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx6f7f6faddfb242bba1038-0068c5709e) test ERROR: ERROR 500 Trying to POST /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx6bc25ee082244ce094b56-0068c5709e) test ERROR: Container GET returning 503 for (204, 404, 503) (txn: tx6bc25ee082244ce094b56-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.2:2002/sdc re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx9cba5b30d9b44f119638f-0068c5709e) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txe9aea1164f2540c7b1907-0068c5709e) test ERROR: ERROR with Container server 10.0.0.2:2002/sdc re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx5baa52878bd549d0a1dd4-0068c5709e) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx8d1c5a881ed24bab89670-0068c5709e)test.unit.proxy.test_mem_server.TestContainerController.test_POST_bad_metadata test.unit.proxy.test_mem_server.TestContainerController.test_POST_bad_metadata ... ok test.unit.proxy.test_mem_server.TestContainerController.test_POST_calls_clean_acl test.unit.proxy.test_mem_server.TestContainerController.test_POST_calls_clean_acl ... ok test.unit.proxy.test_mem_server.TestContainerController.test_POST_metadata test.unit.proxy.test_mem_server.TestContainerController.test_POST_metadata ... ok test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0=0', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0=0', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx83e8b7b7fffa4cd18af76-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx83e8b7b7fffa4cd18af76-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx83e8b7b7fffa4cd18af76-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx7740800dfe7b4b9a96b2b-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx7740800dfe7b4b9a96b2b-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx7740800dfe7b4b9a96b2b-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx7740800dfe7b4b9a96b2b-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx0f97a946d5fc4887b905a-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx0f97a946d5fc4887b905a-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx0f97a946d5fc4887b905a-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx0f97a946d5fc4887b905a-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx332c07d30cf849098b2b2-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx332c07d30cf849098b2b2-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx332c07d30cf849098b2b2-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx332c07d30cf849098b2b2-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx709ae00bbb154d2d94978-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx709ae00bbb154d2d94978-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx709ae00bbb154d2d94978-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx709ae00bbb154d2d94978-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx4c88cd011c6a4cd583c72-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx4c88cd011c6a4cd583c72-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx4c88cd011c6a4cd583c72-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx4c88cd011c6a4cd583c72-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txff955799f8d94b0a9dd51-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txff955799f8d94b0a9dd51-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txff955799f8d94b0a9dd51-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txff955799f8d94b0a9dd51-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx69a4e6eb9c8e410795f0c-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx69a4e6eb9c8e410795f0c-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx69a4e6eb9c8e410795f0c-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx69a4e6eb9c8e410795f0c-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txfc11f5ada4034f2cb53e5-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txfc11f5ada4034f2cb53e5-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txfc11f5ada4034f2cb53e5-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txfc11f5ada4034f2cb53e5-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txf173bd19e3784d7487c3b-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txf173bd19e3784d7487c3b-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txf173bd19e3784d7487c3b-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txf173bd19e3784d7487c3b-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txaaf26c0ee1a74be3ba779-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txaaf26c0ee1a74be3ba779-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txaaf26c0ee1a74be3ba779-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txaaf26c0ee1a74be3ba779-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txf0ab2a47cfdc4767a64e5-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txf0ab2a47cfdc4767a64e5-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txf0ab2a47cfdc4767a64e5-0068c5709e) proxy-ut ERROR: Object PUT returning 503, 0/2 required connections (txn: txf0ab2a47cfdc4767a64e5-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx162c20c4a8144e53bd20b-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx162c20c4a8144e53bd20b-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx162c20c4a8144e53bd20b-0068c5709e) proxy-ut ERROR: Object PUT returning 503, 0/2 required connections (txn: tx162c20c4a8144e53bd20b-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txc92e166f9e9f45a7a203c-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txc92e166f9e9f45a7a203c-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txc92e166f9e9f45a7a203c-0068c5709e) proxy-ut ERROR: Object GET returning 503 for (503, 503, 503) (txn: txc92e166f9e9f45a7a203c-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txaec56b3c81d84ab6a9b1a-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txaec56b3c81d84ab6a9b1a-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txaec56b3c81d84ab6a9b1a-0068c5709e) proxy-ut ERROR: Object GET returning 503 for (503, 503, 503) (txn: txaec56b3c81d84ab6a9b1a-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx68643e61212a49dbac34e-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx68643e61212a49dbac34e-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx68643e61212a49dbac34e-0068c5709e) proxy-ut ERROR: Object GET returning 503 for (503, 503, 503) (txn: tx68643e61212a49dbac34e-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txf7978b9db5d24eb79b1d2-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txf7978b9db5d24eb79b1d2-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txf7978b9db5d24eb79b1d2-0068c5709e) proxy-ut ERROR: Object GET returning 503 for (503, 503, 503) (txn: txf7978b9db5d24eb79b1d2-0068c5709e) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txa7bc06f412ee49e7832e3-0068c5709e) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txa7bc06f412ee49e7832e3-0068c5709e) proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx0dcbb83fc73d4a80a32da-0068c5709e) proxy-ut ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx0dcbb83fc73d4a80a32da-0068c5709e) proxy-ut ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx0dcbb83fc73d4a80a32da-0068c5709e) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx0dcbb83fc73d4a80a32da-0068c5709e)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_error_limiting test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_error_limiting ... ok sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001761913299560547s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.679794311523438e-05s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001010894775390625s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.131431579589844e-05s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00011467933654785156s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001919269561767578s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001671314239501953s, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to 'there' as of 1757769886.38956, (0, 0) as of 1757769886.38956, active as of 1757769886.38956>, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'there' to 'where' as of 1757769886.38958, (0, 0) as of 1757769886.38958, active as of 1757769886.38958>, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to 'yonder' as of 1757769886.38958, (0, 0) as of 1757769886.38958, active as of 1757769886.38958>, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test WARNING: Failed to sufficiently replicate misplaced objects shard .shards_a/where-yonder in state active: 0 successes, 1 required (not removing objects), shard db: /tmp/tmpr119cnzg/sda/containers/0/e50/07b20f6b08408fde4e0bdce650938e50/07b20f6b08408fde4e0bdce650938e50.db, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: Placed 4 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpr119cnzg/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.39010.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00016760826110839844s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00015687942504882812s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00015211105346679688s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00015592575073242188s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00017595291137695312s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00010204315185546875s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010061264038085938s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.036064147949219e-05s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00010061264038085938s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001971721649169922s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00017333030700683594s, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to 'there' as of 1757769886.50968, (0, 0) as of 1757769886.50968, active as of 1757769886.50968>, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'there' to 'where' as of 1757769886.50969, (0, 0) as of 1757769886.50969, active as of 1757769886.50969>, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test WARNING: Failed to sufficiently replicate misplaced objects shard .shards_a/there-where in state active: 1 successes, 2 required (not removing objects), shard db: /tmp/tmpkl_ky9h2/sda/containers/0/170/533f29a8ddb31e55151765e09ccbb170/533f29a8ddb31e55151765e09ccbb170.db, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to 'yonder' as of 1757769886.50970, (0, 0) as of 1757769886.50970, active as of 1757769886.50970>, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: Placed 4 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpkl_ky9h2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.51018.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.dbtest.unit.container.test_sharder.TestSharder.test_misplaced_objects_insufficient_replication_4_replicas test.unit.container.test_sharder.TestSharder.test_misplaced_objects_insufficient_replication_4_replicas ... ok test.unit.proxy.test_mem_server.TestContainerController.test_PUT test.unit.proxy.test_mem_server.TestContainerController.test_PUT ... ok test.unit.proxy.test_mem_server.TestContainerController.test_PUT_autocreate_account_utf8 test.unit.proxy.test_mem_server.TestContainerController.test_PUT_autocreate_account_utf8 ... ok test.unit.proxy.test_mem_server.TestContainerController.test_PUT_autocreate_account_with_sysmeta test.unit.proxy.test_mem_server.TestContainerController.test_PUT_autocreate_account_with_sysmeta ... ok sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00018167495727539062s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0002110004425048828s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00016117095947265625s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.0001933574676513672s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00019884109497070312s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.822845458984375e-05s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010776519775390625s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010728836059570312s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00010728836059570312s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.000194549560546875s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00019311904907226562s, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to 'there' as of 1757769886.55847, (0, 0) as of 1757769886.55847, active as of 1757769886.55847>, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test WARNING: Failed to sufficiently replicate misplaced objects shard .shards_a/here-there in state active: 1 successes, 2 required (not removing objects), shard db: /tmp/tmp8vdh1_1l/sda/containers/0/ed5/9b40bf3cdc484061806b8d0a545d2ed5/9b40bf3cdc484061806b8d0a545d2ed5.db, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'there' to 'where' as of 1757769886.55848, (0, 0) as of 1757769886.55848, active as of 1757769886.55848>, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to 'yonder' as of 1757769886.55849, (0, 0) as of 1757769886.55849, active as of 1757769886.55849>, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test WARNING: Failed to sufficiently replicate misplaced objects shard .shards_a/where-yonder in state active: 0 successes, 2 required (not removing objects), shard db: /tmp/tmp8vdh1_1l/sda/containers/0/e50/07b20f6b08408fde4e0bdce650938e50/07b20f6b08408fde4e0bdce650938e50.db, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: Placed 4 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp8vdh1_1l/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.55904.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00016021728515625s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00014662742614746094s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00013637542724609375s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00014543533325195312s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00017833709716796875s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00011873245239257812s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010132789611816406s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.344650268554688e-05s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 1 rows (deleted=True) in 9.655952453613281e-05s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00015783309936523438s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00014853477478027344s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to 'there' as of 1757769886.63711, (0, 0) as of 1757769886.63711, active as of 1757769886.63711>, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'there' to 'where' as of 1757769886.63712, (0, 0) as of 1757769886.63712, active as of 1757769886.63712>, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.dbtest.unit.proxy.test_mem_server.TestContainerController.test_PUT_backed_x_timestamp_header test.unit.proxy.test_mem_server.TestContainerController.test_PUT_backed_x_timestamp_header ... ok test.unit.container.test_sharder.TestSharder.test_misplaced_objects_newer_objects test.unit.container.test_sharder.TestSharder.test_misplaced_objects_newer_objects ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_mix_ok_and_deleted_shard test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharded_container_with_mix_ok_and_deleted_shard ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 500 Trying to PUT /a/c From Container Server 10.0.0.2:2002/sdc (txn: txd8f9d8b72f464b5491725-0068c5709e) test ERROR: ERROR 500 Trying to PUT /a/c From Container Server 10.0.0.0:2000/sda (txn: txe65f8164c33f478f9a9d1-0068c5709e) test ERROR: Container GET returning 503 for (204, 404, 503) (txn: txe65f8164c33f478f9a9d1-0068c5709e) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.2:1002/sdc (txn: txfac05dd9b1c74e56b1c43-0068c5709e) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: txfac05dd9b1c74e56b1c43-0068c5709e) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: txfac05dd9b1c74e56b1c43-0068c5709e) test ERROR: Account HEAD returning 503 for [503, 503, 503] (txn: txfac05dd9b1c74e56b1c43-0068c5709e) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to PUT /account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txfac05dd9b1c74e56b1c43-0068c5709e) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to PUT /account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txfac05dd9b1c74e56b1c43-0068c5709e) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to PUT /account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txfac05dd9b1c74e56b1c43-0068c5709e) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: txfac05dd9b1c74e56b1c43-0068c5709e) test WARNING: Could not autocreate account '/account' (txn: txfac05dd9b1c74e56b1c43-0068c5709e) test INFO: autocreate account '/account' (txn: tx2a76a65ca9314e3280825-0068c5709e) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.2:1002/sdc (txn: txfe4d058449914f00924c5-0068c5709e) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: txfe4d058449914f00924c5-0068c5709e) test ERROR: Account HEAD returning 503 for [503, 503] (txn: txfe4d058449914f00924c5-0068c5709e) test ERROR: ERROR 503 Trying to PUT /account From Container Server 10.0.0.2:1002/sdc (txn: txfe4d058449914f00924c5-0068c5709e) test ERROR: ERROR 503 Trying to PUT /account From Container Server 10.0.0.0:1000/sda (txn: txfe4d058449914f00924c5-0068c5709e) test ERROR: ERROR 503 Trying to PUT /account From Container Server 10.0.0.1:1001/sdb (txn: txfe4d058449914f00924c5-0068c5709e) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: txfe4d058449914f00924c5-0068c5709e) test WARNING: Could not autocreate account '/account' (txn: txfe4d058449914f00924c5-0068c5709e) test INFO: autocreate account '/account' (txn: txfbdc6af0f29945c099dcd-0068c5709e) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx178a3b19da104be4afc46-0068c5709e) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx178a3b19da104be4afc46-0068c5709e) test ERROR: Container GET returning 503 for (201, 503, 503) (txn: tx178a3b19da104be4afc46-0068c5709e) test INFO: autocreate account '/account' (txn: txdf95f38a539a4e999e540-0068c5709e) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: tx4615188beca94db0905d5-0068c5709e) test ERROR: ERROR 503 Trying to PUT /account From Container Server 10.0.0.1:1001/sdb (txn: tx4615188beca94db0905d5-0068c5709e) test INFO: autocreate account '/account' (txn: tx4615188beca94db0905d5-0068c5709e) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: tx7fef0d3bd16b477c990d7-0068c5709e) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:2000/sda (txn: tx7fef0d3bd16b477c990d7-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: autocreate account '/☃' (txn: txb1749d7bc290437391c1f-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: autocreate account '/account' (txn: tx372847b821704ffa9ce6c-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.2:2002/sdc re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx80623b93ee9749e6ae9ac-0068c5709e)test.unit.proxy.test_mem_server.TestContainerController.test_PUT_bad_metadata test.unit.proxy.test_mem_server.TestContainerController.test_PUT_bad_metadata ... ok test.unit.proxy.test_mem_server.TestContainerController.test_PUT_calls_clean_acl test.unit.proxy.test_mem_server.TestContainerController.test_PUT_calls_clean_acl ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx0c27debe3c1b48ddbf361-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx588268224c7e41158f889-0068c5709e) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx588268224c7e41158f889-0068c5709e) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx588268224c7e41158f889-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txd240002ff9a2453ba986f-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txd240002ff9a2453ba986f-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txd240002ff9a2453ba986f-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txd240002ff9a2453ba986f-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx34bc64aa49d04e5ca7a54-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx34bc64aa49d04e5ca7a54-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx34bc64aa49d04e5ca7a54-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx34bc64aa49d04e5ca7a54-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx0430300d87cc4404b73b4-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx0430300d87cc4404b73b4-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx0430300d87cc4404b73b4-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx0430300d87cc4404b73b4-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx2a3646c6bf404454821b2-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx2a3646c6bf404454821b2-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx2a3646c6bf404454821b2-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx2a3646c6bf404454821b2-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx6e4424f3f6c64b56b31b8-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx6e4424f3f6c64b56b31b8-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx6e4424f3f6c64b56b31b8-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx6e4424f3f6c64b56b31b8-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx57832b0c9d1f487caf663-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx57832b0c9d1f487caf663-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx57832b0c9d1f487caf663-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx57832b0c9d1f487caf663-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx4ae5a38e1ae143418935e-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx4ae5a38e1ae143418935e-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx4ae5a38e1ae143418935e-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx4ae5a38e1ae143418935e-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx6c65353e657942c7b2b49-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx6c65353e657942c7b2b49-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx6c65353e657942c7b2b49-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx6c65353e657942c7b2b49-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txc69401cb68f54c17b0a68-0068c5709e) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda (txn: txc69401cb68f54c17b0a68-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txc69401cb68f54c17b0a68-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txc69401cb68f54c17b0a68-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txc69401cb68f54c17b0a68-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txc69401cb68f54c17b0a68-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txc49638074dc44cbeb7f90-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txc49638074dc44cbeb7f90-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txc49638074dc44cbeb7f90-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503] (txn: txc49638074dc44cbeb7f90-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txc9bad7ae68ed4d2680f09-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txc9bad7ae68ed4d2680f09-0068c5709e) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.1:3001/sdb (txn: txc9bad7ae68ed4d2680f09-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txc9bad7ae68ed4d2680f09-0068c5709e) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txc9bad7ae68ed4d2680f09-0068c5709e) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.2:3002/sdc (txn: txc9bad7ae68ed4d2680f09-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txc9bad7ae68ed4d2680f09-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [503, 503] (txn: txc9bad7ae68ed4d2680f09-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txa12af5ff505f4399a0941-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txa12af5ff505f4399a0941-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txa12af5ff505f4399a0941-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txa12af5ff505f4399a0941-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx4251dce5d97c4aa0b9c26-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx4251dce5d97c4aa0b9c26-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx4251dce5d97c4aa0b9c26-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx4251dce5d97c4aa0b9c26-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txb6ba0e8cb7974a39b796f-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txb6ba0e8cb7974a39b796f-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txb6ba0e8cb7974a39b796f-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txb6ba0e8cb7974a39b796f-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx9e7d793783cc43ffb2557-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx9e7d793783cc43ffb2557-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx9e7d793783cc43ffb2557-0068c5709e)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_error_limiting_survives_ring_reload test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_error_limiting_survives_ring_reload ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_calls_sort_nodes test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_calls_sort_nodes ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_gives_extra_if_error_limited_inline test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_gives_extra_if_error_limited_inline ... ok test.unit.proxy.test_mem_server.TestContainerController.test_PUT_connect_exceptions test.unit.proxy.test_mem_server.TestContainerController.test_PUT_connect_exceptions ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_skips_error_limited test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_skips_error_limited ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_with_replication_network test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_with_replication_network ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_without_replication_network test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_iter_nodes_without_replication_network ... ok sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to 'yonder' as of 1757769886.63713, (0, 0) as of 1757769886.63713, active as of 1757769886.63713>, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: Placed 4 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00010085105895996094s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00012755393981933594s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.654594421386719e-05s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.322166442871094e-05s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00012445449829101562s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.250640869140625e-05s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.702278137207031e-05s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.511543273925781e-05s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.392333984375e-05s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.296966552734375e-05s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011348724365234375s, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to 'there' as of 1757769886.63711, (0, 0) as of 1757769886.63711, active as of 1757769886.63711>, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpny1jm4z8/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.63765.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'there')], path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00015616416931152344s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010061264038085938s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'there')], path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001380443572998047s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00011324882507324219s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010466575622558594s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00017762184143066406s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001659393310546875s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.dbtest.unit.proxy.test_mem_server.TestContainerController.test_PUT_max_container_name_length test.unit.proxy.test_mem_server.TestContainerController.test_PUT_max_container_name_length ... ok test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx59e0d3e095904194b76cd-0068c5709e) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txc2f70e0a9d3f4580a98db-0068c5709e) test ERROR: ERROR with Container server 10.0.0.2:2002/sdc re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txd52ac0f2fa0e467abbd7c-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txd706a2a85f1b4af5a2dbf-0068c5709e) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c/: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx90b6fac2942249f9a41b5-0068c5709e) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx2e3ba16895d341d0ae768-0068c5709e) test ERROR: ERROR with Container server 10.0.0.2:2002/sdc re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx2e3ba16895d341d0ae768-0068c5709e) test ERROR: Container GET returning 503 for (201, 503, 503) (txn: tx2e3ba16895d341d0ae768-0068c5709e) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to PUT /a/c/: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txb99518800c024ea7a3e46-0068c5709e) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c/: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txb99518800c024ea7a3e46-0068c5709e) test ERROR: Container GET returning 503 for (201, 503, 503) (txn: txb99518800c024ea7a3e46-0068c5709e) test ERROR: ERROR with Container server 10.0.0.1:2001/sdb re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx0171809ed6a7475f9cab0-0068c5709e) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:2000/sda (txn: tx0171809ed6a7475f9cab0-0068c5709e) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx0171809ed6a7475f9cab0-0068c5709e) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: tx0171809ed6a7475f9cab0-0068c5709e) test ERROR: ERROR with Container server 10.0.0.0:2000/sda re: Trying to PUT /a/c/: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx790c8dedba244e67999e5-0068c5709e) test ERROR: ERROR 503 Trying to PUT /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx790c8dedba244e67999e5-0068c5709e) test ERROR: ERROR 503 Trying to PUT /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx790c8dedba244e67999e5-0068c5709e) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: tx790c8dedba244e67999e5-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestContainerController.test_PUT_max_containers_per_account test.unit.proxy.test_mem_server.TestContainerController.test_PUT_max_containers_per_account ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_is_deleted test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_is_deleted ... ok test.unit.proxy.test_mem_server.TestContainerController.test_PUT_metadata test.unit.proxy.test_mem_server.TestContainerController.test_PUT_metadata ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_is_old_enough_to_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_is_old_enough_to_reclaim ... ok test.unit.proxy.test_mem_server.TestContainerController.test_PUT_policy_headers test.unit.proxy.test_mem_server.TestContainerController.test_PUT_policy_headers ... ok sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'yonder')], path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001308917999267578s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00010967254638671875s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00011992454528808594s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.000110626220703125s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010585784912109375s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00013589859008789062s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.000125885009765625s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011348724365234375s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010848045349121094s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00010418891906738281s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'there' to 'where' as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to 'yonder' as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Placed 4 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00015115737915039062s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00013065338134765625s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.560585021972656e-05s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.008374214172363281s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00019407272338867188s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00017547607421875s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001697540283203125s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.821487426757812e-05s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.368492126464844e-05s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.559226989746094e-05s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.440017700195312e-05s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001888275146484375s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.dbtest.unit.proxy.test_mem_server.TestContainerController.test_PUT_x_account_headers_with_fewer_account_replicas test.unit.proxy.test_mem_server.TestContainerController.test_PUT_x_account_headers_with_fewer_account_replicas ... ok test.unit.container.test_sharder.TestSharder.test_misplaced_objects_root_container test.unit.container.test_sharder.TestSharder.test_misplaced_objects_root_container ... ok test.unit.proxy.test_mem_server.TestContainerController.test_PUT_x_account_headers_with_more_account_replicas test.unit.proxy.test_mem_server.TestContainerController.test_PUT_x_account_headers_with_more_account_replicas ... ok test.unit.proxy.test_mem_server.TestContainerController.test_acc_missing_returns_404 test.unit.proxy.test_mem_server.TestContainerController.test_acc_missing_returns_404 ... ok test.unit.proxy.test_mem_server.TestContainerController.test_authorized_requests_when_account_not_found test.unit.proxy.test_mem_server.TestContainerController.test_authorized_requests_when_account_not_found ... ok test.unit.proxy.test_mem_server.TestContainerController.test_convert_index_to_name test.unit.proxy.test_mem_server.TestContainerController.test_convert_index_to_name ... ok test.unit.proxy.test_mem_server.TestContainerController.test_convert_policy_to_index test.unit.proxy.test_mem_server.TestContainerController.test_convert_policy_to_index ... ok test.unit.proxy.test_mem_server.TestContainerController.test_error_convert_index_to_name test.unit.proxy.test_mem_server.TestContainerController.test_error_convert_index_to_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_is_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_is_reclaimable ... ok test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: tx163af175f4e747419e8d9-0068c5709f) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx0689248cee474485b53d4-0068c5709f) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx0689248cee474485b53d4-0068c5709f) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx0689248cee474485b53d4-0068c5709f) test ERROR: Account HEAD returning 503 for [] (txn: tx0689248cee474485b53d4-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx712c8563d2014db59f072-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx712c8563d2014db59f072-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx712c8563d2014db59f072-0068c5709f) test ERROR: Account HEAD returning 503 for [] (txn: tx712c8563d2014db59f072-0068c5709f) test ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: tx506b17d253a148ca9d81b-0068c5709f) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txe48ade691ef44534bed6e-0068c5709f) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txe48ade691ef44534bed6e-0068c5709f) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txe48ade691ef44534bed6e-0068c5709f) test ERROR: Account HEAD returning 503 for [] (txn: txe48ade691ef44534bed6e-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx5e3ab049a54b4f61acc41-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx5e3ab049a54b4f61acc41-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx5e3ab049a54b4f61acc41-0068c5709f) test ERROR: Account HEAD returning 503 for [] (txn: tx5e3ab049a54b4f61acc41-0068c5709f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: txec89f1f0fc63498abd857-0068c5709f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: Could not translate X-Backend-Storage-Policy-Index ('-1') from '/a' to policy (txn: tx4c63d19901b5467a9fd1f-0068c5709f) test ERROR: Could not translate X-Backend-Storage-Policy-Index ('-1') from '/a/c' to policy (txn: tx4c63d19901b5467a9fd1f-0068c5709f) test INFO: Client disconnected on read of '/a/c' (txn: tx4c63d19901b5467a9fd1f-0068c5709f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_last_modified_time test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_last_modified_time ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_legacy_pending_files test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_legacy_pending_files ... ok test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: tx028ecee398be4db4a479f-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: txf113c5da62034e9da931f-0068c5709f) test INFO: Client disconnected on read of '/a/c' (txn: txf113c5da62034e9da931f-0068c5709f) test INFO: Client disconnected on read of '/a/c/' (txn: txf113c5da62034e9da931f-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: txa70873a1881548a8abb79-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: txa70873a1881548a8abb79-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: txa70873a1881548a8abb79-0068c5709f) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: txa70873a1881548a8abb79-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: tx6da6b303fc84416795da4-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx6da6b303fc84416795da4-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx6da6b303fc84416795da4-0068c5709f) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx6da6b303fc84416795da4-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: tx94cbf54a01684a878504b-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx94cbf54a01684a878504b-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx94cbf54a01684a878504b-0068c5709f) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx94cbf54a01684a878504b-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: tx91a6fa0c527b48939abdf-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx91a6fa0c527b48939abdf-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx91a6fa0c527b48939abdf-0068c5709f) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx91a6fa0c527b48939abdf-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: txd19a1007942f45e4bf47e-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: txd19a1007942f45e4bf47e-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: txd19a1007942f45e4bf47e-0068c5709f) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: txd19a1007942f45e4bf47e-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: txf985f45b4d9341909d942-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: txf985f45b4d9341909d942-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: txf985f45b4d9341909d942-0068c5709f) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: txf985f45b4d9341909d942-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: tx429d65bd995a48aaa0ef6-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: tx429d65bd995a48aaa0ef6-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: tx429d65bd995a48aaa0ef6-0068c5709f) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx429d65bd995a48aaa0ef6-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.0:2000/sda (txn: tx486c94612c074c1c9ff90-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx486c94612c074c1c9ff90-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx486c94612c074c1c9ff90-0068c5709f) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: tx486c94612c074c1c9ff90-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:2000/sda (txn: txffe05d82554842e69266e-0068c5709f) test ERROR: Node will be error limited for 60.00s: 10.0.0.0:2000/sda (txn: txffe05d82554842e69266e-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txffe05d82554842e69266e-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: txffe05d82554842e69266e-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: txffe05d82554842e69266e-0068c5709f) test ERROR: Container GET returning 503 for [503, 503, 503] (txn: txffe05d82554842e69266e-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx0a4009cc2a9a421a9fc99-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.1:2001/sdb (txn: tx0a4009cc2a9a421a9fc99-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c/ From Container Server 10.0.0.2:2002/sdc (txn: tx0a4009cc2a9a421a9fc99-0068c5709f) test ERROR: Container GET returning 503 for [503, 503] (txn: tx0a4009cc2a9a421a9fc99-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txcc2d4bc19883464c9c0b5-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.1:2001/sdb (txn: txcc2d4bc19883464c9c0b5-0068c5709f) test ERROR: Node will be error limited for 60.00s: 10.0.0.1:2001/sdb (txn: txcc2d4bc19883464c9c0b5-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txcc2d4bc19883464c9c0b5-0068c5709f) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:2002/sdc (txn: txcc2d4bc19883464c9c0b5-0068c5709f) test ERROR: Node will be error limited for 60.00s: 10.0.0.2:2002/sdc (txn: txcc2d4bc19883464c9c0b5-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txcc2d4bc19883464c9c0b5-0068c5709f) test ERROR: Container GET returning 503 for [503, 503] (txn: txcc2d4bc19883464c9c0b5-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx9dc5738282d243228b9d9-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx9dc5738282d243228b9d9-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx9dc5738282d243228b9d9-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: tx9dc5738282d243228b9d9-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx516cd47497eb4f76b5592-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx516cd47497eb4f76b5592-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx516cd47497eb4f76b5592-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: tx516cd47497eb4f76b5592-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx9739965f1da4475dbe4b4-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx9739965f1da4475dbe4b4-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx9739965f1da4475dbe4b4-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: tx9739965f1da4475dbe4b4-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx66b061dc02b5499f8d426-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx66b061dc02b5499f8d426-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx66b061dc02b5499f8d426-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: tx66b061dc02b5499f8d426-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx910e88aa4dae425aba04b-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx910e88aa4dae425aba04b-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx910e88aa4dae425aba04b-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: tx910e88aa4dae425aba04b-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txc06707adfc3044eb972b6-0068c5709f)test.unit.proxy.test_mem_server.TestContainerController.test_error_limiting test.unit.proxy.test_mem_server.TestContainerController.test_error_limiting ... ok test.unit.proxy.test_mem_server.TestContainerController.test_no_convert_index_to_name_when_container_not_found test.unit.proxy.test_mem_server.TestContainerController.test_no_convert_index_to_name_when_container_not_found ... ok sharder-test DEBUG: got 1 rows (deleted=True) in 0.00020503997802734375s, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'yonder' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Placed 3 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpy6n5i7bs/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769886.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00016641616821289062s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00011992454528808594s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00016999244689941406s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00018405914306640625s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00014972686767578125s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test WARNING: Failed to find destination for at least 2 misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00020194053649902344s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00011992454528808594s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.000156402587890625s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: Placed 1 misplaced objects (2 unplaced), path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001270771026611328s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00011801719665527344s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00014090538024902344s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013446807861328125s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011372566223144531s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: misplaced object source bounds [('', 'there'), ('where', '')], path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00011754035949707031s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00014019012451171875s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001163482666015625s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00011873245239257812s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011467933654785156s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.dbtest.unit.container.test_sharder.TestSharder.test_misplaced_objects_shard_container_sharding test.unit.container.test_sharder.TestSharder.test_misplaced_objects_shard_container_sharding ... ok test.unit.proxy.test_mem_server.TestContainerController.test_node_read_timeout_no_retry_to_container test.unit.proxy.test_mem_server.TestContainerController.test_node_read_timeout_no_retry_to_container ... ok test.unit.proxy.test_mem_server.TestContainerController.test_response_get_accept_ranges_header test.unit.proxy.test_mem_server.TestContainerController.test_response_get_accept_ranges_header ... ok sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to 'there' as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00011777877807617188s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001201629638671875s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011920928955078125s, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: Placed 5 misplaced objects (0 unplaced), path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/shard_c, db: /tmp/tmp8qcqh35s/sda/containers/0/f3b/b3fac948f9f029603d4248b5e2d39f3b/b3fac948f9f029603d4248b5e2d39f3b_1757769888.00000.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013566017150878906s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.726119995117188e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.249282836914062e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.416175842285156e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.584426879882812e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 2 rows (deleted=False) in 8.630752563476562e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.630752563476562e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.678436279296875e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.82012939453125e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=True) in 7.62939453125e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test WARNING: Failed to find destination for at least 2 misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Placed 2 misplaced objects (2 unplaced), path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.296966552734375e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.771087646484375e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.605552673339844e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.082389831542969e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=True) in 9.489059448242188e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.dbtest.unit.container.test_sharder.TestSharder.test_misplaced_objects_shard_container_unsharded test.unit.container.test_sharder.TestSharder.test_misplaced_objects_shard_container_unsharded ... ok test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txc06707adfc3044eb972b6-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txc06707adfc3044eb972b6-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: txc06707adfc3044eb972b6-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txed6b1d5cbbde43b7b5de1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txed6b1d5cbbde43b7b5de1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txed6b1d5cbbde43b7b5de1-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: txed6b1d5cbbde43b7b5de1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txae82dd5afa064f1ca5214-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txae82dd5afa064f1ca5214-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txae82dd5afa064f1ca5214-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: txae82dd5afa064f1ca5214-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txff6810c54e744940ab9d1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txff6810c54e744940ab9d1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txff6810c54e744940ab9d1-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: txff6810c54e744940ab9d1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx561ecb1b645e44fab34a1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx561ecb1b645e44fab34a1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx561ecb1b645e44fab34a1-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: tx561ecb1b645e44fab34a1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx266a494a6cc94e939e7f7-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx266a494a6cc94e939e7f7-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx266a494a6cc94e939e7f7-0068c5709f) test ERROR: Container GET returning 503 for [] (txn: tx266a494a6cc94e939e7f7-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txb45341f79b1843ac8bde4-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txb45341f79b1843ac8bde4-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txb45341f79b1843ac8bde4-0068c5709f) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: txb45341f79b1843ac8bde4-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txb21a56b91b0f4fdf99fb1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txb21a56b91b0f4fdf99fb1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txb21a56b91b0f4fdf99fb1-0068c5709f) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: txb21a56b91b0f4fdf99fb1-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: txc2f6b33d61f24cd4a6070-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: txc2f6b33d61f24cd4a6070-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: txc2f6b33d61f24cd4a6070-0068c5709f) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: txc2f6b33d61f24cd4a6070-0068c5709f) test DEBUG: Node is error limited: 10.0.0.0:2000/sda (txn: tx0daf825c29e041999e44b-0068c5709f) test DEBUG: Node is error limited: 10.0.0.1:2001/sdb (txn: tx0daf825c29e041999e44b-0068c5709f) test DEBUG: Node is error limited: 10.0.0.2:2002/sdc (txn: tx0daf825c29e041999e44b-0068c5709f) test ERROR: Container GET returning 503 for (503, 503, 503) (txn: tx0daf825c29e041999e44b-0068c5709f) test INFO: Client disconnected on read of '/a/c' (txn: tx1445a4c2fb3b425ebab95-0068c5709f) test INFO: Client disconnected on read of '/a/c/' (txn: tx1445a4c2fb3b425ebab95-0068c5709f) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx295ccefdb37c4b6392600-0068c5709f) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx295ccefdb37c4b6392600-0068c5709f) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx295ccefdb37c4b6392600-0068c5709f) test ERROR: Account HEAD returning 503 for [] (txn: tx295ccefdb37c4b6392600-0068c5709f) test ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx5b998953dcf54e8293535-0068c5709f) test ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx5b998953dcf54e8293535-0068c5709f) test ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: tx5b998953dcf54e8293535-0068c5709f) test ERROR: Account HEAD returning 503 for [] (txn: tx5b998953dcf54e8293535-0068c5709f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: tx003cdc6018b342bbbceaa-0068c5709f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: txe0cbbeafbbad48fab2a55-0068c5709f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestContainerController.test_response_head_accept_ranges_header test.unit.proxy.test_mem_server.TestContainerController.test_response_head_accept_ranges_header ... ok test.unit.proxy.test_mem_server.TestContainerController.test_transfer_headers test.unit.proxy.test_mem_server.TestContainerController.test_transfer_headers ... ok test.unit.proxy.test_mem_server.TestContainerController.test_unauthorized_requests_when_account_not_found test.unit.proxy.test_mem_server.TestContainerController.test_unauthorized_requests_when_account_not_found ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter ... ok sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 7.796287536621094e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.67572021484375e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 7.200241088867188e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.4849853515625e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00018835067749023438s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.559226989746094e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.58306884765625e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.036064147949219e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.748603820800781e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.535385131835938e-05s, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp7_fib49_/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00014138221740722656s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.369850158691406e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.1552734375e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.654594421386719e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00010323524475097656s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.0108642578125e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00019550323486328125s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.726119995117188e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 7.82012939453125e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.58306884765625e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.987022399902344e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 7.200241088867188e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=True) in 7.510185241699219e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.628036499023438e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.dbtest.unit.container.test_sharder.TestSharder.test_misplaced_objects_shard_container_unsharded_limit_one test.unit.container.test_sharder.TestSharder.test_misplaced_objects_shard_container_unsharded_limit_one ... ok sharder-test WARNING: Failed to find destination for at least 2 misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Placed 2 misplaced objects (2 unplaced), path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.893013000488281e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.794929504394531e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.700920104980469e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.605552673339844e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.821487426757812e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=True) in 7.987022399902344e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.96453857421875e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.535385131835938e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0042688846588134766s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 7.772445678710938e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.937980651855469e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00010824203491210938s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.249282836914062e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.000118255615234375s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 7.462501525878906e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.369850158691406e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.320808410644531e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.177757263183594e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 7.05718994140625e-05s, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmpf4qj4jnr/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013518333435058594s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.dbtest.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter_non_slash test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter_non_slash ... ok sharder-test DEBUG: got 0 rows (deleted=True) in 0.00013756752014160156s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 9.393692016601562e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.320808410644531e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.775161743164062e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 2 rows (deleted=False) in 9.036064147949219e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00016164779663085938s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 7.343292236328125e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.606910705566406e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.748603820800781e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=True) in 7.963180541992188e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test WARNING: Failed to find destination for at least 2 misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Placed 2 misplaced objects (2 unplaced), path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.320808410644531e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 7.009506225585938e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.082389831542969e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.557868957519531e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=True) in 8.869171142578125e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 8.153915405273438e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.794929504394531e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=False) in 6.794929504394531e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.202957153320312e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Looking for misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: misplaced object source bounds [('', 'here'), ('where', '')], path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.369850158691406e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.273124694824219e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 7.82012939453125e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.dbtest.unit.container.test_sharder.TestSharder.test_misplaced_objects_shard_container_unsharded_limit_two test.unit.container.test_sharder.TestSharder.test_misplaced_objects_shard_container_unsharded_limit_two ... ok test.unit.container.test_sharder.TestSharder.test_misplaced_objects_sufficient_replication test.unit.container.test_sharder.TestSharder.test_misplaced_objects_sufficient_replication ... ok test.unit.container.test_sharder.TestSharder.test_old_style_find_shard_ranges_finds_two_root test.unit.container.test_sharder.TestSharder.test_old_style_find_shard_ranges_finds_two_root ... ok test.unit.container.test_sharder.TestSharder.test_old_style_find_shard_ranges_finds_two_shard test.unit.container.test_sharder.TestSharder.test_old_style_find_shard_ranges_finds_two_shard ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter_order_and_reverse test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter_order_and_reverse ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_json test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_json ... ok test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_unknown test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_unknown ... ok test.unit.container.test_sharder.TestSharder.test_old_style_find_shard_ranges_none_found_root test.unit.container.test_sharder.TestSharder.test_old_style_find_shard_ranges_none_found_root ... ok test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_xml test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_accept_xml ... ok test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_bad_accept test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_bad_accept ... ok test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_invalid_utf8 test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_invalid_utf8 ... ok test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_json test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_json ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter_prefix_delim ... ok test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_xml test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_format_xml ... ok test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_utf8 test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_GET_autocreate_utf8 ... ok sharder-test DEBUG: moving misplaced objects found in range ShardRange, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 8.940696716308594e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.796287536621094e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.940696716308594e-05s, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, active as of 1757769836.07887>, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Placed 2 misplaced objects (0 unplaced), path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Finished handling misplaced objects, path: .shards_a/.shard_c, db: /tmp/tmp8eczemr1/sda/containers/0/15e/acd61f6ec4bfa17987465dba0a96315e/acd61f6ec4bfa17987465dba0a96315e.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: misplaced object source bounds [('', '')], path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001728534698486328s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00017023086547851562s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.0001590251922607422s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00017261505126953125s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00018334388732910156s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.512901306152344e-05s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.894371032714844e-05s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00010704994201660156s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00010585784912109375s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00015306472778320312s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00014209747314453125s, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'here' to 'there' as of 1757769887.72210, (0, 0) as of 1757769887.72210, active as of 1757769887.72210>, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'there' to 'where' as of 1757769887.72211, (0, 0) as of 1757769887.72211, active as of 1757769887.72211>, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: moving misplaced objects found in range ShardRange<'where' to 'yonder' as of 1757769887.72212, (0, 0) as of 1757769887.72212, active as of 1757769887.72212>, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: Placed 4 misplaced objects (0 unplaced), path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpzsf67q7w/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769887.72261.db sharder-test INFO: Starting scan for shard ranges, path: a/c, db: /tmp/tmpj2nuev5x/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Completed scan for shard ranges: 2 found, path: a/c, db: /tmp/tmpj2nuev5x/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Final shard range reached., path: a/c, db: /tmp/tmpj2nuev5x/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Scan for shard ranges already completed, path: a/c, db: /tmp/tmpj2nuev5x/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: .shards_a/c_, db: /tmp/tmppohbh5wg/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Completed scan for shard ranges: 2 found, path: .shards_a/c_, db: /tmp/tmppohbh5wg/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Final shard range reached., path: .shards_a/c_, db: /tmp/tmppohbh5wg/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test DEBUG: Scan for shard ranges already completed, path: .shards_a/c_, db: /tmp/tmppohbh5wg/sda/containers/0/cce/04aa2bd2d2fcbc0614f53f00b2b85cce/04aa2bd2d2fcbc0614f53f00b2b85cce.db sharder-test INFO: Starting scan for shard ranges, path: a/c, db: /tmp/tmpxs7k745b/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: No shard ranges found, path: a/c, db: /tmp/tmpxs7k745b/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: a/c, db: /tmp/tmpxs7k745b/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: No shard ranges found, path: a/c, db: /tmp/tmpxs7k745b/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: .shards_a/c, db: /tmp/tmpr8r61e52/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_account_acl_header_access test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_account_acl_header_access ... ok test.unit.container.test_sharder.TestSharder.test_old_style_find_shard_ranges_none_found_shard test.unit.container.test_sharder.TestSharder.test_old_style_find_shard_ranges_none_found_shard ... ok proxy-ut ERROR: Object GET returning 503 for [] (txn: tx9e7d793783cc43ffb2557-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txf91d1e84b8d9455dbdcc0-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txf91d1e84b8d9455dbdcc0-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txf91d1e84b8d9455dbdcc0-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txf91d1e84b8d9455dbdcc0-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txba7f5d50f5db4ed5a09dc-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txba7f5d50f5db4ed5a09dc-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txba7f5d50f5db4ed5a09dc-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txba7f5d50f5db4ed5a09dc-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx3a332f1c10134e70b7772-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx3a332f1c10134e70b7772-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx3a332f1c10134e70b7772-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx3a332f1c10134e70b7772-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txf9289a0d6d17430f89f26-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txf9289a0d6d17430f89f26-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txf9289a0d6d17430f89f26-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txf9289a0d6d17430f89f26-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txa2b128e767fd47a08a726-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txa2b128e767fd47a08a726-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txa2b128e767fd47a08a726-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txa2b128e767fd47a08a726-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txbcb14b4f128a4009a9a13-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txbcb14b4f128a4009a9a13-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txbcb14b4f128a4009a9a13-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: txbcb14b4f128a4009a9a13-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx2347b95be65948c8b904a-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx2347b95be65948c8b904a-0068c5709e) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx2347b95be65948c8b904a-0068c5709e) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx2347b95be65948c8b904a-0068c5709e) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut WARNING: Handoff requested (5) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb proxy-ut WARNING: Handoff requested (5) proxy-ut WARNING: Handoff requested (6) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc proxy-ut DEBUG: Node is error limited: 10.0.0.3:3003/sdd proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut WARNING: Handoff requested (7) proxy-ut WARNING: Handoff requested (8) proxy-ut WARNING: Handoff requested (9) proxy-ut WARNING: Handoff requested (10) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda, error: test proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut WARNING: Handoff requested (4) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda, error: test proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2a52c807789940609f1ef-0068c5709e" "proxy-server 1824498" 0.0014 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "HEAD /sdb1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx8af4f66b8603450d9f881-0068c5709e" "proxy-server 1824498" 0.0119 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/0/a/c/test_leak_1" 201 - "PUT http://localhost/sda1/3/a/c/test_leak_1" "tx1c01d883a9184ba5ba33b-0068c5709e" "object-server 1824498" 0.0005 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/0/a/c/test_leak_1" 201 - "PUT http://localhost/sdb1/3/a/c/test_leak_1" "tx1c01d883a9184ba5ba33b-0068c5709e" "object-server 1824498" 0.0004 "-" 1824498 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sdb1/3/a/c/test_leak_1" 201 - "PUT http://localhost/v1/a/c/test_leak_1" "tx1c01d883a9184ba5ba33b-0068c5709e" "proxy-server 1824498" 0.0142 "-" 1824498 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:46 +0000] "PUT /sda1/3/a/c/test_leak_1" 201 - "PUT http://localhost/v1/a/c/test_leak_1" "tx1c01d883a9184ba5ba33b-0068c5709e" "proxy-server 1824498" 0.0235 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/46 PUT /v1/a/c/test_leak_1 HTTP/1.0 201 - - t 131072 - - tx1c01d883a9184ba5ba33b-0068c5709e - 0.0621 - - 1757769886.930458069 1757769886.992575407 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txac3a5cc792f144b2bb1c4-0068c5709f" "proxy-server 1824498" 0.0075 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "HEAD /sda1/0/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx19c7afa492b543f782e35-0068c5709f" "proxy-server 1824498" 0.0142 "-" 1824498 0test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_account_acls_through_delegation test.unit.proxy.test_server.TestAccountControllerFakeGetResponse.test_account_acls_through_delegation ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter_with_reserved_name test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_list_objects_iter_with_reserved_name ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_load_old_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_load_old_record_from_pending_file ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_make_tuple_for_pickle test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_make_tuple_for_pickle ... ok test INFO: Client disconnected on read of '/a/c' (txn: txfb9996725cea41bf94372-0068c5709f) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmp4f9g28ic/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp4f9g28ic/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmp4f9g28ic/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmp4f9g28ic/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0074 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0073 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0029 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0027 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx608ac61435294861920a0-0068c5709f" "proxy-server 1824535" 0.0053 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a/c" "tx608ac61435294861920a0-0068c5709f" "container-server 1824535" 0.0022 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:38699/sda1/1/a/c" "tx608ac61435294861920a0-0068c5709f" "container-server 1824535" 0.0011 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx608ac61435294861920a0-0068c5709f" "proxy-server 1824535" 0.0227 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx608ac61435294861920a0-0068c5709f" "proxy-server 1824535" 0.0316 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/47 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx608ac61435294861920a0-0068c5709f - 0.0471 - - 1757769887.623835325 1757769887.670908213 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "HEAD /sdb1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx7243fad170a741a8acfc6-0068c5709f" "proxy-server 1824535" 0.0053 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a1/c1" "tx7243fad170a741a8acfc6-0068c5709f" "container-server 1824535" 0.0011 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:38699/sda1/1/a1/c1" "tx7243fad170a741a8acfc6-0068c5709f" "container-server 1824535" 0.0051 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx7243fad170a741a8acfc6-0068c5709f" "proxy-server 1824535" 0.0253 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx7243fad170a741a8acfc6-0068c5709f" "proxy-server 1824535" 0.0383 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/47 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx7243fad170a741a8acfc6-0068c5709f - 0.0492 - - 1757769887.672305584 1757769887.721518755 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa148ccc12e7e424baee63-0068c5709f" "proxy-server 1824535" 0.0018 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/c1" "txa148ccc12e7e424baee63-0068c5709f" "container-server 1824535" 0.0051 "-" 1824535 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/c1" "txa148ccc12e7e424baee63-0068c5709f" "container-server 1824535" 0.0016 "-" 1824535 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txa148ccc12e7e424baee63-0068c5709f" "proxy-server 1824535" 0.0296 "-" 1824535 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txa148ccc12e7e424baee63-0068c5709f" "proxy-server 1824535" 0.0221 "-" 1824535 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/47 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - txa148ccc12e7e424baee63-0068c5709f - 0.0423 - - 1757769887.726958990 1757769887.769238949 1 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb5b409d47df249f8a64fc-0068c5709f" "proxy-server 1824535" 0.0077 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:38699/sda1/1/a/c2" "txb5b409d47df249f8a64fc-0068c5709f" "container-server 1824535" 0.0016 "-" 1824535 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a/c2" "txb5b409d47df249f8a64fc-0068c5709f" "container-server 1824535" 0.0009 "-" 1824535 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txb5b409d47df249f8a64fc-0068c5709f" "proxy-server 1824535" 0.0229 "-" 1824535 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txb5b409d47df249f8a64fc-0068c5709f" "proxy-server 1824535" 0.0196 "-" 1824535 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/47 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txb5b409d47df249f8a64fc-0068c5709f - 0.0457 - - 1757769887.770502806 1757769887.816162348 2 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx261371701e86469798256-0068c5709f" "proxy-server 1824535" 0.0103 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "tx261371701e86469798256-0068c5709f" "container-server 1824535" 0.0010 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "tx261371701e86469798256-0068c5709f" "container-server 1824535" 0.0058 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/ec" 201 - "PUT http://localhost/v1/a/ec" "tx261371701e86469798256-0068c5709f" "proxy-server 1824535" 0.0213 "-" 1824535 3test.unit.proxy.test_server.TestECObjectController.test_GET_ec test.unit.proxy.test_server.TestECObjectController.test_GET_ec ... ok test.unit.container.test_sharder.TestSharder.test_one_shard_cycle test.unit.container.test_sharder.TestSharder.test_one_shard_cycle ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items ... ok sharder-test WARNING: No shard ranges found, path: .shards_a/c, db: /tmp/tmpr8r61e52/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: .shards_a/c, db: /tmp/tmpr8r61e52/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: No shard ranges found, path: .shards_a/c, db: /tmp/tmpr8r61e52/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test WARNING: Skipping xxxx as it is not mounted sharder-test INFO: Since Sun Sep 14 03:24:47 2025 visited - attempted:2 success:2 failure:0 skipped:1 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test WARNING: Skipping xxxx as it is not mounted sharder-test ERROR: Unhandled exception while processing: kapow!, path: a/c1, db: /tmp/tmp2rdxdxds/sdb/containers/0/ash/c1hash/c1hash.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 2507, in _one_shard_cycle self._process_broker(broker, node, part) ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1234, in _execute_mock_call result = effect(*args, **kwargs) File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sharder.py", line 883, in mock_processing raise Exception('kapow!') Exception: kapow! sharder-test INFO: Since Sun Sep 14 03:24:47 2025 visited - attempted:3 success:2 failure:1 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test WARNING: Skipping xxxx as it is not mounted sharder-test INFO: Since Sun Sep 14 03:24:47 2025 visited - attempted:3 success:3 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test WARNING: Skipping xxxx as it is not mounted sharder-test INFO: Since Sun Sep 14 03:24:47 2025 visited - attempted:3 success:3 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:47 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test DEBUG: Unlinked retiring db '/tmp/tmp2rdxdxds/sda/containers/0/ash/c0hash/c0hash.db' sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test WARNING: Skipping xxxx as it is not mounted sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:3 success:3 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test WARNING: Skipping xxxx as it is not mounted sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:3 success:3 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test WARNING: Skipping xxxx as it is not mounted sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:3 success:3 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: Found no containers directories sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0test.unit.container.test_sharder.TestSharder.test_one_shard_cycle_no_containers test.unit.container.test_sharder.TestSharder.test_one_shard_cycle_no_containers ... ok test.unit.proxy.test_server.TestECObjectController.test_GET_ec_404 test.unit.proxy.test_server.TestECObjectController.test_GET_ec_404 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items_is_green test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items_is_green ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items_overwrite test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items_overwrite ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/ec" 201 - "PUT http://localhost/v1/a/ec" "tx261371701e86469798256-0068c5709f" "proxy-server 1824535" 0.0374 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/ec HTTP/1.0 201 - - t - - - tx261371701e86469798256-0068c5709f - 0.0538 - - 1757769887.962676287 1757769888.016520500 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx01204f497f4e4c51a6b48-0068c570a0" "proxy-server 1824535" 0.0019 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx0e83126a00db4ac0bb619-0068c570a0" "proxy-server 1824535" 0.0012 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdh1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "tx53c21f6951f2443fb51e8-0068c570a0" "proxy-server 1824535" 0.0221 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/ec/go-get-it" 201 - "PUT http://localhost/sdg1/3/a/ec/go-get-it" "tx53c21f6951f2443fb51e8-0068c570a0" "object-server 1824535" 0.0006 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/ec/go-get-it" 201 - "PUT http://localhost/sdi1/3/a/ec/go-get-it" "tx53c21f6951f2443fb51e8-0068c570a0" "object-server 1824535" 0.0004 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdi1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "tx53c21f6951f2443fb51e8-0068c570a0" "proxy-server 1824535" 0.0336 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdg1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "tx53c21f6951f2443fb51e8-0068c570a0" "proxy-server 1824535" 0.0351 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/ec/go-get-it HTTP/1.0 201 - - t 1309 - - tx53c21f6951f2443fb51e8-0068c570a0 - 0.0816 - - 1757769888.017891884 1757769888.099537373 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3ec555c4fb714a8ea2e40-0068c570a0" "proxy-server 1824535" 0.0055 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx56dd38f0d0ce4cd3a02b9-0068c570a0" "proxy-server 1824535" 0.0024 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdh1/3/a/ec/go-get-it" 200 736 "GET http://localhost/v1/a/ec/go-get-it" "tx78bd0ad2587d4fd2ae1b0-0068c570a0" "proxy-server 1824535" 0.0007 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdg1/3/a/ec/go-get-it" 200 736 "GET http://localhost/v1/a/ec/go-get-it" "tx78bd0ad2587d4fd2ae1b0-0068c570a0" "proxy-server 1824535" 0.0007 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 GET /v1/a/ec/go-get-it HTTP/1.0 200 - - t - 1309 - tx78bd0ad2587d4fd2ae1b0-0068c570a0 - 0.0332 - - 1757769888.100972652 1757769888.134158373 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx20b066af36704022883ae-0068c570a0" "proxy-server 1824535" 0.0055 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "tx20b066af36704022883ae-0068c570a0" "container-server 1824535" 0.0018 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx20b066af36704022883ae-0068c570a0" "proxy-server 1824535" 0.0153 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "tx20b066af36704022883ae-0068c570a0" "container-server 1824535" 0.0010 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx20b066af36704022883ae-0068c570a0" "proxy-server 1824535" 0.0241 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx20b066af36704022883ae-0068c570a0 - 0.0398 - - 1757769888.140225172 1757769888.180000305 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx655966d0b9154951b441d-0068c570a0" "proxy-server 1824535" 0.0020 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx347e1d766d8546b395369-0068c570a0" "proxy-server 1824535" 0.0012 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdi1/2/a/ec/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec/yes-we-have-no-bananas" "tx05bc47ffd3ad4a688eb64-0068c570a0" "proxy-server 1824535" 0.0003 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdg1/2/a/ec/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec/yes-we-have-no-bananas" "tx05bc47ffd3ad4a688eb64-0068c570a0" "proxy-server 1824535" 0.0003 "-" 1824535 3 proxy DEBUG: Ignoring 404 from primary (txn: tx05bc47ffd3ad4a688eb64-0068c570a0) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: tx05bc47ffd3ad4a688eb64-0068c570a0) (client_ip: 127.0.0.1) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdh1/2/a/ec/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec/yes-we-have-no-bananas" "tx05bc47ffd3ad4a688eb64-0068c570a0" "proxy-server 1824535" 0.0003 "-" 1824535 3 proxy DEBUG: Ignoring 404 from primary (txn: tx05bc47ffd3ad4a688eb64-0068c570a0) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 GET /v1/a/ec/yes-we-have-no-bananas HTTP/1.0 404 - - t - 70 - tx05bc47ffd3ad4a688eb64-0068c570a0 - 0.0374 - - 1757769888.181360245 1757769888.218807220 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx023566701a7a4e718356e-0068c570a0" "proxy-server 1824535" 0.0054 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "tx023566701a7a4e718356e-0068c570a0" "container-server 1824535" 0.0018 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "tx023566701a7a4e718356e-0068c570a0" "container-server 1824535" 0.0011 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx023566701a7a4e718356e-0068c570a0" "proxy-server 1824535" 0.0156 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx023566701a7a4e718356e-0068c570a0" "proxy-server 1824535" 0.0188 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx023566701a7a4e718356e-0068c570a0 - 0.0340 - - 1757769888.220544577 1757769888.254588604 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3fbbef4e48a741118fc93-0068c570a0" "proxy-server 1824535" 0.0061 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx4cef79adfcc745348138a-0068c570a0" "proxy-server 1824535" 0.0054 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/ec/big-obj-get" 201 - "PUT http://localhost/sdh1/3/a/ec/big-obj-get" "tx6937c5b077054d5b87e88-0068c570a0" "object-server 1824535" 0.0005 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/ec/big-obj-get" 201 - "PUT http://localhost/sdi1/3/a/ec/big-obj-get" "tx6937c5b077054d5b87e88-0068c570a0" "object-server 1824535" 0.0004 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdh1/3/a/ec/big-obj-get" 201 - "PUT http://localhost/v1/a/ec/big-obj-get" "tx6937c5b077054d5b87e88-0068c570a0" "proxy-server 1824535" 0.0298 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdi1/3/a/ec/big-obj-get" 201 - "PUT http://localhost/v1/a/ec/big-obj-get" "tx6937c5b077054d5b87e88-0068c570a0" "proxy-server 1824535" 0.0260 "-" 1824535 3test.unit.proxy.test_server.TestECObjectController.test_GET_ec_big test.unit.proxy.test_server.TestECObjectController.test_GET_ec_big ... ok sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Begin container sharder "once" mode sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:3 success:3 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' sharder-test INFO: Container sharder "once" mode completed: 0.05s sharder-test INFO: Begin container sharder "once" mode sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: (Override partitions: 0) sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:1 success:1 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' sharder-test INFO: Container sharder "once" mode completed: 0.01s sharder-test INFO: Begin container sharder "once" mode sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: (Override partitions: 2, 0) sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:2 success:2 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' sharder-test INFO: Container sharder "once" mode completed: 0.02s sharder-test INFO: Begin container sharder "once" mode sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: (Override devices: sdc) sharder-test INFO: (Override partitions: 2, 0) sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:1 success:1 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon'test.unit.container.test_sharder.TestSharder.test_partition_and_device_filters test.unit.container.test_sharder.TestSharder.test_partition_and_device_filters ... ok test.unit.container.test_sharder.TestSharder.test_periodic_warning test.unit.container.test_sharder.TestSharder.test_periodic_warning ... ok test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharding_container_gap_in_shards_with_memcache test.unit.proxy.controllers.test_container.TestGetShardedContainer.test_GET_sharding_container_gap_in_shards_with_memcache ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items_overwrite_unicode test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items_overwrite_unicode ... ok test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_pie?end_marker=pie%00&format=json&limit=9960&marker=h {'X-Backend-Record-Type': 'auto'} (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Found 8 objects in shard (state=unsharded), total = 48 (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_☃', lower='pie', upper='☃') .shards_a/c_☃ with {'X-Backend-Record-Type': 'auto'} (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%E2%98%83?end_marker=%E2%98%83%00&format=json&limit=9952&marker=p {'X-Backend-Record-Type': 'auto'} (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1072 (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Getting listing part 3 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?end_marker=%E2%98%8A&format=json&limit=8928&marker=%D1%B0 {'X-Backend-Record-Type': 'auto'} (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test DEBUG: Found 6 objects in shard (state=unsharded), total = 1078 (txn: tx1deaecad272e45a3ba1ca-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx0dd3805e0aac4724b0f4b-0068c5709c) test DEBUG: GET listing from 5 shards for: /v1/a/c?prefix=hat&format=json&states=listing (txn: tx0dd3805e0aac4724b0f4b-0068c5709c) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='ham', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx0dd3805e0aac4724b0f4b-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_pie?prefix=hat&format=json&limit=10000&marker=&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx0dd3805e0aac4724b0f4b-0068c5709c) test DEBUG: Found 0 objects in shard (state=unsharded), total = 0 (txn: tx0dd3805e0aac4724b0f4b-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx85e1f7e8a8c34b6a9a4bd-0068c5709c) test DEBUG: GET listing from 1 shards for: /v1/a/c?marker=%E2%98%86&end_marker=%E2%98%8A&limit=2&format=json&states=listing (txn: tx85e1f7e8a8c34b6a9a4bd-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx85e1f7e8a8c34b6a9a4bd-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%86&end_marker=%E2%98%8A&limit=2&format=json {'X-Backend-Record-Type': 'auto'} (txn: tx85e1f7e8a8c34b6a9a4bd-0068c5709c) test DEBUG: Found 4 objects in shard (state=unsharded), total = 4 (txn: tx85e1f7e8a8c34b6a9a4bd-0068c5709c) test INFO: Caching listing namespaces for shard-listing-v2/a/c (5 namespaces) (txn: tx4754139a053b43f1b49ba-0068c5709c) test DEBUG: GET listing from 1 shards for: /v1/a/c?marker=%E2%98%8A&end_marker=%E2%98%86&limit=2&reverse=true&format=json&states=listing (txn: tx4754139a053b43f1b49ba-0068c5709c) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_🌴', lower='☃', upper='🌴') .shards_a/c_🌴 with {'X-Backend-Record-Type': 'auto'} (txn: tx4754139a053b43f1b49ba-0068c5709c) test DEBUG: Get listing from /v1/.shards_a/c_%F0%9F%8C%B4?marker=%E2%98%8A&end_marker=%E2%98%86&limit=2&reverse=true&format=json {'X-Backend-Record-Type': 'auto'} (txn: tx4754139a053b43f1b49ba-0068c5709c) test DEBUG: Found 4 objects in shard (state=unsharded), total = 4 (txn: tx4754139a053b43f1b49ba-0068c5709c) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_b', lower='a', upper='b') .shards_a/c_b with {'X-Backend-Record-Type': 'auto'} (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test DEBUG: Get listing from /v1/.shards_a/c_b?format=json&limit=10000&marker=&end_marker=b%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test DEBUG: Found 1 objects in shard (state=unsharded), total = 1 (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_c', lower='b', upper='c') .shards_a/c_c with {'X-Backend-Record-Type': 'auto'} (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test DEBUG: Get listing from /v1/.shards_a/c_c?format=json&limit=9999&marker=b&end_marker=c%00 {'X-Backend-Record-Type': 'auto'} (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test DEBUG: Found 1 objects in shard (state=unsharded), total = 2 (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='c', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9998&marker=c&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test WARNING: Failed to get container auto listing from /v1/.shards_a/c_?format=json&limit=9998&marker=c&end_marker=&states=listing: 404 (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test ERROR: Aborting listing from shards due to bad response: [200, 200, 404] (txn: tx7bb80364c70642c4bf4b3-0068c5709e) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: GET listing from 3 shards for: /v1/a/c?format=json&states=listing (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Getting listing part 0 from shard Namespace(name='.shards_a/c_ham', lower='', upper='ham') .shards_a/c_ham with {'X-Backend-Record-Type': 'auto'} (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Get listing from /v1/.shards_a/c_ham?format=json&limit=10000&marker=&end_marker=ham%00 {'X-Backend-Record-Type': 'auto'} (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Found 40 objects in shard (state=unsharded), total = 40 (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Getting listing part 1 from shard Namespace(name='.shards_a/c_pie', lower='onion', upper='pie') .shards_a/c_pie with {'X-Backend-Record-Type': 'auto'} (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Get listing from /v1/.shards_a/c_pie?format=json&limit=9960&marker=h&end_marker=pie%00 {'X-Backend-Record-Type': 'auto'} (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Found 1 objects in shard (state=unsharded), total = 41 (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Getting listing part 2 from shard Namespace(name='.shards_a/c_', lower='rhubarb', upper='') .shards_a/c_ with {'X-Backend-Record-Type': 'auto'} (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Get listing from /v1/.shards_a/c_?format=json&limit=9959&marker=p&end_marker= {'X-Backend-Record-Type': 'auto'} (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Found 1024 objects in shard (state=unsharded), total = 1065 (txn: tx3adc63e419f247afaa0b1-0068c570a0) test DEBUG: Setting object count to 1065 (txn: tx3adc63e419f247afaa0b1-0068c570a0) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_cache_not_available test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_cache_not_available ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_cache_reading test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_cache_reading ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_cache_recheck_time_zero test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_cache_recheck_time_zero ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_cache_writing test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_cache_writing ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_empty_body test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacyUTF8.test_get_update_shard_empty_body ... ok test.unit.proxy.test_server.TestECObjectController.test_GET_ec_deleted test.unit.proxy.test_server.TestECObjectController.test_GET_ec_deleted ... ok sharder-test INFO: Container sharder "once" mode completed: 0.01s sharder-test INFO: Begin container sharder "once" mode sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: (Override devices: sdb, sdc) sharder-test INFO: Since Sun Sep 14 03:24:48 2025 visited - attempted:2 success:2 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:48 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/container.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/container.recon' sharder-test INFO: Container sharder "once" mode completed: 0.03s sharder-test WARNING: periodic warning 1, path: a/c1, db: /tmp/tmpm8dpwts7/sda/containers/0/8b9/a9f7e97965d6cf799a529102a973b8b9/a9f7e97965d6cf799a529102a973b8b9.db sharder-test WARNING: periodic warning 1a, path: a/c1, db: /tmp/tmpm8dpwts7/sda/containers/0/8b9/a9f7e97965d6cf799a529102a973b8b9/a9f7e97965d6cf799a529102a973b8b9.db sharder-test WARNING: periodic warning 2, path: a/c2, db: /tmp/tmpm8dpwts7/sda/containers/0/229/9ab62b5ef34a985438bfdf7ee0102229/9ab62b5ef34a985438bfdf7ee0102229.db sharder-test WARNING: normal warning, path: a/c1, db: /tmp/tmpm8dpwts7/sda/containers/0/8b9/a9f7e97965d6cf799a529102a973b8b9/a9f7e97965d6cf799a529102a973b8b9.db sharder-test WARNING: periodic warning 1, path: a/c1, db: /tmp/tmpm8dpwts7/sda/containers/0/8b9/a9f7e97965d6cf799a529102a973b8b9/a9f7e97965d6cf799a529102a973b8b9.db sharder-test WARNING: periodic warning 1a, path: a/c1, db: /tmp/tmpm8dpwts7/sda/containers/0/8b9/a9f7e97965d6cf799a529102a973b8b9/a9f7e97965d6cf799a529102a973b8b9.db sharder-test WARNING: periodic warning 2, path: a/c2, db: /tmp/tmpm8dpwts7/sda/containers/0/229/9ab62b5ef34a985438bfdf7ee0102229/9ab62b5ef34a985438bfdf7ee0102229.db sharder-test WARNING: normal warning, path: a/c1, db: /tmp/tmpm8dpwts7/sda/containers/0/8b9/a9f7e97965d6cf799a529102a973b8b9/a9f7e97965d6cf799a529102a973b8b9.db sharder-test WARNING: periodic warning 1, path: a/c1, db: /tmp/tmpm8dpwts7/sda/containers/0/8b9/a9f7e97965d6cf799a529102a973b8b9/a9f7e97965d6cf799a529102a973b8b9.db sharder-test WARNING: periodic warning 1a, path: a/c1, db: /tmp/tmpm8dpwts7/sda/containers/0/8b9/a9f7e97965d6cf799a529102a973b8b9/a9f7e97965d6cf799a529102a973b8b9.db sharder-test WARNING: periodic warning 2, path: a/c2, db: /tmp/tmpm8dpwts7/sda/containers/0/229/9ab62b5ef34a985438bfdf7ee0102229/9ab62b5ef34a985438bfdf7ee0102229.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Identified 1 sharding candidates, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Starting scan for shard ranges, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test INFO: Completed scan for shard ranges: 2 found, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test INFO: Final shard range reached., path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test INFO: Stopped cleave at unready ShardRange, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.dbtest.unit.container.test_sharder.TestSharder.test_process_broker_leader_auto_shard test.unit.container.test_sharder.TestSharder.test_process_broker_leader_auto_shard ... ok test.unit.container.test_sharder.TestSharder.test_process_broker_leader_auto_shard_deleted_db test.unit.container.test_sharder.TestSharder.test_process_broker_leader_auto_shard_deleted_db ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_leak_1 test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_leak_1 ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_mismatched_etags test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_mismatched_etags ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items_post_overwrite_out_of_order test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_items_post_overwrite_out_of_order ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdg1/3/a/ec/big-obj-get" 201 - "PUT http://localhost/v1/a/ec/big-obj-get" "tx6937c5b077054d5b87e88-0068c570a0" "proxy-server 1824535" 0.0386 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/ec/big-obj-get HTTP/1.0 201 - - t 10400 - - tx6937c5b077054d5b87e88-0068c570a0 - 0.0727 - - 1757769888.260220528 1757769888.332949877 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb098ed16293d4c4fb45bb-0068c570a0" "proxy-server 1824535" 0.0021 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx11027ba2551e4de2b90ee-0068c570a0" "proxy-server 1824535" 0.0072 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdi1/3/a/ec/big-obj-get" 200 5440 "GET http://localhost/v1/a/ec/big-obj-get" "txdea76ae613f0447595147-0068c570a0" "proxy-server 1824535" 0.0008 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdg1/3/a/ec/big-obj-get" 200 5440 "GET http://localhost/v1/a/ec/big-obj-get" "txdea76ae613f0447595147-0068c570a0" "proxy-server 1824535" 0.0007 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 GET /v1/a/ec/big-obj-get HTTP/1.0 200 - - t - 10400 - txdea76ae613f0447595147-0068c570a0 - 0.0358 - - 1757769888.334324598 1757769888.370077610 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf85ff06592ba4cad952bc-0068c570a0" "proxy-server 1824535" 0.0056 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/ec_deleted" 201 - "PUT http://127.0.0.1:38699/sda1/1/a/ec_deleted" "txf85ff06592ba4cad952bc-0068c570a0" "container-server 1824535" 0.0010 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/ec_deleted" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a/ec_deleted" "txf85ff06592ba4cad952bc-0068c570a0" "container-server 1824535" 0.0010 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/ec_deleted" 201 - "PUT http://localhost/v1/a/ec_deleted" "txf85ff06592ba4cad952bc-0068c570a0" "proxy-server 1824535" 0.0206 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/ec_deleted" 201 - "PUT http://localhost/v1/a/ec_deleted" "txf85ff06592ba4cad952bc-0068c570a0" "proxy-server 1824535" 0.0297 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/ec_deleted HTTP/1.0 201 - - t - - - txf85ff06592ba4cad952bc-0068c570a0 - 0.0413 - - 1757769888.376059294 1757769888.417382956 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txff4dbfe5e0224c839b038-0068c570a0" "proxy-server 1824535" 0.0019 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/ec_deleted" 204 - "DELETE http://127.0.0.1:44669/sdb1/1/a/ec_deleted" "txff4dbfe5e0224c839b038-0068c570a0" "container-server 1824535" 0.0016 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/ec_deleted" 204 - "DELETE http://127.0.0.1:38699/sda1/1/a/ec_deleted" "txff4dbfe5e0224c839b038-0068c570a0" "container-server 1824535" 0.0010 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "DELETE /sda1/1/a/ec_deleted" 204 - "DELETE http://localhost/v1/a/ec_deleted" "txff4dbfe5e0224c839b038-0068c570a0" "proxy-server 1824535" 0.0276 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "DELETE /sdb1/1/a/ec_deleted" 204 - "DELETE http://localhost/v1/a/ec_deleted" "txff4dbfe5e0224c839b038-0068c570a0" "proxy-server 1824535" 0.0167 "-" 1824535 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 DELETE /v1/a/ec_deleted HTTP/1.0 204 - - - - - - txff4dbfe5e0224c839b038-0068c570a0 - 0.0445 - - 1757769888.422805786 1757769888.467282534 - - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7ec6d4a035864d2abbb22-0068c570a0" "proxy-server 1824535" 0.0062 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/1/a/ec_deleted" 404 - "HEAD http://localhost/v1/a/ec_deleted" "tx405f53392c1a4c34b12b2-0068c570a0" "proxy-server 1824535" 0.0011 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a/ec_deleted" 404 - "HEAD http://localhost/v1/a/ec_deleted" "tx405f53392c1a4c34b12b2-0068c570a0" "proxy-server 1824535" 0.0053 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdh1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "txb87ac8b56f494437b983f-0068c570a0" "proxy-server 1824535" 0.0004 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdi1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "txb87ac8b56f494437b983f-0068c570a0" "proxy-server 1824535" 0.0003 "-" 1824535 3 proxy DEBUG: Ignoring 404 from primary (txn: txb87ac8b56f494437b983f-0068c570a0) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: txb87ac8b56f494437b983f-0068c570a0) (client_ip: 127.0.0.1) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdg1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "txb87ac8b56f494437b983f-0068c570a0" "proxy-server 1824535" 0.0003 "-" 1824535 3 proxy DEBUG: Ignoring 404 from primary (txn: txb87ac8b56f494437b983f-0068c570a0) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 GET /v1/a/ec_deleted/no-object-there HTTP/1.0 404 - - t - 70 - txb87ac8b56f494437b983f-0068c570a0 - 0.0407 - - 1757769888.468624592 1757769888.509313583 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx64feedc447634396a9b19-0068c570a0" "proxy-server 1824535" 0.0063 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "tx64feedc447634396a9b19-0068c570a0" "container-server 1824535" 0.0011 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx64feedc447634396a9b19-0068c570a0" "proxy-server 1824535" 0.0230 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "tx64feedc447634396a9b19-0068c570a0" "container-server 1824535" 0.0010 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx64feedc447634396a9b19-0068c570a0" "proxy-server 1824535" 0.0261 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx64feedc447634396a9b19-0068c570a0 - 0.0449 - - 1757769888.515274048 1757769888.560124159 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5878a6081e584ea38c59b-0068c570a0" "proxy-server 1824535" 0.0020 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txd73be96a5b044f4481b23-0068c570a0" "proxy-server 1824535" 0.0013 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdh1/1/a/ec/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec/crash-test-dummy" "tx7372b73be9044bc8bb20e-0068c570a0" "proxy-server 1824535" 0.0184 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/ec/crash-test-dummy" 201 - "PUT http://localhost/sdi1/1/a/ec/crash-test-dummy" "tx7372b73be9044bc8bb20e-0068c570a0" "object-server 1824535" 0.0004 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/ec/crash-test-dummy" 201 - "PUT http://localhost/sdg1/1/a/ec/crash-test-dummy" "tx7372b73be9044bc8bb20e-0068c570a0" "object-server 1824535" 0.0004 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdg1/1/a/ec/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec/crash-test-dummy" "tx7372b73be9044bc8bb20e-0068c570a0" "proxy-server 1824535" 0.0283 "-" 1824535 3test.unit.proxy.test_server.TestECObjectController.test_GET_ec_failure_handling test.unit.proxy.test_server.TestECObjectController.test_GET_ec_failure_handling ... ok proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=%E1%88%B41_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txd58e0e8fadca4fbea23f8-0068c570a0) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Problem with container shard listing response from /v1/a/c?format=json&states=updating: JSONDecodeError('Expecting value: line 1 column 1 (char 0)') (txn: tx85eaadd5a5bf40dcac352-0068c570a0) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmppi9w93oh/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmppi9w93oh/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmppi9w93oh/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmppi9w93oh/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0072 "-" 1824541 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0028 "-" 1824541 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0026 "-" 1824541 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0068 "-" 1824541 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb6ee7a5c904340fa9ed3b-0068c570a0" "proxy-server 1824541" 0.0053 "-" 1824541 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:43637/sda1/1/a/c" "txb6ee7a5c904340fa9ed3b-0068c570a0" "container-server 1824541" 0.0010 "-" 1824541 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:54499/sdb1/1/a/c" "txb6ee7a5c904340fa9ed3b-0068c570a0" "container-server 1824541" 0.0010 "-" 1824541 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "txb6ee7a5c904340fa9ed3b-0068c570a0" "proxy-server 1824541" 0.0287 "-" 1824541 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "txb6ee7a5c904340fa9ed3b-0068c570a0" "proxy-server 1824541" 0.0172 "-" 1824541 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/c HTTP/1.0 201 - - t - - - txb6ee7a5c904340fa9ed3b-0068c570a0 - 0.0406 - - 1757769888.560587406 1757769888.601187468 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx715a3f37de6241459d03d-0068c570a0" "proxy-server 1824541" 0.0012 "-" 1824541 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:54499/sdb1/1/a1/c1" "tx715a3f37de6241459d03d-0068c570a0" "container-server 1824541" 0.0011 "-" 1824541 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:43637/sda1/1/a1/c1" "tx715a3f37de6241459d03d-0068c570a0" "container-server 1824541" 0.0010 "-" 1824541 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx715a3f37de6241459d03d-0068c570a0" "proxy-server 1824541" 0.0343 "-" 1824541 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx715a3f37de6241459d03d-0068c570a0" "proxy-server 1824541" 0.0432 "-" 1824541 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx715a3f37de6241459d03d-0068c570a0 - 0.0587 - - 1757769888.602560759 1757769888.661238432 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx79cbb85d41ff43acadf29-0068c570a0" "proxy-server 1824541" 0.0019 "-" 1824541 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:43637/sda1/2/a/c1" "tx79cbb85d41ff43acadf29-0068c570a0" "container-server 1824541" 0.0092 "-" 1824541 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:54499/sdb1/2/a/c1" "tx79cbb85d41ff43acadf29-0068c570a0" "container-server 1824541" 0.0016 "-" 1824541 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx79cbb85d41ff43acadf29-0068c570a0" "proxy-server 1824541" 0.0371 "-" 1824541 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx79cbb85d41ff43acadf29-0068c570a0" "proxy-server 1824541" 0.0322 "-" 1824541 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx79cbb85d41ff43acadf29-0068c570a0 - 0.0687 - - 1757769888.662581205 1757769888.731242180 1 -/usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_mem_server.TestProxyServer.test_adds_transaction_id test.unit.proxy.test_mem_server.TestProxyServer.test_adds_transaction_id ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_adds_transaction_id_length_limit test.unit.proxy.test_mem_server.TestProxyServer.test_adds_transaction_id_length_limit ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_calls_authorize_allow test.unit.proxy.test_mem_server.TestProxyServer.test_calls_authorize_allow ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_calls_authorize_deny test.unit.proxy.test_mem_server.TestProxyServer.test_calls_authorize_deny ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_check_response_200 test.unit.proxy.test_mem_server.TestProxyServer.test_check_response_200 ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_check_response_503 test.unit.proxy.test_mem_server.TestProxyServer.test_check_response_503 ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_check_response_507 test.unit.proxy.test_mem_server.TestProxyServer.test_check_response_507 ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_denied_host_header test.unit.proxy.test_mem_server.TestProxyServer.test_denied_host_header ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_error_limit_methods test.unit.proxy.test_mem_server.TestProxyServer.test_error_limit_methods ... ok sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmp5xi_xewn/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769888.42557.db sharder-test DEBUG: Starting processing, state unsharded (deleted), path: a/c, db: /tmp/tmp2iptdgty/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2iptdgty/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2iptdgty/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2iptdgty/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded (deleted), path: a/c, db: /tmp/tmp2iptdgty/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Own shard range in state 'shrinking' but no shard ranges and not leader; remaining unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Own shard range in state 'sharding' but no shard ranges and not leader; remaining unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_sharder.TestSharder.test_process_broker_not_sharding_no_others test.unit.container.test_sharder.TestSharder.test_process_broker_not_sharding_no_others ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_shard_range_single_record test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_shard_range_single_record ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_error_occurred test.unit.proxy.test_mem_server.TestProxyServer.test_error_occurred ... ok sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Own shard range in state 'sharded' but no shard ranges and not leader; remaining unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Own shard range in state 'shrunk' but no shard ranges and not leader; remaining unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp5mhdblr_/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Container 'a/c' cannot be set to sharding state: missing epoch sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Container 'a/c' cannot be set to sharding state: missing epoch sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_sharder.TestSharder.test_process_broker_not_sharding_others test.unit.container.test_sharder.TestSharder.test_process_broker_not_sharding_others ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd6cf93854a1b44b48273b-0068c570a0" "proxy-server 1824541" 0.0019 "-" 1824541 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:54499/sdb1/1/a/c2" "txd6cf93854a1b44b48273b-0068c570a0" "container-server 1824541" 0.0016 "-" 1824541 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:43637/sda1/1/a/c2" "txd6cf93854a1b44b48273b-0068c570a0" "container-server 1824541" 0.0010 "-" 1824541 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txd6cf93854a1b44b48273b-0068c570a0" "proxy-server 1824541" 0.0115 "-" 1824541 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txd6cf93854a1b44b48273b-0068c570a0" "proxy-server 1824541" 0.0203 "-" 1824541 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txd6cf93854a1b44b48273b-0068c570a0 - 0.0365 - - 1757769888.738181114 1757769888.774728298 2 - test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to PUT /v1/a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR 503 full Trying to GET /v1/a/c/o From Object Server 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage test DEBUG: Node is error limited: 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage test DEBUG: Node is error limited: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: test msg 10.0.0.0:1000/sda test ERROR: ERROR with test1 server 10.0.0.0:1000/sda re: test1 msg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1296, in test_error_limit_methods raise Exception('kaboom1!') Exception: kaboom1! test WARNING: ERROR with test2 server 10.0.0.0:1000/sda re: test2 msg Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1310, in test_error_limit_methods raise Exception('kaboom2!') Exception: kaboom2! test WARNING: ERROR with test3 server 10.0.0.0:1000/sda re: test3 msg Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1325, in test_error_limit_methods raise Exception('kaboom3!') Exception: kaboom3! test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test ERROR: succès 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test ERROR: success 10.0.0.0:1000/sda test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: succès: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1!test.unit.proxy.test_mem_server.TestProxyServer.test_exception_occurred test.unit.proxy.test_mem_server.TestProxyServer.test_exception_occurred ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_exception_occurred_replication_ip_port_logging test.unit.proxy.test_mem_server.TestProxyServer.test_exception_occurred_replication_ip_port_logging ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_get_info_controller test.unit.proxy.test_mem_server.TestProxyServer.test_get_info_controller ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_get_object_ring test.unit.proxy.test_mem_server.TestProxyServer.test_get_object_ring ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_inexistent_method_request test.unit.proxy.test_mem_server.TestProxyServer.test_inexistent_method_request ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_info_defaults test.unit.proxy.test_mem_server.TestProxyServer.test_info_defaults ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_internal_method_request test.unit.proxy.test_mem_server.TestProxyServer.test_internal_method_request ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_internal_reserved_name_request test.unit.proxy.test_mem_server.TestProxyServer.test_internal_reserved_name_request ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_negative_content_length test.unit.proxy.test_mem_server.TestProxyServer.test_negative_content_length ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_first_two_time_out_etags_match test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_first_two_time_out_etags_match ... ok test.unit.proxy.test_server.TestECObjectController.test_GET_pipeline test.unit.proxy.test_server.TestECObjectController.test_GET_pipeline ... ok sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Container 'a/c' cannot be set to sharding state: missing epoch sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Container 'a/c' cannot be set to sharding state: missing epoch sharder-test DEBUG: Finished processing, state unsharded, path: a/c, db: /tmp/tmp2itoj_or/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False.db sharder-test INFO: Kick off container cleaving, own shard range in state 'sharding', path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: PUT new shard range container for ShardRange, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: PUT new shard range container for ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test INFO: Completed creating 2 shard range containers, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test INFO: Cleaving from row None into .shards_a/c_m_0 for ShardRange, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001308917999267578s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False.db sharder-test DEBUG: got 0 rows (deleted=True) in 7.987022399902344e-05s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False.db sharder-test INFO: Cleaving ShardRange - zero objects found, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013136863708496094s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.463859558105469e-05s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False.db sharder-test INFO: Cleaving ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887> - zero objects found, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: Finished processing, state sharded, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash60False/hash60False_1757769888.00000.db sharder-test DEBUG: Starting processing, state unsharded (deleted), path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True.db sharder-test INFO: Kick off container cleaving, own shard range in state 'sharding', path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: PUT new shard range container for ShardRange, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: PUT new shard range container for ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test INFO: Completed creating 2 shard range containers, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdi1/1/a/ec/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec/crash-test-dummy" "tx7372b73be9044bc8bb20e-0068c570a0" "proxy-server 1824535" 0.0327 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 PUT /v1/a/ec/crash-test-dummy HTTP/1.0 201 - - t 21000 - - tx7372b73be9044bc8bb20e-0068c570a0 - 0.0589 - - 1757769888.561516762 1757769888.620410204 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5f8f742f56654821ae93d-0068c570a0" "proxy-server 1824535" 0.0012 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx028a33de50284bb4af193-0068c570a0" "proxy-server 1824535" 0.0022 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdi1/1/a/ec/crash-test-dummy" 200 10980 "GET http://localhost/v1/a/ec/crash-test-dummy" "txfabc1ba0493a4bfa9b81c-0068c570a0" "proxy-server 1824535" 0.0007 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdh1/1/a/ec/crash-test-dummy" 200 10980 "GET http://localhost/v1/a/ec/crash-test-dummy" "txfabc1ba0493a4bfa9b81c-0068c570a0" "proxy-server 1824535" 0.0007 "-" 1824535 3 proxy ERROR: Exception fetching fragments for '/a/ec/crash-test-dummy': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1485, in put_fragments_in_queue for fragment in frag_iter: ^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 8297, in explodey_iter raise Exception("doom ba doom") Exception: doom ba doom (txn: txfabc1ba0493a4bfa9b81c-0068c570a0) (client_ip: 127.0.0.1) proxy ERROR: Exception fetching fragments for '/a/ec/crash-test-dummy': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1485, in put_fragments_in_queue for fragment in frag_iter: ^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 8297, in explodey_iter raise Exception("doom ba doom") Exception: doom ba doom (txn: txfabc1ba0493a4bfa9b81c-0068c570a0) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/48 GET /v1/a/ec/crash-test-dummy HTTP/1.0 500 - - t - 4096 - txfabc1ba0493a4bfa9b81c-0068c570a0 - 0.0194 - - 1757769888.621832609 1757769888.641244888 3 - proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: (1824535) wsgi starting up on http://127.0.0.1:43059 proxy DEBUG: (1824535) accepted ('127.0.0.1', 40556) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdb496b37ed11438b808f4-0068c570a0" "proxy-server 1824535" 0.0012 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "txdb496b37ed11438b808f4-0068c570a0" "container-server 1824535" 0.0010 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txdb496b37ed11438b808f4-0068c570a0" "proxy-server 1824535" 0.0058 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "txdb496b37ed11438b808f4-0068c570a0" "container-server 1824535" 0.0018 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txdb496b37ed11438b808f4-0068c570a0" "proxy-server 1824535" 0.0111 "-" 1824535 3 proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:48] "PUT /v1/a/ec HTTP/1.1" 202 252 0.018248 (txn: txdb496b37ed11438b808f4-0068c570a0) proxy DEBUG: (1824535) accepted ('127.0.0.1', 40568) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx39afea6dcd2541ff9254f-0068c570a0" "proxy-server 1824535" 0.0019 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx226cdd3afb3b4b109b2c4-0068c570a0" "proxy-server 1824535" 0.0012 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdi1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "tx338ff3fd605e4e80809ca-0068c570a0" "proxy-server 1824535" 0.0087 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdb1/2/a/ec/go-get-it" 201 - "PUT http://localhost/sdh1/3/a/ec/go-get-it" "tx338ff3fd605e4e80809ca-0068c570a0" "object-server 1824535" 0.0004 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sda1/2/a/ec/go-get-it" 201 - "PUT http://localhost/sdg1/3/a/ec/go-get-it" "tx338ff3fd605e4e80809ca-0068c570a0" "object-server 1824535" 0.0004 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdg1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "tx338ff3fd605e4e80809ca-0068c570a0" "proxy-server 1824535" 0.0190 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "PUT /sdh1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "tx338ff3fd605e4e80809ca-0068c570a0" "proxy-server 1824535" 0.0186 "-" 1824535 3 proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:48] "PUT /v1/a/ec/go-get-it HTTP/1.1" 201 206 0.034718 (txn: tx338ff3fd605e4e80809ca-0068c570a0) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4ebd212e729b47a0b6f2d-0068c570a0" "proxy-server 1824535" 0.0053 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx1748d0b50c704418b71c9-0068c570a0" "proxy-server 1824535" 0.0026 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdi1/3/a/ec/go-get-it" 200 736 "GET http://localhost/v1/a/ec/go-get-it" "txc4d1d7620f9343bdad66f-0068c570a0" "proxy-server 1824535" 0.0007 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:48 +0000] "GET /sdg1/3/a/ec/go-get-it" 200 736 "GET http://localhost/v1/a/ec/go-get-it" "txc4d1d7620f9343bdad66f-0068c570a0" "proxy-server 1824535" 0.0007 "-" 1824535 3 proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:24:48] "GET /v1/a/ec/go-get-it HTTP/1.1" 200 1777 0.026330 (txn: txc4d1d7620f9343bdad66f-0068c570a0) proxy DEBUG: (1824535) timed out ('127.0.0.1', 40568) (txn: txc4d1d7620f9343bdad66f-0068c570a0) proxy INFO: (1824535) wsgi exited, is_accepting=True acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx58e5473b3de040469e537-0068c570a1" "proxy-server 1824535" 0.0013 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "tx58e5473b3de040469e537-0068c570a1" "container-server 1824535" 0.0010 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx58e5473b3de040469e537-0068c570a1" "proxy-server 1824535" 0.0111 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "tx58e5473b3de040469e537-0068c570a1" "container-server 1824535" 0.0010 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx58e5473b3de040469e537-0068c570a1" "proxy-server 1824535" 0.0298 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx58e5473b3de040469e537-0068c570a1 - 0.0411 - - 1757769889.041540623 1757769889.082620144 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx04bd2d3ed0c4489aa3e0f-0068c570a1" "proxy-server 1824535" 0.0102 "-" 1824535 -test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_one_time_out_one_etag_mismatch test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_one_time_out_one_etag_mismatch ... ok test.unit.proxy.test_server.TestECObjectController.test_HEAD_ec test.unit.proxy.test_server.TestECObjectController.test_HEAD_ec ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_shard_ranges ... ok test.unit.proxy.test_server.TestECObjectController.test_HEAD_ec_404 test.unit.proxy.test_server.TestECObjectController.test_HEAD_ec_404 ... ok sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test INFO: Cleaving from row None into .shards_a/c_m_0 for ShardRange, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00011992454528808594s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.082389831542969e-05s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True.db sharder-test INFO: Cleaving ShardRange - zero objects found, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00013303756713867188s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010228157043457031s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True.db sharder-test INFO: Cleaving ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887> - zero objects found, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: Finished processing, state sharded (deleted), path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash60True/hash60True_1757769907.00000.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False.db sharder-test INFO: Kick off container cleaving, own shard range in state 'shrinking', path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: PUT new shard range container for ShardRange, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: PUT new shard range container for ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test INFO: Completed creating 2 shard range containers, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test INFO: Cleaving from row None into .shards_a/c_m_0 for ShardRange, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00012731552124023438s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011134147644042969s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False.db sharder-test INFO: Cleaving ShardRange - zero objects found, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00012612342834472656s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.177757263183594e-05s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False.db sharder-test INFO: Cleaving ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887> - zero objects found, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: Finished processing, state sharded, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/lse/hash50False/hash50False_1757769926.00000.db sharder-test DEBUG: Starting processing, state unsharded (deleted), path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True.db sharder-test INFO: Kick off container cleaving, own shard range in state 'shrinking', path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: PUT new shard range container for ShardRange, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: PUT new shard range container for ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test INFO: Completed creating 2 shard range containers, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.dbtest.unit.container.test_sharder.TestSharder.test_process_broker_sharding_completes_with_own_and_other_ranges test.unit.container.test_sharder.TestSharder.test_process_broker_sharding_completes_with_own_and_other_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_shard_ranges_deleted test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_shard_ranges_deleted ... ok test.unit.proxy.test_server.TestECObjectController.test_PUT_ec test.unit.proxy.test_server.TestECObjectController.test_PUT_ec ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_one_time_out_two_etag_mismatch test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_one_time_out_two_etag_mismatch ... ok sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test INFO: Cleaving from row None into .shards_a/c_m_0 for ShardRange, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00011920928955078125s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011587142944335938s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True.db sharder-test INFO: Cleaving ShardRange - zero objects found, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test INFO: Cleaving from row None into .shards_a/c__1 for ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.00012445449829101562s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.416175842285156e-05s, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True.db sharder-test INFO: Cleaving ShardRange<'m' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887> - zero objects found, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: Finished processing, state sharded (deleted), path: a/c, db: /tmp/tmpqn8st4jg/sda/containers/0/rue/hash50True/hash50True_1757769942.00000.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60.db sharder-test INFO: Kick off container cleaving, own shard range in state 'sharding', path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60_1757769889.33524.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60_1757769889.33524.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60_1757769889.33524.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60_1757769889.33524.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60_1757769889.33524.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60_1757769889.33524.db sharder-test INFO: Stopped cleave at unready ShardRange, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60_1757769889.33524.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60_1757769889.33524.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h60/hash60/hash60_1757769889.33524.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50.db sharder-test INFO: Kick off container cleaving, own shard range in state 'shrinking', path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50_1757769889.37820.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50_1757769889.37820.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50_1757769889.37820.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50_1757769889.37820.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50_1757769889.37820.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50_1757769889.37820.db sharder-test INFO: Stopped cleave at unready ShardRange, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50_1757769889.37820.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50_1757769889.37820.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h50/hash50/hash50_1757769889.37820.db sharder-test DEBUG: Starting processing, state unsharded, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70.db sharder-test INFO: Kick off container cleaving, own shard range in state 'sharded', path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70_1757769889.41621.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70_1757769889.41621.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70_1757769889.41621.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70_1757769889.41621.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70_1757769889.41621.db sharder-test INFO: Starting to cleave (2 todo), path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70_1757769889.41621.dbtest.unit.container.test_sharder.TestSharder.test_process_broker_sharding_stalls_with_own_and_other_ranges test.unit.container.test_sharder.TestSharder.test_process_broker_sharding_stalls_with_own_and_other_ranges ... ok test.unit.container.test_sharder.TestSharder.test_ratelimited_roundrobin test.unit.container.test_sharder.TestSharder.test_ratelimited_roundrobin ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txf0656c646deb40f4ae59f-0068c570a1" "proxy-server 1824535" 0.0013 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdh1/3/a/ec/go-head-it" 201 - "PUT http://localhost/v1/a/ec/go-head-it" "tx9c495bfd530b46878c983-0068c570a1" "proxy-server 1824535" 0.0326 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/2/a/ec/go-head-it" 201 - "PUT http://localhost/sdi1/3/a/ec/go-head-it" "tx9c495bfd530b46878c983-0068c570a1" "object-server 1824535" 0.0005 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/2/a/ec/go-head-it" 201 - "PUT http://localhost/sdg1/3/a/ec/go-head-it" "tx9c495bfd530b46878c983-0068c570a1" "object-server 1824535" 0.0004 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdg1/3/a/ec/go-head-it" 201 - "PUT http://localhost/v1/a/ec/go-head-it" "tx9c495bfd530b46878c983-0068c570a1" "proxy-server 1824535" 0.0489 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdi1/3/a/ec/go-head-it" 201 - "PUT http://localhost/v1/a/ec/go-head-it" "tx9c495bfd530b46878c983-0068c570a1" "proxy-server 1824535" 0.0500 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec/go-head-it HTTP/1.0 201 - - t 1309 - - tx9c495bfd530b46878c983-0068c570a1 - 0.0808 - - 1757769889.092272043 1757769889.173100233 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx65c14ee4ffc84c278a30a-0068c570a1" "proxy-server 1824535" 0.0021 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx77c0b7ef381246129983c-0068c570a1" "proxy-server 1824535" 0.0078 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdh1/3/a/ec/go-head-it" 200 736 "HEAD http://localhost/v1/a/ec/go-head-it" "txb12c658971584a8ba13ad-0068c570a1" "proxy-server 1824535" 0.0048 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 HEAD /v1/a/ec/go-head-it HTTP/1.0 200 - - t - - - txb12c658971584a8ba13ad-0068c570a1 - 0.0300 - - 1757769889.174365044 1757769889.204392433 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx90e01750c8c5415692c91-0068c570a1" "proxy-server 1824535" 0.0012 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "tx90e01750c8c5415692c91-0068c570a1" "container-server 1824535" 0.0011 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx90e01750c8c5415692c91-0068c570a1" "proxy-server 1824535" 0.0225 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "tx90e01750c8c5415692c91-0068c570a1" "container-server 1824535" 0.0011 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx90e01750c8c5415692c91-0068c570a1" "proxy-server 1824535" 0.0309 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx90e01750c8c5415692c91-0068c570a1 - 0.0422 - - 1757769889.206564903 1757769889.248783827 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe9dfa337451242beb7cf2-0068c570a1" "proxy-server 1824535" 0.0020 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txf24a08cd742f4aa7bdddb-0068c570a1" "proxy-server 1824535" 0.0012 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdh1/2/a/ec/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec/yes-we-have-no-bananas" "txb85439f399f3457282e38-0068c570a1" "proxy-server 1824535" 0.0003 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdg1/2/a/ec/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec/yes-we-have-no-bananas" "txb85439f399f3457282e38-0068c570a1" "proxy-server 1824535" 0.0003 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdi1/2/a/ec/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec/yes-we-have-no-bananas" "txb85439f399f3457282e38-0068c570a1" "proxy-server 1824535" 0.0003 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 HEAD /v1/a/ec/yes-we-have-no-bananas HTTP/1.0 404 - - t - - - txb85439f399f3457282e38-0068c570a1 - 0.0357 - - 1757769889.250018835 1757769889.285672426 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbde6828c873b48d391ae0-0068c570a1" "proxy-server 1824535" 0.0061 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "txbde6828c873b48d391ae0-0068c570a1" "container-server 1824535" 0.0010 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "txbde6828c873b48d391ae0-0068c570a1" "container-server 1824535" 0.0010 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txbde6828c873b48d391ae0-0068c570a1" "proxy-server 1824535" 0.0213 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txbde6828c873b48d391ae0-0068c570a1" "proxy-server 1824535" 0.0153 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - txbde6828c873b48d391ae0-0068c570a1 - 0.0340 - - 1757769889.291027546 1757769889.325049400 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe7a86b3f7cff4084b32c0-0068c570a1" "proxy-server 1824535" 0.0020 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx206fbea6a98443cb8f2c4-0068c570a1" "proxy-server 1824535" 0.0012 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdh1/1/a/ec/o1" 201 - "PUT http://localhost/v1/a/ec/o1" "txe7f235ec18014ff692325-0068c570a1" "proxy-server 1824535" 0.0184 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/2/a/ec/o1" 201 - "PUT http://localhost/sdg1/1/a/ec/o1" "txe7f235ec18014ff692325-0068c570a1" "object-server 1824535" 0.0005 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/2/a/ec/o1" 201 - "PUT http://localhost/sdi1/1/a/ec/o1" "txe7f235ec18014ff692325-0068c570a1" "object-server 1824535" 0.0004 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdi1/1/a/ec/o1" 201 - "PUT http://localhost/v1/a/ec/o1" "txe7f235ec18014ff692325-0068c570a1" "proxy-server 1824535" 0.0267 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdg1/1/a/ec/o1" 201 - "PUT http://localhost/v1/a/ec/o1" "txe7f235ec18014ff692325-0068c570a1" "proxy-server 1824535" 0.0330 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec/o1 HTTP/1.0 201 - - t 40 - %22f080b258d6577697b9869dbd168d5628%22 txe7f235ec18014ff692325-0068c570a1 - 0.0583 - - 1757769889.326359987 1757769889.384675026 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txac6611d4ccb94c49b1717-0068c570a1" "proxy-server 1824535" 0.0014 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "txac6611d4ccb94c49b1717-0068c570a1" "container-server 1824535" 0.0052 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txac6611d4ccb94c49b1717-0068c570a1" "proxy-server 1824535" 0.0220 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "txac6611d4ccb94c49b1717-0068c570a1" "container-server 1824535" 0.0059 "-" 1824535 3test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_fragment_archive_etag_mismatch test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_fragment_archive_etag_mismatch ... ok test.unit.container.test_sharder.TestSharder.test_run_forever test.unit.container.test_sharder.TestSharder.test_run_forever ... ok sharder-test INFO: Stopped cleave at unready ShardRange, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70_1757769889.41621.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70_1757769889.41621.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmpfmds3nxz/sda/containers/0/h70/hash70/hash70_1757769889.41621.db sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: Since Thu Jan 1 14:00:01 1970 visited - attempted:2 success:2 failure:0 skipped:0 completed:0 sharder-test INFO: Since Thu Jan 1 14:00:01 1970 scanned - attempted:1 success:1 failure:0 found:2 min_time:99 max_time:123 sharder-test INFO: Since Thu Jan 1 14:00:01 1970 created - attempted:1 success:1 failure:1 sharder-test INFO: Since Thu Jan 1 14:00:01 1970 cleaved - attempted:1 success:1 failure:0 min_time:0.01 max_time:1.3 sharder-test INFO: Since Thu Jan 1 14:00:01 1970 misplaced - attempted:1 success:1 failure:0 found:1 placed:1 unplaced:0 sharder-test INFO: Since Thu Jan 1 14:00:01 1970 audit_root - attempted:5 success:4 failure:1 has_overlap:0 num_overlap:0 sharder-test INFO: Since Thu Jan 1 14:00:01 1970 audit_shard - attempted:2 success:2 failure:0 sharder-test INFO: Container sharder cycle completed: 5.00s sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: Since Thu Jan 1 14:00:06 1970 visited - attempted:1 success:1 failure:0 skipped:0 completed:0 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 scanned - attempted:1 success:1 failure:0 found:2 min_time:99 max_time:123 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 created - attempted:1 success:1 failure:1 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 cleaved - attempted:1 success:1 failure:0 min_time:0.01 max_time:1.3 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 misplaced - attempted:1 success:1 failure:0 found:1 placed:1 unplaced:0 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 audit_root - attempted:5 success:4 failure:1 has_overlap:0 num_overlap:0 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 audit_shard - attempted:2 success:2 failure:0 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 visited - attempted:2 success:2 failure:0 skipped:0 completed:0 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 scanned - attempted:1 success:1 failure:0 found:2 min_time:99 max_time:123 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 created - attempted:1 success:1 failure:1 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 cleaved - attempted:1 success:1 failure:0 min_time:0.01 max_time:1.3 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 misplaced - attempted:1 success:1 failure:0 found:1 placed:1 unplaced:0 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 audit_root - attempted:5 success:4 failure:1 has_overlap:0 num_overlap:0 sharder-test INFO: Since Thu Jan 1 14:00:06 1970 audit_shard - attempted:2 success:2 failure:0 sharder-test INFO: Container sharder cycle completed: 3604.00s sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test INFO: Since Thu Jan 1 15:00:10 1970 visited - attempted:2 success:2 failure:0 skipped:0 completed:0 sharder-test INFO: Since Thu Jan 1 15:00:10 1970 scanned - attempted:1 success:1 failure:0 found:2 min_time:99 max_time:123 sharder-test INFO: Since Thu Jan 1 15:00:10 1970 created - attempted:1 success:1 failure:1 sharder-test INFO: Since Thu Jan 1 15:00:10 1970 cleaved - attempted:1 success:1 failure:0 min_time:0.01 max_time:1.3 sharder-test INFO: Since Thu Jan 1 15:00:10 1970 misplaced - attempted:1 success:1 failure:0 found:1 placed:1 unplaced:0 sharder-test INFO: Since Thu Jan 1 15:00:10 1970 audit_root - attempted:5 success:4 failure:1 has_overlap:0 num_overlap:0 sharder-test INFO: Since Thu Jan 1 15:00:10 1970 audit_shard - attempted:2 success:2 failure:0 sharder-test INFO: Container sharder cycle completed: 30.00s sharder-test INFO: Container sharder cycle starting, auto-sharding False sharder-test ERROR: Unhandled exception while dumping progress: Test over, path: a/c1, db: /tmp/tmp9hcjh6f0/sda/containers/0/ash/c1hash/c1hash.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 2517, in _one_shard_cycle self._record_sharding_progress(broker, node, error) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1049, in _record_sharding_progress own_shard_range = broker.get_own_shard_range() File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2049, in get_own_shard_range self.path, Timestamp.now(), ShardRange.MIN, ShardRange.MAX, ~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/timestamp.py", line 127, in now return cls(time.time(), offset=offset, delta=delta) ~~~~~~~~~^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception: Test over sharder-test ERROR: Exception in sharder: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 2544, in run_forever self._one_shard_cycle(devices_to_shard=Everything(), ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ partitions_to_shard=Everything()) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 2521, in _one_shard_cycle self._periodic_report_stats() ~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1139, in _periodic_report_stats if (time.time() - self.reported) >= self.stats_interval: ~~~~~~~~~^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 2517, in _one_shard_cycle self._record_sharding_progress(broker, node, error) ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1049, in _record_sharding_progress own_shard_range = broker.get_own_shard_range() File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2049, in get_own_shard_range self.path, Timestamp.now(), ShardRange.MIN, ShardRange.MAX, ~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/timestamp.py", line 127, in now return cls(time.time(), offset=offset, delta=delta) ~~~~~~~~~^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception: Test over sharder-test WARNING: Failed to put shard ranges to 10.0.1.2:1102/sdc a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_only_first_time_out test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_only_first_time_out ... ok sharder-test ERROR: Failed to put shard ranges to 10.0.1.2:1102/sdc a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test WARNING: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.2:1102/sdc a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.0:1100/sda a/c: 500, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: 500, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.2:1102/sdc a/c: 500, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to put shard ranges to 10.0.1.0:1100/sda a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test ERROR: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test ERROR: Failed to put shard ranges to 10.0.1.0:1100/sda a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test ERROR: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: , path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Timeout (Nones) sharder-test WARNING: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test WARNING: Failed to put shard ranges to 10.0.1.0:1100/sda a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to put shard ranges to 10.0.1.0:1100/sda a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test ERROR: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test ERROR: Failed to put shard ranges to 10.0.1.0:1100/sda a/c: , path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Timeout (Nones) sharder-test ERROR: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test WARNING: Failed to put shard ranges to 10.0.1.2:1102/sdc a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.3:1103/sdd a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to put shard ranges to 10.0.1.2:1102/sdc a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test ERROR: Failed to put shard ranges to 10.0.1.3:1103/sdd a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test WARNING: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.2:1102/sdc a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.3:1103/sdd a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.0:1100/sda a/c: 500, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: 500, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test WARNING: Failed to put shard ranges to 10.0.1.2:1102/sdc a/c: 500, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to put shard ranges to 10.0.1.0:1100/sda a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Errortest.unit.container.test_sharder.TestSharder.test_send_shard_ranges test.unit.container.test_sharder.TestSharder.test_send_shard_ranges ... ok test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_fragment_quorum_archive_etag_mismatch test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_fragment_quorum_archive_etag_mismatch ... ok sharder-test ERROR: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: FakeStatus Error, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sharder.py", line 1202, in _put_container direct_put_container(node, part, account, container, ~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ conn_timeout=self.conn_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout=self.node_timeout, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers, contents=body) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 399, in direct_put_container _make_req(node, part, 'PUT', path, headers_out, 'Container', conn_timeout, ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ response_timeout, contents=contents, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ content_length=content_length, chunk_size=chunk_size) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/direct_client.py", line 121, in _make_req conn = http_connect(ip, port, node['device'], part, method, path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 690, in __init__ raise status('FakeStatus Error') Exception: FakeStatus Error sharder-test WARNING: Failed to put shard ranges to 10.0.1.3:1103/sdd a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test ERROR: Failed to put shard ranges to 10.0.1.0:1100/sda a/c: , path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Timeout (Nones) sharder-test ERROR: Failed to put shard ranges to 10.0.1.1:1101/sdb a/c: , path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db: Timeout (Nones) sharder-test WARNING: Failed to put shard ranges to 10.0.1.3:1103/sdd a/c: 404, path: a/c, db: /tmp/tmp3t0bomtr/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Moving any misplaced objects from sharding container, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Starting to cleave (4 todo), path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj002_0 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00014543533325195312s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 8.821487426757812e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj002_0 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test WARNING: Failed to sufficiently replicate cleaved shard .shards_a/c_obj002_0 in state cleaved: 2 successes, 3 required, shard db: /tmp/tmpwfk2mupb/sda/containers/0/8fc/857fe81dc763e7cff7e7cd987d6c28fc/857fe81dc763e7cff7e7cd987d6c28fc.db, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: misplaced object source bounds [], path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Starting to cleave (4 todo), path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj002_0 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaving ShardRange - shard db already in sync, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.dbtest.unit.proxy.test_mem_server.TestProxyServer.test_node_concurrency test.unit.proxy.test_mem_server.TestProxyServer.test_node_concurrency ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_node_timing test.unit.proxy.test_mem_server.TestProxyServer.test_node_timing ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_private_method_request test.unit.proxy.test_mem_server.TestProxyServer.test_private_method_request ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy ... ok test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_fragment_quorum_bad_request test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_fragment_quorum_bad_request ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_inherits test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_inherits ... ok sharder-test INFO: Replicating new shard container .shards_a/c_obj002_0 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaved ShardRange in 0.003s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj004_1 for ShardRange<'obj002' to 'obj004' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00014352798461914062s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.298324584960938e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_1 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test WARNING: Failed to sufficiently replicate cleaved shard .shards_a/c_obj004_1 in state cleaved: 0 successes, 1 required, shard db: /tmp/tmpwfk2mupb/sda/containers/0/d88/e4460cf9fd8281b0fc151a616970fd88/e4460cf9fd8281b0fc151a616970fd88.db, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: misplaced object source bounds [('', 'obj002')], path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0001049041748046875s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00011730194091796875s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Continuing to cleave (1 done, 3 todo), path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj004_1 for ShardRange<'obj002' to 'obj004' as of 1757769836.07887, (0, 0) as of 1757769836.07887, cleaved as of 1757769836.07887>, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaving ShardRange<'obj002' to 'obj004' as of 1757769836.07887, (0, 0) as of 1757769836.07887, cleaved as of 1757769836.07887> - shard db already in sync, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_1 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test WARNING: Failed to sufficiently replicate cleaved shard .shards_a/c_obj004_1 in state cleaved: 0 successes, 1 required, shard db: /tmp/tmpwfk2mupb/sda/containers/0/d88/e4460cf9fd8281b0fc151a616970fd88/e4460cf9fd8281b0fc151a616970fd88.db, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: misplaced object source bounds [('', 'obj002')], path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=False) in 6.508827209472656e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.365776062011719e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Continuing to cleave (1 done, 3 todo), path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj004_1 for ShardRange<'obj002' to 'obj004' as of 1757769836.07887, (0, 0) as of 1757769836.07887, cleaved as of 1757769836.07887>, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaving ShardRange<'obj002' to 'obj004' as of 1757769836.07887, (0, 0) as of 1757769836.07887, cleaved as of 1757769836.07887> - shard db already in sync, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_1 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test WARNING: Failed to sufficiently replicate cleaved shard .shards_a/c_obj004_1 in state cleaved: 0 successes, 0 required, shard db: /tmp/tmpwfk2mupb/sda/containers/0/d88/e4460cf9fd8281b0fc151a616970fd88/e4460cf9fd8281b0fc151a616970fd88.db, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: ERROR with server-type server 10.0.0.0:1000/sda re: success: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 1202, in do_test raise Exception('kaboom1!') Exception: kaboom1! test ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.0:1000/sda (txn: tx547abbbdce764a39b78c0-0068c570a0) test INFO: Client disconnected on read of '/a/c' (txn: tx547abbbdce764a39b78c0-0068c570a0) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.1.0:1100/sda (txn: tx3348e0956d504a0682cf2-0068c570a0) test INFO: Client disconnected on read of '/a/c' (txn: tx3348e0956d504a0682cf2-0068c570a0) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to UPDATE /a/c: Network unreachable (txn: tx65121aa0cca349c288fd8-0068c570a1) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to UPDATE /a/c: Network unreachable (txn: tx65121aa0cca349c288fd8-0068c570a1) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to UPDATE /a/c: Network unreachable (txn: tx65121aa0cca349c288fd8-0068c570a1) test ERROR: Container UPDATE returning 503 for (503, 503, 503) (txn: tx65121aa0cca349c288fd8-0068c570a1) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r3=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r3=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r3=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': 'r0=0', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0=0', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_overrides test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_overrides ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_with_no_default test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_per_policy_with_no_default ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txac6611d4ccb94c49b1717-0068c570a1" "proxy-server 1824535" 0.0242 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - txac6611d4ccb94c49b1717-0068c570a1 - 0.0371 - - 1757769889.416295052 1757769889.453429937 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx35b40f69f8684a2cb5bf0-0068c570a1" "proxy-server 1824535" 0.0033 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx78c23accc53a409eb01ae-0068c570a1" "proxy-server 1824535" 0.0076 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdi1/0/a/ec/pimento" 422 93 "PUT http://localhost/v1/a/ec/pimento" "tx531bbce9e9f646f9a4ba9-0068c570a1" "proxy-server 1824535" 0.0039 "-" 1824535 3 proxy ERROR: Not enough object servers ack'ed (got 2) (txn: tx531bbce9e9f646f9a4ba9-0068c570a1) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec/pimento HTTP/1.0 503 - - t 37 118 fc0b2c2af9909d00a8d840b38247222f tx531bbce9e9f646f9a4ba9-0068c570a1 - 0.0615 - - 1757769889.463112354 1757769889.524653196 3 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdh1/0/a/ec/pimento" 499 89 "PUT http://localhost/v1/a/ec/pimento" "tx531bbce9e9f646f9a4ba9-0068c570a1" "proxy-server 1824535" 0.0344 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdg1/0/a/ec/pimento" 499 89 "PUT http://localhost/v1/a/ec/pimento" "tx531bbce9e9f646f9a4ba9-0068c570a1" "proxy-server 1824535" 0.0344 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe22c1f1a17f84ceca2408-0068c570a1" "proxy-server 1824535" 0.0012 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/1/a/ec-con" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/ec-con" "txe22c1f1a17f84ceca2408-0068c570a1" "container-server 1824535" 0.0012 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/1/a/ec-con" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/ec-con" "txe22c1f1a17f84ceca2408-0068c570a1" "container-server 1824535" 0.0019 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/0/a/ec-con" 201 - "PUT http://localhost/v1/a/ec-con" "txe22c1f1a17f84ceca2408-0068c570a1" "proxy-server 1824535" 0.2881 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/0/a/ec-con" 201 - "PUT http://localhost/v1/a/ec-con" "txe22c1f1a17f84ceca2408-0068c570a1" "proxy-server 1824535" 0.0229 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec-con HTTP/1.0 201 - - t - - - txe22c1f1a17f84ceca2408-0068c570a1 - 0.3044 - - 1757769889.539379120 1757769889.843823671 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txca4a835c49f347c4817ae-0068c570a1" "proxy-server 1824535" 0.0021 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txdace826162a54cb29ce24-0068c570a1" "proxy-server 1824535" 0.0013 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdi1/2/a/ec-con/quorum" 422 93 "PUT http://localhost/v1/a/ec-con/quorum" "tx91bc617606c846eeb5eb2-0068c570a1" "proxy-server 1824535" 0.0075 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdh1/2/a/ec-con/quorum" 422 93 "PUT http://localhost/v1/a/ec-con/quorum" "tx91bc617606c846eeb5eb2-0068c570a1" "proxy-server 1824535" 0.0080 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdg1/2/a/ec-con/quorum" 422 93 "PUT http://localhost/v1/a/ec-con/quorum" "tx91bc617606c846eeb5eb2-0068c570a1" "proxy-server 1824535" 0.0107 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec-con/quorum HTTP/1.0 503 - - t 37 118 fc0b2c2af9909d00a8d840b38247222f tx91bc617606c846eeb5eb2-0068c570a1 - 0.0546 - - 1757769889.845564365 1757769889.900156736 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx924cf4b9ea7b47939b3f6-0068c570a1" "proxy-server 1824535" 0.0014 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/1/a/ec-con" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/ec-con" "tx924cf4b9ea7b47939b3f6-0068c570a1" "container-server 1824535" 0.0018 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/1/a/ec-con" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/ec-con" "tx924cf4b9ea7b47939b3f6-0068c570a1" "container-server 1824535" 0.0057 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sdb1/0/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "tx924cf4b9ea7b47939b3f6-0068c570a1" "proxy-server 1824535" 0.0316 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "PUT /sda1/0/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "tx924cf4b9ea7b47939b3f6-0068c570a1" "proxy-server 1824535" 0.0350 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/49 PUT /v1/a/ec-con HTTP/1.0 202 - - t - 76 - tx924cf4b9ea7b47939b3f6-0068c570a1 - 0.0563 - - 1757769889.909247398 1757769889.965536833 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6648477d9d404b16ba67b-0068c570a1" "proxy-server 1824535" 0.0063 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:49 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx17ac803fabee487f88c7f-0068c570a1" "proxy-server 1824535" 0.0054 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/2/a/ec-con/quorum" 400 29 "PUT http://localhost/v1/a/ec-con/quorum" "tx8bee77905597455297d8c-0068c570a1" "proxy-server 1824535" 0.0083 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/2/a/ec-con/quorum" 400 29 "PUT http://localhost/v1/a/ec-con/quorum" "tx8bee77905597455297d8c-0068c570a1" "proxy-server 1824535" 0.0135 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/2/a/ec-con/quorum" 400 29 "PUT http://localhost/v1/a/ec-con/quorum" "tx8bee77905597455297d8c-0068c570a1" "proxy-server 1824535" 0.0140 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec-con/quorum HTTP/1.0 503 - - t 37 118 fc0b2c2af9909d00a8d840b38247222f tx8bee77905597455297d8c-0068c570a1 - 0.0427 - - 1757769889.967529058 1757769890.010196447 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdb403c6ce3af46bea9dc6-0068c570a2" "proxy-server 1824535" 0.0015 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "txdb403c6ce3af46bea9dc6-0068c570a2" "container-server 1824535" 0.0011 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "txdb403c6ce3af46bea9dc6-0068c570a2" "container-server 1824535" 0.0017 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txdb403c6ce3af46bea9dc6-0068c570a2" "proxy-server 1824535" 0.0264 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txdb403c6ce3af46bea9dc6-0068c570a2" "proxy-server 1824535" 0.0165 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - txdb403c6ce3af46bea9dc6-0068c570a2 - 0.0479 - - 1757769890.037563801 1757769890.085457087 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx29fdadf34c754332bd125-0068c570a2" "proxy-server 1824535" 0.0082 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx004608f8bcd74efaa7ca5-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 3test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_proxy_server_config test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_affinity_proxy_server_config ... ok sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: misplaced object source bounds [('', 'obj002')], path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=False) in 6.771087646484375e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.0558319091796875e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Continuing to cleave (1 done, 3 todo), path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj004_1 for ShardRange<'obj002' to 'obj004' as of 1757769836.07887, (0, 0) as of 1757769836.07887, cleaved as of 1757769836.07887>, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaving ShardRange<'obj002' to 'obj004' as of 1757769836.07887, (0, 0) as of 1757769836.07887, cleaved as of 1757769836.07887> - shard db already in sync, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Replicating new shard container .shards_a/c_obj004_1 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaved ShardRange<'obj002' to 'obj004' as of 1757769836.07887, (0, 0) as of 1757769836.07887, cleaved as of 1757769836.07887> in 0.038s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaving from row None into .shards_a/c_obj006_2 for ShardRange<'obj004' to 'obj006' as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00018787384033203125s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00010752677917480469s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c_obj006_2 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaved ShardRange<'obj004' to 'obj006' as of 1757769836.07887, (2, 2) as of 1757769890.09796, cleaved as of 1757769836.07887> in 0.01s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaved 2 shard ranges, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test WARNING: shard_replication_quorum of 99 exceeds replica count 3, reducing to 3 sharder-test WARNING: existing_shard_replication_quorum of 99 exceeds replica count 3, reducing to 3 sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: misplaced object source bounds [('', 'obj006')], path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=False) in 6.604194641113281e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=True) in 6.4849853515625e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Continuing to cleave (3 done, 1 todo), path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaving from row None into .shards_a/c__3 for ShardRange<'obj006' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00015497207641601562s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 9.250640869140625e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test INFO: Replicating new shard container .shards_a/c__3 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test WARNING: Failed to sufficiently replicate cleaved shard .shards_a/c__3 in state cleaved: 2 successes, 3 required, shard db: /tmp/tmpwfk2mupb/sda/containers/0/683/f7a6bb6d9367b7ae7b6b30a833289683/f7a6bb6d9367b7ae7b6b30a833289683.db, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaved 0 shard ranges, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.dbtest.unit.proxy.test_server.TestECObjectController.test_PUT_ec_if_none_match test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_if_none_match ... ok test.unit.container.test_sharder.TestSharder.test_shard_replication_quorum_failures test.unit.container.test_sharder.TestSharder.test_shard_replication_quorum_failures ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_timing_per_policy test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_by_timing_per_policy ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_default test.unit.proxy.test_mem_server.TestProxyServer.test_sort_nodes_default ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_unhandled_exception test.unit.proxy.test_mem_server.TestProxyServer.test_unhandled_exception ... ok test.unit.proxy.test_mem_server.TestProxyServer.test_valid_api_version test.unit.proxy.test_mem_server.TestProxyServer.test_valid_api_version ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_three_time_out test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_three_time_out ... ok test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_multiple_segments test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_multiple_segments ... ok test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0=0', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0=0', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'timing', 'read_affinity': 'r1=1,r2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r2=1', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.container.test_sharder.TestSharder.test_sharded_record_sharding_progress_missing_contexts test.unit.container.test_sharder.TestSharder.test_sharded_record_sharding_progress_missing_contexts ... ok test.unit.container.test_sharder.TestSharder.test_sharding_enabled test.unit.container.test_sharder.TestSharder.test_sharding_enabled ... ok test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_object_etag_mismatch test.unit.proxy.test_server.TestECObjectController.test_PUT_ec_object_etag_mismatch ... ok sharder-test WARNING: shard_replication_quorum of 99 exceeds replica count 3, reducing to 3 sharder-test WARNING: existing_shard_replication_quorum of 99 exceeds replica count 3, reducing to 3 sharder-test DEBUG: Starting processing, state sharding, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Looking for misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: misplaced object source bounds [('', 'obj006')], path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=False) in 6.699562072753906e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: got 0 rows (deleted=True) in 5.817413330078125e-05s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished handling misplaced objects, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Continuing to cleave (3 done, 1 todo), path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaving from row None into .shards_a/c__3 for ShardRange<'obj006' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887>, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaving ShardRange<'obj006' to MaxBound as of 1757769836.07887, (0, 0) as of 1757769836.07887, created as of 1757769836.07887> - shard db already in sync, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Replicating new shard container .shards_a/c__3 for ShardRange, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test INFO: Cleaved ShardRange<'obj006' to MaxBound as of 1757769836.07887, (3, 3) as of 1757769890.18930, cleaved as of 1757769836.07887> in 0.003s, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Cleaved 1 shard ranges, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db' sharder-test INFO: Completed cleaving, DB set to sharded state, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test DEBUG: Finished processing, state sharded, path: a/c, db: /tmp/tmpwfk2mupb/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769889.79411.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '43d3756d-e596-4754-b93e-6c301fe0c937-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': None, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmp6ii2mw9x/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769890.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '43d3756d-e596-4754-b93e-6c301fe0c937-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': 1, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': True, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmp6ii2mw9x/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769890.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '43d3756d-e596-4754-b93e-6c301fe0c937-sda', 'cursor': '', 'max_row': 1, 'cleave_to_row': 1, 'last_cleave_to_row': None, 'cleaving_done': True, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmp6ii2mw9x/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769890.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '43d3756d-e596-4754-b93e-6c301fe0c937-sda', 'cursor': '', 'max_row': 2, 'cleave_to_row': 1, 'last_cleave_to_row': None, 'cleaving_done': True, 'misplaced_done': True, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmp6ii2mw9x/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769890.00000.db sharder-test WARNING: Repeat cleaving required, context: {'ref': '8187070b-3f0e-49bc-b545-aeef027c7bbc-sda', 'cursor': '', 'max_row': 2, 'cleave_to_row': None, 'last_cleave_to_row': None, 'cleaving_done': False, 'misplaced_done': False, 'ranges_done': 0, 'ranges_todo': 0}, path: a/c, db: /tmp/tmp6ii2mw9x/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33_1757769890.00000.db sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4gmglc23/sda/containers/0/ash/c2hash/c2hash.db' sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4gmglc23/sda/containers/0/ash/c1hash/c1hash.db' sharder-test DEBUG: Unlinked retiring db '/tmp/tmp4gmglc23/sda/containers/0/ash/c3hash/c3hash.db' sharder-test INFO: Since Sun Sep 14 03:24:50 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0test.unit.container.test_sharder.TestSharder.test_shrinking_candidate_recon_dump test.unit.container.test_sharder.TestSharder.test_shrinking_candidate_recon_dump ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/3/a/ec/inm" 201 - "PUT http://localhost/v1/a/ec/inm" "tx68e0304a6b6e4e3baa215-0068c570a2" "proxy-server 1824535" 0.0237 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a/ec/inm" 201 - "PUT http://localhost/sdh1/3/a/ec/inm" "tx68e0304a6b6e4e3baa215-0068c570a2" "object-server 1824535" 0.0004 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a/ec/inm" 201 - "PUT http://localhost/sdg1/3/a/ec/inm" "tx68e0304a6b6e4e3baa215-0068c570a2" "object-server 1824535" 0.0004 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/3/a/ec/inm" 201 - "PUT http://localhost/v1/a/ec/inm" "tx68e0304a6b6e4e3baa215-0068c570a2" "proxy-server 1824535" 0.0261 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/3/a/ec/inm" 201 - "PUT http://localhost/v1/a/ec/inm" "tx68e0304a6b6e4e3baa215-0068c570a2" "proxy-server 1824535" 0.0352 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec/inm HTTP/1.0 201 - - t 48 - %22478884f627ab2565c2e752741f8e34cc%22 tx68e0304a6b6e4e3baa215-0068c570a2 - 0.0655 - - 1757769890.086959124 1757769890.152443171 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txddced19ff7ad4637b2b05-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txca08d4c43d6d49cc8fb66-0068c570a2" "proxy-server 1824535" 0.0073 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/3/a/ec/inm" 412 92 "PUT http://localhost/v1/a/ec/inm" "tx838d47fb5e4845b3bbc89-0068c570a2" "proxy-server 1824535" 0.0006 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/3/a/ec/inm" 412 92 "PUT http://localhost/v1/a/ec/inm" "tx838d47fb5e4845b3bbc89-0068c570a2" "proxy-server 1824535" 0.0006 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/3/a/ec/inm" 412 92 "PUT http://localhost/v1/a/ec/inm" "tx838d47fb5e4845b3bbc89-0068c570a2" "proxy-server 1824535" 0.0009 "-" 1824535 3 proxy DEBUG: Object PUT returning 412, [412, 412, 412] (txn: tx838d47fb5e4845b3bbc89-0068c570a2) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec/inm HTTP/1.0 412 - - t - 92 %22478884f627ab2565c2e752741f8e34cc%22 tx838d47fb5e4845b3bbc89-0068c570a2 - 0.0609 - - 1757769890.153968334 1757769890.214902639 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf524d8ef2d1c43caa3b8e-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "txf524d8ef2d1c43caa3b8e-0068c570a2" "container-server 1824535" 0.0011 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txf524d8ef2d1c43caa3b8e-0068c570a2" "proxy-server 1824535" 0.0200 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "txf524d8ef2d1c43caa3b8e-0068c570a2" "container-server 1824535" 0.0020 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txf524d8ef2d1c43caa3b8e-0068c570a2" "proxy-server 1824535" 0.0309 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - txf524d8ef2d1c43caa3b8e-0068c570a2 - 0.0467 - - 1757769890.217275381 1757769890.263929367 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc7e43c34f1744823b5f5b-0068c570a2" "proxy-server 1824535" 0.0022 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txd0176d790c674b28b6764-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/3/a/ec/o2" 201 - "PUT http://localhost/v1/a/ec/o2" "txa535d99ba7a349a2b76c1-0068c570a2" "proxy-server 1824535" 0.0211 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a/ec/o2" 201 - "PUT http://localhost/sdi1/3/a/ec/o2" "txa535d99ba7a349a2b76c1-0068c570a2" "object-server 1824535" 0.0004 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/3/a/ec/o2" 201 - "PUT http://localhost/v1/a/ec/o2" "txa535d99ba7a349a2b76c1-0068c570a2" "proxy-server 1824535" 0.0233 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a/ec/o2" 201 - "PUT http://localhost/sdh1/3/a/ec/o2" "txa535d99ba7a349a2b76c1-0068c570a2" "object-server 1824535" 0.0005 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/3/a/ec/o2" 201 - "PUT http://localhost/v1/a/ec/o2" "txa535d99ba7a349a2b76c1-0068c570a2" "proxy-server 1824535" 0.0335 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec/o2 HTTP/1.0 201 - - t 12288 - - txa535d99ba7a349a2b76c1-0068c570a2 - 0.0611 - - 1757769890.265411615 1757769890.326486111 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx022907e7eeaf400ab2e1e-0068c570a2" "proxy-server 1824535" 0.0064 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/ec" "tx022907e7eeaf400ab2e1e-0068c570a2" "container-server 1824535" 0.0011 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx022907e7eeaf400ab2e1e-0068c570a2" "proxy-server 1824535" 0.0263 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/ec" "tx022907e7eeaf400ab2e1e-0068c570a2" "container-server 1824535" 0.0012 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx022907e7eeaf400ab2e1e-0068c570a2" "proxy-server 1824535" 0.0242 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx022907e7eeaf400ab2e1e-0068c570a2 - 0.0434 - - 1757769890.341948748 1757769890.385324001 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7b38276777e54d848a726-0068c570a2" "proxy-server 1824535" 0.0072 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txceed3d128c4046dea420d-0068c570a2" "proxy-server 1824535" 0.0014 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec/o3 HTTP/1.0 422 - - t 50 93 6c7ba9c5a141421e1c03cb9807c97c74 tx0abf461df6924e83b317a-0068c570a2 - 0.0338 - - 1757769890.394903660 1757769890.428705931 3 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/0/a/ec/o3" 499 89 "PUT http://localhost/v1/a/ec/o3" "tx0abf461df6924e83b317a-0068c570a2" "proxy-server 1824535" 0.0076 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/0/a/ec/o3" 499 89 "PUT http://localhost/v1/a/ec/o3" "tx0abf461df6924e83b317a-0068c570a2" "proxy-server 1824535" 0.0222 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/0/a/ec/o3" 499 89 "PUT http://localhost/v1/a/ec/o3" "tx0abf461df6924e83b317a-0068c570a2" "proxy-server 1824535" 0.0174 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8479bcbd5f844d4bb6e90-0068c570a2" "proxy-server 1824535" 0.0021 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/d3c676b865df46078c69641fb84da19d" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/d3c676b865df46078c69641fb84da19d" "tx8479bcbd5f844d4bb6e90-0068c570a2" "container-server 1824535" 0.0052 "-" 1824535 3test.unit.container.test_sharder.TestSharder.test_update_root_container_all_ranges test.unit.container.test_sharder.TestSharder.test_update_root_container_all_ranges ... ok test.unit.container.test_sharder.TestSharder.test_update_root_container_already_reported test.unit.container.test_sharder.TestSharder.test_update_root_container_already_reported ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_two_time_out test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_read_timeout_retry_two_time_out ... ok cont1 DEBUG: Could not load '/tmp/tmpjza_jej0/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpjza_jej0/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmpjza_jej0/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpjza_jej0/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0068 "-" 1824541 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0112 "-" 1824541 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0068 "-" 1824541 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0108 "-" 1824541 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx461361b9fd0f4efe9c273-0068c570a2" "proxy-server 1824541" 0.0011 "-" 1824541 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:58941/sda1/1/a/c" "tx461361b9fd0f4efe9c273-0068c570a2" "container-server 1824541" 0.0011 "-" 1824541 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:48675/sdb1/1/a/c" "tx461361b9fd0f4efe9c273-0068c570a2" "container-server 1824541" 0.0010 "-" 1824541 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx461361b9fd0f4efe9c273-0068c570a2" "proxy-server 1824541" 0.0291 "-" 1824541 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx461361b9fd0f4efe9c273-0068c570a2" "proxy-server 1824541" 0.0252 "-" 1824541 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx461361b9fd0f4efe9c273-0068c570a2 - 0.0500 - - 1757769890.370481968 1757769890.420476675 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx290ee2318466483c8cc48-0068c570a2" "proxy-server 1824541" 0.0011 "-" 1824541 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:58941/sda1/1/a1/c1" "tx290ee2318466483c8cc48-0068c570a2" "container-server 1824541" 0.0010 "-" 1824541 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:48675/sdb1/1/a1/c1" "tx290ee2318466483c8cc48-0068c570a2" "container-server 1824541" 0.0010 "-" 1824541 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx290ee2318466483c8cc48-0068c570a2" "proxy-server 1824541" 0.0265 "-" 1824541 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx290ee2318466483c8cc48-0068c570a2" "proxy-server 1824541" 0.0228 "-" 1824541 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx290ee2318466483c8cc48-0068c570a2 - 0.0467 - - 1757769890.421829700 1757769890.468560934 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb2c36db420fd49bc93ec8-0068c570a2" "proxy-server 1824541" 0.0018 "-" 1824541 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:48675/sdb1/2/a/c1" "txb2c36db420fd49bc93ec8-0068c570a2" "container-server 1824541" 0.0018 "-" 1824541 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:58941/sda1/2/a/c1" "txb2c36db420fd49bc93ec8-0068c570a2" "container-server 1824541" 0.0010 "-" 1824541 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txb2c36db420fd49bc93ec8-0068c570a2" "proxy-server 1824541" 0.0290 "-" 1824541 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txb2c36db420fd49bc93ec8-0068c570a2" "proxy-server 1824541" 0.0337 "-" 1824541 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - txb2c36db420fd49bc93ec8-0068c570a2 - 0.0514 - - 1757769890.469956160 1757769890.521367550 1 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx740134c1c4e341a9902c4-0068c570a2" "proxy-server 1824541" 0.0067 "-" 1824541 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:48675/sdb1/1/a/c2" "tx740134c1c4e341a9902c4-0068c570a2" "container-server 1824541" 0.0016 "-" 1824541 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:58941/sda1/1/a/c2" "tx740134c1c4e341a9902c4-0068c570a2" "container-server 1824541" 0.0009 "-" 1824541 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx740134c1c4e341a9902c4-0068c570a2" "proxy-server 1824541" 0.0219 "-" 1824541 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx740134c1c4e341a9902c4-0068c570a2" "proxy-server 1824541" 0.0264 "-" 1824541 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - tx740134c1c4e341a9902c4-0068c570a2 - 0.0395 - - 1757769890.526806593 1757769890.566307545 2 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx46dd2e52e57b4cbdba8c5-0068c570a2" "proxy-server 1824541" 0.0105 "-" 1824541 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/ec-con" 201 - "PUT http://127.0.0.1:48675/sdb1/0/a/ec-con" "tx46dd2e52e57b4cbdba8c5-0068c570a2" "container-server 1824541" 0.0010 "-" 1824541 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/1/a/ec-con" 201 - "PUT http://127.0.0.1:58941/sda1/0/a/ec-con" "tx46dd2e52e57b4cbdba8c5-0068c570a2" "container-server 1824541" 0.0057 "-" 1824541 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/0/a/ec-con" 201 - "PUT http://localhost/v1/a/ec-con" "tx46dd2e52e57b4cbdba8c5-0068c570a2" "proxy-server 1824541" 0.0247 "-" 1824541 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/0/a/ec-con" 201 - "PUT http://localhost/v1/a/ec-con" "tx46dd2e52e57b4cbdba8c5-0068c570a2" "proxy-server 1824541" 0.0174 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec-con HTTP/1.0 201 - - t - - - tx46dd2e52e57b4cbdba8c5-0068c570a2 - 0.0458 - - 1757769890.575866699 1757769890.621638298 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0cea52f5a36a40f097848-0068c570a2" "proxy-server 1824541" 0.0064 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx98ab63dc910f4ec4b40c6-0068c570a2" "proxy-server 1824541" 0.0053 "-" 1824541 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/0/a/ec-con/range-get-test" 201 - "PUT http://localhost/sdh1/2/a/ec-con/range-get-test" "txce23a7b350f84805a5855-0068c570a2" "object-server 1824541" 0.0005 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/2/a/ec-con/range-get-test" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test" "txce23a7b350f84805a5855-0068c570a2" "proxy-server 1824541" 0.0321 "-" 1824541 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/1/a/d3c676b865df46078c69641fb84da19d" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/d3c676b865df46078c69641fb84da19d" "tx8479bcbd5f844d4bb6e90-0068c570a2" "container-server 1824535" 0.0010 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a/d3c676b865df46078c69641fb84da19d" 201 - "PUT http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "tx8479bcbd5f844d4bb6e90-0068c570a2" "proxy-server 1824535" 0.0200 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a/d3c676b865df46078c69641fb84da19d" 201 - "PUT http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "tx8479bcbd5f844d4bb6e90-0068c570a2" "proxy-server 1824535" 0.0291 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/d3c676b865df46078c69641fb84da19d HTTP/1.0 201 - - t - - - tx8479bcbd5f844d4bb6e90-0068c570a2 - 0.0540 - - 1757769890.445315599 1757769890.499324560 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx61f3d376594d41c1a8740-0068c570a2" "proxy-server 1824535" 0.0058 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "tx84c8a4d3be4b447ab1d1c-0068c570a2" "proxy-server 1824535" 0.0012 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 201 - "PUT http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx038c96605ac4421b947d6-0068c570a2" "proxy-server 1824535" 0.0242 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 201 - "PUT http://localhost/sdi1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx038c96605ac4421b947d6-0068c570a2" "object-server 1824535" 0.0005 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 201 - "PUT http://localhost/sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx038c96605ac4421b947d6-0068c570a2" "object-server 1824535" 0.0004 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 201 - "PUT http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx038c96605ac4421b947d6-0068c570a2" "proxy-server 1824535" 0.0452 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 201 - "PUT http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx038c96605ac4421b947d6-0068c570a2" "proxy-server 1824535" 0.0472 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/d3c676b865df46078c69641fb84da19d/conditionals HTTP/1.0 201 - - t 52 - - tx038c96605ac4421b947d6-0068c570a2 - 0.0847 - - 1757769890.500913382 1757769890.585592747 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1f020c0844184636a392b-0068c570a2" "proxy-server 1824535" 0.0022 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "tx3c63ab8428f648e7addfd-0068c570a2" "proxy-server 1824535" 0.0050 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdg1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 200 106 "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx871a7cf2eed940a8abd65-0068c570a2" "proxy-server 1824535" 0.0089 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdi1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 200 106 "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx871a7cf2eed940a8abd65-0068c570a2" "proxy-server 1824535" 0.0007 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4d5fe955f2bb4a3988726-0068c570a2" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "tx6999d0022181470bb5457-0068c570a2" "proxy-server 1824535" 0.0095 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdg1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 412 - "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx2e1cc1f26b3d454a9ee7a-0068c570a2" "proxy-server 1824535" 0.0008 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 412 - "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx2e1cc1f26b3d454a9ee7a-0068c570a2" "proxy-server 1824535" 0.0007 "-" 1824535 3 proxy DEBUG: Ignoring 412 from primary (txn: tx2e1cc1f26b3d454a9ee7a-0068c570a2) proxy DEBUG: Ignoring 412 from primary (txn: tx2e1cc1f26b3d454a9ee7a-0068c570a2) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdi1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 412 - "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx2e1cc1f26b3d454a9ee7a-0068c570a2" "proxy-server 1824535" 0.0008 "-" 1824535 3 proxy DEBUG: Ignoring 412 from primary (txn: tx2e1cc1f26b3d454a9ee7a-0068c570a2) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1137f92223a9479d8aba5-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "tx9b8ca2688a5f4cb581076-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdg1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 200 106 "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx2d8678505fee43c5bf50e-0068c570a2" "proxy-server 1824535" 0.0049 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdi1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 200 106 "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx2d8678505fee43c5bf50e-0068c570a2" "proxy-server 1824535" 0.0007 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx92cec944fb2043478f6ed-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "txc8426e8e96094aee8a838-0068c570a2" "proxy-server 1824535" 0.0024 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdg1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 304 - "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txe8a65e53197241e6a37f1-0068c570a2" "proxy-server 1824535" 0.0008 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdi1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 304 - "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txe8a65e53197241e6a37f1-0068c570a2" "proxy-server 1824535" 0.0007 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 304 - "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txe8a65e53197241e6a37f1-0068c570a2" "proxy-server 1824535" 0.0028 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf80eb3515116456dbe9dc-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "txe212426b3270420e89774-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 3test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_request_setting test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_request_setting ... ok sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 visited - attempted:0 success:0 failure:0 skipped:0 completed:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 scanned - attempted:0 success:0 failure:0 found:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 created - attempted:0 success:0 failure:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 cleaved - attempted:0 success:0 failure:0 min_time:0 max_time:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 misplaced - attempted:0 success:0 failure:0 found:0 placed:0 unplaced:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_root - attempted:0 success:0 failure:0 has_overlap:0 num_overlap:0 sharder-test INFO: Since Sun Sep 14 03:24:50 2025 audit_shard - attempted:0 success:0 failure:0 sharder-test DEBUG: updated root objs=0, tombstones=-1, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=0, tombstones=-1, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=3, tombstones=0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=4, tombstones=0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=5, tombstones=0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=6, tombstones=0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=7, tombstones=0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=8, tombstones=0, path: a/c, db: /tmp/tmpgft0efve/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmporqfckx2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmporqfckx2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmporqfckx2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmporqfckx2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmporqfckx2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmporqfckx2/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=0, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=0, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=3, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=4, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=5, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=6, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=7, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=8, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=8, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=8, tombstones=0, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 3, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=5, tombstones=3, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 4, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=4, tombstones=4, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_sharder.TestSharder.test_update_root_container_own_range test.unit.container.test_sharder.TestSharder.test_update_root_container_own_range ... ok test.unit.container.test_sharder.TestSharder.test_update_stat test.unit.container.test_sharder.TestSharder.test_update_stat ... ok test.unit.container.test_sharder.TestSharder.test_yield_objects test.unit.container.test_sharder.TestSharder.test_yield_objects ... ok test.unit.proxy.test_server.TestECObjectController.test_conditional_GET_ec test.unit.proxy.test_server.TestECObjectController.test_conditional_GET_ec ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_left test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_left ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/0/a/ec-con/range-get-test" 201 - "PUT http://localhost/sdi1/2/a/ec-con/range-get-test" "txce23a7b350f84805a5855-0068c570a2" "object-server 1824541" 0.0005 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/2/a/ec-con/range-get-test" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test" "txce23a7b350f84805a5855-0068c570a2" "proxy-server 1824541" 0.0382 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/2/a/ec-con/range-get-test" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test" "txce23a7b350f84805a5855-0068c570a2" "proxy-server 1824541" 0.0397 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec-con/range-get-test HTTP/1.0 201 - - t 14513 - - txce23a7b350f84805a5855-0068c570a2 - 0.0914 - - 1757769890.631539106 1757769890.722982168 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txaf77818f3023407dab538-0068c570a2" "proxy-server 1824541" 0.0019 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txeb98f1ecf9c240888f2e1-0068c570a2" "proxy-server 1824541" 0.0108 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/3/a/ec-con/range-get-test-tiny" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test-tiny" "txe6112fc18e9542d994f8c-0068c570a2" "proxy-server 1824541" 0.0258 "-" 1824541 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/0/a/ec-con/range-get-test-tiny" 201 - "PUT http://localhost/sdh1/3/a/ec-con/range-get-test-tiny" "txe6112fc18e9542d994f8c-0068c570a2" "object-server 1824541" 0.0004 "-" 1824541 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/0/a/ec-con/range-get-test-tiny" 201 - "PUT http://localhost/sdi1/3/a/ec-con/range-get-test-tiny" "txe6112fc18e9542d994f8c-0068c570a2" "object-server 1824541" 0.0004 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/3/a/ec-con/range-get-test-tiny" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test-tiny" "txe6112fc18e9542d994f8c-0068c570a2" "proxy-server 1824541" 0.0330 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/3/a/ec-con/range-get-test-tiny" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test-tiny" "txe6112fc18e9542d994f8c-0068c570a2" "proxy-server 1824541" 0.0385 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec-con/range-get-test-tiny HTTP/1.0 201 - - t 17 - - txe6112fc18e9542d994f8c-0068c570a2 - 0.0862 - - 1757769890.724509478 1757769890.810723066 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbeb54bf5e63243fcae44e-0068c570a2" "proxy-server 1824541" 0.0055 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx24b9013b7da94d8880123-0068c570a2" "proxy-server 1824541" 0.0050 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/0/a/ec-con/range-get-test-aligned" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test-aligned" "tx94328902206447ae905f6-0068c570a2" "proxy-server 1824541" 0.0182 "-" 1824541 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/0/a/ec-con/range-get-test-aligned" 201 - "PUT http://localhost/sdh1/0/a/ec-con/range-get-test-aligned" "tx94328902206447ae905f6-0068c570a2" "object-server 1824541" 0.0004 "-" 1824541 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/0/a/ec-con/range-get-test-aligned" 201 - "PUT http://localhost/sdi1/0/a/ec-con/range-get-test-aligned" "tx94328902206447ae905f6-0068c570a2" "object-server 1824541" 0.0004 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/0/a/ec-con/range-get-test-aligned" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test-aligned" "tx94328902206447ae905f6-0068c570a2" "proxy-server 1824541" 0.0317 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/0/a/ec-con/range-get-test-aligned" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test-aligned" "tx94328902206447ae905f6-0068c570a2" "proxy-server 1824541" 0.0317 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec-con/range-get-test-aligned HTTP/1.0 201 - - t 8192 - - tx94328902206447ae905f6-0068c570a2 - 0.0606 - - 1757769890.812304497 1757769890.872930050 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3dff3f8e40a34748a3a28-0068c570a2" "proxy-server 1824541" 0.0012 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx612ebb54f7b449049aa19-0068c570a2" "proxy-server 1824541" 0.0076 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdi1/0/a/ec-con/range-get-test-zero-byte" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test-zero-byte" "txc0b1e7f13b8b4bcfade69-0068c570a2" "proxy-server 1824541" 0.0189 "-" 1824541 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdb1/0/a/ec-con/range-get-test-zero-byte" 201 - "PUT http://localhost/sdg1/0/a/ec-con/range-get-test-zero-byte" "txc0b1e7f13b8b4bcfade69-0068c570a2" "object-server 1824541" 0.0004 "-" 1824541 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sda1/0/a/ec-con/range-get-test-zero-byte" 201 - "PUT http://localhost/sdh1/0/a/ec-con/range-get-test-zero-byte" "txc0b1e7f13b8b4bcfade69-0068c570a2" "object-server 1824541" 0.0005 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdh1/0/a/ec-con/range-get-test-zero-byte" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test-zero-byte" "txc0b1e7f13b8b4bcfade69-0068c570a2" "proxy-server 1824541" 0.0321 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "PUT /sdg1/0/a/ec-con/range-get-test-zero-byte" 201 - "PUT http://localhost/v1/a/ec-con/range-get-test-zero-byte" "txc0b1e7f13b8b4bcfade69-0068c570a2" "proxy-server 1824541" 0.0312 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/50 PUT /v1/a/ec-con/range-get-test-zero-byte HTTP/1.0 201 - - t - - - txc0b1e7f13b8b4bcfade69-0068c570a2 - 0.0639 - - 1757769890.874340057 1757769890.938202381 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0c6f4bf1f2914a699a6eb-0068c570a2" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txe901654ac50e4b679ede1-0068c570a2" "proxy-server 1824541" 0.0032 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "tx509cc211c4e241afb9f25-0068c570a2" "proxy-server 1824541" 0.0009 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "tx509cc211c4e241afb9f25-0068c570a2" "proxy-server 1824541" 0.0057 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 5501 - tx509cc211c4e241afb9f25-0068c570a2 - 0.0575 - - 1757769890.949925423 1757769891.007462263 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_off_end test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_off_end ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_range test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_range ... ok sharder-test DEBUG: tombstones = 5, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=3, tombstones=5, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 6, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=2, tombstones=6, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 7, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=1, tombstones=7, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: tombstones = 8, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: updated root objs=0, tombstones=8, path: a/c, db: /tmp/tmpjy4fwmip/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 15 rows (deleted=False) in 0.00022125244140625s, path: a/c, db: /tmp/tmpsoi69dy1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 15 rows (deleted=True) in 0.00017189979553222656s, path: a/c, db: /tmp/tmpsoi69dy1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 10 rows (deleted=False) in 0.0001270771026611328s, path: a/c, db: /tmp/tmpsoi69dy1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=False) in 0.00017380714416503906s, path: a/c, db: /tmp/tmpsoi69dy1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 10 rows (deleted=True) in 0.00010585784912109375s, path: a/c, db: /tmp/tmpsoi69dy1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=True) in 0.00017452239990234375s, path: a/c, db: /tmp/tmpsoi69dy1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=False) in 0.00020623207092285156s, path: a/c, db: /tmp/tmpsoi69dy1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=True) in 0.00019025802612304688s, path: a/c, db: /tmp/tmpsoi69dy1/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00020051002502441406s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 4 rows (deleted=False) in 0.00016927719116210938s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00014352798461914062s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 4 rows (deleted=True) in 0.00014829635620117188s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00014829635620117188s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 4 rows (deleted=False) in 0.00010371208190917969s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.700920104980469e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 4 rows (deleted=True) in 9.059906005859375e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=True) in 7.152557373046875e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 4 rows (deleted=False) in 0.0001723766326904297s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 7.772445678710938e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 4 rows (deleted=True) in 0.00023651123046875s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=True) in 8.702278137207031e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.72747802734375e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=False) in 8.916854858398438e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=True) in 8.20159912109375e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 3 rows (deleted=False) in 8.58306884765625e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 3 rows (deleted=True) in 8.368492126464844e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.0001049041748046875s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00010395050048828125s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=True) in 0.00010895729064941406s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.679794311523438e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=False) in 0.00010180473327636719s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=True) in 0.00011658668518066406s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=False) in 9.632110595703125e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=True) in 9.274482727050781e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 3 rows (deleted=False) in 8.702278137207031e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.dbtest.unit.container.test_sharder.TestSharder.test_yield_objects_to_shard_range test.unit.container.test_sharder.TestSharder.test_yield_objects_to_shard_range ... ok test.unit.container.test_sharder.TestSharder.test_yield_objects_to_shard_range_no_objects test.unit.container.test_sharder.TestSharder.test_yield_objects_to_shard_range_no_objects ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_check_policy test.unit.obj.test_diskfile.TestECDiskFileManager.test_check_policy ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_ondisk_files_commit_window test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_ondisk_files_commit_window ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_ondisk_files_reclaim_non_data_files test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_ondisk_files_reclaim_non_data_files ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 200 106 "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txc544e7d84c4c4cd6ae22a-0068c570a2" "proxy-server 1824535" 0.0089 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdi1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 200 106 "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txc544e7d84c4c4cd6ae22a-0068c570a2" "proxy-server 1824535" 0.0007 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd4be9da023154b208cbf6-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "txc7ddd611386947fe8006f-0068c570a2" "proxy-server 1824535" 0.0012 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdi1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 304 - "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txb2904f5a514e4c9f9c042-0068c570a2" "proxy-server 1824535" 0.0050 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdg1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 304 - "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txb2904f5a514e4c9f9c042-0068c570a2" "proxy-server 1824535" 0.0007 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "GET /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 304 - "GET http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txb2904f5a514e4c9f9c042-0068c570a2" "proxy-server 1824535" 0.0014 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7cff4d3abad34bff833b3-0068c570a2" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "tx6f0f9d0ec41040b3861b1-0068c570a2" "proxy-server 1824535" 0.0056 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 200 106 "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txc9034197fe6b455a930c3-0068c570a2" "proxy-server 1824535" 0.0006 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4c8f6650f45340d9b1527-0068c570a2" "proxy-server 1824535" 0.0088 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "tx5dd15b18952b4a1c8b222-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdi1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 412 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx6e50eec947254b2692126-0068c570a2" "proxy-server 1824535" 0.0006 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 412 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx6e50eec947254b2692126-0068c570a2" "proxy-server 1824535" 0.0006 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdg1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 412 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx6e50eec947254b2692126-0068c570a2" "proxy-server 1824535" 0.0007 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcbd76dd591654602b7edc-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "txfc9a28ecf2624b5d9e6ca-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdg1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 200 106 "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "txf9d0d7e6f948420ca48a2-0068c570a2" "proxy-server 1824535" 0.0006 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx45a6c3def59b4829b9bd4-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "tx517a919384d641b39f417-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 304 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx591a829f367f489bab681-0068c570a2" "proxy-server 1824535" 0.0006 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7b4c7c53a2da40f395269-0068c570a2" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "txa9498758a1574886b88de-0068c570a2" "proxy-server 1824535" 0.0012 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 200 106 "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx8062da3001ee4156a674e-0068c570a2" "proxy-server 1824535" 0.0006 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8b38a2b7436040a6afab9-0068c570a2" "proxy-server 1824535" 0.0021 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:50 +0000] "HEAD /sda1/2/a/d3c676b865df46078c69641fb84da19d" 204 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d" "txb001f29b769241259d413-0068c570a2" "proxy-server 1824535" 0.0058 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdh1/2/a/d3c676b865df46078c69641fb84da19d/conditionals" 304 - "HEAD http://localhost/v1/a/d3c676b865df46078c69641fb84da19d/conditionals" "tx0952d3b4304b45f9b049a-0068c570a2" "proxy-server 1824535" 0.0006 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcaaf8be070cb442aaf995-0068c570a3" "proxy-server 1824535" 0.0013 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdb1/1/a/ec-discon" 201 - "PUT http://127.0.0.1:38699/sda1/1/a/ec-discon" "txcaaf8be070cb442aaf995-0068c570a3" "container-server 1824535" 0.0086 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sda1/1/a/ec-discon" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a/ec-discon" "txcaaf8be070cb442aaf995-0068c570a3" "container-server 1824535" 0.0012 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdb1/1/a/ec-discon" 201 - "PUT http://localhost/v1/a/ec-discon" "txcaaf8be070cb442aaf995-0068c570a3" "proxy-server 1824535" 0.0323 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sda1/1/a/ec-discon" 201 - "PUT http://localhost/v1/a/ec-discon" "txcaaf8be070cb442aaf995-0068c570a3" "proxy-server 1824535" 0.0291 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-discon HTTP/1.0 201 - - t - - - txcaaf8be070cb442aaf995-0068c570a3 - 0.0507 - - 1757769891.010158777 1757769891.060877562 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx93ffb35f33534bbdba698-0068c570a3" "proxy-server 1824535" 0.0021 "-" 1824535 -test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_ondisk_files_reclaim_with_data_files test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_ondisk_files_reclaim_with_data_files ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_ondisk_files_reclaim_with_data_files_legacy_durable test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_ondisk_files_reclaim_with_data_files_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_uses_configured_reclaim_age test.unit.obj.test_diskfile.TestECDiskFileManager.test_cleanup_uses_configured_reclaim_age ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_range_aligned_obj test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_range_aligned_obj ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_construct_dev_path test.unit.obj.test_diskfile.TestECDiskFileManager.test_construct_dev_path ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_focused_yield_hashes_does_not_clean_up test.unit.obj.test_diskfile.TestECDiskFileManager.test_focused_yield_hashes_does_not_clean_up ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_and_filenames_from_hash test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_and_filenames_from_hash ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_bad_meta_name test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_bad_meta_name ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_dev_path_fail test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_dev_path_fail ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_range_end test.unit.proxy.test_server.TestObjectECRangedGET.test_aligned_range_end ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_frag_index_filter test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_frag_index_filter ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_frag_index_filter_legacy_durable test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_frag_index_filter_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_no_actual_files test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_no_actual_files ... ok test.unit.proxy.test_server.TestECObjectController.test_ec_client_disconnect test.unit.proxy.test_server.TestECObjectController.test_ec_client_disconnect ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_bogus test.unit.proxy.test_server.TestObjectECRangedGET.test_bogus ... ok sharder-test DEBUG: got 3 rows (deleted=True) in 0.00011229515075683594s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 0.00012040138244628906s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=False) in 9.775161743164062e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 2 rows (deleted=True) in 8.392333984375e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=False) in 0.00013113021850585938s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=True) in 0.0012888908386230469s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 3 rows (deleted=False) in 0.00010752677917480469s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 3 rows (deleted=True) in 8.749961853027344e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 1 rows (deleted=False) in 9.059906005859375e-05s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 10 rows (deleted=False) in 0.008237123489379883s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=False) in 0.00011396408081054688s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 10 rows (deleted=True) in 0.00020813941955566406s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 5 rows (deleted=True) in 0.00010395050048828125s, path: a/c, db: /tmp/tmpp2htjyjv/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=False) in 0.0025250911712646484s, path: a/c, db: /tmp/tmpkkar2s2b/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db sharder-test DEBUG: got 0 rows (deleted=True) in 0.00012111663818359375s, path: a/c, db: /tmp/tmpkkar2s2b/sda/containers/0/f33/4a8a08f09d37b73795649038408b5f33/4a8a08f09d37b73795649038408b5f33.db test-TestECDiskFileManager WARNING: Unexpected file /tmp/tmpk4b9pb_3/tmp_test_obj_server_DiskFile/119c5a91-0050-4b71-8008-134dbf9f989f/junk: Invalid Timestamp value in filename 'junk' Quarantined /srv/dev/objects/9/900/9a7175077c01a23ade5956b8a2bba900 to because it could not be listed Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1570, in get_diskfile_and_filenames_from_hash filenames = self.cleanup_ondisk_files(object_path)['files'] ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_no_data test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_no_data ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_no_dir test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_no_dir ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_no_meta_name test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_no_meta_name ... ok Quarantined /srv/dev/objects/9/900/9a7175077c01a23ade5956b8a2bba900 to because it is not a directory Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1570, in get_diskfile_and_filenames_from_hash filenames = self.cleanup_ondisk_files(object_path)['files'] ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_not_dir test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_not_dir ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_other_oserror test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_other_oserror ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_read_metadata_problem test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_read_metadata_problem ... ok Quarantined /srv/dev/objects/9/900/9a7175077c01a23ade5956b8a2bba900 to because it could not be listed Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1570, in get_diskfile_and_filenames_from_hash filenames = self.cleanup_ondisk_files(object_path)['files'] ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_unclean test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_diskfile_from_hash_unclean ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_no_rsync_temp_file_warning test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_no_rsync_temp_file_warning ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx88a73a444c954ea7a4542-0068c570a3" "proxy-server 1824541" 0.0081 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx8d7fc371adf84d728f9bd-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 3322 "GET http://localhost/v1/a/ec-con/range-get-test" "tx6ef2922b72f643c1ac165-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 3322 "GET http://localhost/v1/a/ec-con/range-get-test" "tx6ef2922b72f643c1ac165-0068c570a3" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 6321 - tx6ef2922b72f643c1ac165-0068c570a3 - 0.0604 - - 1757769891.020792246 1757769891.081219435 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx59e766b2bf664702b9afc-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx5230373dde0a48f59f293-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 2128 "GET http://localhost/v1/a/ec-con/range-get-test" "tx862b129926b4432eac29b-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 2128 "GET http://localhost/v1/a/ec-con/range-get-test" "tx862b129926b4432eac29b-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 4096 - tx862b129926b4432eac29b-0068c570a3 - 0.0400 - - 1757769891.090357780 1757769891.130315542 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5db849467392443bbd9fa-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx4e092b8fe1e744a19ac66-0068c570a3" "proxy-server 1824541" 0.0062 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/0/a/ec-con/range-get-test-aligned" 206 2128 "GET http://localhost/v1/a/ec-con/range-get-test-aligned" "txb3424210168049b38eb09-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/0/a/ec-con/range-get-test-aligned" 206 2128 "GET http://localhost/v1/a/ec-con/range-get-test-aligned" "txb3424210168049b38eb09-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test-aligned HTTP/1.0 206 - - t - 4096 - txb3424210168049b38eb09-0068c570a3 - 0.0391 - - 1757769891.143232107 1757769891.182301998 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9b9b4aa7d1d745269b767-0068c570a3" "proxy-server 1824541" 0.0029 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txafcc27b9466a439a98506-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "txa21a5dc6bfce46509b07a-0068c570a3" "proxy-server 1824541" 0.0049 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "txa21a5dc6bfce46509b07a-0068c570a3" "proxy-server 1824541" 0.0046 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 2225 - txa21a5dc6bfce46509b07a-0068c570a3 - 0.0311 - - 1757769891.200231075 1757769891.231311083 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe65c9ae37b36416584484-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx8c284bbb41514bf99f9f2-0068c570a3" "proxy-server 1824541" 0.0082 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 200 7578 "GET http://localhost/v1/a/ec-con/range-get-test" "tx96e84bbc30f64975908b8-0068c570a3" "proxy-server 1824541" 0.0048 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 200 7578 "GET http://localhost/v1/a/ec-con/range-get-test" "tx96e84bbc30f64975908b8-0068c570a3" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 200 - - t - 14513 - tx96e84bbc30f64975908b8-0068c570a3 - 0.0417 - - 1757769891.242392540 1757769891.284082651 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfb1072f716f9463ebc743-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx88c5f2ec721a4fc6acec6-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "txcc1a14c1ffa440809e70f-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "txcc1a14c1ffa440809e70f-0068c570a3" "proxy-server 1824541" 0.0049 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 2 - txcc1a14c1ffa440809e70f-0068c570a3 - 0.0278 - - 1757769891.293811798 1757769891.321643114 3 -test.unit.proxy.test_server.TestObjectECRangedGET.test_boundaries test.unit.proxy.test_server.TestObjectECRangedGET.test_boundaries ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_byte_0 test.unit.proxy.test_server.TestObjectECRangedGET.test_byte_0 ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy_and_frag_index test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy_and_frag_index ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_ignore_range_if_metadata_present test.unit.proxy.test_server.TestObjectECRangedGET.test_ignore_range_if_metadata_present ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy_and_frag_index_legacy test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy_and_frag_index_legacy ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy_and_legacy_durable test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy_and_legacy_durable ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_large_suffix test.unit.proxy.test_server.TestObjectECRangedGET.test_large_suffix ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy_some_legacy test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_ec_policy_some_legacy ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_empty_dir test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_empty_dir ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_stray_meta test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_stray_meta ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_unexpected_file test.unit.obj.test_diskfile.TestECDiskFileManager.test_get_ondisk_files_with_unexpected_file ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_init test.unit.obj.test_diskfile.TestECDiskFileManager.test_init ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_init_commit_window test.unit.obj.test_diskfile.TestECDiskFileManager.test_init_commit_window ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_off_end test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_off_end ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx9d9b1078364944d890ff4-0068c570a3" "proxy-server 1824535" 0.0055 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdg1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "tx63473042ee824efa83f17-0068c570a3" "proxy-server 1824535" 0.0267 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdb1/1/a/ec-discon/test" 201 - "PUT http://localhost/sdh1/1/a/ec-discon/test" "tx63473042ee824efa83f17-0068c570a3" "object-server 1824535" 0.0005 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sda1/1/a/ec-discon/test" 201 - "PUT http://localhost/sdi1/1/a/ec-discon/test" "tx63473042ee824efa83f17-0068c570a3" "object-server 1824535" 0.0004 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdi1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "tx63473042ee824efa83f17-0068c570a3" "proxy-server 1824535" 0.0326 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdh1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "tx63473042ee824efa83f17-0068c570a3" "proxy-server 1824535" 0.0339 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-discon/test HTTP/1.0 201 - - t 262144 - - tx63473042ee824efa83f17-0068c570a3 - 0.0735 - - 1757769891.061879635 1757769891.135396719 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbfe55c39eab84c039da9a-0068c570a3" "proxy-server 1824535" 0.0020 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "txde34816480e14b0080841-0068c570a3" "proxy-server 1824535" 0.0077 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/1/a/ec-discon/test" 200 136192 "GET http://localhost/v1/a/ec-discon/test" "tx2511dadd5efe46ffb2321-0068c570a3" "proxy-server 1824535" 0.0007 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/1/a/ec-discon/test" 200 136192 "GET http://localhost/v1/a/ec-discon/test" "tx2511dadd5efe46ffb2321-0068c570a3" "proxy-server 1824535" 0.0058 "-" 1824535 3 proxy WARNING: Client disconnected on read of EC frag '/a/ec-discon/test' (txn: tx2511dadd5efe46ffb2321-0068c570a3) (client_ip: 127.0.0.1) proxy WARNING: Client disconnected on read of EC frag '/a/ec-discon/test' (txn: tx2511dadd5efe46ffb2321-0068c570a3) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-discon/test HTTP/1.0 499 - - t - 12288 - tx2511dadd5efe46ffb2321-0068c570a3 - 0.0439 - - 1757769891.136461496 1757769891.180351019 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx71999c666796419ab5e56-0068c570a3" "proxy-server 1824535" 0.0055 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdb1/1/a/ec-discon" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a/ec-discon" "tx71999c666796419ab5e56-0068c570a3" "container-server 1824535" 0.0011 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdb1/1/a/ec-discon" 202 - "PUT http://localhost/v1/a/ec-discon" "tx71999c666796419ab5e56-0068c570a3" "proxy-server 1824535" 0.0151 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sda1/1/a/ec-discon" 201 - "PUT http://127.0.0.1:38699/sda1/1/a/ec-discon" "tx71999c666796419ab5e56-0068c570a3" "container-server 1824535" 0.0010 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sda1/1/a/ec-discon" 202 - "PUT http://localhost/v1/a/ec-discon" "tx71999c666796419ab5e56-0068c570a3" "proxy-server 1824535" 0.0220 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-discon HTTP/1.0 202 - - t - 76 - tx71999c666796419ab5e56-0068c570a3 - 0.0402 - - 1757769891.275866985 1757769891.316042900 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5b94adc0243a43dcb8784-0068c570a3" "proxy-server 1824535" 0.0021 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx0ea8a05334204aa5a2e01-0068c570a3" "proxy-server 1824535" 0.0013 "-" 1824535 3 proxy WARNING: Client disconnected without sending enough data (txn: tx4fc9a869567c44a8b9240-0068c570a3) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-discon/test HTTP/1.0 499 - - t 262134 89 - tx4fc9a869567c44a8b9240-0068c570a3 - 0.0390 - - 1757769891.317164183 1757769891.356132030 3 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdg1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx4fc9a869567c44a8b9240-0068c570a3" "proxy-server 1824535" 0.0160 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdh1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx4fc9a869567c44a8b9240-0068c570a3" "proxy-server 1824535" 0.0206 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdi1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx4fc9a869567c44a8b9240-0068c570a3" "proxy-server 1824535" 0.0177 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb0926c22028d444887e92-0068c570a3" "proxy-server 1824535" 0.0020 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx8773307ddff84fa7a1f77-0068c570a3" "proxy-server 1824535" 0.0054 "-" 1824535 3 proxy WARNING: Client disconnected without sending last chunk (txn: txd46bb6556e0a40adaef4b-0068c570a3) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-discon/test HTTP/1.0 499 - - t 65536 89 - txd46bb6556e0a40adaef4b-0068c570a3 - 0.0338 - - 1757769891.418848753 1757769891.452624321 3 - obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdi1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txd46bb6556e0a40adaef4b-0068c570a3" "proxy-server 1824535" 0.0099 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdg1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txd46bb6556e0a40adaef4b-0068c570a3" "proxy-server 1824535" 0.0094 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdh1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txd46bb6556e0a40adaef4b-0068c570a3" "proxy-server 1824535" 0.0132 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6eb8249d63fd46e9b043d-0068c570a3" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx33c8ca1288da4cfbb43d4-0068c570a3" "proxy-server 1824535" 0.0054 "-" 1824535 3 proxy WARNING: Client disconnected without sending last chunk (txn: txe2a752370af140f984dc0-0068c570a3) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-discon/test HTTP/1.0 499 - - t - 89 - txe2a752370af140f984dc0-0068c570a3 - 0.0414 - - 1757769891.519562960 1757769891.560925007 3 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdh1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txe2a752370af140f984dc0-0068c570a3" "proxy-server 1824535" 0.0082 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdg1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txe2a752370af140f984dc0-0068c570a3" "proxy-server 1824535" 0.0077 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdi1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txe2a752370af140f984dc0-0068c570a3" "proxy-server 1824535" 0.0234 "-" 1824535 3test.unit.obj.test_diskfile.TestECDiskFileManager.test_listdir test.unit.obj.test_diskfile.TestECDiskFileManager.test_listdir ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_listdir_enoent test.unit.obj.test_diskfile.TestECDiskFileManager.test_listdir_enoent ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_listdir_other_oserror test.unit.obj.test_diskfile.TestECDiskFileManager.test_listdir_other_oserror ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_make_on_disk_filename test.unit.obj.test_diskfile.TestECDiskFileManager.test_make_on_disk_filename ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_make_on_disk_filename_for_meta_with_content_type test.unit.obj.test_diskfile.TestECDiskFileManager.test_make_on_disk_filename_for_meta_with_content_type ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_make_on_disk_filename_with_bad_frag_index test.unit.obj.test_diskfile.TestECDiskFileManager.test_make_on_disk_filename_with_bad_frag_index ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_missing_splice_warning test.unit.obj.test_diskfile.TestECDiskFileManager.test_missing_splice_warning ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_object_audit_location_generator test.unit.obj.test_diskfile.TestECDiskFileManager.test_object_audit_location_generator ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_parse_on_disk_filename test.unit.obj.test_diskfile.TestECDiskFileManager.test_parse_on_disk_filename ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_parse_on_disk_filename_errors test.unit.obj.test_diskfile.TestECDiskFileManager.test_parse_on_disk_filename_errors ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx709a30b061c9439398d94-0068c570a3" "proxy-server 1824541" 0.0012 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx1b082155d6c7425ca950d-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 2128 "GET http://localhost/v1/a/ec-con/range-get-test" "tx3cd29010bd764e77aac67-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 2128 "GET http://localhost/v1/a/ec-con/range-get-test" "tx3cd29010bd764e77aac67-0068c570a3" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 1 - tx3cd29010bd764e77aac67-0068c570a3 - 0.0421 - - 1757769891.345723152 1757769891.387825251 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc15490d9c85645c39c65a-0068c570a3" "proxy-server 1824541" 0.0012 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txe20c01ce7e634d548bfe5-0068c570a3" "proxy-server 1824541" 0.0012 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 200 7578 "GET http://localhost/v1/a/ec-con/range-get-test" "txa718a313a4024369a8b28-0068c570a3" "proxy-server 1824541" 0.0125 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 200 7578 "GET http://localhost/v1/a/ec-con/range-get-test" "txa718a313a4024369a8b28-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 200 - - t - 14513 - txa718a313a4024369a8b28-0068c570a3 - 0.0367 - - 1757769891.403340101 1757769891.439993382 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa45e70490dbb413287482-0068c570a3" "proxy-server 1824541" 0.0015 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx5478c5fd2d2d43c281f08-0068c570a3" "proxy-server 1824541" 0.0014 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 6384 "GET http://localhost/v1/a/ec-con/range-get-test" "tx5467374fb26d4706b230f-0068c570a3" "proxy-server 1824541" 0.0130 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 6384 "GET http://localhost/v1/a/ec-con/range-get-test" "tx5467374fb26d4706b230f-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 5000 - tx5467374fb26d4706b230f-0068c570a3 - 0.0577 - - 1757769891.453435421 1757769891.511134863 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx618ef3f1e6da431485bd4-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txe984a67c50b4494ab72a7-0068c570a3" "proxy-server 1824541" 0.0055 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 4487 "GET http://localhost/v1/a/ec-con/range-get-test" "txf1fd38d183944d7aa7160-0068c570a3" "proxy-server 1824541" 0.0049 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 4487 "GET http://localhost/v1/a/ec-con/range-get-test" "txf1fd38d183944d7aa7160-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 854 - txf1fd38d183944d7aa7160-0068c570a3 - 0.0395 - - 1757769891.523752451 1757769891.563249588 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7f1554d7cb4d471684014-0068c570a3" "proxy-server 1824541" 0.0054 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx1124cb904fe94a8d89670-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 3553 "GET http://localhost/v1/a/ec-con/range-get-test" "tx563cbd06c7d848b4ad084-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 3553 "GET http://localhost/v1/a/ec-con/range-get-test" "tx563cbd06c7d848b4ad084-0068c570a3" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 257 - tx563cbd06c7d848b4ad084-0068c570a3 - 0.0328 - - 1757769891.569019556 1757769891.601866007 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc91c915c457d410d8a2bf-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx2c8d4be6778f488db8771-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 5777 "GET http://localhost/v1/a/ec-con/range-get-test" "txf1a6c58667f244268a2b6-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_one_barely_unsatisfiable test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_one_barely_unsatisfiable ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_overlapping_in_segment test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_overlapping_in_segment ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_some_unsatisfiable test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_some_unsatisfiable ... ok test.unit.proxy.test_server.TestECObjectController.test_ec_client_put_disconnect test.unit.proxy.test_server.TestECObjectController.test_ec_client_put_disconnect ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_some_unsatisfiable_out_of_order test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_some_unsatisfiable_out_of_order ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_suffix_off_end test.unit.proxy.test_server.TestObjectECRangedGET.test_multiple_ranges_suffix_off_end ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:47 +0000] "GET /sdb1/3/a/c/test_leak_1" 200 131072 "GET http://localhost/v1/a/c/test_leak_1" "txcb14babbc29c44bc8679b-0068c5709f" "proxy-server 1824498" 0.0003 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/47 GET /v1/a/c/test_leak_1 HTTP/1.0 200 - - t - 131072 - txcb14babbc29c44bc8679b-0068c5709f - 0.0554 - - 1757769887.862066746 1757769887.917511702 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txed8d84bc32444bc795c99-0068c570a0) proxy-ut ERROR: Object servers returned 2 mismatched etags (txn: txed8d84bc32444bc795c99-0068c570a0) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account/container From Container Server 10.0.0.1:1001/sdb (txn: tx42b23e159dff48e09747e-0068c570a0) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.1:3001/sdb (txn: txb04ce7ee30a44110aec8d-0068c570a0) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.2:3002/sdc (txn: txb04ce7ee30a44110aec8d-0068c570a0) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.1:3001/sdb (txn: tx8109c6f73d654f04815ac-0068c570a0) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.1:3001/sdb (txn: tx9f9234dc8aaa4da2a3c33-0068c570a1) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx9f9234dc8aaa4da2a3c33-0068c570a1) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.0:3000/sda (txn: txde873d9bb28b478a98e25-0068c570a1) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.0:3000/sda (txn: txa3832c0cf02942d792d6e-0068c570a1) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.2:3002/sdc (txn: txa3832c0cf02942d792d6e-0068c570a1) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.1:3001/sdb (txn: txa3832c0cf02942d792d6e-0068c570a1) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txa3832c0cf02942d792d6e-0068c570a1) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.1:3001/sdb (txn: txbb19e6d8ee2848d3aaf24-0068c570a2) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.2:3002/sdc (txn: txbb19e6d8ee2848d3aaf24-0068c570a2) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx1079b2a20a004bc5a3760-0068c570a3)test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_write_timeout test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_node_write_timeout ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_policy_IO test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_policy_IO ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_policy_IO_override test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_policy_IO_override ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_partition_lock_and_replication_lock_same_partition test.unit.obj.test_diskfile.TestECDiskFileManager.test_partition_lock_and_replication_lock_same_partition ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_proxy_passes_content_length_on_head test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_proxy_passes_content_length_on_head ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_off_end test.unit.proxy.test_server.TestObjectECRangedGET.test_off_end ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_proxy_passes_content_type test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_proxy_passes_content_type ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_response_get_accept_ranges_header test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_response_get_accept_ranges_header ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_response_head_accept_ranges_header test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_response_head_accept_ranges_header ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 5777 "GET http://localhost/v1/a/ec-con/range-get-test" "txf1a6c58667f244268a2b6-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 249 - txf1a6c58667f244268a2b6-0068c570a3 - 0.0318 - - 1757769891.618716717 1757769891.650480032 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6a70296a8b4b48c3b9994-0068c570a3" "proxy-server 1824541" 0.0012 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txdf07d63fe5e342ee986de-0068c570a3" "proxy-server 1824541" 0.0055 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 11156 "GET http://localhost/v1/a/ec-con/range-get-test" "tx7c0bc8d04a464be39349d-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 11156 "GET http://localhost/v1/a/ec-con/range-get-test" "tx7c0bc8d04a464be39349d-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 564 - tx7c0bc8d04a464be39349d-0068c570a3 - 0.0381 - - 1757769891.663901806 1757769891.702005863 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx20f27a60e80d43b5bd9a1-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx69c029fadcd24a9e81818-0068c570a3" "proxy-server 1824541" 0.0054 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 6612 "GET http://localhost/v1/a/ec-con/range-get-test" "tx73db71275d6947ddbcd38-0068c570a3" "proxy-server 1824541" 0.0050 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 6612 "GET http://localhost/v1/a/ec-con/range-get-test" "tx73db71275d6947ddbcd38-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 1254 - tx73db71275d6947ddbcd38-0068c570a3 - 0.0329 - - 1757769891.715740204 1757769891.748606443 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd6b3ec208a9a43769aa43-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx01a98991670941909eb99-0068c570a3" "proxy-server 1824541" 0.0053 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 6612 "GET http://localhost/v1/a/ec-con/range-get-test" "tx2a75a966fff84ee7bcbde-0068c570a3" "proxy-server 1824541" 0.0049 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 6612 "GET http://localhost/v1/a/ec-con/range-get-test" "tx2a75a966fff84ee7bcbde-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 1254 - tx2a75a966fff84ee7bcbde-0068c570a3 - 0.0331 - - 1757769891.763515711 1757769891.796569109 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx44e673e6e033406ca4987-0068c570a3" "proxy-server 1824541" 0.0094 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx42b44112807e4b36b5d00-0068c570a3" "proxy-server 1824541" 0.0055 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 6615 "GET http://localhost/v1/a/ec-con/range-get-test" "tx00203bb522d04a068e03b-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 6615 "GET http://localhost/v1/a/ec-con/range-get-test" "tx00203bb522d04a068e03b-0068c570a3" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 257 - tx00203bb522d04a068e03b-0068c570a3 - 0.0367 - - 1757769891.804216385 1757769891.840953112 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2c51970fe8024b3c8bc6f-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx2e495fc6124a445cbf704-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "tx0c6b2867d9ec4bbb95e52-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "tx0c6b2867d9ec4bbb95e52-0068c570a3" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 1 - tx0c6b2867d9ec4bbb95e52-0068c570a3 - 0.0388 - - 1757769891.849811792 1757769891.888639212 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe226730669544129a8faa-0068c570a3" "proxy-server 1824541" 0.0013 "-" 1824541 -test.unit.proxy.test_server.TestObjectECRangedGET.test_overlarge_suffix test.unit.proxy.test_server.TestObjectECRangedGET.test_overlarge_suffix ... ok test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_x_container_headers_db_states test.unit.proxy.test_mem_server.TestReplicatedObjectController.test_x_container_headers_db_states ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_partition_lock_same_partition test.unit.obj.test_diskfile.TestECDiskFileManager.test_partition_lock_same_partition ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_partition_lock_same_partition_different_name test.unit.obj.test_diskfile.TestECDiskFileManager.test_partition_lock_same_partition_different_name ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_pickle_async_update test.unit.obj.test_diskfile.TestECDiskFileManager.test_pickle_async_update ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_overlarge_suffix_tiny_object test.unit.proxy.test_server.TestObjectECRangedGET.test_overlarge_suffix_tiny_object ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_small_suffix test.unit.proxy.test_server.TestObjectECRangedGET.test_small_suffix ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_small_suffix_aligned test.unit.proxy.test_server.TestObjectECRangedGET.test_small_suffix_aligned ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_2 test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_2 ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_another_device_fine test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_another_device_fine ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_off test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_off ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_small_suffix_tiny_object test.unit.proxy.test_server.TestObjectECRangedGET.test_small_suffix_tiny_object ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txee36291527774702974b0-0068c570a3" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "txdc0cdf2da85145f29b135-0068c570a3" "proxy-server 1824535" 0.0015 "-" 1824535 3 proxy WARNING: Client disconnected without sending last chunk (txn: tx0d2ff3407a9a4a93ae73b-0068c570a3) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-discon/test HTTP/1.0 499 - - t - 89 - tx0d2ff3407a9a4a93ae73b-0068c570a3 - 0.0322 - - 1757769891.621164083 1757769891.653405905 3 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdg1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx0d2ff3407a9a4a93ae73b-0068c570a3" "proxy-server 1824535" 0.0027 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdh1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx0d2ff3407a9a4a93ae73b-0068c570a3" "proxy-server 1824535" 0.0136 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdi1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx0d2ff3407a9a4a93ae73b-0068c570a3" "proxy-server 1824535" 0.0133 "-" 1824535 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7a52cc19b973485f9c4bc-0068c570a3" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx5bb9a05a2a81480a8912d-0068c570a3" "proxy-server 1824535" 0.0014 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdb1/1/a/ec-discon/test" 201 - "PUT http://localhost/sdi1/1/a/ec-discon/test" "txb369f514db7a433ea0c9b-0068c570a3" "object-server 1824535" 0.0005 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sda1/1/a/ec-discon/test" 201 - "PUT http://localhost/sdh1/1/a/ec-discon/test" "txb369f514db7a433ea0c9b-0068c570a3" "object-server 1824535" 0.0004 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdi1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "txb369f514db7a433ea0c9b-0068c570a3" "proxy-server 1824535" 0.0266 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdh1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "txb369f514db7a433ea0c9b-0068c570a3" "proxy-server 1824535" 0.0334 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdg1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "txb369f514db7a433ea0c9b-0068c570a3" "proxy-server 1824535" 0.0298 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-discon/test HTTP/1.0 201 - - t 65536 - - txb369f514db7a433ea0c9b-0068c570a3 - 0.0599 - - 1757769891.722505808 1757769891.782449722 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5047c817bb8a441f9a134-0068c570a3" "proxy-server 1824535" 0.0055 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sda1/1/a/ec-con" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/ec-con" "tx5047c817bb8a441f9a134-0068c570a3" "container-server 1824535" 0.0011 "-" 1824535 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdb1/1/a/ec-con" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/ec-con" "tx5047c817bb8a441f9a134-0068c570a3" "container-server 1824535" 0.0092 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdb1/0/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "tx5047c817bb8a441f9a134-0068c570a3" "proxy-server 1824535" 0.0189 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sda1/0/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "tx5047c817bb8a441f9a134-0068c570a3" "proxy-server 1824535" 0.0221 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-con HTTP/1.0 202 - - t - 76 - tx5047c817bb8a441f9a134-0068c570a3 - 0.0378 - - 1757769891.788473606 1757769891.826238394 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9e4f8fe041b54f27b1a37-0068c570a3" "proxy-server 1824535" 0.0103 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx3ffcde2df3da4fe3abcc4-0068c570a3" "proxy-server 1824535" 0.0013 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdg1/2/a/ec-con/o2" 201 - "PUT http://localhost/v1/a/ec-con/o2" "txf9f9f0c908c84519af5eb-0068c570a3" "proxy-server 1824535" 0.0335 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sda1/0/a/ec-con/o2" 201 - "PUT http://localhost/sdh1/2/a/ec-con/o2" "txf9f9f0c908c84519af5eb-0068c570a3" "object-server 1824535" 0.0005 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdb1/0/a/ec-con/o2" 201 - "PUT http://localhost/sdi1/2/a/ec-con/o2" "txf9f9f0c908c84519af5eb-0068c570a3" "object-server 1824535" 0.0004 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdi1/2/a/ec-con/o2" 201 - "PUT http://localhost/v1/a/ec-con/o2" "txf9f9f0c908c84519af5eb-0068c570a3" "proxy-server 1824535" 0.0480 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "PUT /sdh1/2/a/ec-con/o2" 201 - "PUT http://localhost/v1/a/ec-con/o2" "txf9f9f0c908c84519af5eb-0068c570a3" "proxy-server 1824535" 0.0478 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 PUT /v1/a/ec-con/o2 HTTP/1.0 201 - - t 40 - %22f080b258d6577697b9869dbd168d5628%22 txf9f9f0c908c84519af5eb-0068c570a3 - 0.1004 - - 1757769891.836489677 1757769891.936871052 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx004a497dbac7493aad220-0068c570a3" "proxy-server 1824535" 0.0023 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx0b34da3e1abf48809451a-0068c570a3" "proxy-server 1824535" 0.0103 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdg1/2/a/ec-con/o2" 200 100 "HEAD http://localhost/v1/a/ec-con/o2" "tx701ecc5dde6d4281b0409-0068c570a3" "proxy-server 1824535" 0.0007 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 HEAD /v1/a/ec-con/o2 HTTP/1.0 200 - - t - - - tx701ecc5dde6d4281b0409-0068c570a3 - 0.0461 - - 1757769891.938359499 1757769891.984500408 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc208569164cc4244af629-0068c570a3" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txc1a7336fd2a24acd8969f-0068c570a4" "proxy-server 1824535" 0.0014 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/2/a/ec-con/o2" 200 100 "GET http://localhost/v1/a/ec-con/o2" "txf0a822b97f2f44148237a-0068c570a4" "proxy-server 1824535" 0.0007 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/2/a/ec-con/o2" 200 100 "GET http://localhost/v1/a/ec-con/o2" "txf0a822b97f2f44148237a-0068c570a4" "proxy-server 1824535" 0.0007 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/o2 HTTP/1.0 200 - - t - 40 - txf0a822b97f2f44148237a-0068c570a4 - 0.0522 - - 1757769891.986029148 1757769892.038243771 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx47c3607da3d946b881a1c-0068c570a4" "proxy-server 1824535" 0.0094 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx07e8ac639bc64b0698414-0068c570a4" "proxy-server 1824535" 0.0095 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/ec-con/o2" 201 - "POST http://localhost/sdg1/2/a/ec-con/o2" "tx30d8c6143a0e49c98df79-0068c570a4" "object-server 1824535" 0.0004 "-" 1824535 3test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_on test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_on ... ok proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx1079b2a20a004bc5a3760-0068c570a3) proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: tx1079b2a20a004bc5a3760-0068c570a3) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txfa660d5d79434699a0628-0068c570a3) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txfa660d5d79434699a0628-0068c570a3) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txfa660d5d79434699a0628-0068c570a3) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx4b73f5a0cf8842f1bf1af-0068c570a3) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmpyh4uegjs/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpyh4uegjs/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmpyh4uegjs/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpyh4uegjs/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a" 201 - "-" "test" "-" 0.0074 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a" 201 - "-" "test" "-" 0.0071 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a1" 201 - "-" "test" "-" 0.0028 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a1" 201 - "-" "test" "-" 0.0027 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7283bf5b694e465a8a88f-0068c570a4" "proxy-server 1824498" 0.0012 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://127.0.0.1:33753/sda1/0/a/c" "tx7283bf5b694e465a8a88f-0068c570a4" "container-server 1824498" 0.0010 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://127.0.0.1:54711/sdb1/0/a/c" "tx7283bf5b694e465a8a88f-0068c570a4" "container-server 1824498" 0.0011 "-" 1824498 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/c" 201 - "PUT http://localhost/v1/a/c" "tx7283bf5b694e465a8a88f-0068c570a4" "proxy-server 1824498" 0.0169 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/c" 201 - "PUT http://localhost/v1/a/c" "tx7283bf5b694e465a8a88f-0068c570a4" "proxy-server 1824498" 0.0263 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx7283bf5b694e465a8a88f-0068c570a4 - 0.0470 - - 1757769892.064219475 1757769892.111193419 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "txb52a789e7c7e4705af10a-0068c570a4" "proxy-server 1824498" 0.0054 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a1/c1" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a1/c1" "txb52a789e7c7e4705af10a-0068c570a4" "container-server 1824498" 0.0011 "-" 1824498 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a1/c1" 201 - "PUT http://127.0.0.1:33753/sda1/2/a1/c1" "txb52a789e7c7e4705af10a-0068c570a4" "container-server 1824498" 0.0010 "-" 1824498 0test.unit.proxy.test_server.TestECObjectController.test_reload_ring_ec test.unit.proxy.test_server.TestECObjectController.test_reload_ring_ec ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx6a33be26583747e98f6bc-0068c570a3" "proxy-server 1824541" 0.0096 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 7578 "GET http://localhost/v1/a/ec-con/range-get-test" "tx3c646e8691384f809fbcf-0068c570a3" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 7578 "GET http://localhost/v1/a/ec-con/range-get-test" "tx3c646e8691384f809fbcf-0068c570a3" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 14513 - tx3c646e8691384f809fbcf-0068c570a3 - 0.0532 - - 1757769891.901185274 1757769891.954360723 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2e257d19a3124ad08d742-0068c570a3" "proxy-server 1824541" 0.0012 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx969499b6f8a84e1db1025-0068c570a3" "proxy-server 1824541" 0.0056 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdh1/3/a/ec-con/range-get-test-tiny" 206 90 "GET http://localhost/v1/a/ec-con/range-get-test-tiny" "tx4341a05a40ec4fb8aba63-0068c570a3" "proxy-server 1824541" 0.0049 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:51 +0000] "GET /sdi1/3/a/ec-con/range-get-test-tiny" 206 90 "GET http://localhost/v1/a/ec-con/range-get-test-tiny" "tx4341a05a40ec4fb8aba63-0068c570a3" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/51 GET /v1/a/ec-con/range-get-test-tiny HTTP/1.0 206 - - t - 17 - tx4341a05a40ec4fb8aba63-0068c570a3 - 0.0320 - - 1757769891.967596054 1757769891.999631643 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd6095aaf97024adcab147-0068c570a4" "proxy-server 1824541" 0.0012 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx97c2dd8d968041f989457-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "tx681f0d0844074444b0124-0068c570a4" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "tx681f0d0844074444b0124-0068c570a4" "proxy-server 1824541" 0.0048 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 100 - tx681f0d0844074444b0124-0068c570a4 - 0.0318 - - 1757769892.009716034 1757769892.041470289 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx94c7d59dce3e4ec69aa94-0068c570a4" "proxy-server 1824541" 0.0076 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txe4e14fe55c2c4f2782880-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/0/a/ec-con/range-get-test-aligned" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test-aligned" "tx6dec54f918854efb897c8-0068c570a4" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/0/a/ec-con/range-get-test-aligned" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test-aligned" "tx6dec54f918854efb897c8-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test-aligned HTTP/1.0 206 - - t - 100 - tx6dec54f918854efb897c8-0068c570a4 - 0.0342 - - 1757769892.055166721 1757769892.089367151 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb90894de33304e1984a8d-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txdca5d0aab67b41c1a9348-0068c570a4" "proxy-server 1824541" 0.0014 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/3/a/ec-con/range-get-test-tiny" 206 90 "GET http://localhost/v1/a/ec-con/range-get-test-tiny" "tx82f58457e2724b07a187a-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/3/a/ec-con/range-get-test-tiny" 206 90 "GET http://localhost/v1/a/ec-con/range-get-test-tiny" "tx82f58457e2724b07a187a-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test-tiny HTTP/1.0 206 - - t - 5 - tx82f58457e2724b07a187a-0068c570a4 - 0.0324 - - 1757769892.102059841 1757769892.134447575 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx242babb574fa41299483f-0068c570a4" "proxy-server 1824541" 0.0054 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txd11d689c743949ee82c79-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "tx684c19c511af4f2d800e5-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "tx684c19c511af4f2d800e5-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 2226 - tx684c19c511af4f2d800e5-0068c570a4 - 0.0346 - - 1757769892.144483089 1757769892.179084063 3 -test.unit.proxy.test_server.TestObjectECRangedGET.test_suffix_two_segs test.unit.proxy.test_server.TestObjectECRangedGET.test_suffix_two_segs ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_suffix_zero_byte_object test.unit.proxy.test_server.TestObjectECRangedGET.test_suffix_zero_byte_object ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_two_ranges_one_unsatisfiable test.unit.proxy.test_server.TestObjectECRangedGET.test_two_ranges_one_unsatisfiable ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_same_partition test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_lock_same_partition ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_one_per_device_deprecation test.unit.obj.test_diskfile.TestECDiskFileManager.test_replication_one_per_device_deprecation ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_verify_ondisk_files test.unit.obj.test_diskfile.TestECDiskFileManager.test_verify_ondisk_files ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_two_ranges_one_unsatisfiable_same_segment test.unit.proxy.test_server.TestObjectECRangedGET.test_two_ranges_one_unsatisfiable_same_segment ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_cleans_up_everything test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_cleans_up_everything ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_dev_path_fail test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_dev_path_fail ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_empty test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_empty ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_empty_suffixes test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_empty_suffixes ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_filters_frag_index test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_filters_frag_index ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_unaligned test.unit.proxy.test_server.TestObjectECRangedGET.test_unaligned ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_filters_frag_index_legacy_durable test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_filters_frag_index_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_ignores_bad_ondisk_filesets test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_ignores_bad_ondisk_filesets ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_legacy_durable test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_optionally_yields_non_durable_data test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_optionally_yields_non_durable_data ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_skips_missing_legacy_durable test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_skips_missing_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_skips_newer_data_without_legacy_durable test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_skips_newer_data_without_legacy_durable ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "POST /sdg1/2/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "tx30d8c6143a0e49c98df79-0068c570a4" "proxy-server 1824535" 0.0153 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "POST /sdi1/2/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "tx30d8c6143a0e49c98df79-0068c570a4" "proxy-server 1824535" 0.0155 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/ec-con/o2" 201 - "POST http://localhost/sdh1/2/a/ec-con/o2" "tx30d8c6143a0e49c98df79-0068c570a4" "object-server 1824535" 0.0004 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "POST /sdh1/2/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "tx30d8c6143a0e49c98df79-0068c570a4" "proxy-server 1824535" 0.0158 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 POST /v1/a/ec-con/o2 HTTP/1.0 202 - - t - 76 - tx30d8c6143a0e49c98df79-0068c570a4 - 0.0567 - - 1757769892.051911354 1757769892.108613014 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx465de3516dfa4941b460d-0068c570a4" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txf9c520bdd10a44db9fc19-0068c570a4" "proxy-server 1824535" 0.0068 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "POST /sdg1/2/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "tx063797f736a44f44baf9c-0068c570a4" "proxy-server 1824535" 0.0135 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/ec-con/o2" 201 - "POST http://localhost/sdh1/2/a/ec-con/o2" "tx063797f736a44f44baf9c-0068c570a4" "object-server 1824535" 0.0004 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/ec-con/o2" 201 - "POST http://localhost/sdi1/2/a/ec-con/o2" "tx063797f736a44f44baf9c-0068c570a4" "object-server 1824535" 0.0045 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "POST /sdi1/2/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "tx063797f736a44f44baf9c-0068c570a4" "proxy-server 1824535" 0.0242 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "POST /sdh1/2/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "tx063797f736a44f44baf9c-0068c570a4" "proxy-server 1824535" 0.0237 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 POST /v1/a/ec-con/o2 HTTP/1.0 202 - - t - 76 - tx063797f736a44f44baf9c-0068c570a4 - 0.0595 - - 1757769892.110129833 1757769892.169643402 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc16427dc67c54e3089845-0068c570a4" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txa41a3f179f8c4a7094a9d-0068c570a4" "proxy-server 1824535" 0.0102 "-" 1824535 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "DELETE /sdb1/0/a/ec-con/o2" 204 - "DELETE http://localhost/sdh1/2/a/ec-con/o2" "tx7b9651b684f8496e97413-0068c570a4" "object-server 1824535" 0.0004 "-" 1824535 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "DELETE /sdh1/2/a/ec-con/o2" 204 - "DELETE http://localhost/v1/a/ec-con/o2" "tx7b9651b684f8496e97413-0068c570a4" "proxy-server 1824535" 0.0190 "-" 1824535 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "DELETE /sdi1/2/a/ec-con/o2" 204 - "DELETE http://localhost/v1/a/ec-con/o2" "tx7b9651b684f8496e97413-0068c570a4" "proxy-server 1824535" 0.0156 "-" 1824535 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "DELETE /sda1/0/a/ec-con/o2" 204 - "DELETE http://localhost/sdg1/2/a/ec-con/o2" "tx7b9651b684f8496e97413-0068c570a4" "object-server 1824535" 0.0004 "-" 1824535 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "DELETE /sdg1/2/a/ec-con/o2" 204 - "DELETE http://localhost/v1/a/ec-con/o2" "tx7b9651b684f8496e97413-0068c570a4" "proxy-server 1824535" 0.0108 "-" 1824535 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 DELETE /v1/a/ec-con/o2 HTTP/1.0 204 - - t - - - tx7b9651b684f8496e97413-0068c570a4 - 0.0644 - - 1757769892.175357103 1757769892.239727020 3 - proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9d43b63db7584e2cab88f-0068c570a4" "proxy-server 1824535" 0.0014 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/1/a/versions" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/versions" "tx9d43b63db7584e2cab88f-0068c570a4" "container-server 1824535" 0.0011 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/1/a/versions" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/versions" "tx9d43b63db7584e2cab88f-0068c570a4" "container-server 1824535" 0.0093 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/versions" 201 - "PUT http://localhost/v1/a/versions" "tx9d43b63db7584e2cab88f-0068c570a4" "proxy-server 1824535" 0.0254 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/versions" 201 - "PUT http://localhost/v1/a/versions" "tx9d43b63db7584e2cab88f-0068c570a4" "proxy-server 1824535" 0.0354 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/versions HTTP/1.0 201 - - t - - - tx9d43b63db7584e2cab88f-0068c570a4 - 0.0509 - - 1757769892.247037888 1757769892.297942162 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc4544d1184d442df8ea3c-0068c570a4" "proxy-server 1824535" 0.0061 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdb1/0/a/versions" 200 2 "GET http://localhost/v1/a/versions?format=json&states=listing" "txc4544d1184d442df8ea3c-0068c570a4" "proxy-server 1824535" 0.0103 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/versions%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - txc4544d1184d442df8ea3c-0068c570a4 - 0.0222 - - 1757769892.303561926 1757769892.325757504 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5de625dea3f8422d8782e-0068c570a4" "proxy-server 1824535" 0.0060 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/1/a/vers" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/vers" "tx5de625dea3f8422d8782e-0068c570a4" "container-server 1824535" 0.0010 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/1/a/vers" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/vers" "tx5de625dea3f8422d8782e-0068c570a4" "container-server 1824535" 0.0010 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/vers" 201 - "PUT http://localhost/v1/a/vers" "tx5de625dea3f8422d8782e-0068c570a4" "proxy-server 1824535" 0.0199 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/vers" 201 - "PUT http://localhost/v1/a/vers" "tx5de625dea3f8422d8782e-0068c570a4" "proxy-server 1824535" 0.0328 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/vers HTTP/1.0 201 - - t - - - tx5de625dea3f8422d8782e-0068c570a4 - 0.0448 - - 1757769892.331715584 1757769892.376487732 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe3e7a48f41604c8081ae4-0068c570a4" "proxy-server 1824535" 0.0019 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/52 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txe3e7a48f41604c8081ae4-0068c570a4 - 0.0168 VW - 1757769892.378058434 1757769892.394810438 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx1503d0e0050c4f9c8510c-0068c570a4" "proxy-server 1824535" 0.0012 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - tx1503d0e0050c4f9c8510c-0068c570a4 - 0.0080 VW - 1757769892.395371199 1757769892.403329372 0 -test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_skips_newer_non_durable_data test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_skips_newer_non_durable_data ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_skips_non_durable_data test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_skips_non_durable_data ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_suffix_filter test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_suffix_filter ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_suffix_filter_legacy_durable test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_suffix_filter_legacy_durable ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_tombstones test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_tombstones ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd86f97f1a25f4b62a5cd6-0068c570a4" "proxy-server 1824541" 0.0060 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx2c939d2127d64a69b0f4c-0068c570a4" "proxy-server 1824541" 0.0091 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/0/a/ec-con/range-get-test-zero-byte" 200 - "GET http://localhost/v1/a/ec-con/range-get-test-zero-byte" "tx6625ba510a9e44c188417-0068c570a4" "proxy-server 1824541" 0.0076 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/0/a/ec-con/range-get-test-zero-byte" 200 - "GET http://localhost/v1/a/ec-con/range-get-test-zero-byte" "tx6625ba510a9e44c188417-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test-zero-byte HTTP/1.0 200 - - t - - - tx6625ba510a9e44c188417-0068c570a4 - 0.0384 - - 1757769892.200004339 1757769892.238424301 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3afb326b3c55496c8181c-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx47754b32be114b8284958-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 2128 "GET http://localhost/v1/a/ec-con/range-get-test" "txf0ce6cd45a39473abbd8a-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 2128 "GET http://localhost/v1/a/ec-con/range-get-test" "txf0ce6cd45a39473abbd8a-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 101 - txf0ce6cd45a39473abbd8a-0068c570a4 - 0.0345 - - 1757769892.255836248 1757769892.290302992 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx373607590db54f7db2231-0068c570a4" "proxy-server 1824541" 0.0012 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txabbf67fb6b2c41c190189-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 2622 "GET http://localhost/v1/a/ec-con/range-get-test" "txfac2ff0b7cd74c1f9d266-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 2622 "GET http://localhost/v1/a/ec-con/range-get-test" "txfac2ff0b7cd74c1f9d266-0068c570a4" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 11 - txfac2ff0b7cd74c1f9d266-0068c570a4 - 0.0363 - - 1757769892.303659916 1757769892.339982510 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1118dd6405284b1eb0257-0068c570a4" "proxy-server 1824541" 0.0055 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx7a4262e430cb47c388f89-0068c570a4" "proxy-server 1824541" 0.0054 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "tx201bbf239be84259afeeb-0068c570a4" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 4256 "GET http://localhost/v1/a/ec-con/range-get-test" "tx201bbf239be84259afeeb-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 4096 - tx201bbf239be84259afeeb-0068c570a4 - 0.0360 - - 1757769892.352133036 1757769892.388165951 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9dd4b9f6ac334873a7c82-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txefa2d29346e64557a8c16-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "tx09edf069d5ae4ba695818-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "tx09edf069d5ae4ba695818-0068c570a4" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 416 - - t - 97 - tx09edf069d5ae4ba695818-0068c570a4 - 0.0278 - - 1757769892.401760817 1757769892.429563284 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0a0819cc209e4ac5b44a8-0068c570a4" "proxy-server 1824541" 0.0015 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx7715fd18e5004a089109f-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 416 97 "GET http://localhost/v1/a/ec-con/range-get-test" "txed5fdf8806b94cb687643-0068c570a4" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 416 97 "GET http://localhost/v1/a/ec-con/range-get-test" "txed5fdf8806b94cb687643-0068c570a4" "proxy-server 1824541" 0.0008 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 416 - - t - 97 - txed5fdf8806b94cb687643-0068c570a4 - 0.0408 - - 1757769892.435416937 1757769892.476213694 3 -test.unit.proxy.test_server.TestObjectECRangedGET.test_unsatisfiable test.unit.proxy.test_server.TestObjectECRangedGET.test_unsatisfiable ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_unsatisfiable_socket_leak test.unit.proxy.test_server.TestObjectECRangedGET.test_unsatisfiable_socket_leak ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_until_end test.unit.proxy.test_server.TestObjectECRangedGET.test_until_end ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_yields_meta_timestamp test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_yields_meta_timestamp ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_yields_meta_timestamp_legacy_durable test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_hashes_yields_meta_timestamp_legacy_durable ... ok /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_suffixes test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_suffixes ... ok test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec ... ok test.unit.proxy.test_server.TestObjectECRangedGET.test_way_off_end test.unit.proxy.test_server.TestObjectECRangedGET.test_way_off_end ... ok test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_suffixes_dev_path_fail test.unit.obj.test_diskfile.TestECDiskFileManager.test_yield_suffixes_dev_path_fail ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_build_task_obj_round_trip test.unit.obj.test_expirer.TestObjectExpirer.test_build_task_obj_round_trip ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_container_timestamp_break test.unit.obj.test_expirer.TestObjectExpirer.test_container_timestamp_break ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_delete_object test.unit.obj.test_expirer.TestObjectExpirer.test_delete_object ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "txb52a789e7c7e4705af10a-0068c570a4" "proxy-server 1824498" 0.0324 "-" 1824498 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "txb52a789e7c7e4705af10a-0068c570a4" "proxy-server 1824498" 0.0249 "-" 1824498 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - txb52a789e7c7e4705af10a-0068c570a4 - 0.0485 - - 1757769892.112665653 1757769892.161153555 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf22fb7e6a4ff47579a075-0068c570a4" "proxy-server 1824498" 0.0019 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://127.0.0.1:33753/sda1/0/a/c1" "txf22fb7e6a4ff47579a075-0068c570a4" "container-server 1824498" 0.0011 "-" 1824498 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://127.0.0.1:54711/sdb1/0/a/c1" "txf22fb7e6a4ff47579a075-0068c570a4" "container-server 1824498" 0.0075 "-" 1824498 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txf22fb7e6a4ff47579a075-0068c570a4" "proxy-server 1824498" 0.0348 "-" 1824498 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/c1" 201 - "PUT http://localhost/v1/a/c1" "txf22fb7e6a4ff47579a075-0068c570a4" "proxy-server 1824498" 0.0273 "-" 1824498 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - txf22fb7e6a4ff47579a075-0068c570a4 - 0.0564 - - 1757769892.162539482 1757769892.218917608 1 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx56f0732fd30f4720b286e-0068c570a4" "proxy-server 1824498" 0.0065 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/c2" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/c2" "tx56f0732fd30f4720b286e-0068c570a4" "container-server 1824498" 0.0017 "-" 1824498 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/c2" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/c2" "tx56f0732fd30f4720b286e-0068c570a4" "container-server 1824498" 0.0091 "-" 1824498 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/2/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx56f0732fd30f4720b286e-0068c570a4" "proxy-server 1824498" 0.0291 "-" 1824498 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/2/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx56f0732fd30f4720b286e-0068c570a4" "proxy-server 1824498" 0.0216 "-" 1824498 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - tx56f0732fd30f4720b286e-0068c570a4 - 0.0461 - - 1757769892.220196962 1757769892.266328096 2 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1fed83cbe4fe49ef906e5-0068c570a4" "proxy-server 1824498" 0.0100 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "tx1fed83cbe4fe49ef906e5-0068c570a4" "container-server 1824498" 0.0019 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "tx1fed83cbe4fe49ef906e5-0068c570a4" "container-server 1824498" 0.0092 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/2/a/ec-dup" 201 - "PUT http://localhost/v1/a/ec-dup" "tx1fed83cbe4fe49ef906e5-0068c570a4" "proxy-server 1824498" 0.0495 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/2/a/ec-dup" 201 - "PUT http://localhost/v1/a/ec-dup" "tx1fed83cbe4fe49ef906e5-0068c570a4" "proxy-server 1824498" 0.0263 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/ec-dup HTTP/1.0 201 - - t - - - tx1fed83cbe4fe49ef906e5-0068c570a4 - 0.0742 - - 1757769892.276102543 1757769892.350347519 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6f5c119e3b4744bd87553-0068c570a4" "proxy-server 1824498" 0.0102 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx00acc8a84d8743c9bf6b3-0068c570a4" "proxy-server 1824498" 0.0094 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdi1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx867806cea2f34085a3653-0068c570a4" "proxy-server 1824498" 0.0775 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdk1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx867806cea2f34085a3653-0068c570a4" "proxy-server 1824498" 0.0941 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdg1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx867806cea2f34085a3653-0068c570a4" "proxy-server 1824498" 0.0806 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdl1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx867806cea2f34085a3653-0068c570a4" "proxy-server 1824498" 0.0803 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/2/a/ec-dup/go-get-it" 201 - "PUT http://localhost/sdj1/1/a/ec-dup/go-get-it" "tx867806cea2f34085a3653-0068c570a4" "object-server 1824498" 0.0005 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/2/a/ec-dup/go-get-it" 201 - "PUT http://localhost/sdh1/1/a/ec-dup/go-get-it" "tx867806cea2f34085a3653-0068c570a4" "object-server 1824498" 0.0004 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdj1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx867806cea2f34085a3653-0068c570a4" "proxy-server 1824498" 0.0840 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdh1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx867806cea2f34085a3653-0068c570a4" "proxy-server 1824498" 0.0921 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/ec-dup/go-get-it HTTP/1.0 201 - - t 1309 - - tx867806cea2f34085a3653-0068c570a4 - 0.1451 - - 1757769892.359941721 1757769892.505061865 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0b138b5c9a1e413eaecfa-0068c570a4" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "txe10052e743514cb19e7d0-0068c570a4" "proxy-server 1824498" 0.0076 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/1/a/ec-dup/go-get-it" 200 736 "GET http://localhost/v1/a/ec-dup/go-get-it" "tx229be3ddcbfd46859d1ec-0068c570a4" "proxy-server 1824498" 0.0013 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/1/a/ec-dup/go-get-it" 200 736 "GET http://localhost/v1/a/ec-dup/go-get-it" "tx229be3ddcbfd46859d1ec-0068c570a4" "proxy-server 1824498" 0.0049 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-dup/go-get-it HTTP/1.0 200 - - t - 1309 - tx229be3ddcbfd46859d1ec-0068c570a4 - 0.0393 - - 1757769892.506534100 1757769892.545804024 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3f5c806ffbb14a33b3a4e-0068c570a4" "proxy-server 1824498" 0.0057 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "tx3f5c806ffbb14a33b3a4e-0068c570a4" "container-server 1824498" 0.0015 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx3f5c806ffbb14a33b3a4e-0068c570a4" "proxy-server 1824498" 0.0107 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "tx3f5c806ffbb14a33b3a4e-0068c570a4" "container-server 1824498" 0.0103 "-" 1824498 4test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec_404 test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec_404 ... ok test-TestECDiskFileManager DEBUG: Rsync tempfile: /tmp/tmpcokyyobb/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/.1472017820.44503.data.QBYCYU test-TestECDiskFileManager DEBUG: Rsync tempfile: /tmp/tmpcokyyobb/tmp_test_obj_server_DiskFile/sda1/objects/0/77c/ab4a8c0dec756ad76845d2920375f77c/.total-bs.abcdef test-TestECDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects/junk: Invalid Timestamp value in filename 'junk' test-TestECDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects/junk.data: Invalid Timestamp value in filename 'junk.data' test-TestECDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects/.junk: Invalid Timestamp value in filename '.junk' test-TestECDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects-1/junk: Invalid Timestamp value in filename 'junk' test-TestECDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects-1/junk.data: Invalid Timestamp value in filename 'junk.data' test-TestECDiskFileManager WARNING: Unexpected file /srv/node/sdb1/objects-1/.junk: Invalid Timestamp value in filename '.junk' test-TestECDiskFileManager WARNING: Use of splice() requested (config says "splice = yes"), but the system does not support it. splice() will not be used. test-TestECDiskFileManager WARNING: Option replication_one_per_device is deprecated and will be removed in a future version. Update your configuration to use option replication_concurrency_per_device. test-TestECDiskFileManager WARNING: Option replication_one_per_device is deprecated and will be removed in a future version. Update your configuration to use option replication_concurrency_per_device. test-TestECDiskFileManager WARNING: Option replication_one_per_device ignored as replication_concurrency_per_device is defined. test-TestECDiskFileManager WARNING: Option replication_one_per_device ignored as replication_concurrency_per_device is defined. test-TestECDiskFileManager WARNING: Option replication_one_per_device ignored as replication_concurrency_per_device is defined. test-TestECDiskFileManager DEBUG: Run listdir on /tmp/tmpmd6z1w0m/tmp_test_obj_server_DiskFile/sda1/objects/0 test-TestECDiskFileManager WARNING: Unexpected file /tmp/tmpgct860iu/tmp_test_obj_server_DiskFile/sda1/objects/9/456/9444a92d072897b136b3fc06595b7456/1757769892.00000.data: Bad fragment index: None: invalid literal for int() with base 10: 'None' test-TestECDiskFileManager WARNING: Unexpected file /tmp/tmpgct860iu/tmp_test_obj_server_DiskFile/sda1/objects/9/456/9555a92d072897b136b3fc06595b8456/junk_file: Invalid Timestamp value in filename 'junk_file' test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 0 objects expired test-expirer ERROR: Unexpected response while deleting object account container obj: 404 test-expirer DEBUG: b'' test-expirer ERROR: Unexpected response while deleting object account container obj: 412 test-expirer DEBUG: b'' test-expirer ERROR: Unexpected response while deleting object account container obj: 500 test-expirer DEBUG: b'' test-expirer ERROR: Exception while deleting object account container obj : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect Exception test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer ERROR: Exception while deleting object .expiring_objects 1757635168 1757683492-a0/c0/o0 TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given test-expirer ERROR: Exception while deleting object .expiring_objects 1757635168 1757683492-a1/c1/o1 TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given test-expirer ERROR: Exception while deleting object .expiring_objects 1757635168 1757683492-a2/c2/o2 TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given test-expirer ERROR: Exception while deleting object .expiring_objects 1757635168 1757683492-a3/c3/o3 TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given test-expirer ERROR: Exception while deleting object .expiring_objects 1757635168 1757683492-a4/c4/o4 TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given test-expirer ERROR: Exception while deleting object .expiring_objects 1757721568 1757769891-a5/c5/o5 TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdb1/3/a/versions/name" 404 70 "GET http://localhost/v1/a/versions/name?symlink=get" "tx055264fc4fcc4d0aaaadc-0068c570a4" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sda1/3/a/versions/name" 404 70 "GET http://localhost/v1/a/versions/name?symlink=get" "tx055264fc4fcc4d0aaaadc-0068c570a4" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 GET /v1/a/versions/name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx055264fc4fcc4d0aaaadc-0068c570a4 - 0.0115 VW - 1757769892.403936863 1757769892.415395021 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "txc9851d6199034c9eba322-0068c570a4" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txc9851d6199034c9eba322-0068c570a4" "proxy-server 1824535" 0.0097 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "txc9851d6199034c9eba322-0068c570a4" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txc9851d6199034c9eba322-0068c570a4" "proxy-server 1824535" 0.0392 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/versions/name HTTP/1.0 201 - - t 5 - - txc9851d6199034c9eba322-0068c570a4 - 0.0427 - - 1757769892.415788174 1757769892.458483696 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx023e1e0103864b29939ae-0068c570a4" "proxy-server 1824535" 0.0012 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/52 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx023e1e0103864b29939ae-0068c570a4 - 0.0045 VW - 1757769892.479611635 1757769892.484111547 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx7ba47cb7ff344b01a3b0d-0068c570a4" "proxy-server 1824535" 0.0142 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - tx7ba47cb7ff344b01a3b0d-0068c570a4 - 0.0168 VW - 1757769892.484603643 1757769892.501364946 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdb1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name?symlink=get" "txfe8af12ad763479c9ee6e-0068c570a4" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sda1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name?symlink=get" "txfe8af12ad763479c9ee6e-0068c570a4" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/vers" 204 - "HEAD http://localhost/v1/a/vers" "tx234ae155e3f34b96ab1db-0068c570a4" "proxy-server 1824535" 0.0014 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 GET /v1/a/versions/name%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txfe8af12ad763479c9ee6e-0068c570a4 - 0.0606 VW - 1757769892.501889467 1757769892.562441111 0 - (txn: txa29c737bd13b4349918f2-0068c570a4) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/vers/004name/1757769892.41628" 201 - "PUT http://localhost/sdb1/0/a/vers/004name/1757769892.41628" "txa29c737bd13b4349918f2-0068c570a4" "object-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/vers/004name/1757769892.41628" 201 - "PUT http://localhost/v1/a/vers/004name/1757769892.41628" "txa29c737bd13b4349918f2-0068c570a4" "proxy-server 1824535" 0.0084 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/vers/004name/1757769892.41628" 201 - "PUT http://localhost/sda1/0/a/vers/004name/1757769892.41628" "txa29c737bd13b4349918f2-0068c570a4" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/vers/004name/1757769892.41628" 201 - "PUT http://localhost/v1/a/vers/004name/1757769892.41628" "txa29c737bd13b4349918f2-0068c570a4" "proxy-server 1824535" 0.0108 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 PUT /v1/a/vers/004name/1757769892.41628 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txa29c737bd13b4349918f2-0068c570a4 - 0.0400 VW - 1757769892.533172369 1757769892.573160887 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "tx7e6ae0d04f62482a93ea5-0068c570a4" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "tx7e6ae0d04f62482a93ea5-0068c570a4" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx7e6ae0d04f62482a93ea5-0068c570a4" "proxy-server 1824535" 0.0079 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx7e6ae0d04f62482a93ea5-0068c570a4" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/versions/name HTTP/1.0 201 - - t 5 - - tx7e6ae0d04f62482a93ea5-0068c570a4 - 0.0134 - - 1757769892.573631287 1757769892.587018251 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd838872782564dc2ab969-0068c570a4" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txd2f0a8a6aa4e467fac88b-0068c570a4" "proxy-server 1824535" 0.0027 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sda1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name" "tx939eb66c609f410c9be6b-0068c570a4" "proxy-server 1824535" 0.0033 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/versions/name HTTP/1.0 200 - - t - 5 - tx939eb66c609f410c9be6b-0068c570a4 - 0.0167 - - 1757769892.588641644 1757769892.605365515 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx09694a9d5a464ad2a2ac4-0068c570a4" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/52 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx09694a9d5a464ad2a2ac4-0068c570a4 - 0.0164 VW - 1757769892.619737148 1757769892.636091471 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx73e36d7475044d1ba78f1-0068c570a4" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - tx73e36d7475044d1ba78f1-0068c570a4 - 0.0123 VW - 1757769892.636605263 1757769892.648858070 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdb1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name?symlink=get" "tx056ce007a1f949448062e-0068c570a4" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sda1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name?symlink=get" "tx056ce007a1f949448062e-0068c570a4" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/vers" 204 - "HEAD http://localhost/v1/a/vers" "tx85b0fe763d4647a49925a-0068c570a4" "proxy-server 1824535" 0.0101 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 GET /v1/a/versions/name%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx056ce007a1f949448062e-0068c570a4 - 0.0467 VW - 1757769892.649383307 1757769892.696117401 0 - (txn: tx0ffeb3f23649458ba9c3b-0068c570a4) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/vers/004name/1757769892.57415" 201 - "PUT http://localhost/sdb1/2/a/vers/004name/1757769892.57415" "tx0ffeb3f23649458ba9c3b-0068c570a4" "object-server 1824535" 0.0058 "-" 1824535 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx31fa7401861847658f681-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx46bb5d62315641d98cc29-0068c570a4" "proxy-server 1824541" 0.0015 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "txb17eb648700b4a93abb53-0068c570a4" "proxy-server 1824541" 0.0008 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "txb17eb648700b4a93abb53-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 416 - - t - 97 - txb17eb648700b4a93abb53-0068c570a4 - 0.0191 - - 1757769892.495133162 1757769892.514281750 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4fb614edd1234945bba7c-0068c570a4" "proxy-server 1824541" 0.0012 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txdd862eec6ee84f9b90040-0068c570a4" "proxy-server 1824541" 0.0012 "-" 1824541 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/2/a/ec-con/range-get-test" 206 7578 "GET http://localhost/v1/a/ec-con/range-get-test" "txc41e5c302f894b56b00df-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 7578 "GET http://localhost/v1/a/ec-con/range-get-test" "txc41e5c302f894b56b00df-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 10418 - txc41e5c302f894b56b00df-0068c570a4 - 0.0157 - - 1757769892.519523144 1757769892.535223484 3 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txddb4c272fcd0421abdef6-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txf9361c8da9994f46bdecd-0068c570a4" "proxy-server 1824541" 0.0013 "-" 1824541 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "tx8960d370be5d424e81457-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/2/a/ec-con/range-get-test" 206 1194 "GET http://localhost/v1/a/ec-con/range-get-test" "tx8960d370be5d424e81457-0068c570a4" "proxy-server 1824541" 0.0007 "-" 1824541 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-con/range-get-test HTTP/1.0 206 - - t - 1 - tx8960d370be5d424e81457-0068c570a4 - 0.0150 - - 1757769892.540458918 1757769892.555456161 3 - test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec_big test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec_big ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_failed_delete_keeps_entry test.unit.obj.test_expirer.TestObjectExpirer.test_failed_delete_keeps_entry ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_get_delay_reaping test.unit.obj.test_expirer.TestObjectExpirer.test_get_delay_reaping ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_get_task_containers_invalid_container test.unit.obj.test_expirer.TestObjectExpirer.test_get_task_containers_invalid_container ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_get_task_containers_unexpected_container test.unit.obj.test_expirer.TestObjectExpirer.test_get_task_containers_unexpected_container ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_hash_mod test.unit.obj.test_expirer.TestObjectExpirer.test_hash_mod ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init test.unit.obj.test_expirer.TestObjectExpirer.test_init ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_concurrency_too_small test.unit.obj.test_expirer.TestObjectExpirer.test_init_concurrency_too_small ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_default_round_robin_cache_default test.unit.obj.test_expirer.TestObjectExpirer.test_init_default_round_robin_cache_default ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_log_name test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_log_name ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_empty_conf test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_empty_conf ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_expirer_conf test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_expirer_conf ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_internal_and_other_conf test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_internal_and_other_conf ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_other_and_other_conf test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_other_and_other_conf ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_server_and_other_conf test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_server_and_other_conf ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_server_conf test.unit.obj.test_expirer.TestObjectExpirer.test_init_internal_client_path_from_server_conf ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_init_large_round_robin_cache test.unit.obj.test_expirer.TestObjectExpirer.test_init_large_round_robin_cache ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_invalid_delay_reaping_keys test.unit.obj.test_expirer.TestObjectExpirer.test_invalid_delay_reaping_keys ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_invalid_delay_reaping_values test.unit.obj.test_expirer.TestObjectExpirer.test_invalid_delay_reaping_values ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_accounts_to_expire test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_accounts_to_expire ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx3f5c806ffbb14a33b3a4e-0068c570a4" "proxy-server 1824498" 0.0257 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - tx3f5c806ffbb14a33b3a4e-0068c570a4 - 0.0439 - - 1757769892.552402020 1757769892.596282005 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc00e96902fdd483697b71-0068c570a4" "proxy-server 1824498" 0.0020 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx274f9b285265432c85102-0068c570a4" "proxy-server 1824498" 0.0013 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdl1/0/a/ec-dup/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "txe85e59acec4e4cf9926ce-0068c570a4" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdj1/0/a/ec-dup/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "txe85e59acec4e4cf9926ce-0068c570a4" "proxy-server 1824498" 0.0003 "-" 1824498 4 proxy DEBUG: Ignoring 404 from primary (txn: txe85e59acec4e4cf9926ce-0068c570a4) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: txe85e59acec4e4cf9926ce-0068c570a4) (client_ip: 127.0.0.1) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdh1/0/a/ec-dup/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "txe85e59acec4e4cf9926ce-0068c570a4" "proxy-server 1824498" 0.0085 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdi1/0/a/ec-dup/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "txe85e59acec4e4cf9926ce-0068c570a4" "proxy-server 1824498" 0.0003 "-" 1824498 4 proxy DEBUG: Ignoring 404 from primary (txn: txe85e59acec4e4cf9926ce-0068c570a4) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: txe85e59acec4e4cf9926ce-0068c570a4) (client_ip: 127.0.0.1) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdg1/0/a/ec-dup/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "txe85e59acec4e4cf9926ce-0068c570a4" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdk1/0/a/ec-dup/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "txe85e59acec4e4cf9926ce-0068c570a4" "proxy-server 1824498" 0.0003 "-" 1824498 4 proxy DEBUG: Ignoring 404 from primary (txn: txe85e59acec4e4cf9926ce-0068c570a4) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: txe85e59acec4e4cf9926ce-0068c570a4) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-dup/yes-we-have-no-bananas HTTP/1.0 404 - - t - 70 - txe85e59acec4e4cf9926ce-0068c570a4 - 0.0941 - - 1757769892.597666025 1757769892.691729069 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx25603bf09e6849f2a9126-0068c570a4" "proxy-server 1824498" 0.0022 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "tx25603bf09e6849f2a9126-0068c570a4" "container-server 1824498" 0.0093 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "tx25603bf09e6849f2a9126-0068c570a4" "container-server 1824498" 0.0011 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx25603bf09e6849f2a9126-0068c570a4" "proxy-server 1824498" 0.0149 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx25603bf09e6849f2a9126-0068c570a4" "proxy-server 1824498" 0.0305 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - tx25603bf09e6849f2a9126-0068c570a4 - 0.0552 - - 1757769892.697233438 1757769892.752415657 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1fbcae0421c747ad848e1-0068c570a4" "proxy-server 1824498" 0.0020 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx5c4125077ce247d88d23e-0068c570a4" "proxy-server 1824498" 0.0013 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdk1/2/a/ec-dup/big-obj-get" 201 - "PUT http://localhost/v1/a/ec-dup/big-obj-get" "txa0f1b75daa504dbb86f42-0068c570a4" "proxy-server 1824498" 0.0532 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdj1/2/a/ec-dup/big-obj-get" 201 - "PUT http://localhost/v1/a/ec-dup/big-obj-get" "txa0f1b75daa504dbb86f42-0068c570a4" "proxy-server 1824498" 0.0560 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdl1/2/a/ec-dup/big-obj-get" 201 - "PUT http://localhost/v1/a/ec-dup/big-obj-get" "txa0f1b75daa504dbb86f42-0068c570a4" "proxy-server 1824498" 0.0554 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdg1/2/a/ec-dup/big-obj-get" 201 - "PUT http://localhost/v1/a/ec-dup/big-obj-get" "txa0f1b75daa504dbb86f42-0068c570a4" "proxy-server 1824498" 0.0505 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/2/a/ec-dup/big-obj-get" 201 - "PUT http://localhost/sdi1/2/a/ec-dup/big-obj-get" "txa0f1b75daa504dbb86f42-0068c570a4" "object-server 1824498" 0.0005 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/2/a/ec-dup/big-obj-get" 201 - "PUT http://localhost/sdh1/2/a/ec-dup/big-obj-get" "txa0f1b75daa504dbb86f42-0068c570a4" "object-server 1824498" 0.0004 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdi1/2/a/ec-dup/big-obj-get" 201 - "PUT http://localhost/v1/a/ec-dup/big-obj-get" "txa0f1b75daa504dbb86f42-0068c570a4" "proxy-server 1824498" 0.0834 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdh1/2/a/ec-dup/big-obj-get" 201 - "PUT http://localhost/v1/a/ec-dup/big-obj-get" "txa0f1b75daa504dbb86f42-0068c570a4" "proxy-server 1824498" 0.0826 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/ec-dup/big-obj-get HTTP/1.0 201 - - t 10400 - - txa0f1b75daa504dbb86f42-0068c570a4 - 0.1354 - - 1757769892.753833055 1757769892.889268875 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb4c4975021bf451b9768f-0068c570a4" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "txb9dab13b371544d49fbee-0068c570a4" "proxy-server 1824498" 0.0023 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdl1/2/a/ec-dup/big-obj-get" 200 5440 "GET http://localhost/v1/a/ec-dup/big-obj-get" "tx0c32345b712e41788fef2-0068c570a4" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdj1/2/a/ec-dup/big-obj-get" 200 5440 "GET http://localhost/v1/a/ec-dup/big-obj-get" "tx0c32345b712e41788fef2-0068c570a4" "proxy-server 1824498" 0.0007 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/ec-dup/big-obj-get HTTP/1.0 200 - - t - 10400 - tx0c32345b712e41788fef2-0068c570a4 - 0.0574 - - 1757769892.890606403 1757769892.948041677 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx40bc10a71cea4e5d91c73-0068c570a4" "proxy-server 1824498" 0.0013 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/ec_deleted" 201 - "PUT http://127.0.0.1:54711/sdb1/0/a/ec_deleted" "tx40bc10a71cea4e5d91c73-0068c570a4" "container-server 1824498" 0.0011 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/2/a/vers/004name/1757769892.57415" 201 - "PUT http://localhost/v1/a/vers/004name/1757769892.57415" "tx0ffeb3f23649458ba9c3b-0068c570a4" "proxy-server 1824535" 0.0213 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/vers/004name/1757769892.57415" 201 - "PUT http://localhost/sda1/2/a/vers/004name/1757769892.57415" "tx0ffeb3f23649458ba9c3b-0068c570a4" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/2/a/vers/004name/1757769892.57415" 201 - "PUT http://localhost/v1/a/vers/004name/1757769892.57415" "tx0ffeb3f23649458ba9c3b-0068c570a4" "proxy-server 1824535" 0.0296 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 PUT /v1/a/vers/004name/1757769892.57415 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 tx0ffeb3f23649458ba9c3b-0068c570a4 - 0.0528 VW - 1757769892.671864748 1757769892.724713802 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "txe05dee728a9d4fd1b11bd-0068c570a4" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "txe05dee728a9d4fd1b11bd-0068c570a4" "object-server 1824535" 0.0043 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txe05dee728a9d4fd1b11bd-0068c570a4" "proxy-server 1824535" 0.0193 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txe05dee728a9d4fd1b11bd-0068c570a4" "proxy-server 1824535" 0.0209 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 PUT /v1/a/versions/name HTTP/1.0 201 - - t 5 - - txe05dee728a9d4fd1b11bd-0068c570a4 - 0.0328 - - 1757769892.725168228 1757769892.758006573 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1499176d8c5d40d6ae320-0068c570a4" "proxy-server 1824535" 0.0102 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx3cf3dac1f57f4657afd29-0068c570a4" "proxy-server 1824535" 0.0107 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdb1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name" "txf12d1ec05af646f28f1d5-0068c570a4" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/versions/name HTTP/1.0 200 - - t - 5 - txf12d1ec05af646f28f1d5-0068c570a4 - 0.0302 - - 1757769892.771665335 1757769892.801876783 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0553e1d17efe45eabe1fc-0068c570a4" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdb1/0/a/vers" 200 352 "GET http://localhost/v1/a/vers?format=json&states=listing" "tx0553e1d17efe45eabe1fc-0068c570a4" "proxy-server 1824535" 0.0041 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/52 GET /v1/a/vers%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 352 - tx0553e1d17efe45eabe1fc-0068c570a4 - 0.0488 - - 1757769892.819724083 1757769892.868568182 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6deed0ee10054f9eb22a9-0068c570a4" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx2b066828a2e141d9b88d2-0068c570a4" "proxy-server 1824535" 0.0066 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdb1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name" "tx5fa671ac36c14824b7496-0068c570a4" "proxy-server 1824535" 0.0128 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sda1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name" "tx5fa671ac36c14824b7496-0068c570a4" "proxy-server 1824535" 0.0006 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2c8b28595f554104bf0ca-0068c570a4" "proxy-server 1824535" 0.0093 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/52 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx2c8b28595f554104bf0ca-0068c570a4 - 0.0121 VW - 1757769892.927944183 1757769892.940021992 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx24082b93acdd4871b49df-0068c570a4" "proxy-server 1824535" 0.0098 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - tx24082b93acdd4871b49df-0068c570a4 - 0.0125 VW - 1757769892.940556049 1757769892.953083277 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sda1/0/a/versions/copied_name" 404 70 "GET http://localhost/v1/a/versions/copied_name?symlink=get" "tx1a6621af4f2b40f6ac605-0068c570a4" "proxy-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "GET /sdb1/0/a/versions/copied_name" 404 70 "GET http://localhost/v1/a/versions/copied_name?symlink=get" "tx1a6621af4f2b40f6ac605-0068c570a4" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/52 GET /v1/a/versions/copied_name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx1a6621af4f2b40f6ac605-0068c570a4 - 0.0217 VW - 1757769892.953659296 1757769892.975357533 0 - proxy INFO: - - 13/Sep/2025/13/24/52 GET /v1/a/versions/name HTTP/1.0 200 - Swift t - 5 - tx5fa671ac36c14824b7496-0068c570a4 - 0.1177 SSC - 1757769892.870557070 1757769892.988282919 0 - (txn: tx53ae6b1ad4de46dfba66a-0068c570a4) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sda1/0/a/versions/copied_name" 201 - "PUT http://localhost/sdb1/0/a/versions/copied_name" "tx53ae6b1ad4de46dfba66a-0068c570a4" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:52 +0000] "PUT /sdb1/0/a/versions/copied_name" 201 - "PUT http://localhost/v1/a/versions/copied_name" "tx53ae6b1ad4de46dfba66a-0068c570a4" "proxy-server 1824535" 0.0108 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/versions/copied_name" 201 - "PUT http://localhost/sda1/0/a/versions/copied_name" "tx53ae6b1ad4de46dfba66a-0068c570a4" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/versions/copied_name" 201 - "PUT http://localhost/v1/a/versions/copied_name" "tx53ae6b1ad4de46dfba66a-0068c570a4" "proxy-server 1824535" 0.0361 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 COPY /v1/a/versions/copied_name HTTP/1.0 201 - - t 5 - db7282901da891bea2fcd73840caad1c tx53ae6b1ad4de46dfba66a-0068c570a4 - 0.0477 SSC - 1757769892.975749016 1757769893.023462057 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb1fb5e2a1efd4274b949b-0068c570a5" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txb2fae28cc87a46c5a6760-0068c570a5" "proxy-server 1824535" 0.0023 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/0/a/versions/copied_name" 200 5 "GET http://localhost/v1/a/versions/copied_name" "tx18c94205b824499a9f8b1-0068c570a5" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/versions/copied_name HTTP/1.0 200 - - t - 5 - tx18c94205b824499a9f8b1-0068c570a5 - 0.0417 - - 1757769893.025202513 1757769893.066874743 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8df21ff0ebb540738a949-0068c570a5" "proxy-server 1824535" 0.0095 "-" 1824535 -test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec_deleted test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec_deleted ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_404_response_on_missing_container test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_404_response_on_missing_container ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_503_response_on_container test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_503_response_on_container ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/ec_deleted" 201 - "PUT http://127.0.0.1:33753/sda1/0/a/ec_deleted" "tx40bc10a71cea4e5d91c73-0068c570a4" "container-server 1824498" 0.0020 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/ec_deleted" 201 - "PUT http://localhost/v1/a/ec_deleted" "tx40bc10a71cea4e5d91c73-0068c570a4" "proxy-server 1824498" 0.0452 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/ec_deleted" 201 - "PUT http://localhost/v1/a/ec_deleted" "tx40bc10a71cea4e5d91c73-0068c570a4" "proxy-server 1824498" 0.0336 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 PUT /v1/a/ec_deleted HTTP/1.0 201 - - t - - - tx40bc10a71cea4e5d91c73-0068c570a4 - 0.0777 - - 1757769892.949932575 1757769893.027659893 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8af3c1dc92164fed8a248-0068c570a5" "proxy-server 1824498" 0.0020 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/ec_deleted" 204 - "DELETE http://127.0.0.1:33753/sda1/0/a/ec_deleted" "tx8af3c1dc92164fed8a248-0068c570a5" "container-server 1824498" 0.0017 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/ec_deleted" 204 - "DELETE http://127.0.0.1:54711/sdb1/0/a/ec_deleted" "tx8af3c1dc92164fed8a248-0068c570a5" "container-server 1824498" 0.0093 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sda1/0/a/ec_deleted" 204 - "DELETE http://localhost/v1/a/ec_deleted" "tx8af3c1dc92164fed8a248-0068c570a5" "proxy-server 1824498" 0.0321 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sdb1/0/a/ec_deleted" 204 - "DELETE http://localhost/v1/a/ec_deleted" "tx8af3c1dc92164fed8a248-0068c570a5" "proxy-server 1824498" 0.0251 "-" 1824498 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 DELETE /v1/a/ec_deleted HTTP/1.0 204 - - - - - - tx8af3c1dc92164fed8a248-0068c570a5 - 0.0608 - - 1757769893.029038668 1757769893.089802742 - - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa8cf79d0c5584e2ab7299-0068c570a5" "proxy-server 1824498" 0.0082 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a/ec_deleted" 404 - "HEAD http://localhost/v1/a/ec_deleted" "txbedfce7c58e0464dbf986-0068c570a5" "proxy-server 1824498" 0.0011 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/ec_deleted" 404 - "HEAD http://localhost/v1/a/ec_deleted" "txbedfce7c58e0464dbf986-0068c570a5" "proxy-server 1824498" 0.0012 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdj1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "tx95db33bd164b4524bf4cf-0068c570a5" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdg1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "tx95db33bd164b4524bf4cf-0068c570a5" "proxy-server 1824498" 0.0003 "-" 1824498 4 proxy DEBUG: Ignoring 404 from primary (txn: tx95db33bd164b4524bf4cf-0068c570a5) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: tx95db33bd164b4524bf4cf-0068c570a5) (client_ip: 127.0.0.1) obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdk1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "tx95db33bd164b4524bf4cf-0068c570a5" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdi1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "tx95db33bd164b4524bf4cf-0068c570a5" "proxy-server 1824498" 0.0003 "-" 1824498 4 proxy DEBUG: Ignoring 404 from primary (txn: tx95db33bd164b4524bf4cf-0068c570a5) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: tx95db33bd164b4524bf4cf-0068c570a5) (client_ip: 127.0.0.1) obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdl1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "tx95db33bd164b4524bf4cf-0068c570a5" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdh1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "tx95db33bd164b4524bf4cf-0068c570a5" "proxy-server 1824498" 0.0003 "-" 1824498 4 proxy DEBUG: Ignoring 404 from primary (txn: tx95db33bd164b4524bf4cf-0068c570a5) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: tx95db33bd164b4524bf4cf-0068c570a5) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/ec_deleted/no-object-there HTTP/1.0 404 - - t - 70 - tx95db33bd164b4524bf4cf-0068c570a5 - 0.0849 - - 1757769893.099336386 1757769893.184228897 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbcd4a17c8a3a4fbd83758-0068c570a5" "proxy-server 1824498" 0.0021 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "txbcd4a17c8a3a4fbd83758-0068c570a5" "container-server 1824498" 0.0052 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "txbcd4a17c8a3a4fbd83758-0068c570a5" "proxy-server 1824498" 0.0087 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "txbcd4a17c8a3a4fbd83758-0068c570a5" "container-server 1824498" 0.0011 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "txbcd4a17c8a3a4fbd83758-0068c570a5" "proxy-server 1824498" 0.0328 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - txbcd4a17c8a3a4fbd83758-0068c570a5 - 0.0559 - - 1757769893.185949087 1757769893.241815090 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9d904efd36004cd6a54a4-0068c570a5" "proxy-server 1824498" 0.0101 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx906c0ffed3674c3596ee1-0068c570a5" "proxy-server 1824498" 0.0095 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdj1/2/a/ec-dup/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec-dup/crash-test-dummy" "tx26bb3aa8d84f4f01ab52d-0068c570a5" "proxy-server 1824498" 0.0496 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdl1/2/a/ec-dup/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec-dup/crash-test-dummy" "tx26bb3aa8d84f4f01ab52d-0068c570a5" "proxy-server 1824498" 0.0543 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdi1/2/a/ec-dup/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec-dup/crash-test-dummy" "tx26bb3aa8d84f4f01ab52d-0068c570a5" "proxy-server 1824498" 0.0565 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdg1/2/a/ec-dup/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec-dup/crash-test-dummy" "tx26bb3aa8d84f4f01ab52d-0068c570a5" "proxy-server 1824498" 0.0579 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/2/a/ec-dup/crash-test-dummy" 201 - "PUT http://localhost/sdh1/2/a/ec-dup/crash-test-dummy" "tx26bb3aa8d84f4f01ab52d-0068c570a5" "object-server 1824498" 0.0005 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/2/a/ec-dup/crash-test-dummy" 201 - "PUT http://localhost/sdk1/2/a/ec-dup/crash-test-dummy" "tx26bb3aa8d84f4f01ab52d-0068c570a5" "object-server 1824498" 0.0004 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdh1/2/a/ec-dup/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec-dup/crash-test-dummy" "tx26bb3aa8d84f4f01ab52d-0068c570a5" "proxy-server 1824498" 0.0687 "-" 1824498 4test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec_failure_handling test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_ec_failure_handling ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_exception test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_exception ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx114b495fc87e4405a4b16-0068c570a5" "proxy-server 1824535" 0.0130 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/versions/name" 201 - "POST http://localhost/sdb1/3/a/versions/name" "txf776848d177a40ebb2afe-0068c570a5" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "POST /sdb1/3/a/versions/name" 202 76 "POST http://localhost/v1/a/versions/name" "txf776848d177a40ebb2afe-0068c570a5" "proxy-server 1824535" 0.0104 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/versions/name" 201 - "POST http://localhost/sda1/3/a/versions/name" "txf776848d177a40ebb2afe-0068c570a5" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "POST /sda1/3/a/versions/name" 202 76 "POST http://localhost/v1/a/versions/name" "txf776848d177a40ebb2afe-0068c570a5" "proxy-server 1824535" 0.0170 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 POST /v1/a/versions/name HTTP/1.0 202 - - t - 76 - txf776848d177a40ebb2afe-0068c570a5 - 0.0578 - - 1757769893.068559885 1757769893.126330853 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx258814393dd54faa8049a-0068c570a5" "proxy-server 1824535" 0.0096 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx44828f33be014eafa59e4-0068c570a5" "proxy-server 1824535" 0.0215 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name" "txa53666cccba2419a92467-0068c570a5" "proxy-server 1824535" 0.0049 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/versions/name HTTP/1.0 200 - - t - 5 - txa53666cccba2419a92467-0068c570a5 - 0.0448 - - 1757769893.136076212 1757769893.180846691 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx71abd59176364a10b72d6-0068c570a5" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/0/a/versions" 200 311 "GET http://localhost/v1/a/versions?format=json&states=listing" "tx71abd59176364a10b72d6-0068c570a5" "proxy-server 1824535" 0.0063 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/versions%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 311 - tx71abd59176364a10b72d6-0068c570a5 - 0.0300 - - 1757769893.182422161 1757769893.212398767 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0d7f1f10655d4c6687e22-0068c570a5" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx0d7f1f10655d4c6687e22-0068c570a5 - 0.0405 VW - 1757769893.214213133 1757769893.254723072 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx19e4274e92ee419eb7ee6-0068c570a5" "proxy-server 1824535" 0.0015 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - tx19e4274e92ee419eb7ee6-0068c570a5 - 0.0123 VW - 1757769893.255335331 1757769893.267669678 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/0/a/vers" 200 352 "GET http://localhost/v1/a/vers?prefix=004name%2F&marker=&reverse=on&format=json&states=listing" "tx1410a27d998c4d38bab96-0068c570a5" "proxy-server 1824535" 0.0106 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 GET /v1/a/vers%3Fprefix%3D004name%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 352 - tx1410a27d998c4d38bab96-0068c570a5 - 0.0139 VW - 1757769893.268232107 1757769893.282100201 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/2/a/vers/004name/1757769892.57415" 200 5 "GET http://localhost/v1/a/vers/004name/1757769892.57415?symlink=get" "txf91bf3bbb3da45fcabea5-0068c570a5" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/2/a/vers/004name/1757769892.57415" 200 5 "GET http://localhost/v1/a/vers/004name/1757769892.57415?symlink=get" "txf91bf3bbb3da45fcabea5-0068c570a5" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 GET /v1/a/vers/004name/1757769892.57415%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txf91bf3bbb3da45fcabea5-0068c570a5 - 0.0438 VW - 1757769893.282612562 1757769893.326385736 0 - (txn: tx32ad7a51a4b04863ab914-0068c570a5) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "tx32ad7a51a4b04863ab914-0068c570a5" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "tx32ad7a51a4b04863ab914-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx32ad7a51a4b04863ab914-0068c570a5" "proxy-server 1824535" 0.0206 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx32ad7a51a4b04863ab914-0068c570a5" "proxy-server 1824535" 0.0199 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 PUT /v1/a/versions/name HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 tx32ad7a51a4b04863ab914-0068c570a5 - 0.0329 VW - 1757769893.305595875 1757769893.338485479 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sdb1/0/a/vers/004name/1757769892.57415" 204 - "DELETE http://localhost/sdb1/2/a/vers/004name/1757769892.57415" "txc1602ae106234802b0136-0068c570a5" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sda1/0/a/vers/004name/1757769892.57415" 204 - "DELETE http://localhost/sda1/2/a/vers/004name/1757769892.57415" "txc1602ae106234802b0136-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sdb1/2/a/vers/004name/1757769892.57415" 204 - "DELETE http://localhost/v1/a/vers/004name/1757769892.57415" "txc1602ae106234802b0136-0068c570a5" "proxy-server 1824535" 0.0227 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sda1/2/a/vers/004name/1757769892.57415" 204 - "DELETE http://localhost/v1/a/vers/004name/1757769892.57415" "txc1602ae106234802b0136-0068c570a5" "proxy-server 1824535" 0.0224 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 DELETE /v1/a/vers/004name/1757769892.57415 HTTP/1.0 204 - Swift - - - - txc1602ae106234802b0136-0068c570a5 - 0.0268 VW - 1757769893.350325584 1757769893.377089977 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7a93100235614a478c172-0068c570a5" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txd6edb2fc00724d4cbf71e-0068c570a5" "proxy-server 1824535" 0.0118 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name" "txd5ee2d21138d47f8993ab-0068c570a5" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/versions/name HTTP/1.0 200 - - t - 5 - txd5ee2d21138d47f8993ab-0068c570a5 - 0.0457 - - 1757769893.378538847 1757769893.424248219 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx20bffce1a60e4d19bef55-0068c570a5" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/0/a/vers" 200 176 "GET http://localhost/v1/a/vers?prefix=004name%2F&format=json&states=listing" "tx20bffce1a60e4d19bef55-0068c570a5" "proxy-server 1824535" 0.0122 "-" 1824535 0test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_unexpected_response test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_unexpected_response ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_delay_reaping test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_delay_reaping ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_delay_reaping_is_async test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_delay_reaping_is_async ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_skipped_and_delayed_tasks test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_skipped_and_delayed_tasks ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_skipped_tasks_multi_processes test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_skipped_tasks_multi_processes ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_skipped_tasks_single_process test.unit.obj.test_expirer.TestObjectExpirer.test_iter_task_to_expire_with_skipped_tasks_single_process ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/vers%3Fprefix%3D004name%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 176 - tx20bffce1a60e4d19bef55-0068c570a5 - 0.0402 - - 1757769893.425900459 1757769893.466085911 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6d80d2e28215441bad2a0-0068c570a5" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx6d80d2e28215441bad2a0-0068c570a5 - 0.0081 VW - 1757769893.471608400 1757769893.479722023 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txfcb9456ae8b84de5beea1-0068c570a5" "proxy-server 1824535" 0.0038 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - txfcb9456ae8b84de5beea1-0068c570a5 - 0.0064 VW - 1757769893.480239391 1757769893.486594677 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/0/a/vers" 200 176 "GET http://localhost/v1/a/vers?prefix=004name%2F&marker=&reverse=on&format=json&states=listing" "txcf8f0966e44b4c22ae033-0068c570a5" "proxy-server 1824535" 0.0047 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 GET /v1/a/vers%3Fprefix%3D004name%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 176 - txcf8f0966e44b4c22ae033-0068c570a5 - 0.0130 VW - 1757769893.487195969 1757769893.500208616 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/0/a/vers/004name/1757769892.41628" 200 5 "GET http://localhost/v1/a/vers/004name/1757769892.41628?symlink=get" "tx5dd896b2931440f0b236c-0068c570a5" "proxy-server 1824535" 0.0040 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/0/a/vers/004name/1757769892.41628" 200 5 "GET http://localhost/v1/a/vers/004name/1757769892.41628?symlink=get" "tx5dd896b2931440f0b236c-0068c570a5" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 GET /v1/a/vers/004name/1757769892.41628%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx5dd896b2931440f0b236c-0068c570a5 - 0.0224 VW - 1757769893.500698090 1757769893.523072958 0 - (txn: txf7de09823cd8472593940-0068c570a5) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "txf7de09823cd8472593940-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "txf7de09823cd8472593940-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txf7de09823cd8472593940-0068c570a5" "proxy-server 1824535" 0.0174 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txf7de09823cd8472593940-0068c570a5" "proxy-server 1824535" 0.0168 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 PUT /v1/a/versions/name HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txf7de09823cd8472593940-0068c570a5 - 0.0228 VW - 1757769893.510281563 1757769893.533055067 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sdb1/0/a/vers/004name/1757769892.41628" 204 - "DELETE http://localhost/sda1/0/a/vers/004name/1757769892.41628" "tx9326adbbf3294b3782e42-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sda1/0/a/vers/004name/1757769892.41628" 204 - "DELETE http://localhost/sdb1/0/a/vers/004name/1757769892.41628" "tx9326adbbf3294b3782e42-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sdb1/0/a/vers/004name/1757769892.41628" 204 - "DELETE http://localhost/v1/a/vers/004name/1757769892.41628" "tx9326adbbf3294b3782e42-0068c570a5" "proxy-server 1824535" 0.0068 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sda1/0/a/vers/004name/1757769892.41628" 204 - "DELETE http://localhost/v1/a/vers/004name/1757769892.41628" "tx9326adbbf3294b3782e42-0068c570a5" "proxy-server 1824535" 0.0059 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 DELETE /v1/a/vers/004name/1757769892.41628 HTTP/1.0 204 - Swift - - - - tx9326adbbf3294b3782e42-0068c570a5 - 0.0110 VW - 1757769893.533510923 1757769893.544478655 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfdd9968fcdd64c4ebd97f-0068c570a5" "proxy-server 1824535" 0.0015 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx1e738540266041f4a4619-0068c570a5" "proxy-server 1824535" 0.0028 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name" "tx93be430f03af4f36833df-0068c570a5" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/versions/name HTTP/1.0 200 - - t - 5 - tx93be430f03af4f36833df-0068c570a5 - 0.0136 - - 1757769893.545989275 1757769893.559633493 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx99f67ed8fe204db584d82-0068c570a5" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/0/a/vers" 200 2 "GET http://localhost/v1/a/vers?prefix=004name%2F&format=json&states=listing" "tx99f67ed8fe204db584d82-0068c570a5" "proxy-server 1824535" 0.0033 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/vers%3Fprefix%3D004name%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx99f67ed8fe204db584d82-0068c570a5 - 0.0108 - - 1757769893.561255455 1757769893.572018862 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx41e4dce974264a75ad402-0068c570a5" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/0/a/vers" 200 2 "GET http://localhost/v1/a/vers?prefix=004name%2F&format=json&states=listing" "tx41e4dce974264a75ad402-0068c570a5" "proxy-server 1824535" 0.0037 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/vers%3Fprefix%3D004name%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx41e4dce974264a75ad402-0068c570a5 - 0.0110 - - 1757769893.573821068 1757769893.584835052 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txec903010f1984c22803b9-0068c570a5" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txec903010f1984c22803b9-0068c570a5 - 0.0042 VW - 1757769893.594826937 1757769893.598996401 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx39e4e59c92c645bcb5dbe-0068c570a5" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - tx39e4e59c92c645bcb5dbe-0068c570a5 - 0.0041 VW - 1757769893.599512100 1757769893.603649139 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/0/a/vers" 200 2 "GET http://localhost/v1/a/vers?prefix=004name%2F&marker=&reverse=on&format=json&states=listing" "txa3d49bc1092b46eba2bf1-0068c570a5" "proxy-server 1824535" 0.0022 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 GET /v1/a/vers%3Fprefix%3D004name%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 2 - txa3d49bc1092b46eba2bf1-0068c570a5 - 0.0055 VW - 1757769893.604191542 1757769893.609673977 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sda1/0/a/versions/name" 204 - "DELETE http://localhost/sda1/3/a/versions/name" "tx8e6519f06c6149c8bed21-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0test.unit.obj.test_expirer.TestObjectExpirer.test_object_timestamp_break test.unit.obj.test_expirer.TestObjectExpirer.test_object_timestamp_break ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_parse_task_obj test.unit.obj.test_expirer.TestObjectExpirer.test_parse_task_obj ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_pop_queue test.unit.obj.test_expirer.TestObjectExpirer.test_pop_queue ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sdb1/0/a/versions/name" 204 - "DELETE http://localhost/sdb1/3/a/versions/name" "tx8e6519f06c6149c8bed21-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sda1/3/a/versions/name" 204 - "DELETE http://localhost/v1/a/versions/name" "tx8e6519f06c6149c8bed21-0068c570a5" "proxy-server 1824535" 0.0109 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "DELETE /sdb1/3/a/versions/name" 204 - "DELETE http://localhost/v1/a/versions/name" "tx8e6519f06c6149c8bed21-0068c570a5" "proxy-server 1824535" 0.0129 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 DELETE /v1/a/versions/name HTTP/1.0 204 - - t - - - tx8e6519f06c6149c8bed21-0068c570a5 - 0.0163 - - 1757769893.610110044 1757769893.626363277 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6534db70fae24c0d95f9a-0068c570a5" "proxy-server 1824535" 0.0055 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txd9e7a3c8f4514642aa075-0068c570a5" "proxy-server 1824535" 0.0068 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/3/a/versions/name" 404 70 "GET http://localhost/v1/a/versions/name" "tx8adc8c22e9864557924e3-0068c570a5" "proxy-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/3/a/versions/name" 404 70 "GET http://localhost/v1/a/versions/name" "tx8adc8c22e9864557924e3-0068c570a5" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/versions/name HTTP/1.0 404 - - t - 70 - tx8adc8c22e9864557924e3-0068c570a5 - 0.0258 - - 1757769893.632031202 1757769893.657852173 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa826b76181d747988f817-0068c570a5" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa826b76181d747988f817-0068c570a5 - 0.0040 VW - 1757769893.669637442 1757769893.673640251 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txcd84bbd0dd8c4641a50c2-0068c570a5" "proxy-server 1824535" 0.0090 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - txcd84bbd0dd8c4641a50c2-0068c570a5 - 0.0187 VW - 1757769893.674142122 1757769893.692799807 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/3/a/versions/name" 404 70 "GET http://localhost/v1/a/versions/name?symlink=get" "tx6a7c6628b1654fd0869a0-0068c570a5" "proxy-server 1824535" 0.0048 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/3/a/versions/name" 404 70 "GET http://localhost/v1/a/versions/name?symlink=get" "tx6a7c6628b1654fd0869a0-0068c570a5" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 GET /v1/a/versions/name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx6a7c6628b1654fd0869a0-0068c570a5 - 0.0122 VW - 1757769893.693306923 1757769893.705506802 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "txd6b1075d9fcd4788bd7fa-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "txd6b1075d9fcd4788bd7fa-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txd6b1075d9fcd4788bd7fa-0068c570a5" "proxy-server 1824535" 0.0079 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txd6b1075d9fcd4788bd7fa-0068c570a5" "proxy-server 1824535" 0.0074 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 PUT /v1/a/versions/name HTTP/1.0 201 - - t - - - txd6b1075d9fcd4788bd7fa-0068c570a5 - 0.0121 - - 1757769893.705866814 1757769893.718010664 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa7295369c1c04b75afd51-0068c570a5" "proxy-server 1824535" 0.0015 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa7295369c1c04b75afd51-0068c570a5 - 0.0051 VW - 1757769893.731220245 1757769893.736324787 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txed252d982ed044b1aac4c-0068c570a5" "proxy-server 1824535" 0.0029 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - txed252d982ed044b1aac4c-0068c570a5 - 0.0068 VW - 1757769893.737372160 1757769893.744188070 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/3/a/versions/name" 200 - "GET http://localhost/v1/a/versions/name?symlink=get" "tx6930cafe61844c99943e7-0068c570a5" "proxy-server 1824535" 0.0016 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/3/a/versions/name" 200 - "GET http://localhost/v1/a/versions/name?symlink=get" "tx6930cafe61844c99943e7-0068c570a5" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 GET /v1/a/versions/name%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx6930cafe61844c99943e7-0068c570a5 - 0.0073 VW - 1757769893.744766474 1757769893.752041101 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/vers" 204 - "HEAD http://localhost/v1/a/vers" "tx977fbd5f35c9464cad12d-0068c570a5" "proxy-server 1824535" 0.0016 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/vers/004name/1757769893.70634" 201 - "PUT http://localhost/sdb1/0/a/vers/004name/1757769893.70634" "txd7959bf2213540bdb58af-0068c570a5" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/vers/004name/1757769893.70634" 201 - "PUT http://localhost/sda1/0/a/vers/004name/1757769893.70634" "txd7959bf2213540bdb58af-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/vers/004name/1757769893.70634" 201 - "PUT http://localhost/v1/a/vers/004name/1757769893.70634" "txd7959bf2213540bdb58af-0068c570a5" "proxy-server 1824535" 0.0078 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/vers/004name/1757769893.70634" 201 - "PUT http://localhost/v1/a/vers/004name/1757769893.70634" "txd7959bf2213540bdb58af-0068c570a5" "proxy-server 1824535" 0.0075 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 PUT /v1/a/vers/004name/1757769893.70634 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txd7959bf2213540bdb58af-0068c570a5 - 0.0170 VW - 1757769893.752618551 1757769893.769634724 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "tx18e956fa5f504e7ab24b3-0068c570a5" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "tx18e956fa5f504e7ab24b3-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx18e956fa5f504e7ab24b3-0068c570a5" "proxy-server 1824535" 0.0132 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx18e956fa5f504e7ab24b3-0068c570a5" "proxy-server 1824535" 0.0121 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 PUT /v1/a/versions/name HTTP/1.0 201 - - t - - - tx18e956fa5f504e7ab24b3-0068c570a5 - 0.0228 - - 1757769893.770040512 1757769893.792842865 0 -test.unit.obj.test_expirer.TestObjectExpirer.test_process_based_concurrency test.unit.obj.test_expirer.TestObjectExpirer.test_process_based_concurrency ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_report test.unit.obj.test_expirer.TestObjectExpirer.test_report ... ok test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_pipeline test.unit.proxy.test_server.TestECDuplicationObjectController.test_GET_pipeline ... ok test-expirer ERROR: Exception while deleting object .expiring_objects 1757721568 1757769891-a6/c6/o6 TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given test-expirer ERROR: Exception while deleting object .expiring_objects 1757721568 1757769891-a7/c7/o7 TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given test-expirer ERROR: Exception while deleting object .expiring_objects 1757721568 1757769891-a8/c8/o8♡ TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given test-expirer ERROR: Exception while deleting object .expiring_objects 1757721568 1757769891-a9/c9/o9ø TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 680, in delete_object self.delete_actual_object(target_path, delete_timestamp, ~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ is_async_delete) ^^^^^^^^^^^^^^^^ TypeError: TestObjectExpirer.test_failed_delete_keeps_entry..deliberately_blow_up() takes 2 positional arguments but 3 were given test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 0 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 10 objects expired test-expirer ERROR: skipping invalid task container: task_account/-1 test-expirer ERROR: skipping invalid task container: task_account/rogue test-expirer INFO: processing 2 unexpected task containers (e.g. 86300 86401) test-expirer INFO: processing 1 unexpected task containers (e.g. 1757721368) test-expirer ERROR: Unexcepted error handling task '1757683493-invalid0': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 477, in _iter_task_container target_object = parse_task_obj(task_object) File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 180, in parse_task_obj split_path('/' + target_path, 3, 3, True) ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/base.py", line 117, in split_path raise ValueError('Invalid path: %s' % quote(path)) ValueError: Invalid path: /invalid0 test-expirer ERROR: Unexcepted error handling task '1757683493-invalid1': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 477, in _iter_task_container target_object = parse_task_obj(task_object) File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 180, in parse_task_obj split_path('/' + target_path, 3, 3, True) ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/base.py", line 117, in split_path raise ValueError('Invalid path: %s' % quote(path)) ValueError: Invalid path: /invalid1 test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 5 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 10 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 5 possible containers; 12 possible objects test-expirer ERROR: Unexpected response while listing objects in container .expiring_objects 1757548768: Mocked error test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 10 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 6 possible objects test-expirer ERROR: Exception while listing objects in container .expiring_objects 1757721568: failed to connect test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 5 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 6 possible objects test-expirer ERROR: Unexpected response while listing objects in container .expiring_objects 1757721568: Mocked error test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 5 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 10 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 0 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 0 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 0 objects expired test-expirer INFO: Pass completed in 0s; 0 objects expired test-expirer ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' test-expirer INFO: Pass so far 0s; 0 objects expired test-expirer ERROR: Unexcepted error handling task {'task_account': '.expiring_objects', 'task_container': '0000000000', 'task_object': '0000-invalid0', 'delete_timestamp': 0000000000.00000_0000000000000000, 'target_path': 'invalid0', 'is_async_delete': False} test-expirer ERROR: Unexcepted error handling task {'task_account': '.expiring_objects', 'task_container': '0000000000', 'task_object': '0001-invalid1', 'delete_timestamp': 0000000001.00000_0000000000000000, 'target_path': 'invalid1', 'is_async_delete': False}test.unit.obj.test_expirer.TestObjectExpirer.test_round_robin_order test.unit.obj.test_expirer.TestObjectExpirer.test_round_robin_order ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_run_forever_bad_process_values_command_line test.unit.obj.test_expirer.TestObjectExpirer.test_run_forever_bad_process_values_command_line ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_run_forever_bad_process_values_config test.unit.obj.test_expirer.TestObjectExpirer.test_run_forever_bad_process_values_config ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_run_forever_catches_usual_exceptions test.unit.obj.test_expirer.TestObjectExpirer.test_run_forever_catches_usual_exceptions ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_run_forever_initial_sleep_random test.unit.obj.test_expirer.TestObjectExpirer.test_run_forever_initial_sleep_random ... ok obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdk1/2/a/ec-dup/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec-dup/crash-test-dummy" "tx26bb3aa8d84f4f01ab52d-0068c570a5" "proxy-server 1824498" 0.0891 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 PUT /v1/a/ec-dup/crash-test-dummy HTTP/1.0 201 - - t 21000 - - tx26bb3aa8d84f4f01ab52d-0068c570a5 - 0.1413 - - 1757769893.251439571 1757769893.392768145 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe8802daee1454498ba270-0068c570a5" "proxy-server 1824498" 0.0022 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx027ea61bf4354e5fa0043-0068c570a5" "proxy-server 1824498" 0.0073 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdg1/2/a/ec-dup/crash-test-dummy" 200 10980 "GET http://localhost/v1/a/ec-dup/crash-test-dummy" "txb971d5520de44d60b1059-0068c570a5" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdh1/2/a/ec-dup/crash-test-dummy" 200 10980 "GET http://localhost/v1/a/ec-dup/crash-test-dummy" "txb971d5520de44d60b1059-0068c570a5" "proxy-server 1824498" 0.0007 "-" 1824498 4 proxy ERROR: Exception fetching fragments for '/a/ec-dup/crash-test-dummy': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1485, in put_fragments_in_queue for fragment in frag_iter: ^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 8297, in explodey_iter raise Exception("doom ba doom") Exception: doom ba doom (txn: txb971d5520de44d60b1059-0068c570a5) (client_ip: 127.0.0.1) proxy ERROR: Exception fetching fragments for '/a/ec-dup/crash-test-dummy': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1485, in put_fragments_in_queue for fragment in frag_iter: ^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 8297, in explodey_iter raise Exception("doom ba doom") Exception: doom ba doom (txn: txb971d5520de44d60b1059-0068c570a5) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/ec-dup/crash-test-dummy HTTP/1.0 500 - - t - 4096 - txb971d5520de44d60b1059-0068c570a5 - 0.0639 - - 1757769893.394292831 1757769893.458198309 4 - proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: (1824498) wsgi starting up on http://127.0.0.1:38239 proxy DEBUG: (1824498) accepted ('127.0.0.1', 52098) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx554f927837ae4a2b863d6-0068c570a5" "proxy-server 1824498" 0.0013 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "tx554f927837ae4a2b863d6-0068c570a5" "container-server 1824498" 0.0010 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx554f927837ae4a2b863d6-0068c570a5" "proxy-server 1824498" 0.0161 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "tx554f927837ae4a2b863d6-0068c570a5" "container-server 1824498" 0.0053 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx554f927837ae4a2b863d6-0068c570a5" "proxy-server 1824498" 0.0246 "-" 1824498 4 proxy INFO: 127.0.0.1 - - [13/Sep/2025 13:24:53] "PUT /v1/a/ec-dup HTTP/1.1" 202 252 0.040331 (txn: tx554f927837ae4a2b863d6-0068c570a5) proxy DEBUG: (1824498) accepted ('127.0.0.1', 52110) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx98e59dcb14974383a4138-0068c570a5" "proxy-server 1824498" 0.0020 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx50fd7fe62e4e4742b130b-0068c570a5" "proxy-server 1824498" 0.0093 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdl1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx32529ceaee7f42509f3e6-0068c570a5" "proxy-server 1824498" 0.0657 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdh1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx32529ceaee7f42509f3e6-0068c570a5" "proxy-server 1824498" 0.0513 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdi1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx32529ceaee7f42509f3e6-0068c570a5" "proxy-server 1824498" 0.0512 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdg1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx32529ceaee7f42509f3e6-0068c570a5" "proxy-server 1824498" 0.0539 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/2/a/ec-dup/go-get-it" 201 - "PUT http://localhost/sdj1/1/a/ec-dup/go-get-it" "tx32529ceaee7f42509f3e6-0068c570a5" "object-server 1824498" 0.0005 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/2/a/ec-dup/go-get-it" 201 - "PUT http://localhost/sdk1/1/a/ec-dup/go-get-it" "tx32529ceaee7f42509f3e6-0068c570a5" "object-server 1824498" 0.0004 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdk1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx32529ceaee7f42509f3e6-0068c570a5" "proxy-server 1824498" 0.0795 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdj1/1/a/ec-dup/go-get-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-get-it" "tx32529ceaee7f42509f3e6-0068c570a5" "proxy-server 1824498" 0.0951 "-" 1824498 4 proxy INFO: 127.0.0.1 - - [13/Sep/2025 13:24:53] "PUT /v1/a/ec-dup/go-get-it HTTP/1.1" 201 206 0.135704 (txn: tx32529ceaee7f42509f3e6-0068c570a5) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbc54bb793f234cd2853b4-0068c570a5" "proxy-server 1824498" 0.0015 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx8238dccbb31642ecb44b6-0068c570a5" "proxy-server 1824498" 0.0052 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdl1/1/a/ec-dup/go-get-it" 200 736 "GET http://localhost/v1/a/ec-dup/go-get-it" "tx72d335cb72974e1685c29-0068c570a5" "proxy-server 1824498" 0.0008 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdi1/1/a/ec-dup/go-get-it" 200 736 "GET http://localhost/v1/a/ec-dup/go-get-it" "tx72d335cb72974e1685c29-0068c570a5" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdg1/1/a/ec-dup/go-get-it" 200 736 "GET http://localhost/v1/a/ec-dup/go-get-it" "tx72d335cb72974e1685c29-0068c570a5" "proxy-server 1824498" 0.0007 "-" 1824498 4 proxy INFO: 127.0.0.1 - - [13/Sep/2025 13:24:53] "GET /v1/a/ec-dup/go-get-it HTTP/1.1" 200 1777 0.028823 (txn: tx72d335cb72974e1685c29-0068c570a5) proxy DEBUG: (1824498) timed out ('127.0.0.1', 52110) (txn: tx72d335cb72974e1685c29-0068c570a5) proxy INFO: (1824498) wsgi exited, is_accepting=True acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx64cc092391ed4ee1a546f-0068c570a6" "proxy-server 1824498" 0.0021 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "tx64cc092391ed4ee1a546f-0068c570a6" "container-server 1824498" 0.0011 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx585dba66fed64acc8c1c0-0068c570a5" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx585dba66fed64acc8c1c0-0068c570a5 - 0.0043 VW - 1757769893.805780649 1757769893.810112238 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txa599b52d303a49f2be4ea-0068c570a5" "proxy-server 1824535" 0.0026 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - txa599b52d303a49f2be4ea-0068c570a5 - 0.0056 VW - 1757769893.818742037 1757769893.824378729 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/3/a/versions/name" 200 - "GET http://localhost/v1/a/versions/name?symlink=get" "txa83f0966a4b8472aa22d5-0068c570a5" "proxy-server 1824535" 0.0034 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/3/a/versions/name" 200 - "GET http://localhost/v1/a/versions/name?symlink=get" "txa83f0966a4b8472aa22d5-0068c570a5" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 GET /v1/a/versions/name%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txa83f0966a4b8472aa22d5-0068c570a5 - 0.0103 VW - 1757769893.824944735 1757769893.835218430 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/vers" 204 - "HEAD http://localhost/v1/a/vers" "txe273f2f6e0694b6eb9301-0068c570a5" "proxy-server 1824535" 0.0024 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/vers/004name/1757769893.77053" 201 - "PUT http://localhost/sdb1/1/a/vers/004name/1757769893.77053" "txf2ddfd64958147dcb679e-0068c570a5" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/vers/004name/1757769893.77053" 201 - "PUT http://localhost/sda1/1/a/vers/004name/1757769893.77053" "txf2ddfd64958147dcb679e-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/1/a/vers/004name/1757769893.77053" 201 - "PUT http://localhost/v1/a/vers/004name/1757769893.77053" "txf2ddfd64958147dcb679e-0068c570a5" "proxy-server 1824535" 0.0140 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/1/a/vers/004name/1757769893.77053" 201 - "PUT http://localhost/v1/a/vers/004name/1757769893.77053" "txf2ddfd64958147dcb679e-0068c570a5" "proxy-server 1824535" 0.0137 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 PUT /v1/a/vers/004name/1757769893.77053 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txf2ddfd64958147dcb679e-0068c570a5 - 0.0315 VW - 1757769893.835775375 1757769893.867314577 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "tx78db2dbe2ee6460e9a343-0068c570a5" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "tx78db2dbe2ee6460e9a343-0068c570a5" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx78db2dbe2ee6460e9a343-0068c570a5" "proxy-server 1824535" 0.0145 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx78db2dbe2ee6460e9a343-0068c570a5" "proxy-server 1824535" 0.0117 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 PUT /v1/a/versions/name HTTP/1.0 201 - - t - - - tx78db2dbe2ee6460e9a343-0068c570a5 - 0.0187 - - 1757769893.867776871 1757769893.886518240 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcf2d6f21afb543998aaf6-0068c570a5" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/0/a/vers" 200 352 "GET http://localhost/v1/a/vers?prefix=004name%2F&format=json&states=listing" "txcf2d6f21afb543998aaf6-0068c570a5" "proxy-server 1824535" 0.0037 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/53 GET /v1/a/vers%3Fprefix%3D004name%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 352 - txcf2d6f21afb543998aaf6-0068c570a5 - 0.0216 - - 1757769893.892437935 1757769893.914029837 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb2141d0d08044349bb82d-0068c570a5" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txb2141d0d08044349bb82d-0068c570a5 - 0.0093 VW - 1757769893.920076370 1757769893.929349184 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx3f3ed74bbb9c46c49db7b-0068c570a5" "proxy-server 1824535" 0.0060 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - tx3f3ed74bbb9c46c49db7b-0068c570a5 - 0.0134 VW - 1757769893.929861546 1757769893.943306684 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sda1/3/a/versions/name" 200 - "GET http://localhost/v1/a/versions/name?symlink=get" "tx361cdd4904aa4da3b7125-0068c570a5" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "GET /sdb1/3/a/versions/name" 200 - "GET http://localhost/v1/a/versions/name?symlink=get" "tx361cdd4904aa4da3b7125-0068c570a5" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/53 GET /v1/a/versions/name%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx361cdd4904aa4da3b7125-0068c570a5 - 0.0317 VW - 1757769893.943852663 1757769893.975530386 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:53 +0000] "HEAD /sda1/0/a/vers" 204 - "HEAD http://localhost/v1/a/vers" "tx07ea1ddd709647b6ba6e9-0068c570a5" "proxy-server 1824535" 0.0178 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/vers/004name/1757769893.86827" 201 - "PUT http://localhost/sdb1/2/a/vers/004name/1757769893.86827" "tx41f06614137d447f98b6d-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/vers/004name/1757769893.86827" 201 - "PUT http://localhost/sda1/2/a/vers/004name/1757769893.86827" "tx41f06614137d447f98b6d-0068c570a6" "object-server 1824535" 0.0049 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/2/a/vers/004name/1757769893.86827" 201 - "PUT http://localhost/v1/a/vers/004name/1757769893.86827" "tx41f06614137d447f98b6d-0068c570a6" "proxy-server 1824535" 0.0311 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/2/a/vers/004name/1757769893.86827" 201 - "PUT http://localhost/v1/a/vers/004name/1757769893.86827" "tx41f06614137d447f98b6d-0068c570a6" "proxy-server 1824535" 0.0309 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 PUT /v1/a/vers/004name/1757769893.86827 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx41f06614137d447f98b6d-0068c570a6 - 0.0620 VW - 1757769893.976129293 1757769894.038145304 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "tx6b992c8b79294383ad6d0-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx6b992c8b79294383ad6d0-0068c570a6" "proxy-server 1824535" 0.0132 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "tx6b992c8b79294383ad6d0-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx6b992c8b79294383ad6d0-0068c570a6" "proxy-server 1824535" 0.0333 "-" 1824535 0test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_calls_report test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_calls_report ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_nothing_to_do test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_nothing_to_do ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_rate_limited test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_rate_limited ... ok test.unit.proxy.test_server.TestECDuplicationObjectController.test_HEAD_ec test.unit.proxy.test_server.TestECDuplicationObjectController.test_HEAD_ec ... ok test.unit.proxy.test_server.TestECDuplicationObjectController.test_HEAD_ec_404 test.unit.proxy.test_server.TestECDuplicationObjectController.test_HEAD_ec_404 ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/versions/name HTTP/1.0 201 - - t 5 - - tx6b992c8b79294383ad6d0-0068c570a6 - 0.0515 - - 1757769894.038547754 1757769894.090060949 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcd4aecbc49c2499e876cb-0068c570a6" "proxy-server 1824535" 0.0140 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txcd4aecbc49c2499e876cb-0068c570a6 - 0.0166 VW - 1757769894.091669083 1757769894.108315229 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txbf8d9f6d91784edf8e4bb-0068c570a6" "proxy-server 1824535" 0.0069 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - txbf8d9f6d91784edf8e4bb-0068c570a6 - 0.0094 VW - 1757769894.108823299 1757769894.118224621 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name?symlink=get" "tx732ff26b3c074a1797cc8-0068c570a6" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/3/a/versions/name" 200 5 "GET http://localhost/v1/a/versions/name?symlink=get" "tx732ff26b3c074a1797cc8-0068c570a6" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a/vers" 204 - "HEAD http://localhost/v1/a/vers" "txe85c7ee12a124b37ba963-0068c570a6" "proxy-server 1824535" 0.0064 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/versions/name%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx732ff26b3c074a1797cc8-0068c570a6 - 0.0350 VW - 1757769894.122834444 1757769894.157839775 0 - (txn: txdb2459cf22dd4db989bd2-0068c570a6) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/vers/004name/1757769894.04993" 201 - "PUT http://localhost/sdb1/3/a/vers/004name/1757769894.04993" "txdb2459cf22dd4db989bd2-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/3/a/vers/004name/1757769894.04993" 201 - "PUT http://localhost/v1/a/vers/004name/1757769894.04993" "txdb2459cf22dd4db989bd2-0068c570a6" "proxy-server 1824535" 0.0128 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/vers/004name/1757769894.04993" 201 - "PUT http://localhost/sda1/3/a/vers/004name/1757769894.04993" "txdb2459cf22dd4db989bd2-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/3/a/vers/004name/1757769894.04993" 201 - "PUT http://localhost/v1/a/vers/004name/1757769894.04993" "txdb2459cf22dd4db989bd2-0068c570a6" "proxy-server 1824535" 0.0228 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 PUT /v1/a/vers/004name/1757769894.04993 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txdb2459cf22dd4db989bd2-0068c570a6 - 0.0409 VW - 1757769894.133222103 1757769894.174158335 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "txb2c3d2e7564141d99a67a-0068c570a6" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "txb2c3d2e7564141d99a67a-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txb2c3d2e7564141d99a67a-0068c570a6" "proxy-server 1824535" 0.0152 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "txb2c3d2e7564141d99a67a-0068c570a6" "proxy-server 1824535" 0.0167 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/versions/name HTTP/1.0 201 - - t 5 - - txb2c3d2e7564141d99a67a-0068c570a6 - 0.0286 - - 1757769894.174546003 1757769894.203131199 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx687bc76947a9476791c63-0068c570a6" "proxy-server 1824535" 0.0056 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx687bc76947a9476791c63-0068c570a6 - 0.0083 VW - 1757769894.204742670 1757769894.213029623 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "txb03cd9b2c7774c49ae24e-0068c570a6" "proxy-server 1824535" 0.0026 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - txb03cd9b2c7774c49ae24e-0068c570a6 - 0.0133 VW - 1757769894.213529110 1757769894.226820946 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/1/a/versions/name/sub" 404 70 "GET http://localhost/v1/a/versions/name/sub?symlink=get" "tx9ff679c3dcb9443facaca-0068c570a6" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/1/a/versions/name/sub" 404 70 "GET http://localhost/v1/a/versions/name/sub?symlink=get" "tx9ff679c3dcb9443facaca-0068c570a6" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/versions/name/sub%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx9ff679c3dcb9443facaca-0068c570a6 - 0.0093 VW - 1757769894.227391005 1757769894.236659288 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/versions/name/sub" 201 - "PUT http://localhost/sdb1/1/a/versions/name/sub" "txd1ee020b53414d4b8aa1f-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/versions/name/sub" 201 - "PUT http://localhost/v1/a/versions/name/sub" "txd1ee020b53414d4b8aa1f-0068c570a6" "proxy-server 1824535" 0.0088 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/versions/name/sub" 201 - "PUT http://localhost/sda1/1/a/versions/name/sub" "txd1ee020b53414d4b8aa1f-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/versions/name/sub" 201 - "PUT http://localhost/v1/a/versions/name/sub" "txd1ee020b53414d4b8aa1f-0068c570a6" "proxy-server 1824535" 0.0128 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/versions/name/sub HTTP/1.0 201 - - t 4 - - txd1ee020b53414d4b8aa1f-0068c570a6 - 0.0203 - - 1757769894.237046003 1757769894.257299662 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9a0a92f1decb45a68929e-0068c570a6" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx9a0a92f1decb45a68929e-0068c570a6 - 0.0080 VW - 1757769894.262727737 1757769894.270691395 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx7fdf753afbef444aaca6e-0068c570a6" "proxy-server 1824535" 0.0068 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - tx7fdf753afbef444aaca6e-0068c570a6 - 0.0095 VW - 1757769894.271259308 1757769894.280776978 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/1/a/versions/name/sub" 200 4 "GET http://localhost/v1/a/versions/name/sub?symlink=get" "txd2a62daae71e4d94b2ba2-0068c570a6" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/1/a/versions/name/sub" 200 4 "GET http://localhost/v1/a/versions/name/sub?symlink=get" "txd2a62daae71e4d94b2ba2-0068c570a6" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a/vers" 204 - "HEAD http://localhost/v1/a/vers" "txc205fe8aa00c409b81141-0068c570a6" "proxy-server 1824535" 0.0066 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/versions/name/sub%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 4 - txd2a62daae71e4d94b2ba2-0068c570a6 - 0.0360 VW - 1757769894.281303644 1757769894.317304134 0 - (txn: tx5bb14bcdcdd84cc7a0ee0-0068c570a6)test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_unicode_problem test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_unicode_problem ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_with_invalid_container test.unit.obj.test_expirer.TestObjectExpirer.test_run_once_with_invalid_container ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_from_config test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_from_config ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_from_kwargs test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_from_kwargs ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx64cc092391ed4ee1a546f-0068c570a6" "proxy-server 1824498" 0.0262 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "tx64cc092391ed4ee1a546f-0068c570a6" "container-server 1824498" 0.0011 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx64cc092391ed4ee1a546f-0068c570a6" "proxy-server 1824498" 0.0225 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - tx64cc092391ed4ee1a546f-0068c570a6 - 0.0618 - - 1757769894.009876013 1757769894.071720600 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb627ce82ebab43c4a312c-0068c570a6" "proxy-server 1824498" 0.0022 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "txd720d7f32e4a498bbc5d0-0068c570a6" "proxy-server 1824498" 0.0013 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdk1/0/a/ec-dup/go-head-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-head-it" "tx04908715644f4d478f0a4-0068c570a6" "proxy-server 1824498" 0.0395 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdi1/0/a/ec-dup/go-head-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-head-it" "tx04908715644f4d478f0a4-0068c570a6" "proxy-server 1824498" 0.0330 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdh1/0/a/ec-dup/go-head-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-head-it" "tx04908715644f4d478f0a4-0068c570a6" "proxy-server 1824498" 0.0430 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdj1/0/a/ec-dup/go-head-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-head-it" "tx04908715644f4d478f0a4-0068c570a6" "proxy-server 1824498" 0.0430 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/2/a/ec-dup/go-head-it" 201 - "PUT http://localhost/sdl1/0/a/ec-dup/go-head-it" "tx04908715644f4d478f0a4-0068c570a6" "object-server 1824498" 0.0004 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdl1/0/a/ec-dup/go-head-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-head-it" "tx04908715644f4d478f0a4-0068c570a6" "proxy-server 1824498" 0.0593 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/2/a/ec-dup/go-head-it" 201 - "PUT http://localhost/sdg1/0/a/ec-dup/go-head-it" "tx04908715644f4d478f0a4-0068c570a6" "object-server 1824498" 0.0004 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdg1/0/a/ec-dup/go-head-it" 201 - "PUT http://localhost/v1/a/ec-dup/go-head-it" "tx04908715644f4d478f0a4-0068c570a6" "proxy-server 1824498" 0.0631 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup/go-head-it HTTP/1.0 201 - - t 1309 - - tx04908715644f4d478f0a4-0068c570a6 - 0.1097 - - 1757769894.073194981 1757769894.182868004 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx222c945fb0fc499997c7c-0068c570a6" "proxy-server 1824498" 0.0032 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx7d9946d5822d48b3a7958-0068c570a6" "proxy-server 1824498" 0.0078 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdh1/0/a/ec-dup/go-head-it" 200 736 "HEAD http://localhost/v1/a/ec-dup/go-head-it" "txe1a990111fe24cfe8dbb7-0068c570a6" "proxy-server 1824498" 0.0047 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 HEAD /v1/a/ec-dup/go-head-it HTTP/1.0 200 - - t - - - txe1a990111fe24cfe8dbb7-0068c570a6 - 0.0240 - - 1757769894.184318066 1757769894.208314180 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9a035817c146431abfd13-0068c570a6" "proxy-server 1824498" 0.0020 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "tx9a035817c146431abfd13-0068c570a6" "container-server 1824498" 0.0010 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx9a035817c146431abfd13-0068c570a6" "proxy-server 1824498" 0.0144 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "tx9a035817c146431abfd13-0068c570a6" "container-server 1824498" 0.0046 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx9a035817c146431abfd13-0068c570a6" "proxy-server 1824498" 0.0222 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - tx9a035817c146431abfd13-0068c570a6 - 0.0382 - - 1757769894.210233927 1757769894.248431444 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx777a8bdb2bcf4820b89bf-0068c570a6" "proxy-server 1824498" 0.0020 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "txec1101f63ad84f7ba7b37-0068c570a6" "proxy-server 1824498" 0.0013 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdj1/0/a/ec-dup/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "tx367d5d8668d24f1289118-0068c570a6" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdk1/0/a/ec-dup/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "tx367d5d8668d24f1289118-0068c570a6" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdl1/0/a/ec-dup/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "tx367d5d8668d24f1289118-0068c570a6" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdi1/0/a/ec-dup/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "tx367d5d8668d24f1289118-0068c570a6" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdg1/0/a/ec-dup/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "tx367d5d8668d24f1289118-0068c570a6" "proxy-server 1824498" 0.0003 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdh1/0/a/ec-dup/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec-dup/yes-we-have-no-bananas" "tx367d5d8668d24f1289118-0068c570a6" "proxy-server 1824498" 0.0003 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 HEAD /v1/a/ec-dup/yes-we-have-no-bananas HTTP/1.0 404 - - t - - - tx367d5d8668d24f1289118-0068c570a6 - 0.0532 - - 1757769894.249703884 1757769894.302940845 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa8e4037c3dba40118571c-0068c570a6" "proxy-server 1824498" 0.0054 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "txa8e4037c3dba40118571c-0068c570a6" "container-server 1824498" 0.0010 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "txa8e4037c3dba40118571c-0068c570a6" "container-server 1824498" 0.0061 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "txa8e4037c3dba40118571c-0068c570a6" "proxy-server 1824498" 0.0310 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "txa8e4037c3dba40118571c-0068c570a6" "proxy-server 1824498" 0.0340 "-" 1824498 4test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_negative_process test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_negative_process ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_negative_processes test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_negative_processes ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_process_equal_to_processes test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_process_equal_to_processes ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_process_greater_than_processes test.unit.obj.test_expirer.TestObjectExpirer.test_set_process_values_process_greater_than_processes ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_skip_task_account_without_task_container test.unit.obj.test_expirer.TestObjectExpirer.test_skip_task_account_without_task_container ... ok test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/vers/008name/sub/1757769894.23752" 201 - "PUT http://localhost/sdb1/1/a/vers/008name/sub/1757769894.23752" "tx5bb14bcdcdd84cc7a0ee0-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/vers/008name/sub/1757769894.23752" 201 - "PUT http://localhost/v1/a/vers/008name/sub/1757769894.23752" "tx5bb14bcdcdd84cc7a0ee0-0068c570a6" "proxy-server 1824535" 0.0091 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/vers/008name/sub/1757769894.23752" 201 - "PUT http://localhost/sda1/1/a/vers/008name/sub/1757769894.23752" "tx5bb14bcdcdd84cc7a0ee0-0068c570a6" "object-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/vers/008name/sub/1757769894.23752" 201 - "PUT http://localhost/v1/a/vers/008name/sub/1757769894.23752" "tx5bb14bcdcdd84cc7a0ee0-0068c570a6" "proxy-server 1824535" 0.0141 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 PUT /v1/a/vers/008name/sub/1757769894.23752 HTTP/1.0 201 - Swift - 4 - 1b52eb8ef2c1875cfdf3ffbe9e3c05da tx5bb14bcdcdd84cc7a0ee0-0068c570a6 - 0.0310 VW - 1757769894.299423933 1757769894.330456018 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/versions/name/sub" 201 - "PUT http://localhost/sda1/1/a/versions/name/sub" "txdb0bfaed098649a3b6519-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/versions/name/sub" 201 - "PUT http://localhost/sdb1/1/a/versions/name/sub" "txdb0bfaed098649a3b6519-0068c570a6" "object-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/versions/name/sub" 201 - "PUT http://localhost/v1/a/versions/name/sub" "txdb0bfaed098649a3b6519-0068c570a6" "proxy-server 1824535" 0.0160 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/versions/name/sub" 201 - "PUT http://localhost/v1/a/versions/name/sub" "txdb0bfaed098649a3b6519-0068c570a6" "proxy-server 1824535" 0.0217 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/versions/name/sub HTTP/1.0 201 - - t 4 - - txdb0bfaed098649a3b6519-0068c570a6 - 0.0253 - - 1757769894.335078716 1757769894.360372066 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1c6d9607271f4b6a800da-0068c570a6" "proxy-server 1824535" 0.0012 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx1c6d9607271f4b6a800da-0068c570a6 - 0.0080 VW - 1757769894.361875534 1757769894.369851828 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a/versions" 204 - "HEAD http://localhost/v1/a/versions" "tx66593247978a44e8a2f20-0068c570a6" "proxy-server 1824535" 0.0022 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a/versions HTTP/1.0 204 - Swift - - - - tx66593247978a44e8a2f20-0068c570a6 - 0.0131 VW - 1757769894.370337963 1757769894.383470058 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/0/a/vers" 200 704 "GET http://localhost/v1/a/vers?prefix=004name%2F&marker=&reverse=on&format=json&states=listing" "txe36a335f4ccc424c8bea0-0068c570a6" "proxy-server 1824535" 0.0075 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/vers%3Fprefix%3D004name%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 704 - txe36a335f4ccc424c8bea0-0068c570a6 - 0.0105 VW - 1757769894.384025574 1757769894.394492149 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/3/a/vers/004name/1757769894.04993" 200 5 "GET http://localhost/v1/a/vers/004name/1757769894.04993?symlink=get" "tx6f8d5cd4949f4eae9c185-0068c570a6" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/3/a/vers/004name/1757769894.04993" 200 5 "GET http://localhost/v1/a/vers/004name/1757769894.04993?symlink=get" "tx6f8d5cd4949f4eae9c185-0068c570a6" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/vers/004name/1757769894.04993%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx6f8d5cd4949f4eae9c185-0068c570a6 - 0.0190 VW - 1757769894.399166107 1757769894.418194771 0 - (txn: tx1064c5ee86074be492a37-0068c570a6) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/versions/name" 201 - "PUT http://localhost/sdb1/3/a/versions/name" "tx1064c5ee86074be492a37-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/versions/name" 201 - "PUT http://localhost/sda1/3/a/versions/name" "tx1064c5ee86074be492a37-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx1064c5ee86074be492a37-0068c570a6" "proxy-server 1824535" 0.0149 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/3/a/versions/name" 201 - "PUT http://localhost/v1/a/versions/name" "tx1064c5ee86074be492a37-0068c570a6" "proxy-server 1824535" 0.0165 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 PUT /v1/a/versions/name HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx1064c5ee86074be492a37-0068c570a6 - 0.0243 VW - 1757769894.409352303 1757769894.433651686 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "DELETE /sdb1/0/a/vers/004name/1757769894.04993" 204 - "DELETE http://localhost/sda1/3/a/vers/004name/1757769894.04993" "txc1a5687df26f4227bcd87-0068c570a6" "object-server 1824535" 0.0043 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "DELETE /sda1/0/a/vers/004name/1757769894.04993" 204 - "DELETE http://localhost/sdb1/3/a/vers/004name/1757769894.04993" "txc1a5687df26f4227bcd87-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "DELETE /sdb1/3/a/vers/004name/1757769894.04993" 204 - "DELETE http://localhost/v1/a/vers/004name/1757769894.04993" "txc1a5687df26f4227bcd87-0068c570a6" "proxy-server 1824535" 0.0134 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "DELETE /sda1/3/a/vers/004name/1757769894.04993" 204 - "DELETE http://localhost/v1/a/vers/004name/1757769894.04993" "txc1a5687df26f4227bcd87-0068c570a6" "proxy-server 1824535" 0.0206 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 DELETE /v1/a/vers/004name/1757769894.04993 HTTP/1.0 204 - Swift - - - - txc1a5687df26f4227bcd87-0068c570a6 - 0.0280 VW - 1757769894.434109211 1757769894.462122440 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx257901da585d49468f065-0068c570a6" "proxy-server 1824535" 0.0095 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/0/a/vers" 200 180 "GET http://localhost/v1/a/vers?prefix=008name%2Fsub%2F&format=json&states=listing" "tx257901da585d49468f065-0068c570a6" "proxy-server 1824535" 0.0038 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 GET /v1/a/vers%3Fprefix%3D008name%252Fsub%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 180 - tx257901da585d49468f065-0068c570a6 - 0.0233 - - 1757769894.467804432 1757769894.491109133 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0ff29943df8e4a79ac6a9-0068c570a6" "proxy-server 1824535" 0.0054 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/versionswhoops" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a/versionswhoops" "tx0ff29943df8e4a79ac6a9-0068c570a6" "container-server 1824535" 0.0010 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/versionswhoops" 201 - "PUT http://127.0.0.1:38699/sda1/1/a/versionswhoops" "tx0ff29943df8e4a79ac6a9-0068c570a6" "container-server 1824535" 0.0010 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/versionswhoops" 201 - "PUT http://localhost/v1/a/versionswhoops" "tx0ff29943df8e4a79ac6a9-0068c570a6" "proxy-server 1824535" 0.0168 "-" 1824535 0test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_fragment_archive_etag_mismatch test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_fragment_archive_etag_mismatch ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_success_gets_counted test.unit.obj.test_expirer.TestObjectExpirer.test_success_gets_counted ... ok test.unit.obj.test_expirer.TestObjectExpirer.test_valid_delay_reaping test.unit.obj.test_expirer.TestObjectExpirer.test_valid_delay_reaping ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_creates_empty_hashes test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_creates_empty_hashes ... ok test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_handoff test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_handoff ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_mixed test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_mixed ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_no_hashes test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_no_hashes ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_primary test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_primary ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_revert_only_tombstones test.unit.obj.test_reconstructor.TestObjectReconstructor.test_build_jobs_revert_only_tombstones ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_cleans_tmp test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_cleans_tmp ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_creates_datadir test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_creates_datadir ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_creates_datadir_error test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_creates_datadir_error ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_mount_check test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_mount_check ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - txa8e4037c3dba40118571c-0068c570a6 - 0.0492 - - 1757769894.304762363 1757769894.353946209 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5c2fdd493fc04f7998cfb-0068c570a6" "proxy-server 1824498" 0.0064 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx4fcb1d1f5a6d46569f203-0068c570a6" "proxy-server 1824498" 0.0055 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdj1/3/a/ec-dup/o1" 201 - "PUT http://localhost/v1/a/ec-dup/o1" "tx2d5f47a499194378b5287-0068c570a6" "proxy-server 1824498" 0.0317 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdl1/3/a/ec-dup/o1" 201 - "PUT http://localhost/v1/a/ec-dup/o1" "tx2d5f47a499194378b5287-0068c570a6" "proxy-server 1824498" 0.0314 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdg1/3/a/ec-dup/o1" 201 - "PUT http://localhost/v1/a/ec-dup/o1" "tx2d5f47a499194378b5287-0068c570a6" "proxy-server 1824498" 0.0409 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/2/a/ec-dup/o1" 201 - "PUT http://localhost/sdh1/3/a/ec-dup/o1" "tx2d5f47a499194378b5287-0068c570a6" "object-server 1824498" 0.0004 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdk1/3/a/ec-dup/o1" 201 - "PUT http://localhost/v1/a/ec-dup/o1" "tx2d5f47a499194378b5287-0068c570a6" "proxy-server 1824498" 0.0472 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/2/a/ec-dup/o1" 201 - "PUT http://localhost/sdi1/3/a/ec-dup/o1" "tx2d5f47a499194378b5287-0068c570a6" "object-server 1824498" 0.0004 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdi1/3/a/ec-dup/o1" 201 - "PUT http://localhost/v1/a/ec-dup/o1" "tx2d5f47a499194378b5287-0068c570a6" "proxy-server 1824498" 0.0445 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdh1/3/a/ec-dup/o1" 201 - "PUT http://localhost/v1/a/ec-dup/o1" "tx2d5f47a499194378b5287-0068c570a6" "proxy-server 1824498" 0.0436 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup/o1 HTTP/1.0 201 - - t 40 - %22f080b258d6577697b9869dbd168d5628%22 tx2d5f47a499194378b5287-0068c570a6 - 0.0779 - - 1757769894.359469414 1757769894.437410593 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx52616462a9984c0182469-0068c570a6" "proxy-server 1824498" 0.0063 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "tx52616462a9984c0182469-0068c570a6" "container-server 1824498" 0.0018 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx52616462a9984c0182469-0068c570a6" "proxy-server 1824498" 0.0146 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "tx52616462a9984c0182469-0068c570a6" "container-server 1824498" 0.0011 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx52616462a9984c0182469-0068c570a6" "proxy-server 1824498" 0.0221 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - tx52616462a9984c0182469-0068c570a6 - 0.0440 - - 1757769894.455730438 1757769894.499709606 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd79a43b3b853480cb7619-0068c570a6" "proxy-server 1824498" 0.0022 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx24015719c3bb48eab21d3-0068c570a6" "proxy-server 1824498" 0.0014 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdg1/1/a/ec-dup/pimento" 422 93 "PUT http://localhost/v1/a/ec-dup/pimento" "txc07a2dc885814a328c2bd-0068c570a6" "proxy-server 1824498" 0.0135 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdh1/1/a/ec-dup/pimento" 422 93 "PUT http://localhost/v1/a/ec-dup/pimento" "txc07a2dc885814a328c2bd-0068c570a6" "proxy-server 1824498" 0.0231 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdj1/1/a/ec-dup/pimento" 422 93 "PUT http://localhost/v1/a/ec-dup/pimento" "txc07a2dc885814a328c2bd-0068c570a6" "proxy-server 1824498" 0.0251 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdl1/1/a/ec-dup/pimento" 422 93 "PUT http://localhost/v1/a/ec-dup/pimento" "txc07a2dc885814a328c2bd-0068c570a6" "proxy-server 1824498" 0.0249 "-" 1824498 4 proxy ERROR: Not enough object servers ack'ed (got 2) (txn: txc07a2dc885814a328c2bd-0068c570a6) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup/pimento HTTP/1.0 503 - - t 37 118 fc0b2c2af9909d00a8d840b38247222f txc07a2dc885814a328c2bd-0068c570a6 - 0.0655 - - 1757769894.501271725 1757769894.566751480 4 - obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdi1/1/a/ec-dup/pimento" 499 89 "PUT http://localhost/v1/a/ec-dup/pimento" "txc07a2dc885814a328c2bd-0068c570a6" "proxy-server 1824498" 0.0335 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdk1/1/a/ec-dup/pimento" 499 89 "PUT http://localhost/v1/a/ec-dup/pimento" "txc07a2dc885814a328c2bd-0068c570a6" "proxy-server 1824498" 0.0293 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd916b83cd6284807a5ee3-0068c570a6" "proxy-server 1824498" 0.0013 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/ec-con" 201 - "PUT http://127.0.0.1:54711/sdb1/1/a/ec-con" "txd916b83cd6284807a5ee3-0068c570a6" "container-server 1824498" 0.0018 "-" 1824498 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/ec-con" 201 - "PUT http://127.0.0.1:33753/sda1/1/a/ec-con" "txd916b83cd6284807a5ee3-0068c570a6" "container-server 1824498" 0.0009 "-" 1824498 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/ec-con" 201 - "PUT http://localhost/v1/a/ec-con" "txd916b83cd6284807a5ee3-0068c570a6" "proxy-server 1824498" 0.0318 "-" 1824498 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/ec-con" 201 - "PUT http://localhost/v1/a/ec-con" "txd916b83cd6284807a5ee3-0068c570a6" "proxy-server 1824498" 0.0220 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-con HTTP/1.0 201 - - t - - - txd916b83cd6284807a5ee3-0068c570a6 - 0.0482 - - 1757769894.577118635 1757769894.625330925 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx97e974a7f2a5498689bf1-0068c570a6" "proxy-server 1824498" 0.0019 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txfd6867561a054261a249c-0068c570a6" "proxy-server 1824498" 0.0012 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdg1/2/a/ec-con/quorum" 422 93 "PUT http://localhost/v1/a/ec-con/quorum" "tx7b55bbced8d4485aaa52d-0068c570a6" "proxy-server 1824498" 0.0097 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdi1/2/a/ec-con/quorum" 422 93 "PUT http://localhost/v1/a/ec-con/quorum" "tx7b55bbced8d4485aaa52d-0068c570a6" "proxy-server 1824498" 0.0091 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdh1/2/a/ec-con/quorum" 422 93 "PUT http://localhost/v1/a/ec-con/quorum" "tx7b55bbced8d4485aaa52d-0068c570a6" "proxy-server 1824498" 0.0112 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-con/quorum HTTP/1.0 503 - - t 37 118 fc0b2c2af9909d00a8d840b38247222f tx7b55bbced8d4485aaa52d-0068c570a6 - 0.0381 - - 1757769894.631059647 1757769894.669201612 3 -test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_fragment_quorum_archive_etag_mismatch test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_fragment_quorum_archive_etag_mismatch ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_multi_device_skips_non_non_local_devs test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_multi_device_skips_non_non_local_devs ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/versionswhoops" 201 - "PUT http://localhost/v1/a/versionswhoops" "tx0ff29943df8e4a79ac6a9-0068c570a6" "proxy-server 1824535" 0.0265 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/versionswhoops HTTP/1.0 201 - - t - - - tx0ff29943df8e4a79ac6a9-0068c570a6 - 0.0418 - - 1757769894.492834568 1757769894.534594297 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx817ab61ec89a401184593-0068c570a6" "proxy-server 1824535" 0.0062 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx817ab61ec89a401184593-0068c570a6 - 0.0089 VW - 1757769894.540319204 1757769894.549181461 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/1/a/versionswhoops" 204 - "HEAD http://localhost/v1/a/versionswhoops" "tx58cd940ea3864f57a42a4-0068c570a6" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a/versionswhoops HTTP/1.0 204 - Swift - - - - tx58cd940ea3864f57a42a4-0068c570a6 - 0.0081 VW - 1757769894.549720287 1757769894.557861805 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/1/a/versionswhoops/foo" 404 70 "GET http://localhost/v1/a/versionswhoops/foo?symlink=get" "tx61fadabce9ed4d31b0a76-0068c570a6" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/1/a/versionswhoops/foo" 404 70 "GET http://localhost/v1/a/versionswhoops/foo?symlink=get" "tx61fadabce9ed4d31b0a76-0068c570a6" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/versionswhoops/foo%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx61fadabce9ed4d31b0a76-0068c570a6 - 0.0136 VW - 1757769894.558383703 1757769894.571988821 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/versionswhoops/foo" 201 - "PUT http://localhost/sdb1/1/a/versionswhoops/foo" "tx6e6a6dab7ffe41a2805e0-0068c570a6" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/versionswhoops/foo" 201 - "PUT http://localhost/sda1/1/a/versionswhoops/foo" "tx6e6a6dab7ffe41a2805e0-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/versionswhoops/foo" 201 - "PUT http://localhost/v1/a/versionswhoops/foo" "tx6e6a6dab7ffe41a2805e0-0068c570a6" "proxy-server 1824535" 0.0119 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/versionswhoops/foo" 201 - "PUT http://localhost/v1/a/versionswhoops/foo" "tx6e6a6dab7ffe41a2805e0-0068c570a6" "proxy-server 1824535" 0.0134 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/versionswhoops/foo HTTP/1.0 201 - - t 5 - - tx6e6a6dab7ffe41a2805e0-0068c570a6 - 0.0209 - - 1757769894.572383642 1757769894.593320608 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe0e986b2a77849c8a0a4b-0068c570a6" "proxy-server 1824535" 0.0019 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txe0e986b2a77849c8a0a4b-0068c570a6 - 0.0044 VW - 1757769894.594761610 1757769894.599151134 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a/versionswhoops" 204 - "HEAD http://localhost/v1/a/versionswhoops" "txd6c66d5cb92b4bf1b1b39-0068c570a6" "proxy-server 1824535" 0.0023 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a/versionswhoops HTTP/1.0 204 - Swift - - - - txd6c66d5cb92b4bf1b1b39-0068c570a6 - 0.0049 VW - 1757769894.599644184 1757769894.604497910 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/1/a/versionswhoops/foo" 200 5 "GET http://localhost/v1/a/versionswhoops/foo?symlink=get" "tx01b46105a8b84405a1c07-0068c570a6" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/1/a/versionswhoops/foo" 200 5 "GET http://localhost/v1/a/versionswhoops/foo?symlink=get" "tx01b46105a8b84405a1c07-0068c570a6" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx63226066e5f546adad860-0068c570a6" "proxy-server 1824535" 0.0003 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx63226066e5f546adad860-0068c570a6" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/versionswhoops/foo%3Fsymlink%3Dget HTTP/1.0 499 - Swift - - 5 - tx01b46105a8b84405a1c07-0068c570a6 - 0.0114 VW - 1757769894.605033875 1757769894.616406202 0 - (txn: tx34be083b70dc405587123-0068c570a6) proxy INFO: - - 13/Sep/2025/13/24/54 PUT /v1/a/none/003foo/1757769894.57293 HTTP/1.0 404 - Swift - - 70 dcddb75469b4b4875094e14561e573d8 tx34be083b70dc405587123-0068c570a6 - 0.0057 VW - 1757769894.611124754 1757769894.616811752 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa2428281c93549e09d6ee-0068c570a6" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa2428281c93549e09d6ee-0068c570a6 - 0.0039 VW - 1757769894.618227959 1757769894.622086048 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a/versionswhoops" 204 - "HEAD http://localhost/v1/a/versionswhoops" "txeb3072113159464d92e6d-0068c570a6" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a/versionswhoops HTTP/1.0 204 - Swift - - - - txeb3072113159464d92e6d-0068c570a6 - 0.0038 VW - 1757769894.622565985 1757769894.626415730 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txf44d76b49bf245c0aa2cd-0068c570a6" "proxy-server 1824535" 0.0003 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txf44d76b49bf245c0aa2cd-0068c570a6" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/none%3Fprefix%3D003foo%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 404 - Swift - - 70 - txf44d76b49bf245c0aa2cd-0068c570a6 - 0.0051 VW - 1757769894.626972198 1757769894.632028580 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "DELETE /sdb1/1/a/versionswhoops/foo" 204 - "DELETE http://localhost/sda1/1/a/versionswhoops/foo" "tx4b93ecc4800f4beba13d1-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "DELETE /sda1/1/a/versionswhoops/foo" 204 - "DELETE http://localhost/sdb1/1/a/versionswhoops/foo" "tx4b93ecc4800f4beba13d1-0068c570a6" "object-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "DELETE /sda1/1/a/versionswhoops/foo" 204 - "DELETE http://localhost/v1/a/versionswhoops/foo" "tx4b93ecc4800f4beba13d1-0068c570a6" "proxy-server 1824535" 0.0061 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "DELETE /sdb1/1/a/versionswhoops/foo" 204 - "DELETE http://localhost/v1/a/versionswhoops/foo" "tx4b93ecc4800f4beba13d1-0068c570a6" "proxy-server 1824535" 0.0051 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 DELETE /v1/a/versionswhoops/foo HTTP/1.0 204 - - t - - - tx4b93ecc4800f4beba13d1-0068c570a6 - 0.0136 - - 1757769894.632385492 1757769894.645956278 0 - proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb5ef6d975f6747a997287-0068c570a6" "proxy-server 1824535" 0.0014 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/0_oc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:44669/sdb1/3/a/0_oc_non_ascii%C2%A3" "txb5ef6d975f6747a997287-0068c570a6" "container-server 1824535" 0.0011 "-" 1824535 0test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_multi_device_skips_non_ring_devices test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_multi_device_skips_non_ring_devices ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_overrides test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_overrides ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_skips_invalid_paths test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_skips_invalid_paths ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_skips_non_ec_policy_and_device test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_skips_non_ec_policy_and_device ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_skips_non_local_devs_servers_per_port test.unit.obj.test_reconstructor.TestObjectReconstructor.test_collect_parts_skips_non_local_devs_servers_per_port ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_local_devices test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_local_devices ... ok test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_fragment_quorum_bad_request test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_fragment_quorum_bad_request ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_local_devices_with_no_ec_policy_env test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_local_devices_with_no_ec_policy_env ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_suffix_delta test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_suffix_delta ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_suffixes_in_sync test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_suffixes_in_sync ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_suffixes_to_sync test.unit.obj.test_reconstructor.TestObjectReconstructor.test_get_suffixes_to_sync ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_first_enables_handoffs_only test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_first_enables_handoffs_only ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_default test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_default ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_enabled test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_enabled ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_false_and_first_false test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_false_and_first_false ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_false_and_first_none test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_false_and_first_none ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_ignores_handoffs_first test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_ignores_handoffs_first ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_none_and_first_false test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_none_and_first_false ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_true_and_first_false test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_true_and_first_false ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_true_and_first_true test.unit.obj.test_reconstructor.TestObjectReconstructor.test_handoffs_only_true_and_first_true ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_handoff test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_handoff ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_primary_down test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_primary_down ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_primary_in_sync test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_primary_in_sync ... ok test-expirer ERROR: Unexcepted error handling task {'task_account': '.expiring_objects', 'task_container': '0000000000', 'task_object': '0002-invalid2', 'delete_timestamp': 0000000002.00000_0000000000000000, 'target_path': 'invalid2', 'is_async_delete': False} test-expirer ERROR: Unhandled exception: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 638, in run_forever self.run_once(*args, **kwargs) ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/obj/test_expirer.py", line 2245, in raise_exceptions raise Exception('exception %d' % raises[0]) Exception: exception 1 test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 10 objects expired test-expirer DEBUG: Run begin test-expirer ERROR: Unhandled exception: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/expirer.py", line 585, in run_once self.swift.get_account_info(task_account) ^^^^^^^^^^^^^^^^^^^^^^^^^^^ AttributeError: 'str' object has no attribute 'get_account_info' test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 10 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 10 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 3 possible containers; 9 possible objects test-expirer ERROR: skipping invalid task container: .expiring_objects/1757635168-crazy test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 6 objects expired test-expirer DEBUG: Run begin test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 0 objects expired test-expirer DEBUG: Run begin test-expirer INFO: Pass beginning for task account .expiring_objects; 4 possible containers; 12 possible objects test-expirer DEBUG: Run end test-expirer INFO: Pass completed in 0s; 10 objects expired object-reconstructor DEBUG: Run listdir on /tmp/tmpiiqqe835/devices/sda/objects/0 object-reconstructor DEBUG: Run listdir on /tmp/tmpiiqqe835/devices/sda/objects/0 object-reconstructor INFO: Nothing reconstructed for 8.344650268554688e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.245208740234375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor ERROR: Unable to create /tmp/tmp5pz4trpv/devices/sda/objects: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 1350, in collect_parts mkdirs(obj_path) ~~~~~~^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: kaboom! object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor WARNING: sda is not mounted object-reconstructor WARNING: sdb is not mounted object-reconstructor WARNING: sdb is not mounted object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor ERROR: Unable to list partitions in '/tmp/tmpj0bx5u0l/devices/sda/objects': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 1356, in collect_parts partitions = os.listdir(obj_path) NotADirectoryError: [Errno 20] Not a directory: '/tmp/tmpj0bx5u0l/devices/sda/objects' object-reconstructor INFO: Nothing reconstructed for 2.6226043701171875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.0067901611328125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.76837158203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.76837158203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor DEBUG: Run listdir on /tmp/tmpd8bw5jpn/devices/sda/objects/1 object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor DEBUG: Run listdir on /tmp/tmprq6vzs70/devices/sda/objects/1 object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 8.58306884765625e-06 seconds. object-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. object-reconstructor INFO: Nothing reconstructed for 5.4836273193359375e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 4.0531158447265625e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor WARNING: Ignored handoffs_first option in favor of handoffs_only. object-reconstructor INFO: Nothing reconstructed for 4.76837158203125e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. object-reconstructor INFO: Nothing reconstructed for 4.291534423828125e-06 seconds. object-reconstructor WARNING: The handoffs_first option is deprecated in favor of handoffs_only. This option may be ignored in a future release. object-reconstructor WARNING: Handoff only mode is not intended for normal operation, use handoffs_only with care. object-reconstructor INFO: Nothing reconstructed for 4.5299530029296875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds.test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_primary_not_in_sync test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_primary_not_in_sync ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_primary_some_in_sync test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_primary_some_in_sync ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_cleanup test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_cleanup ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_cleanup_but_already_reclaimed test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_cleanup_but_already_reclaimed ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_cleanup_tombstone test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_cleanup_tombstone ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_does_cleanup_meta_pure_handoff test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_does_cleanup_meta_pure_handoff ... ok test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_if_none_match test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_if_none_match ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_does_not_cleanup_meta_also_primary test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_does_not_cleanup_meta_also_primary ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_does_not_cleanup_meta_new_data test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_does_not_cleanup_meta_new_data ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/0_oc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:38699/sda1/3/a/0_oc_non_ascii%C2%A3" "txb5ef6d975f6747a997287-0068c570a6" "container-server 1824535" 0.0010 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txb5ef6d975f6747a997287-0068c570a6" "proxy-server 1824535" 0.0343 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txb5ef6d975f6747a997287-0068c570a6" "proxy-server 1824535" 0.0261 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - txb5ef6d975f6747a997287-0068c570a6 - 0.0434 - - 1757769894.650011539 1757769894.693371534 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx72ab431058ca4c69a809c-0068c570a6" "proxy-server 1824535" 0.0019 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/3/a/0_oc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3?format=json&states=listing" "tx72ab431058ca4c69a809c-0068c570a6" "proxy-server 1824535" 0.0103 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 GET /v1/a/0_oc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx72ab431058ca4c69a809c-0068c570a6 - 0.0225 - - 1757769894.694845676 1757769894.717332125 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx209c3d7ddfbd4adc8af55-0068c570a6" "proxy-server 1824535" 0.0061 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/0_vc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/0_vc_non_ascii%C2%A3" "tx209c3d7ddfbd4adc8af55-0068c570a6" "container-server 1824535" 0.0011 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/0_vc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/0_vc_non_ascii%C2%A3" "tx209c3d7ddfbd4adc8af55-0068c570a6" "container-server 1824535" 0.0010 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3" "tx209c3d7ddfbd4adc8af55-0068c570a6" "proxy-server 1824535" 0.0246 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3" "tx209c3d7ddfbd4adc8af55-0068c570a6" "proxy-server 1824535" 0.0337 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/0_vc_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx209c3d7ddfbd4adc8af55-0068c570a6 - 0.0457 - - 1757769894.723351717 1757769894.769074678 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txabcddf436595498bb37c8-0068c570a6" "proxy-server 1824535" 0.0080 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txabcddf436595498bb37c8-0068c570a6 - 0.0108 VW - 1757769894.774802446 1757769894.785626411 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx165290f9e1fd48ddbc519-0068c570a6" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx165290f9e1fd48ddbc519-0068c570a6 - 0.0081 VW - 1757769894.786147833 1757769894.794234514 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "tx7370e16497cd46958b0fd-0068c570a6" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "tx7370e16497cd46958b0fd-0068c570a6" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx7370e16497cd46958b0fd-0068c570a6 - 0.0096 VW - 1757769894.798984051 1757769894.808548927 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txfcd1ac5255c3445cbcb57-0068c570a6" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txfcd1ac5255c3445cbcb57-0068c570a6" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txfcd1ac5255c3445cbcb57-0068c570a6" "proxy-server 1824535" 0.0237 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txfcd1ac5255c3445cbcb57-0068c570a6" "proxy-server 1824535" 0.0236 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - txfcd1ac5255c3445cbcb57-0068c570a6 - 0.0364 - - 1757769894.808969498 1757769894.845387459 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc1350eabb4904c12960af-0068c570a6" "proxy-server 1824535" 0.0022 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txc1350eabb4904c12960af-0068c570a6 - 0.0130 VW - 1757769894.857738256 1757769894.870769501 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx7a320c92e6ee4c5f81554-0068c570a6" "proxy-server 1824535" 0.0073 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx7a320c92e6ee4c5f81554-0068c570a6 - 0.0101 VW - 1757769894.871403933 1757769894.881484509 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "tx1cfded19ef73493abaed8-0068c570a6" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "tx1cfded19ef73493abaed8-0068c570a6" "proxy-server 1824535" 0.0048 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a/0_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_vc_non_ascii%C2%A3" "tx8f1a74e01e414031b10e3-0068c570a6" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx1cfded19ef73493abaed8-0068c570a6 - 0.0441 VW - 1757769894.882067680 1757769894.926146984 0 - (txn: tx5b6e54b0ba2d40dd92d73-0068c570a6) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 201 - "PUT http://localhost/sdb1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" "tx5b6e54b0ba2d40dd92d73-0068c570a6" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 201 - "PUT http://localhost/sda1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" "tx5b6e54b0ba2d40dd92d73-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_is_handoff_fails test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_revert_is_handoff_fails ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_suffix_call_errors test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_suffix_call_errors ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_sync_missing_durable test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_sync_missing_durable ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_sync_partner_unmounted test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_sync_partner_unmounted ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_will_not_revert_to_handoff test.unit.obj.test_reconstructor.TestObjectReconstructor.test_process_job_will_not_revert_to_handoff ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4fd343d73d264f6d99587-0068c570a6" "proxy-server 1824498" 0.0095 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/ec-con" 201 - "PUT http://127.0.0.1:54711/sdb1/1/a/ec-con" "tx4fd343d73d264f6d99587-0068c570a6" "container-server 1824498" 0.0016 "-" 1824498 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/ec-con" 201 - "PUT http://127.0.0.1:33753/sda1/1/a/ec-con" "tx4fd343d73d264f6d99587-0068c570a6" "container-server 1824498" 0.0051 "-" 1824498 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "tx4fd343d73d264f6d99587-0068c570a6" "proxy-server 1824498" 0.0148 "-" 1824498 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "tx4fd343d73d264f6d99587-0068c570a6" "proxy-server 1824498" 0.0218 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-con HTTP/1.0 202 - - t - 76 - tx4fd343d73d264f6d99587-0068c570a6 - 0.0373 - - 1757769894.688113213 1757769894.725390673 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txade7e6acf23c42958ce4c-0068c570a6" "proxy-server 1824498" 0.0060 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/1/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx1d4674e504fd408784083-0068c570a6" "proxy-server 1824498" 0.0053 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdg1/2/a/ec-con/quorum" 400 29 "PUT http://localhost/v1/a/ec-con/quorum" "tx973be79489df41829509a-0068c570a6" "proxy-server 1824498" 0.0123 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdh1/2/a/ec-con/quorum" 400 29 "PUT http://localhost/v1/a/ec-con/quorum" "tx973be79489df41829509a-0068c570a6" "proxy-server 1824498" 0.0077 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdi1/2/a/ec-con/quorum" 400 29 "PUT http://localhost/v1/a/ec-con/quorum" "tx973be79489df41829509a-0068c570a6" "proxy-server 1824498" 0.0094 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-con/quorum HTTP/1.0 503 - - t 37 118 fc0b2c2af9909d00a8d840b38247222f tx973be79489df41829509a-0068c570a6 - 0.0516 - - 1757769894.731344938 1757769894.782932997 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1adf3ac821454e9c9af80-0068c570a6" "proxy-server 1824498" 0.0056 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "tx1adf3ac821454e9c9af80-0068c570a6" "container-server 1824498" 0.0018 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "tx1adf3ac821454e9c9af80-0068c570a6" "container-server 1824498" 0.0053 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx1adf3ac821454e9c9af80-0068c570a6" "proxy-server 1824498" 0.0155 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx1adf3ac821454e9c9af80-0068c570a6" "proxy-server 1824498" 0.0229 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - tx1adf3ac821454e9c9af80-0068c570a6 - 0.0344 - - 1757769894.791727781 1757769894.826100826 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc191d445c3564c27a73da-0068c570a6" "proxy-server 1824498" 0.0062 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx051bcbe5fae74efa907bd-0068c570a6" "proxy-server 1824498" 0.0054 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdh1/0/a/ec-dup/inm" 201 - "PUT http://localhost/v1/a/ec-dup/inm" "tx888dd61b5a944e5dac953-0068c570a6" "proxy-server 1824498" 0.0316 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdk1/0/a/ec-dup/inm" 201 - "PUT http://localhost/v1/a/ec-dup/inm" "tx888dd61b5a944e5dac953-0068c570a6" "proxy-server 1824498" 0.0378 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdg1/0/a/ec-dup/inm" 201 - "PUT http://localhost/v1/a/ec-dup/inm" "tx888dd61b5a944e5dac953-0068c570a6" "proxy-server 1824498" 0.0315 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/2/a/ec-dup/inm" 201 - "PUT http://localhost/sdi1/0/a/ec-dup/inm" "tx888dd61b5a944e5dac953-0068c570a6" "object-server 1824498" 0.0048 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/2/a/ec-dup/inm" 201 - "PUT http://localhost/sdj1/0/a/ec-dup/inm" "tx888dd61b5a944e5dac953-0068c570a6" "object-server 1824498" 0.0004 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdj1/0/a/ec-dup/inm" 201 - "PUT http://localhost/v1/a/ec-dup/inm" "tx888dd61b5a944e5dac953-0068c570a6" "proxy-server 1824498" 0.0417 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdi1/0/a/ec-dup/inm" 201 - "PUT http://localhost/v1/a/ec-dup/inm" "tx888dd61b5a944e5dac953-0068c570a6" "proxy-server 1824498" 0.0479 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdl1/0/a/ec-dup/inm" 201 - "PUT http://localhost/v1/a/ec-dup/inm" "tx888dd61b5a944e5dac953-0068c570a6" "proxy-server 1824498" 0.0459 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup/inm HTTP/1.0 201 - - t 48 - %22478884f627ab2565c2e752741f8e34cc%22 tx888dd61b5a944e5dac953-0068c570a6 - 0.0810 - - 1757769894.831659079 1757769894.912636518 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx050dde1c2b2045a6bad71-0068c570a6" "proxy-server 1824498" 0.0014 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx756b84228046415596fe6-0068c570a6" "proxy-server 1824498" 0.0077 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdk1/0/a/ec-dup/inm" 412 92 "PUT http://localhost/v1/a/ec-dup/inm" "txf378b2f1f2af4df6a9eca-0068c570a6" "proxy-server 1824498" 0.0006 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdi1/0/a/ec-dup/inm" 412 92 "PUT http://localhost/v1/a/ec-dup/inm" "txf378b2f1f2af4df6a9eca-0068c570a6" "proxy-server 1824498" 0.0006 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdh1/0/a/ec-dup/inm" 412 92 "PUT http://localhost/v1/a/ec-dup/inm" "txf378b2f1f2af4df6a9eca-0068c570a6" "proxy-server 1824498" 0.0006 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdg1/0/a/ec-dup/inm" 412 92 "PUT http://localhost/v1/a/ec-dup/inm" "txf378b2f1f2af4df6a9eca-0068c570a6" "proxy-server 1824498" 0.0047 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdl1/0/a/ec-dup/inm" 412 92 "PUT http://localhost/v1/a/ec-dup/inm" "txf378b2f1f2af4df6a9eca-0068c570a6" "proxy-server 1824498" 0.0006 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdj1/0/a/ec-dup/inm" 412 92 "PUT http://localhost/v1/a/ec-dup/inm" "txf378b2f1f2af4df6a9eca-0068c570a6" "proxy-server 1824498" 0.0006 "-" 1824498 4 proxy DEBUG: Object PUT returning 412, [412, 412, 412, 412, 412, 412] (txn: txf378b2f1f2af4df6a9eca-0068c570a6) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/ec-dup/inm HTTP/1.0 412 - - t - 92 %22478884f627ab2565c2e752741f8e34cc%22 txf378b2f1f2af4df6a9eca-0068c570a6 - 0.0552 - - 1757769894.914190769 1757769894.969357014 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6d20c6216eaf43cd9df6a-0068c570a6" "proxy-server 1824498" 0.0063 "-" 1824498 -test.unit.obj.test_reconstructor.TestObjectReconstructor.test_reconstruct_removes_non_partition_files test.unit.obj.test_reconstructor.TestObjectReconstructor.test_reconstruct_removes_non_partition_files ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_reconstruct_with_no_ec_policy_env test.unit.obj.test_reconstructor.TestObjectReconstructor.test_reconstruct_with_no_ec_policy_env ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_ring_ip_and_bind_ip test.unit.obj.test_reconstructor.TestObjectReconstructor.test_ring_ip_and_bind_ip ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_sync_duplicates_to_remote_region test.unit.obj.test_reconstructor.TestObjectReconstructor.test_sync_duplicates_to_remote_region ... ok test.unit.obj.test_reconstructor.TestObjectReconstructor.test_two_ec_policies test.unit.obj.test_reconstructor.TestObjectReconstructor.test_two_ec_policies ... ok test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_multiple_segments test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_multiple_segments ... ok object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 2.6226043701171875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.0:1000/sda/0 policy#0': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 920, in _get_suffixes_to_sync conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], job['partition'], 'REPLICATE', '', headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Unable to get remote suffix hashes from '10.0.0.1:1001/sdb/0 policy#0': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 920, in _get_suffixes_to_sync conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], job['partition'], 'REPLICATE', '', headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 920, in _get_suffixes_to_sync conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], job['partition'], 'REPLICATE', '', headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor INFO: Nothing reconstructed for 3.0994415283203125e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.5762786865234375e-06 seconds. object-reconstructor ERROR: 10.0.0.1:1001/sdb/0 policy#0 responded as unmounted object-reconstructor INFO: Nothing reconstructed for 2.86102294921875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 3.337860107421875e-06 seconds. object-reconstructor WARNING: Unexpected entity in data dir: '/tmp/tmphm9zhog6/devices/sda/objects/junk' object-reconstructor INFO: Removing partition: /tmp/tmphm9zhog6/devices/sda/objects/junk object-reconstructor WARNING: Unexpected entity in data dir: '/tmp/tmphm9zhog6/devices/sda/objects/not' object-reconstructor INFO: Removing partition: /tmp/tmphm9zhog6/devices/sda/objects/not object-reconstructor DEBUG: Run listdir on /tmp/tmphm9zhog6/devices/sda/objects/2 object-reconstructor DEBUG: Run listdir on /tmp/tmphm9zhog6/devices/sda/objects/0 object-reconstructor DEBUG: Run listdir on /tmp/tmphm9zhog6/devices/sda/objects/1 object-reconstructor WARNING: Unable to read '/tmp/tmphm9zhog6/devices/sda/objects/1234/hashes.pkl' Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 1336, in __get_hashes orig_hashes = self.consolidate_hashes(partition_path) File "/build/reproducible-path/swift-2.36.0/swift/obj/diskfile.py", line 436, in consolidate_hashes with lock_path(partition_dir): ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1294, in lock_path mkdirs(directory) ~~~~~~^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 802, in mkdirs os.makedirs(path) ~~~~~~~~~~~^^^^^^ File "", line 228, in makedirs FileExistsError: [Errno 17] File exists: '/tmp/tmphm9zhog6/devices/sda/objects/1234' object-reconstructor WARNING: Unexpected entity '/tmp/tmphm9zhog6/devices/sda/objects/1234' is not a directory object-reconstructor INFO: Removing partition: /tmp/tmphm9zhog6/devices/sda/objects/1234 object-reconstructor INFO: 6/6 (100.00%) partitions reconstructed in 0.02s (359.19/sec, 0s remaining) object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 0.00028228759765625 seconds. object-reconstructor INFO: Nothing reconstructed for 2.6226043701171875e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor DEBUG: ssync completed ok: dev: sda, part: 0, policy: 0, num suffixes: 1, available: 0, sent: 0, deletable: 0 object-reconstructor INFO: Nothing reconstructed for 5.0067901611328125e-06 seconds. object-reconstructor INFO: Running object reconstructor in script mode. object-reconstructor DEBUG: Run listdir on /tmp/tmpqoq2m472/devices/sda/objects-1/0 object-reconstructor INFO: 1/1 (100.00%) partitions reconstructed in 0.01s (160.87/sec, 0s remaining) object-reconstructor INFO: Object reconstruction complete (once). (0.00 minutes) object-reconstructor ERROR: Exception dumping recon cache: [Errno 2] No such file or directory: '/var/cache/swift/object.recon': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2194, in dump_recon_cache with lock_file(cache_file, lock_timeout, unlink=False) as cf: ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/contextlib.py", line 141, in __enter__ return next(self.gen) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 1342, in lock_file fd = os.open(filename, flags) FileNotFoundError: [Errno 2] No such file or directory: '/var/cache/swift/object.recon' object-reconstructor INFO: Nothing reconstructed for 5.9604644775390625e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 1.049041748046875e-05 seconds.test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_quarantine_age_conf test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_quarantine_age_conf ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_quarantine_threshold_conf test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_quarantine_threshold_conf ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_all_404s_fails test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_all_404s_fails ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_all_404s_fails_custom_request_node_count test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_all_404s_fails_custom_request_node_count ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_error_with_invalid_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_error_with_invalid_header ... ok test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_object_etag_mismatch test.unit.proxy.test_server.TestECDuplicationObjectController.test_PUT_ec_object_etag_mismatch ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" "tx5b6e54b0ba2d40dd92d73-0068c570a6" "proxy-server 1824535" 0.0314 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" "tx5b6e54b0ba2d40dd92d73-0068c570a6" "proxy-server 1824535" 0.0311 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/54 PUT /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769894.80949 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx5b6e54b0ba2d40dd92d73-0068c570a6 - 0.0607 VW - 1757769894.896873713 1757769894.957539558 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txdc5e8256ef9e4a1488ce9-0068c570a6" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txdc5e8256ef9e4a1488ce9-0068c570a6" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txdc5e8256ef9e4a1488ce9-0068c570a6" "proxy-server 1824535" 0.0267 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:54 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txdc5e8256ef9e4a1488ce9-0068c570a6" "proxy-server 1824535" 0.0263 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/54 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - txdc5e8256ef9e4a1488ce9-0068c570a6 - 0.0393 - - 1757769894.958007336 1757769894.997308969 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx37a268f750e04c3dbca73-0068c570a7" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx7e3fe78523544ecf926e1-0068c570a7" "proxy-server 1824535" 0.0104 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txade3a2ff3311476ba6aab-0068c570a7" "proxy-server 1824535" 0.0048 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - txade3a2ff3311476ba6aab-0068c570a7 - 0.0376 - - 1757769895.006947041 1757769895.044588804 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf2ef978ec98343a286b4a-0068c570a7" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/55 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txf2ef978ec98343a286b4a-0068c570a7 - 0.0083 VW - 1757769895.056691647 1757769895.065022469 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx20253edf7d58451f9d553-0068c570a7" "proxy-server 1824535" 0.0024 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx20253edf7d58451f9d553-0068c570a7 - 0.0093 VW - 1757769895.065547228 1757769895.074821949 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "txd85d15ed780247adbba78-0068c570a7" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "txd85d15ed780247adbba78-0068c570a7" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a/0_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_vc_non_ascii%C2%A3" "tx4485953bce5a474986c26-0068c570a7" "proxy-server 1824535" 0.0024 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txd85d15ed780247adbba78-0068c570a7 - 0.0679 VW - 1757769895.075398684 1757769895.143269539 0 - (txn: txd3e143547a3345e08f753-0068c570a7) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 201 - "PUT http://localhost/sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" "txd3e143547a3345e08f753-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 201 - "PUT http://localhost/sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" "txd3e143547a3345e08f753-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" "txd3e143547a3345e08f753-0068c570a7" "proxy-server 1824535" 0.0360 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" "txd3e143547a3345e08f753-0068c570a7" "proxy-server 1824535" 0.0457 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 PUT /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769894.95855 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 txd3e143547a3345e08f753-0068c570a7 - 0.0748 VW - 1757769895.094052076 1757769895.168840408 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx16823f0654a648de869d6-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx16823f0654a648de869d6-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx16823f0654a648de869d6-0068c570a7" "proxy-server 1824535" 0.0154 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx16823f0654a648de869d6-0068c570a7" "proxy-server 1824535" 0.0170 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx16823f0654a648de869d6-0068c570a7 - 0.0288 - - 1757769895.169279337 1757769895.198078632 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx157b3fec3a2249868c3c8-0068c570a7" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx6dff001153ab4b8f98383-0068c570a7" "proxy-server 1824535" 0.0139 "-" 1824535 0test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_errors_works test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_errors_works ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "tx6d20c6216eaf43cd9df6a-0068c570a6" "container-server 1824498" 0.0073 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx6d20c6216eaf43cd9df6a-0068c570a6" "proxy-server 1824498" 0.0263 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "tx6d20c6216eaf43cd9df6a-0068c570a6" "container-server 1824498" 0.0010 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "tx6d20c6216eaf43cd9df6a-0068c570a6" "proxy-server 1824498" 0.0265 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - tx6d20c6216eaf43cd9df6a-0068c570a6 - 0.0425 - - 1757769894.975739241 1757769895.018275023 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txba424d40137348b183a63-0068c570a7" "proxy-server 1824498" 0.0051 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "txfc8b17a35f51479888e2f-0068c570a7" "proxy-server 1824498" 0.0012 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdl1/0/a/ec-dup/o2" 201 - "PUT http://localhost/v1/a/ec-dup/o2" "tx0e1b9bde7d5649cfa7c38-0068c570a7" "proxy-server 1824498" 0.0399 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdh1/0/a/ec-dup/o2" 201 - "PUT http://localhost/v1/a/ec-dup/o2" "tx0e1b9bde7d5649cfa7c38-0068c570a7" "proxy-server 1824498" 0.0405 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdg1/0/a/ec-dup/o2" 201 - "PUT http://localhost/v1/a/ec-dup/o2" "tx0e1b9bde7d5649cfa7c38-0068c570a7" "proxy-server 1824498" 0.0413 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdk1/0/a/ec-dup/o2" 201 - "PUT http://localhost/v1/a/ec-dup/o2" "tx0e1b9bde7d5649cfa7c38-0068c570a7" "proxy-server 1824498" 0.0425 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/2/a/ec-dup/o2" 201 - "PUT http://localhost/sdi1/0/a/ec-dup/o2" "tx0e1b9bde7d5649cfa7c38-0068c570a7" "object-server 1824498" 0.0004 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/2/a/ec-dup/o2" 201 - "PUT http://localhost/sdj1/0/a/ec-dup/o2" "tx0e1b9bde7d5649cfa7c38-0068c570a7" "object-server 1824498" 0.0004 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdi1/0/a/ec-dup/o2" 201 - "PUT http://localhost/v1/a/ec-dup/o2" "tx0e1b9bde7d5649cfa7c38-0068c570a7" "proxy-server 1824498" 0.0621 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdj1/0/a/ec-dup/o2" 201 - "PUT http://localhost/v1/a/ec-dup/o2" "tx0e1b9bde7d5649cfa7c38-0068c570a7" "proxy-server 1824498" 0.0537 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 PUT /v1/a/ec-dup/o2 HTTP/1.0 201 - - t 12288 - - tx0e1b9bde7d5649cfa7c38-0068c570a7 - 0.0948 - - 1757769895.035678625 1757769895.130485773 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdaf2a4461d594a7fa83f5-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:54711/sdb1/2/a/ec-dup" "txdaf2a4461d594a7fa83f5-0068c570a7" "container-server 1824498" 0.0009 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "txdaf2a4461d594a7fa83f5-0068c570a7" "proxy-server 1824498" 0.0107 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/ec-dup" 201 - "PUT http://127.0.0.1:33753/sda1/2/a/ec-dup" "txdaf2a4461d594a7fa83f5-0068c570a7" "container-server 1824498" 0.0058 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/2/a/ec-dup" 202 - "PUT http://localhost/v1/a/ec-dup" "txdaf2a4461d594a7fa83f5-0068c570a7" "proxy-server 1824498" 0.0232 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 PUT /v1/a/ec-dup HTTP/1.0 202 - - t - 76 - txdaf2a4461d594a7fa83f5-0068c570a7 - 0.0403 - - 1757769895.145534039 1757769895.185796499 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd831680302954882b7d64-0068c570a7" "proxy-server 1824498" 0.0060 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/2/a/ec-dup" 204 - "HEAD http://localhost/v1/a/ec-dup" "tx9f560b57c7bf427bb2894-0068c570a7" "proxy-server 1824498" 0.0053 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 PUT /v1/a/ec-dup/o3 HTTP/1.0 422 - - t 50 93 6c7ba9c5a141421e1c03cb9807c97c74 tx445aa47d993341b997341-0068c570a7 - 0.0416 - - 1757769895.191358089 1757769895.233007431 4 - obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdi1/2/a/ec-dup/o3" 499 89 "PUT http://localhost/v1/a/ec-dup/o3" "tx445aa47d993341b997341-0068c570a7" "proxy-server 1824498" 0.0081 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdk1/2/a/ec-dup/o3" 499 89 "PUT http://localhost/v1/a/ec-dup/o3" "tx445aa47d993341b997341-0068c570a7" "proxy-server 1824498" 0.0113 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdl1/2/a/ec-dup/o3" 499 89 "PUT http://localhost/v1/a/ec-dup/o3" "tx445aa47d993341b997341-0068c570a7" "proxy-server 1824498" 0.0121 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdh1/2/a/ec-dup/o3" 499 89 "PUT http://localhost/v1/a/ec-dup/o3" "tx445aa47d993341b997341-0068c570a7" "proxy-server 1824498" 0.0298 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdg1/2/a/ec-dup/o3" 499 89 "PUT http://localhost/v1/a/ec-dup/o3" "tx445aa47d993341b997341-0068c570a7" "proxy-server 1824498" 0.0323 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdj1/2/a/ec-dup/o3" 499 89 "PUT http://localhost/v1/a/ec-dup/o3" "tx445aa47d993341b997341-0068c570a7" "proxy-server 1824498" 0.0346 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7878709662c74156b03b6-0068c570a7" "proxy-server 1824498" 0.0065 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/60e6ee45f2de4e49bd8891a89b893c95" 201 - "PUT http://127.0.0.1:54711/sdb1/3/a/60e6ee45f2de4e49bd8891a89b893c95" "tx7878709662c74156b03b6-0068c570a7" "container-server 1824498" 0.0016 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/60e6ee45f2de4e49bd8891a89b893c95" 201 - "PUT http://127.0.0.1:33753/sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" "tx7878709662c74156b03b6-0068c570a7" "container-server 1824498" 0.0009 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 201 - "PUT http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx7878709662c74156b03b6-0068c570a7" "proxy-server 1824498" 0.0190 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 201 - "PUT http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx7878709662c74156b03b6-0068c570a7" "proxy-server 1824498" 0.0324 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 PUT /v1/a/60e6ee45f2de4e49bd8891a89b893c95 HTTP/1.0 201 - - t - - - tx7878709662c74156b03b6-0068c570a7 - 0.0496 - - 1757769895.259952784 1757769895.309522629 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx315a83b83a86468f9ceb9-0068c570a7" "proxy-server 1824498" 0.0045 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx8e8a1a5f404b4f6e9993b-0068c570a7" "proxy-server 1824498" 0.0022 "-" 1824498 4 object-reconstructor INFO: Nothing reconstructed for 8.344650268554688e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 5.245208740234375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.3:1003/sdd/0/a/c/oè policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'None') object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 1.0013580322265625e-05 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.6:1006/sdg/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 7, 8, 9, 10, 11] object-reconstructor ERROR: Trying to GET 10.0.0.6:1006/sdg/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 5, 7, 8, 9, 10, 11, 12] object-reconstructor ERROR: Trying to GET 10.0.0.1:1001/sdb/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.6:1006/sdg/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 2, 5, 7, 8, 9, 10, 11, 12, 13] object-reconstructor INFO: Nothing reconstructed for 1.1205673217773438e-05 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.0:1000/sda/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.2:1002/sdc/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.3:1003/sdd/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.4:1004/sde/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.5:1005/sdf/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.6:1006/sdg/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.7:1007/sdh/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.8:1008/sdi/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.10:1010/sdk/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor ERROR: Trying to GET 10.0.0.11:1011/sdl/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.12:1012/sdm/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.13:1013/sdn/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom!test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_exceptions_fails test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_exceptions_fails ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_finds_duplicate_does_not_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_finds_duplicate_does_not_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_finds_missing_frag_does_not_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_finds_missing_frag_does_not_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_frags_on_handoffs test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_frags_on_handoffs ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_invalid_frag_index_headers test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_invalid_frag_index_headers ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_missing_headers test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_missing_headers ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_mixed_meta_timestamps_works test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_mixed_meta_timestamps_works ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_mixture_of_errors_fails test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_mixture_of_errors_fails ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_errors test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_errors ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_frag_not_old_enough test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_frag_not_old_enough ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_frag_resp_different_timestamp test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_frag_resp_different_timestamp ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdg1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 201 - "PUT http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txf1bcec62f7114232bf74a-0068c570a7" "proxy-server 1824498" 0.0577 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdj1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 201 - "PUT http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txf1bcec62f7114232bf74a-0068c570a7" "proxy-server 1824498" 0.0603 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdl1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 201 - "PUT http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txf1bcec62f7114232bf74a-0068c570a7" "proxy-server 1824498" 0.0453 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 201 - "PUT http://localhost/sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txf1bcec62f7114232bf74a-0068c570a7" "object-server 1824498" 0.0004 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 201 - "PUT http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txf1bcec62f7114232bf74a-0068c570a7" "proxy-server 1824498" 0.0671 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdk1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 201 - "PUT http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txf1bcec62f7114232bf74a-0068c570a7" "proxy-server 1824498" 0.0598 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/3/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 201 - "PUT http://localhost/sdi1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txf1bcec62f7114232bf74a-0068c570a7" "object-server 1824498" 0.0004 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdi1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 201 - "PUT http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txf1bcec62f7114232bf74a-0068c570a7" "proxy-server 1824498" 0.0764 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 PUT /v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals HTTP/1.0 201 - - t 52 - - txf1bcec62f7114232bf74a-0068c570a7 - 0.1155 - - 1757769895.315763950 1757769895.431274176 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx037fba66e87e4dcdadbc1-0068c570a7" "proxy-server 1824498" 0.0059 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx51a6842fcea04fb8b237d-0068c570a7" "proxy-server 1824498" 0.0099 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdk1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 200 106 "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc9bf63509a594c34aa562-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdi1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 200 106 "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc9bf63509a594c34aa562-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7d9571dd706b41c08ae08-0068c570a7" "proxy-server 1824498" 0.0055 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx91d552bd539342d3abb20-0068c570a7" "proxy-server 1824498" 0.0054 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdl1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx01032e7ab2bb4eb0bd0ff-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdj1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx01032e7ab2bb4eb0bd0ff-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 proxy DEBUG: Ignoring 412 from primary (txn: tx01032e7ab2bb4eb0bd0ff-0068c570a7) proxy DEBUG: Ignoring 412 from primary (txn: tx01032e7ab2bb4eb0bd0ff-0068c570a7) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdi1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx01032e7ab2bb4eb0bd0ff-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdk1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx01032e7ab2bb4eb0bd0ff-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 proxy DEBUG: Ignoring 412 from primary (txn: tx01032e7ab2bb4eb0bd0ff-0068c570a7) proxy DEBUG: Ignoring 412 from primary (txn: tx01032e7ab2bb4eb0bd0ff-0068c570a7) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdg1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx01032e7ab2bb4eb0bd0ff-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx01032e7ab2bb4eb0bd0ff-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 proxy DEBUG: Ignoring 412 from primary (txn: tx01032e7ab2bb4eb0bd0ff-0068c570a7) proxy DEBUG: Ignoring 412 from primary (txn: tx01032e7ab2bb4eb0bd0ff-0068c570a7) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6ca070f068d84b8a9d5fb-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx8f2c1890024a430ba1d27-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdg1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 200 106 "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc7b12f4b629f452da8665-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdl1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 200 106 "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc7b12f4b629f452da8665-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb7ba51232d664889aef41-0068c570a7" "proxy-server 1824498" 0.0055 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "txa34e207e2aba46e680d36-0068c570a7" "proxy-server 1824498" 0.0054 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx5be023da3c9b4eb08f231-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdg1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx5be023da3c9b4eb08f231-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdk1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx5be023da3c9b4eb08f231-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_frag_resp_mixed_etags test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_frag_resp_mixed_etags ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txf2500798620b4de6bc068-0068c570a7" "proxy-server 1824535" 0.0128 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - txf2500798620b4de6bc068-0068c570a7 - 0.0451 - - 1757769895.211704254 1757769895.256834030 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx92a7d47a3d6449089ba9f-0068c570a7" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/0/a/0_vc_non_ascii%C2%A3" 200 382 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?format=json&states=listing" "tx92a7d47a3d6449089ba9f-0068c570a7" "proxy-server 1824535" 0.0086 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 382 - tx92a7d47a3d6449089ba9f-0068c570a7 - 0.0364 - - 1757769895.258458376 1757769895.294844151 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx473e8f29131240c48fca2-0068c570a7" "proxy-server 1824535" 0.0094 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txd8bdc0f733c4413899cfb-0068c570a7" "proxy-server 1824535" 0.0014 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx80b4065586de40b3b4abd-0068c570a7" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx80b4065586de40b3b4abd-0068c570a7" "proxy-server 1824535" 0.0006 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx04df359a34e042b2845c0-0068c570a7" "proxy-server 1824535" 0.0095 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/55 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx04df359a34e042b2845c0-0068c570a7 - 0.0121 VW - 1757769895.344258785 1757769895.356359720 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txb4b76ad12723452ba1db6-0068c570a7" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txb4b76ad12723452ba1db6-0068c570a7 - 0.0121 VW - 1757769895.356902122 1757769895.368982792 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/copied_name" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/copied_name?symlink=get" "tx2cd3a3e1b1a042249c862-0068c570a7" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/copied_name" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/copied_name?symlink=get" "tx2cd3a3e1b1a042249c862-0068c570a7" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 GET /v1/a/0_oc_non_ascii%25C2%25A3/copied_name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx2cd3a3e1b1a042249c862-0068c570a7 - 0.0214 VW - 1757769895.369567394 1757769895.390968561 0 - proxy INFO: - - 13/Sep/2025/13/24/55 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 200 - Swift t - 5 - tx80b4065586de40b3b4abd-0068c570a7 - 0.1070 SSC - 1757769895.296930790 1757769895.403937578 0 - (txn: tx7fbbf734c6e94f56972fb-0068c570a7) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/copied_name" "tx7fbbf734c6e94f56972fb-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/copied_name" "tx7fbbf734c6e94f56972fb-0068c570a7" "proxy-server 1824535" 0.0187 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/copied_name" "tx7fbbf734c6e94f56972fb-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/copied_name" "tx7fbbf734c6e94f56972fb-0068c570a7" "proxy-server 1824535" 0.0316 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 COPY /v1/a/0_oc_non_ascii%25C2%25A3/copied_name HTTP/1.0 201 - - t 5 - db7282901da891bea2fcd73840caad1c tx7fbbf734c6e94f56972fb-0068c570a7 - 0.0350 SSC - 1757769895.391383410 1757769895.426344156 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4163f9c0b38243bc9d9a4-0068c570a7" "proxy-server 1824535" 0.0095 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx65b3f463a45644ecb7459-0068c570a7" "proxy-server 1824535" 0.0222 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/copied_name" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/copied_name" "txf6c9922544834bd08fc55-0068c570a7" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 GET /v1/a/0_oc_non_ascii%25C2%25A3/copied_name HTTP/1.0 200 - - t - 5 - txf6c9922544834bd08fc55-0068c570a7 - 0.0453 - - 1757769895.436134338 1757769895.481431246 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx58e02707e4d240aa8eeba-0068c570a7" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txc5e7832206934dcd8222e-0068c570a7" "proxy-server 1824535" 0.0014 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "POST http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx387926a8adbf4358b72f2-0068c570a7" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "POST http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx387926a8adbf4358b72f2-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "POST /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 202 76 "POST http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx387926a8adbf4358b72f2-0068c570a7" "proxy-server 1824535" 0.0160 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "POST /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 202 76 "POST http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx387926a8adbf4358b72f2-0068c570a7" "proxy-server 1824535" 0.0257 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 POST /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 202 - - t - 76 - tx387926a8adbf4358b72f2-0068c570a7 - 0.0540 - - 1757769895.491102934 1757769895.545102835 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx624f340eef29490e8f9d4-0068c570a7" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx059007ebb26642c185dfc-0068c570a7" "proxy-server 1824535" 0.0119 "-" 1824535 0test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_frag_resp_mixed_timestamps test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_frag_resp_mixed_timestamps ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_invalid_frag_index_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_invalid_frag_index_header ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_missing_etag_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_missing_etag_header ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdi1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx5be023da3c9b4eb08f231-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdj1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx5be023da3c9b4eb08f231-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdl1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx5be023da3c9b4eb08f231-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf1fd133d7cea447e80716-0068c570a7" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx4c640e812147431da52ee-0068c570a7" "proxy-server 1824498" 0.0173 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 200 106 "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx46bd10441bb248d897542-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdi1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 200 106 "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx46bd10441bb248d897542-0068c570a7" "proxy-server 1824498" 0.0008 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx98be6273fb5b40deaa71e-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx8c3eb18fbbb5495f91ca9-0068c570a7" "proxy-server 1824498" 0.0023 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdk1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc4493bcdeb02435ba6b7b-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc4493bcdeb02435ba6b7b-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdg1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc4493bcdeb02435ba6b7b-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdl1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc4493bcdeb02435ba6b7b-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdi1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc4493bcdeb02435ba6b7b-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdj1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "GET http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txc4493bcdeb02435ba6b7b-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx942a0f1fc0a341149befd-0068c570a7" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx015b124e939e4a13bad60-0068c570a7" "proxy-server 1824498" 0.0014 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 200 106 "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx2e5c6ee6360b44428389f-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx373c87df1059488986ccb-0068c570a7" "proxy-server 1824498" 0.0016 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx6c6b923c0bc548e094153-0068c570a7" "proxy-server 1824498" 0.0071 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdg1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx0e0133253c2c4f60a7041-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdj1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx0e0133253c2c4f60a7041-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdi1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx0e0133253c2c4f60a7041-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdk1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx0e0133253c2c4f60a7041-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdl1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx0e0133253c2c4f60a7041-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 412 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx0e0133253c2c4f60a7041-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4f1c2f6f8512446ea6d42-0068c570a7" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx2b35f2d3d8b3482b99746-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdi1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 200 106 "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx73ff4c243eeb420b88f53-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx509b9c25ce154c368564c-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "tx917886657e1147b9884b1-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdl1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txcb133d87909c4e97b1c80-0068c570a7" "proxy-server 1824498" 0.0008 "-" 1824498 4test.unit.proxy.test_server.TestECDuplicationObjectController.test_conditional_GET_ec test.unit.proxy.test_server.TestECDuplicationObjectController.test_conditional_GET_ec ... ok object-reconstructor ERROR: Unable to get enough responses (13 x unknown error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 6.198883056640625e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor DEBUG: Found existing frag #3 at 10.0.0.4:1004/sde/0/a/c/oè policy#0 while rebuilding to 10.0.0.3:1003/sdd/0/a/c/oè policy#0 object-reconstructor DEBUG: Reconstruct frag #3 with frag indexes [0, 1, 2, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor DEBUG: Reconstructing frag from handoffs, node_count=28 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 7.152557373046875e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/oè policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'None') object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/oè policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'invalid') object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 7.3909759521484375e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/oè policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: None) object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/oè policy#0, frag index 0 (missing Etag) object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor WARNING: Invalid resp from 10.0.0.0:1000/sda/0/a/c/oè policy#0, frag index 0 (missing X-Backend-Data-Timestamp and X-Backend-Timestamp) object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [2, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #4 with frag indexes [0, 1, 2, 3, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 8.344650268554688e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.0:1000/sda/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.5:1005/sdf/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor WARNING: Invalid response 507 from 10.0.0.3:1003/sdd/0/a/c/oè policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.4:1004/sde/0/a/c/oè policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.6:1006/sdg/0/a/c/oè policy#0 object-reconstructor WARNING: Invalid response 507 from 10.0.0.7:1007/sdh/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (3 x unknown, 6 x 404, 4 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 5.245208740234375e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor INFO: Nothing reconstructed for 1.0967254638671875e-05 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 5.7220458984375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor ERROR: Mixed Etag (unexpected_etag, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 7.152557373046875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 7.62939453125e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/oè policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: 'two') object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/oè policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 11 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/oè policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 6.9141387939453125e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/oè policy#0, frag index 3 (missing Etag) object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/oè policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 11 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/oè policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 7.3909759521484375e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/oè policy#0 (invalid X-Object-Sysmeta-Ec-Frag-Index: '') object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/oè policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_missing_frag_index_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_missing_frag_index_header ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_missing_timestamp_header test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_missing_timestamp_header ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txdf7137881aac46b59a38f-0068c570a7" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - txdf7137881aac46b59a38f-0068c570a7 - 0.0471 - - 1757769895.546498060 1757769895.593558788 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx358197386c3f4c3caf569-0068c570a7" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/3/a/0_oc_non_ascii%C2%A3" 200 326 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3?format=json&states=listing" "tx358197386c3f4c3caf569-0068c570a7" "proxy-server 1824535" 0.0114 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 GET /v1/a/0_oc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 326 - tx358197386c3f4c3caf569-0068c570a7 - 0.0267 - - 1757769895.603379250 1757769895.630049944 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx97a8374389d7419aa03e7-0068c570a7" "proxy-server 1824535" 0.0093 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/55 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx97a8374389d7419aa03e7-0068c570a7 - 0.0119 VW - 1757769895.636060476 1757769895.648009300 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx0e394037a04d4c1a96ffc-0068c570a7" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx0e394037a04d4c1a96ffc-0068c570a7 - 0.0121 VW - 1757769895.648520231 1757769895.660583735 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/0/a/0_vc_non_ascii%C2%A3" 200 382 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?prefix=00f0_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "txc921612f62354b06b78c2-0068c570a7" "proxy-server 1824535" 0.0021 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fprefix%3D00f0_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 382 - txc921612f62354b06b78c2-0068c570a7 - 0.0134 VW - 1757769895.661199570 1757769895.674606562 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 200 5 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855?symlink=get" "tx4ce61ce4be3c4383ad824-0068c570a7" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 200 5 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855?symlink=get" "tx4ce61ce4be3c4383ad824-0068c570a7" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 GET /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769894.95855%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx4ce61ce4be3c4383ad824-0068c570a7 - 0.0359 VW - 1757769895.683338642 1757769895.719237804 0 - (txn: tx905645e64ba04837a58a6-0068c570a7) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx905645e64ba04837a58a6-0068c570a7" "object-server 1824535" 0.0085 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx905645e64ba04837a58a6-0068c570a7" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx905645e64ba04837a58a6-0068c570a7" "proxy-server 1824535" 0.0366 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx905645e64ba04837a58a6-0068c570a7" "proxy-server 1824535" 0.0360 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 tx905645e64ba04837a58a6-0068c570a7 - 0.0572 VW - 1757769895.697916746 1757769895.755111933 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "DELETE /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 204 - "DELETE http://localhost/sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" "txff033863f9fe4f8483a35-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "DELETE /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 204 - "DELETE http://localhost/sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" "txff033863f9fe4f8483a35-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "DELETE /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 204 - "DELETE http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" "txff033863f9fe4f8483a35-0068c570a7" "proxy-server 1824535" 0.0146 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "DELETE /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" 204 - "DELETE http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.95855" "txff033863f9fe4f8483a35-0068c570a7" "proxy-server 1824535" 0.0059 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 DELETE /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769894.95855 HTTP/1.0 204 - Swift - - - - txff033863f9fe4f8483a35-0068c570a7 - 0.0186 VW - 1757769895.755680561 1757769895.774256468 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx20e13d0a8de240c8bab81-0068c570a7" "proxy-server 1824535" 0.0136 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx9f7233028c9e4dc6a07c2-0068c570a7" "proxy-server 1824535" 0.0185 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx5f07910a7bcb40f68b899-0068c570a7" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx5f07910a7bcb40f68b899-0068c570a7 - 0.0458 - - 1757769895.788010359 1757769895.833857536 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx63f0dce04d7e4d3581a84-0068c570a7" "proxy-server 1824535" 0.0054 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sda1/0/a/0_vc_non_ascii%C2%A3" 200 191 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?prefix=00f0_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx63f0dce04d7e4d3581a84-0068c570a7" "proxy-server 1824535" 0.0077 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fprefix%3D00f0_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 191 - tx63f0dce04d7e4d3581a84-0068c570a7 - 0.0233 - - 1757769895.839690924 1757769895.863036156 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx17b3992435d14d05a83ca-0068c570a7" "proxy-server 1824535" 0.0055 "-" 1824535 - object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 11 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/oè policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 7.867813110351562e-06 seconds. object-reconstructor WARNING: Invalid resp from 10.0.0.2:1002/sdc/0/a/c/oè policy#0, frag index 3 (missing X-Backend-Data-Timestamp and X-Backend-Timestamp) object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/oè policy#0 frag#0 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (1 x unknown, 11 x 404 error responses) to reconstruct non-durable 10.0.0.0:1000/sda/0/a/c/oè policy#0 frag#0 object-reconstructor INFO: Nothing reconstructed for 7.152557373046875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (3/10 from 3 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (10 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (9 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (3/10 from 3 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (10 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (9 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (3/10 from 3 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (10 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1test.unit.proxy.test_server.TestECDuplicationObjectController.test_ec_client_disconnect test.unit.proxy.test_server.TestECDuplicationObjectController.test_ec_client_disconnect ... ok proxy INFO: - - 13/Sep/2025/13/24/55 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx17b3992435d14d05a83ca-0068c570a7 - 0.0084 VW - 1757769895.864953279 1757769895.873383999 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx131987fe139247cfa81d2-0068c570a7" "proxy-server 1824535" 0.0077 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx131987fe139247cfa81d2-0068c570a7 - 0.0185 VW - 1757769895.873925447 1757769895.892444372 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/0/a/0_vc_non_ascii%C2%A3" 200 191 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?prefix=00f0_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "txdcb5faf325ad4fecb5dbc-0068c570a7" "proxy-server 1824535" 0.0035 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fprefix%3D00f0_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 191 - txdcb5faf325ad4fecb5dbc-0068c570a7 - 0.0189 VW - 1757769895.893071651 1757769895.912008047 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdb1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 200 5 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949?symlink=get" "txc5af620f0688445eb68da-0068c570a7" "proxy-server 1824535" 0.0087 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sda1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 200 5 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949?symlink=get" "txc5af620f0688445eb68da-0068c570a7" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 GET /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769894.80949%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txc5af620f0688445eb68da-0068c570a7 - 0.0320 VW - 1757769895.912566900 1757769895.944554567 0 - (txn: tx9f2fb97f8e7b4eb0a99be-0068c570a7) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx9f2fb97f8e7b4eb0a99be-0068c570a7" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx9f2fb97f8e7b4eb0a99be-0068c570a7" "proxy-server 1824535" 0.0159 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx9f2fb97f8e7b4eb0a99be-0068c570a7" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx9f2fb97f8e7b4eb0a99be-0068c570a7" "proxy-server 1824535" 0.0146 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx9f2fb97f8e7b4eb0a99be-0068c570a7 - 0.0275 VW - 1757769895.935743570 1757769895.963257790 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "DELETE /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 204 - "DELETE http://localhost/sdb1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" "tx0bb3791a440b413694257-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "DELETE /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 204 - "DELETE http://localhost/sda1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" "tx0bb3791a440b413694257-0068c570a7" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "DELETE /sda1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 204 - "DELETE http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" "tx0bb3791a440b413694257-0068c570a7" "proxy-server 1824535" 0.0290 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "DELETE /sdb1/1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" 204 - "DELETE http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769894.80949" "tx0bb3791a440b413694257-0068c570a7" "proxy-server 1824535" 0.0240 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/55 DELETE /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769894.80949 HTTP/1.0 204 - Swift - - - - tx0bb3791a440b413694257-0068c570a7 - 0.0331 VW - 1757769895.963844538 1757769895.996987820 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx87f48f6c2dcc4d569814e-0068c570a8" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx9f49e426a94346adb3d0d-0068c570a8" "proxy-server 1824535" 0.0070 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx88938855f3f64c3eb288d-0068c570a8" "proxy-server 1824535" 0.0048 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx88938855f3f64c3eb288d-0068c570a8 - 0.0343 - - 1757769895.998529196 1757769896.032847881 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa796eab48fd4454fbaea4-0068c570a8" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/0/a/0_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?prefix=00f0_o_non_ascii%C2%A3%2F&format=json&states=listing" "txa796eab48fd4454fbaea4-0068c570a8" "proxy-server 1824535" 0.0036 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fprefix%3D00f0_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - txa796eab48fd4454fbaea4-0068c570a8 - 0.0196 - - 1757769896.034502745 1757769896.054079771 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx35b6b1323b434b38a4df9-0068c570a8" "proxy-server 1824535" 0.0055 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/0/a/0_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?prefix=00f0_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx35b6b1323b434b38a4df9-0068c570a8" "proxy-server 1824535" 0.0077 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fprefix%3D00f0_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx35b6b1323b434b38a4df9-0068c570a8 - 0.0236 - - 1757769896.060148001 1757769896.083705902 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txad90f99f2a324ae49b832-0068c570a8" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txad90f99f2a324ae49b832-0068c570a8 - 0.0081 VW - 1757769896.085602760 1757769896.093704700 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx1883c9b4f2c94710923ba-0068c570a8" "proxy-server 1824535" 0.0027 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx1883c9b4f2c94710923ba-0068c570a8 - 0.0137 VW - 1757769896.094228983 1757769896.107894182 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx16edae2bc128495289c52-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "txb2110c15167d4f0894330-0068c570a7" "proxy-server 1824498" 0.0012 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 200 106 "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "tx79762c275d3d4ad994ac8-0068c570a7" "proxy-server 1824498" 0.0006 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx211885593eee468c9e707-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/3/a/60e6ee45f2de4e49bd8891a89b893c95" 204 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95" "txf311c81bf5184168a0a3d-0068c570a7" "proxy-server 1824498" 0.0017 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdh1/0/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" 304 - "HEAD http://localhost/v1/a/60e6ee45f2de4e49bd8891a89b893c95/conditionals" "txb27909457ed14e19a9860-0068c570a7" "proxy-server 1824498" 0.0008 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx572eebc3749947b49a538-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/ec-dup-discon" 201 - "PUT http://127.0.0.1:33753/sda1/0/a/ec-dup-discon" "tx572eebc3749947b49a538-0068c570a7" "container-server 1824498" 0.0010 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/ec-dup-discon" 201 - "PUT http://127.0.0.1:54711/sdb1/0/a/ec-dup-discon" "tx572eebc3749947b49a538-0068c570a7" "container-server 1824498" 0.0107 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/ec-dup-discon" 201 - "PUT http://localhost/v1/a/ec-dup-discon" "tx572eebc3749947b49a538-0068c570a7" "proxy-server 1824498" 0.0209 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/ec-dup-discon" 201 - "PUT http://localhost/v1/a/ec-dup-discon" "tx572eebc3749947b49a538-0068c570a7" "proxy-server 1824498" 0.0259 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 PUT /v1/a/ec-dup-discon HTTP/1.0 201 - - t - - - tx572eebc3749947b49a538-0068c570a7 - 0.0437 - - 1757769895.801416874 1757769895.845098734 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx88058590c20b431aba9cd-0068c570a7" "proxy-server 1824498" 0.0021 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a/ec-dup-discon" 204 - "HEAD http://localhost/v1/a/ec-dup-discon" "tx1e2487aaac4f496d8153b-0068c570a7" "proxy-server 1824498" 0.0012 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdl1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx6c3cd1a1d44d4eb1ab76d-0068c570a7" "proxy-server 1824498" 0.0539 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdh1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx6c3cd1a1d44d4eb1ab76d-0068c570a7" "proxy-server 1824498" 0.0529 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdi1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx6c3cd1a1d44d4eb1ab76d-0068c570a7" "proxy-server 1824498" 0.0570 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdk1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx6c3cd1a1d44d4eb1ab76d-0068c570a7" "proxy-server 1824498" 0.0565 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdb1/0/a/ec-dup-discon/test" 201 - "PUT http://localhost/sdg1/3/a/ec-dup-discon/test" "tx6c3cd1a1d44d4eb1ab76d-0068c570a7" "object-server 1824498" 0.0005 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdg1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx6c3cd1a1d44d4eb1ab76d-0068c570a7" "proxy-server 1824498" 0.0737 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sda1/0/a/ec-dup-discon/test" 201 - "PUT http://localhost/sdj1/3/a/ec-dup-discon/test" "tx6c3cd1a1d44d4eb1ab76d-0068c570a7" "object-server 1824498" 0.0005 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "PUT /sdj1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx6c3cd1a1d44d4eb1ab76d-0068c570a7" "proxy-server 1824498" 0.0819 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 PUT /v1/a/ec-dup-discon/test HTTP/1.0 201 - - t 262144 - - tx6c3cd1a1d44d4eb1ab76d-0068c570a7 - 0.0994 - - 1757769895.846055746 1757769895.945423365 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx04ebe445623a49dcb2528-0068c570a7" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "HEAD /sdb1/0/a/ec-dup-discon" 204 - "HEAD http://localhost/v1/a/ec-dup-discon" "txe1b7416fc267403bb8ee9-0068c570a7" "proxy-server 1824498" 0.0076 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdk1/3/a/ec-dup-discon/test" 200 136192 "GET http://localhost/v1/a/ec-dup-discon/test" "tx14c98e4f638e497dac12d-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:55 +0000] "GET /sdi1/3/a/ec-dup-discon/test" 200 136192 "GET http://localhost/v1/a/ec-dup-discon/test" "tx14c98e4f638e497dac12d-0068c570a7" "proxy-server 1824498" 0.0007 "-" 1824498 4 proxy WARNING: Client disconnected on read of EC frag '/a/ec-dup-discon/test' (txn: tx14c98e4f638e497dac12d-0068c570a7) (client_ip: 127.0.0.1) proxy WARNING: Client disconnected on read of EC frag '/a/ec-dup-discon/test' (txn: tx14c98e4f638e497dac12d-0068c570a7) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/55 GET /v1/a/ec-dup-discon/test HTTP/1.0 499 - - t - 12288 - tx14c98e4f638e497dac12d-0068c570a7 - 0.0527 - - 1757769895.946333647 1757769895.999066830 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcfe88050181a4d979f261-0068c570a8" "proxy-server 1824498" 0.0013 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/ec-dup-discon" 201 - "PUT http://127.0.0.1:54711/sdb1/0/a/ec-dup-discon" "txcfe88050181a4d979f261-0068c570a8" "container-server 1824498" 0.0015 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/ec-dup-discon" 202 - "PUT http://localhost/v1/a/ec-dup-discon" "txcfe88050181a4d979f261-0068c570a8" "proxy-server 1824498" 0.0105 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/ec-dup-discon" 201 - "PUT http://127.0.0.1:33753/sda1/0/a/ec-dup-discon" "txcfe88050181a4d979f261-0068c570a8" "container-server 1824498" 0.0010 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/ec-dup-discon" 202 - "PUT http://localhost/v1/a/ec-dup-discon" "txcfe88050181a4d979f261-0068c570a8" "proxy-server 1824498" 0.0249 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/ec-dup-discon HTTP/1.0 202 - - t - 76 - txcfe88050181a4d979f261-0068c570a8 - 0.0402 - - 1757769896.094182730 1757769896.134360075 4 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1b9d87051ce74e7bb7f9b-0068c570a8" "proxy-server 1824498" 0.0101 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a/ec-dup-discon" 204 - "HEAD http://localhost/v1/a/ec-dup-discon" "txd5ffbd7b3d11493e810c5-0068c570a8" "proxy-server 1824498" 0.0054 "-" 1824498 4 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (9 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (9 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (8 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (6/10 from 6 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (7 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (7/10 from 7 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_more_than_threshold_frags test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_more_than_threshold_frags ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/0/a/0_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?prefix=00f0_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "txa6d6d780031548c5a2500-0068c570a8" "proxy-server 1824535" 0.0103 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fprefix%3D00f0_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 2 - txa6d6d780031548c5a2500-0068c570a8 - 0.0136 VW - 1757769896.108534336 1757769896.122130394 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "DELETE /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txa19d7c12af89406c99912-0068c570a8" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "DELETE /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txa19d7c12af89406c99912-0068c570a8" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "DELETE /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txa19d7c12af89406c99912-0068c570a8" "proxy-server 1824535" 0.0166 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "DELETE /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txa19d7c12af89406c99912-0068c570a8" "proxy-server 1824535" 0.0223 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 DELETE /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 204 - - t - - - txa19d7c12af89406c99912-0068c570a8 - 0.0341 - - 1757769896.122568369 1757769896.156675577 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe1eeafc9595140e3a93ce-0068c570a8" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txe78540e9f5e5414aa6b30-0068c570a8" "proxy-server 1824535" 0.0110 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx2728dd4abba748ba89db3-0068c570a8" "proxy-server 1824535" 0.0046 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx2728dd4abba748ba89db3-0068c570a8" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 404 - - t - 70 - tx2728dd4abba748ba89db3-0068c570a8 - 0.0402 - - 1757769896.158300161 1757769896.198529243 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7cb4416ea1d641d9bff21-0068c570a8" "proxy-server 1824535" 0.0054 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx7cb4416ea1d641d9bff21-0068c570a8 - 0.0081 VW - 1757769896.212870598 1757769896.220962286 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx9c48b24fb08640c0a1313-0068c570a8" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx9c48b24fb08640c0a1313-0068c570a8 - 0.0081 VW - 1757769896.221490622 1757769896.229604959 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "txa25360031a754cd394b80-0068c570a8" "proxy-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "txa25360031a754cd394b80-0068c570a8" "proxy-server 1824535" 0.0086 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txa25360031a754cd394b80-0068c570a8 - 0.0182 VW - 1757769896.230173588 1757769896.248345137 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx1bba86a873eb4445823cf-0068c570a8" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx1bba86a873eb4445823cf-0068c570a8" "proxy-server 1824535" 0.0171 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx1bba86a873eb4445823cf-0068c570a8" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx1bba86a873eb4445823cf-0068c570a8" "proxy-server 1824535" 0.0195 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx1bba86a873eb4445823cf-0068c570a8 - 0.0363 - - 1757769896.248755455 1757769896.285013914 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1776e9c3a80b4a79a585e-0068c570a8" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx1776e9c3a80b4a79a585e-0068c570a8 - 0.0101 VW - 1757769896.296978712 1757769896.307034731 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx2f5accb329054b90a771d-0068c570a8" "proxy-server 1824535" 0.0065 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx2f5accb329054b90a771d-0068c570a8 - 0.0092 VW - 1757769896.307615042 1757769896.316819191 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "tx6ee7e799f7344b45b3803-0068c570a8" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "tx6ee7e799f7344b45b3803-0068c570a8" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx6ee7e799f7344b45b3803-0068c570a8 - 0.0127 VW - 1757769896.317418814 1757769896.330155373 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a/0_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_vc_non_ascii%C2%A3" "tx70171dc46dbd4be48a13e-0068c570a8" "proxy-server 1824535" 0.0014 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.24929" 201 - "PUT http://localhost/sdb1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.24929" "tx2f66b748673a4cb7a3ed5-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 proxy WARNING: Client disconnected without sending enough data (txn: tx274667e06723471e9032e-0068c570a8) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/ec-dup-discon/test HTTP/1.0 499 - - t 262134 89 - tx274667e06723471e9032e-0068c570a8 - 0.0827 - - 1757769896.139763594 1757769896.222501040 4 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdg1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx274667e06723471e9032e-0068c570a8" "proxy-server 1824498" 0.0399 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdh1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx274667e06723471e9032e-0068c570a8" "proxy-server 1824498" 0.0323 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdl1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx274667e06723471e9032e-0068c570a8" "proxy-server 1824498" 0.0491 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdi1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx274667e06723471e9032e-0068c570a8" "proxy-server 1824498" 0.0394 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdj1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx274667e06723471e9032e-0068c570a8" "proxy-server 1824498" 0.0420 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdk1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx274667e06723471e9032e-0068c570a8" "proxy-server 1824498" 0.0594 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2c5617fb557b4992b38f3-0068c570a8" "proxy-server 1824498" 0.0015 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a/ec-dup-discon" 204 - "HEAD http://localhost/v1/a/ec-dup-discon" "tx813194df231f4418a582a-0068c570a8" "proxy-server 1824498" 0.0014 "-" 1824498 4 proxy WARNING: Client disconnected without sending last chunk (txn: tx900a44bd0945407eb2f19-0068c570a8) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/ec-dup-discon/test HTTP/1.0 499 - - t 65536 89 - tx900a44bd0945407eb2f19-0068c570a8 - 0.0583 - - 1757769896.253427982 1757769896.311754227 4 - obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdj1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx900a44bd0945407eb2f19-0068c570a8" "proxy-server 1824498" 0.0085 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdi1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx900a44bd0945407eb2f19-0068c570a8" "proxy-server 1824498" 0.0101 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdk1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx900a44bd0945407eb2f19-0068c570a8" "proxy-server 1824498" 0.0214 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdh1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx900a44bd0945407eb2f19-0068c570a8" "proxy-server 1824498" 0.0210 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdg1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx900a44bd0945407eb2f19-0068c570a8" "proxy-server 1824498" 0.0276 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdl1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx900a44bd0945407eb2f19-0068c570a8" "proxy-server 1824498" 0.0257 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx09f7896608364e5d9d537-0068c570a8" "proxy-server 1824498" 0.0020 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a/ec-dup-discon" 204 - "HEAD http://localhost/v1/a/ec-dup-discon" "tx3b5e8507ef354c8086f4e-0068c570a8" "proxy-server 1824498" 0.0054 "-" 1824498 4 proxy WARNING: Client disconnected without sending last chunk (txn: txae4c30801bb24ccfbddd3-0068c570a8) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/ec-dup-discon/test HTTP/1.0 499 - - t - 89 - txae4c30801bb24ccfbddd3-0068c570a8 - 0.0415 - - 1757769896.354974270 1757769896.396520376 4 - obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdk1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "txae4c30801bb24ccfbddd3-0068c570a8" "proxy-server 1824498" 0.0088 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdg1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "txae4c30801bb24ccfbddd3-0068c570a8" "proxy-server 1824498" 0.0171 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdi1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "txae4c30801bb24ccfbddd3-0068c570a8" "proxy-server 1824498" 0.0159 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdj1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "txae4c30801bb24ccfbddd3-0068c570a8" "proxy-server 1824498" 0.0155 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdh1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "txae4c30801bb24ccfbddd3-0068c570a8" "proxy-server 1824498" 0.0221 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdl1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "txae4c30801bb24ccfbddd3-0068c570a8" "proxy-server 1824498" 0.0150 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx23fa9c29cb8c4e97bc7d0-0068c570a8" "proxy-server 1824498" 0.0012 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a/ec-dup-discon" 204 - "HEAD http://localhost/v1/a/ec-dup-discon" "tx8714efdf758b4b1f83bb7-0068c570a8" "proxy-server 1824498" 0.0012 "-" 1824498 4 proxy WARNING: Client disconnected without sending last chunk (txn: tx1ebd357f81244c5cbe841-0068c570a8) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/ec-dup-discon/test HTTP/1.0 499 - - t - 89 - tx1ebd357f81244c5cbe841-0068c570a8 - 0.0556 - - 1757769896.455580235 1757769896.511185884 4 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdg1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx1ebd357f81244c5cbe841-0068c570a8" "proxy-server 1824498" 0.0155 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdk1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx1ebd357f81244c5cbe841-0068c570a8" "proxy-server 1824498" 0.0143 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdi1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx1ebd357f81244c5cbe841-0068c570a8" "proxy-server 1824498" 0.0175 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdl1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx1ebd357f81244c5cbe841-0068c570a8" "proxy-server 1824498" 0.0162 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdh1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx1ebd357f81244c5cbe841-0068c570a8" "proxy-server 1824498" 0.0108 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdj1/3/a/ec-dup-discon/test" 499 89 "PUT http://localhost/v1/a/ec-dup-discon/test" "tx1ebd357f81244c5cbe841-0068c570a8" "proxy-server 1824498" 0.0103 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3372e10a022b472b9487a-0068c570a8" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a/ec-dup-discon" 204 - "HEAD http://localhost/v1/a/ec-dup-discon" "tx343af71e5e5e45bb9dc12-0068c570a8" "proxy-server 1824498" 0.0014 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.24929" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.24929" "tx2f66b748673a4cb7a3ed5-0068c570a8" "proxy-server 1824535" 0.0130 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.24929" 201 - "PUT http://localhost/sda1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.24929" "tx2f66b748673a4cb7a3ed5-0068c570a8" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.24929" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.24929" "tx2f66b748673a4cb7a3ed5-0068c570a8" "proxy-server 1824535" 0.0246 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 PUT /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769896.24929 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx2f66b748673a4cb7a3ed5-0068c570a8 - 0.0489 VW - 1757769896.338935375 1757769896.387855768 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx03f81911dd034a3dbfc94-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx03f81911dd034a3dbfc94-0068c570a8" "proxy-server 1824535" 0.0138 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx03f81911dd034a3dbfc94-0068c570a8" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx03f81911dd034a3dbfc94-0068c570a8" "proxy-server 1824535" 0.0252 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx03f81911dd034a3dbfc94-0068c570a8 - 0.0368 - - 1757769896.388312578 1757769896.425074339 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx49052aa0559a421eaaead-0068c570a8" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx49052aa0559a421eaaead-0068c570a8 - 0.0082 VW - 1757769896.439749718 1757769896.447985411 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txeb3b95212c2b4311a7255-0068c570a8" "proxy-server 1824535" 0.0136 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txeb3b95212c2b4311a7255-0068c570a8 - 0.0162 VW - 1757769896.448513269 1757769896.464762688 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "tx3b9564d3ef714febac927-0068c570a8" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "tx3b9564d3ef714febac927-0068c570a8" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx3b9564d3ef714febac927-0068c570a8 - 0.0146 VW - 1757769896.465346813 1757769896.479937792 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a/0_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_vc_non_ascii%C2%A3" "txe1c2e386ea2e405a8e3ff-0068c570a8" "proxy-server 1824535" 0.0104 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.38887" 201 - "PUT http://localhost/sda1/3/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.38887" "tx92d644adc1fe4e8f8b82c-0068c570a8" "object-server 1824535" 0.0056 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/3/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.38887" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.38887" "tx92d644adc1fe4e8f8b82c-0068c570a8" "proxy-server 1824535" 0.0199 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.38887" 201 - "PUT http://localhost/sdb1/3/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.38887" "tx92d644adc1fe4e8f8b82c-0068c570a8" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/3/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.38887" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.38887" "tx92d644adc1fe4e8f8b82c-0068c570a8" "proxy-server 1824535" 0.0263 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 PUT /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769896.38887 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx92d644adc1fe4e8f8b82c-0068c570a8 - 0.0439 VW - 1757769896.480560303 1757769896.524452448 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txe7238ddf79b74142bd336-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txe7238ddf79b74142bd336-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txe7238ddf79b74142bd336-0068c570a8" "proxy-server 1824535" 0.0300 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "txe7238ddf79b74142bd336-0068c570a8" "proxy-server 1824535" 0.0295 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - txe7238ddf79b74142bd336-0068c570a8 - 0.0490 - - 1757769896.524923801 1757769896.573960781 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd1171f541f2249929966f-0068c570a8" "proxy-server 1824535" 0.0057 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/0/a/0_vc_non_ascii%C2%A3" 200 382 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?prefix=00f0_o_non_ascii%C2%A3%2F&format=json&states=listing" "txd1171f541f2249929966f-0068c570a8" "proxy-server 1824535" 0.0100 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fprefix%3D00f0_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 382 - txd1171f541f2249929966f-0068c570a8 - 0.0222 - - 1757769896.575834990 1757769896.598083735 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx47ea98bfbb164a9faa732-0068c570a8" "proxy-server 1824535" 0.0057 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx47ea98bfbb164a9faa732-0068c570a8 - 0.0105 VW - 1757769896.604268074 1757769896.614796400 - -test.unit.proxy.test_server.TestECDuplicationObjectController.test_ec_client_put_disconnect test.unit.proxy.test_server.TestECDuplicationObjectController.test_ec_client_put_disconnect ... ok object-reconstructor ERROR: Unable to get enough responses (6 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (8/10 from 8 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (5 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (9/10 from 9 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (4 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor DEBUG: Found existing frag #3 at 10.0.0.1:1001/sdb/0/a/c/oè policy#0 while rebuilding to 10.0.0.3:1003/sdd/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 2 ok responses) to reconstruct non-durable 10.0.0.3:1003/sdd/0/a/c/oè policy#0 frag#3 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769895.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404 error responses) to reconstruct non-durable 10.0.0.3:1003/sdd/0/a/c/oè policy#0 frag#3 object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor WARNING: Invalid response 400 from 10.0.0.13:1013/sdn/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 11 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.27:1027/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.41:1041/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 39 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.181:1181/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 179 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.17:1017/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.17:1017/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 400 from 10.0.0.17:1017/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (1 x 400, 27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.13:1013/sdn/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.27:1027/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.41:1041/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (39 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.181:1181/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (179 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.17:1017/sda/0/a/c/oè policy#0test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_non_404_response test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_no_quarantine_non_404_response ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx33fb52f4730240c28ac45-0068c570a8" "proxy-server 1824535" 0.0073 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx33fb52f4730240c28ac45-0068c570a8 - 0.0102 VW - 1757769896.615475178 1757769896.625710249 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "txebb720adc65d4a0da6a4f-0068c570a8" "proxy-server 1824535" 0.0067 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "txebb720adc65d4a0da6a4f-0068c570a8" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txebb720adc65d4a0da6a4f-0068c570a8 - 0.0171 VW - 1757769896.626325846 1757769896.643429995 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a/0_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_vc_non_ascii%C2%A3" "tx323c4b71459c44c68c2e5-0068c570a8" "proxy-server 1824535" 0.0050 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.52546" 201 - "PUT http://localhost/sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.52546" "txe12108ca01ee4318ac772-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.52546" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.52546" "txe12108ca01ee4318ac772-0068c570a8" "proxy-server 1824535" 0.0087 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.52546" 201 - "PUT http://localhost/sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.52546" "txe12108ca01ee4318ac772-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.52546" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.52546" "txe12108ca01ee4318ac772-0068c570a8" "proxy-server 1824535" 0.0245 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 PUT /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769896.52546 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txe12108ca01ee4318ac772-0068c570a8 - 0.0417 VW - 1757769896.644049406 1757769896.685731888 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx8298291de09445e0929f3-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx8298291de09445e0929f3-0068c570a8" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx8298291de09445e0929f3-0068c570a8" "proxy-server 1824535" 0.0229 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx8298291de09445e0929f3-0068c570a8" "proxy-server 1824535" 0.0224 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx8298291de09445e0929f3-0068c570a8 - 0.0439 - - 1757769896.686197519 1757769896.730103254 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8efad9dd80674fe5a5703-0068c570a8" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx8efad9dd80674fe5a5703-0068c570a8 - 0.0107 VW - 1757769896.731829643 1757769896.742573023 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txe38a846816784c258884b-0068c570a8" "proxy-server 1824535" 0.0061 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txe38a846816784c258884b-0068c570a8 - 0.0090 VW - 1757769896.745919228 1757769896.754923344 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "txb9756d8188de41aa8d3f0-0068c570a8" "proxy-server 1824535" 0.0096 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3?symlink=get" "txb9756d8188de41aa8d3f0-0068c570a8" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a/0_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_vc_non_ascii%C2%A3" "txaa04d8cec05b41c8b336c-0068c570a8" "proxy-server 1824535" 0.0062 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txb9756d8188de41aa8d3f0-0068c570a8 - 0.0417 VW - 1757769896.755590439 1757769896.797308683 0 - (txn: tx088d479228fc4b81b160a-0068c570a8) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 201 - "PUT http://localhost/sda1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" "tx088d479228fc4b81b160a-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" "tx088d479228fc4b81b160a-0068c570a8" "proxy-server 1824535" 0.0148 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 201 - "PUT http://localhost/sdb1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" "tx088d479228fc4b81b160a-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" "tx088d479228fc4b81b160a-0068c570a8" "proxy-server 1824535" 0.0310 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 PUT /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769896.69099 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx088d479228fc4b81b160a-0068c570a8 - 0.0481 VW - 1757769896.773632288 1757769896.821737051 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx8a2b136a965046238a375-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx8a2b136a965046238a375-0068c570a8" "proxy-server 1824535" 0.0137 "-" 1824535 0 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdl1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx990edd74b7de4526af506-0068c570a8" "proxy-server 1824498" 0.0552 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdj1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx990edd74b7de4526af506-0068c570a8" "proxy-server 1824498" 0.0586 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdh1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx990edd74b7de4526af506-0068c570a8" "proxy-server 1824498" 0.0690 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdg1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx990edd74b7de4526af506-0068c570a8" "proxy-server 1824498" 0.0489 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/ec-dup-discon/test" 201 - "PUT http://localhost/sdk1/3/a/ec-dup-discon/test" "tx990edd74b7de4526af506-0068c570a8" "object-server 1824498" 0.0005 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/ec-dup-discon/test" 201 - "PUT http://localhost/sdi1/3/a/ec-dup-discon/test" "tx990edd74b7de4526af506-0068c570a8" "object-server 1824498" 0.0004 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdk1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx990edd74b7de4526af506-0068c570a8" "proxy-server 1824498" 0.0770 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdi1/3/a/ec-dup-discon/test" 201 - "PUT http://localhost/v1/a/ec-dup-discon/test" "tx990edd74b7de4526af506-0068c570a8" "proxy-server 1824498" 0.0770 "-" 1824498 4 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/ec-dup-discon/test HTTP/1.0 201 - - t 65536 - - tx990edd74b7de4526af506-0068c570a8 - 0.1225 - - 1757769896.557323456 1757769896.679815769 4 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc5a3e24509cd41229ba6a-0068c570a8" "proxy-server 1824498" 0.0014 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/0/a/ec-con" 201 - "PUT http://127.0.0.1:33753/sda1/1/a/ec-con" "txc5a3e24509cd41229ba6a-0068c570a8" "container-server 1824498" 0.0010 "-" 1824498 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/ec-con" 201 - "PUT http://127.0.0.1:54711/sdb1/1/a/ec-con" "txc5a3e24509cd41229ba6a-0068c570a8" "container-server 1824498" 0.0010 "-" 1824498 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/1/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "txc5a3e24509cd41229ba6a-0068c570a8" "proxy-server 1824498" 0.0145 "-" 1824498 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/1/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "txc5a3e24509cd41229ba6a-0068c570a8" "proxy-server 1824498" 0.0218 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/ec-con HTTP/1.0 202 - - t - 76 - txc5a3e24509cd41229ba6a-0068c570a8 - 0.0357 - - 1757769896.681624651 1757769896.717293024 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx19caf0fe53eb492db7253-0068c570a8" "proxy-server 1824498" 0.0063 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/1/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txed117ed166a743a4929e4-0068c570a8" "proxy-server 1824498" 0.0090 "-" 1824498 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/1/a/ec-con/o2" 201 - "PUT http://localhost/sdi1/1/a/ec-con/o2" "tx556f580e5754463b8abde-0068c570a8" "object-server 1824498" 0.0005 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdg1/1/a/ec-con/o2" 201 - "PUT http://localhost/v1/a/ec-con/o2" "tx556f580e5754463b8abde-0068c570a8" "proxy-server 1824498" 0.0214 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdi1/1/a/ec-con/o2" 201 - "PUT http://localhost/v1/a/ec-con/o2" "tx556f580e5754463b8abde-0068c570a8" "proxy-server 1824498" 0.0234 "-" 1824498 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/1/a/ec-con/o2" 201 - "PUT http://localhost/sdh1/1/a/ec-con/o2" "tx556f580e5754463b8abde-0068c570a8" "object-server 1824498" 0.0004 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdh1/1/a/ec-con/o2" 201 - "PUT http://localhost/v1/a/ec-con/o2" "tx556f580e5754463b8abde-0068c570a8" "proxy-server 1824498" 0.0268 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/ec-con/o2 HTTP/1.0 201 - - t 40 - %22f080b258d6577697b9869dbd168d5628%22 tx556f580e5754463b8abde-0068c570a8 - 0.0602 - - 1757769896.723489046 1757769896.783664465 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0c0818b587af447cb4636-0068c570a8" "proxy-server 1824498" 0.0044 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/1/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txdd3bbbb0e3fe47e39f82a-0068c570a8" "proxy-server 1824498" 0.0104 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdh1/1/a/ec-con/o2" 200 100 "HEAD http://localhost/v1/a/ec-con/o2" "tx02b35479dd2b4439bd0ba-0068c570a8" "proxy-server 1824498" 0.0006 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 HEAD /v1/a/ec-con/o2 HTTP/1.0 200 - - t - - - tx02b35479dd2b4439bd0ba-0068c570a8 - 0.0236 - - 1757769896.785146713 1757769896.808708429 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf14a86c7ccc245f7b595b-0068c570a8" "proxy-server 1824498" 0.0020 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/1/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txd338b4145c044cac9f174-0068c570a8" "proxy-server 1824498" 0.0073 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdi1/1/a/ec-con/o2" 200 100 "GET http://localhost/v1/a/ec-con/o2" "tx11de8e5ab34d43f2aca09-0068c570a8" "proxy-server 1824498" 0.0007 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdh1/1/a/ec-con/o2" 200 100 "GET http://localhost/v1/a/ec-con/o2" "tx11de8e5ab34d43f2aca09-0068c570a8" "proxy-server 1824498" 0.0007 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 GET /v1/a/ec-con/o2 HTTP/1.0 200 - - t - 40 - tx11de8e5ab34d43f2aca09-0068c570a8 - 0.0506 - - 1757769896.810149908 1757769896.860705614 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx053e2eeba86c435288e93-0068c570a8" "proxy-server 1824498" 0.0014 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/1/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txe202169c0c9b4e66a9872-0068c570a8" "proxy-server 1824498" 0.0014 "-" 1824498 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/1/a/ec-con/o2" 201 - "POST http://localhost/sdi1/1/a/ec-con/o2" "txe4c8b5fcd1d044d8a2c24-0068c570a8" "object-server 1824498" 0.0005 "-" 1824498 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/1/a/ec-con/o2" 201 - "POST http://localhost/sdg1/1/a/ec-con/o2" "txe4c8b5fcd1d044d8a2c24-0068c570a8" "object-server 1824498" 0.0004 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "POST /sdh1/1/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "txe4c8b5fcd1d044d8a2c24-0068c570a8" "proxy-server 1824498" 0.0103 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "POST /sdg1/1/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "txe4c8b5fcd1d044d8a2c24-0068c570a8" "proxy-server 1824498" 0.0192 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "POST /sdi1/1/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "txe4c8b5fcd1d044d8a2c24-0068c570a8" "proxy-server 1824498" 0.0189 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 POST /v1/a/ec-con/o2 HTTP/1.0 202 - - t - 76 - txe4c8b5fcd1d044d8a2c24-0068c570a8 - 0.0620 - - 1757769896.862172127 1757769896.924207687 3 - object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.17:1017/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 503 from 10.0.0.17:1017/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404, 1 x 503 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.13:1013/sdn/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (11 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.27:1027/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.41:1041/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (39 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.181:1181/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (179 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.17:1017/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.17:1017/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Invalid response 507 from 10.0.0.17:1017/sda/0/a/c/oè policy#0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404, 1 x 507 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor INFO: Nothing reconstructed for 7.152557373046875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2test.unit.proxy.test_server.TestECDuplicationObjectController.test_reload_ring_ec test.unit.proxy.test_server.TestECDuplicationObjectController.test_reload_ring_ec ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx8a2b136a965046238a375-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx8a2b136a965046238a375-0068c570a8" "proxy-server 1824535" 0.0210 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx8a2b136a965046238a375-0068c570a8 - 0.0267 - - 1757769896.822182417 1757769896.848922014 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4cf0c46aa7384306b6b77-0068c570a8" "proxy-server 1824535" 0.0015 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx4cf0c46aa7384306b6b77-0068c570a8 - 0.0128 VW - 1757769896.850533962 1757769896.863327026 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txd54fcfd2b167496e8db2a-0068c570a8" "proxy-server 1824535" 0.0150 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txd54fcfd2b167496e8db2a-0068c570a8 - 0.0179 VW - 1757769896.863928795 1757769896.881847620 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub?symlink=get" "txe3485820129c424c8ba05-0068c570a8" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub?symlink=get" "txe3485820129c424c8ba05-0068c570a8" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3/sub%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txe3485820129c424c8ba05-0068c570a8 - 0.0131 VW - 1757769896.882470608 1757769896.895593405 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" "txc305f76c6efe45e38b9e4-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" "txc305f76c6efe45e38b9e4-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" "txc305f76c6efe45e38b9e4-0068c570a8" "proxy-server 1824535" 0.0215 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" "txc305f76c6efe45e38b9e4-0068c570a8" "proxy-server 1824535" 0.0170 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3/sub HTTP/1.0 201 - - t 4 - - txc305f76c6efe45e38b9e4-0068c570a8 - 0.0259 - - 1757769896.896007776 1757769896.921890736 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx22a82361a97c4f64b91ca-0068c570a8" "proxy-server 1824535" 0.0015 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx22a82361a97c4f64b91ca-0068c570a8 - 0.0043 VW - 1757769896.930851221 1757769896.935140610 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "txaab2bc25ca8b4dcfb1d5b-0068c570a8" "proxy-server 1824535" 0.0060 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txaab2bc25ca8b4dcfb1d5b-0068c570a8 - 0.0087 VW - 1757769896.935688496 1757769896.944367647 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 200 4 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub?symlink=get" "tx4550c584c7d0499597ba8-0068c570a8" "proxy-server 1824535" 0.0087 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "GET /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 200 4 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub?symlink=get" "tx4550c584c7d0499597ba8-0068c570a8" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sda1/0/a/0_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_vc_non_ascii%C2%A3" "tx548aa31f01e649e28ed71-0068c570a8" "proxy-server 1824535" 0.0071 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/56 GET /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3/sub%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 4 - tx4550c584c7d0499597ba8-0068c570a8 - 0.0534 VW - 1757769896.944944382 1757769896.998309612 0 - (txn: tx119f0c09f16f4f849405b-0068c570a8) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/0_vc_non_ascii%C2%A3/0130_o_non_ascii%C2%A3/sub/1757769896.89654" 201 - "PUT http://localhost/sdb1/1/a/0_vc_non_ascii%C2%A3/0130_o_non_ascii%C2%A3/sub/1757769896.89654" "tx119f0c09f16f4f849405b-0068c570a8" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/0_vc_non_ascii%C2%A3/0130_o_non_ascii%C2%A3/sub/1757769896.89654" 201 - "PUT http://localhost/sda1/1/a/0_vc_non_ascii%C2%A3/0130_o_non_ascii%C2%A3/sub/1757769896.89654" "tx119f0c09f16f4f849405b-0068c570a8" "object-server 1824535" 0.0108 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/1/a/0_vc_non_ascii%C2%A3/0130_o_non_ascii%C2%A3/sub/1757769896.89654" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/0130_o_non_ascii%C2%A3/sub/1757769896.89654" "tx119f0c09f16f4f849405b-0068c570a8" "proxy-server 1824535" 0.0326 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/1/a/0_vc_non_ascii%C2%A3/0130_o_non_ascii%C2%A3/sub/1757769896.89654" 201 - "PUT http://localhost/v1/a/0_vc_non_ascii%C2%A3/0130_o_non_ascii%C2%A3/sub/1757769896.89654" "tx119f0c09f16f4f849405b-0068c570a8" "proxy-server 1824535" 0.0342 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 PUT /v1/a/0_vc_non_ascii%25C2%25A3/0130_o_non_ascii%25C2%25A3/sub/1757769896.89654 HTTP/1.0 201 - Swift - 4 - 1b52eb8ef2c1875cfdf3ffbe9e3c05da tx119f0c09f16f4f849405b-0068c570a8 - 0.0646 VW - 1757769896.975566387 1757769897.040166140 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" "tx8bb44fa7a365497da2b36-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" "tx8bb44fa7a365497da2b36-0068c570a9" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" "tx8bb44fa7a365497da2b36-0068c570a9" "proxy-server 1824535" 0.0199 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3/sub" "tx8bb44fa7a365497da2b36-0068c570a9" "proxy-server 1824535" 0.0195 "-" 1824535 0 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (12 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (13 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (14 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (15 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (16 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (17 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (18 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx143bdee209984a5791eab-0068c570a8" "proxy-server 1824498" 0.0095 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/1/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx736ce46ddaa34d5aba73f-0068c570a8" "proxy-server 1824498" 0.0067 "-" 1824498 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sdb1/1/a/ec-con/o2" 201 - "POST http://localhost/sdi1/1/a/ec-con/o2" "txe11d8486f2d749ac8be98-0068c570a8" "object-server 1824498" 0.0005 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "POST /sdi1/1/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "txe11d8486f2d749ac8be98-0068c570a8" "proxy-server 1824498" 0.0096 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "POST /sdh1/1/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "txe11d8486f2d749ac8be98-0068c570a8" "proxy-server 1824498" 0.0098 "-" 1824498 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "PUT /sda1/1/a/ec-con/o2" 201 - "POST http://localhost/sdg1/1/a/ec-con/o2" "txe11d8486f2d749ac8be98-0068c570a8" "object-server 1824498" 0.0005 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "POST /sdg1/1/a/ec-con/o2" 202 76 "POST http://localhost/v1/a/ec-con/o2" "txe11d8486f2d749ac8be98-0068c570a8" "proxy-server 1824498" 0.0175 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/56 POST /v1/a/ec-con/o2 HTTP/1.0 202 - - t - 76 - txe11d8486f2d749ac8be98-0068c570a8 - 0.0489 - - 1757769896.936132431 1757769896.985082150 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:56 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb21a9377537243f3bbfda-0068c570a8" "proxy-server 1824498" 0.0014 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/1/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txa08b39ce66c54c0f9965b-0068c570a9" "proxy-server 1824498" 0.0028 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sdh1/1/a/ec-con/o2" 204 - "DELETE http://localhost/v1/a/ec-con/o2" "tx512faffab25e4880add83-0068c570a9" "proxy-server 1824498" 0.0065 "-" 1824498 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sda1/1/a/ec-con/o2" 204 - "DELETE http://localhost/sdg1/1/a/ec-con/o2" "tx512faffab25e4880add83-0068c570a9" "object-server 1824498" 0.0042 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sdg1/1/a/ec-con/o2" 204 - "DELETE http://localhost/v1/a/ec-con/o2" "tx512faffab25e4880add83-0068c570a9" "proxy-server 1824498" 0.0087 "-" 1824498 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sdb1/1/a/ec-con/o2" 204 - "DELETE http://localhost/sdi1/1/a/ec-con/o2" "tx512faffab25e4880add83-0068c570a9" "object-server 1824498" 0.0004 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sdi1/1/a/ec-con/o2" 204 - "DELETE http://localhost/v1/a/ec-con/o2" "tx512faffab25e4880add83-0068c570a9" "proxy-server 1824498" 0.0277 "-" 1824498 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 DELETE /v1/a/ec-con/o2 HTTP/1.0 204 - - t - - - tx512faffab25e4880add83-0068c570a9 - 0.0578 - - 1757769896.986592293 1757769897.044435263 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx20b6dfd128654190bb62d-0068c570a9" "proxy-server 1824498" 0.0013 "-" 1824498 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/ec-crazytown" 201 - "PUT http://127.0.0.1:54711/sdb1/3/a/ec-crazytown" "tx20b6dfd128654190bb62d-0068c570a9" "container-server 1824498" 0.0010 "-" 1824498 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/ec-crazytown" 201 - "PUT http://127.0.0.1:33753/sda1/3/a/ec-crazytown" "tx20b6dfd128654190bb62d-0068c570a9" "container-server 1824498" 0.0010 "-" 1824498 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/ec-crazytown" 201 - "PUT http://localhost/v1/a/ec-crazytown" "tx20b6dfd128654190bb62d-0068c570a9" "proxy-server 1824498" 0.0246 "-" 1824498 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/ec-crazytown" 201 - "PUT http://localhost/v1/a/ec-crazytown" "tx20b6dfd128654190bb62d-0068c570a9" "proxy-server 1824498" 0.0170 "-" 1824498 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txecf4780e856c434c9c881-0068c570a9" "proxy-server 1824498" 0.0059 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/3/a/ec-crazytown" 204 - "HEAD http://localhost/v1/a/ec-crazytown" "tx8617b77585c14db287630-0068c570a9" "proxy-server 1824498" 0.0055 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdi1/3/a/ec-crazytown/obj" 507 6 "PUT http://localhost/v1/a/ec-crazytown/obj" "txaeba904aab5d4ec4b67f6-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 3 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:35143/sdi1, error: ERROR Insufficient Storage (txn: txaeba904aab5d4ec4b67f6-0068c570a9) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdh1/3/a/ec-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-crazytown/obj" "txaeba904aab5d4ec4b67f6-0068c570a9" "proxy-server 1824498" 0.0161 "-" 1824498 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/ec-crazytown/obj" 201 - "PUT http://localhost/sdg1/3/a/ec-crazytown/obj" "txaeba904aab5d4ec4b67f6-0068c570a9" "object-server 1824498" 0.0005 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdg1/3/a/ec-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-crazytown/obj" "txaeba904aab5d4ec4b67f6-0068c570a9" "proxy-server 1824498" 0.0209 "-" 1824498 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc001de0bafb1409e8214d-0068c570a9" "proxy-server 1824498" 0.0014 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/3/a/ec-crazytown" 204 - "HEAD http://localhost/v1/a/ec-crazytown" "txe3c89fd228cd48e4b667f-0068c570a9" "proxy-server 1824498" 0.0078 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdg1/3/a/ec-crazytown/obj" 507 6 "PUT http://localhost/v1/a/ec-crazytown/obj" "tx607fa5cd6e204019972b7-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 3 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:48623/sdg1, error: ERROR Insufficient Storage (txn: tx607fa5cd6e204019972b7-0068c570a9) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdh1/3/a/ec-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-crazytown/obj" "tx607fa5cd6e204019972b7-0068c570a9" "proxy-server 1824498" 0.0176 "-" 1824498 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/ec-crazytown/obj" 201 - "PUT http://localhost/sdi1/3/a/ec-crazytown/obj" "tx607fa5cd6e204019972b7-0068c570a9" "object-server 1824498" 0.0005 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdi1/3/a/ec-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-crazytown/obj" "tx607fa5cd6e204019972b7-0068c570a9" "proxy-server 1824498" 0.0233 "-" 1824498 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx866d33c80ca948ae88b09-0068c570a9" "proxy-server 1824498" 0.0021 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/3/a/ec-crazytown" 204 - "HEAD http://localhost/v1/a/ec-crazytown" "tx77f69529cec74c0ab6275-0068c570a9" "proxy-server 1824498" 0.0024 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdh1/3/a/ec-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-crazytown/obj" "tx259bd0a8026941a595f41-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdi1/3/a/ec-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-crazytown/obj" "tx259bd0a8026941a595f41-0068c570a9" "proxy-server 1824498" 0.0007 "-" 1824498 3 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:37375/sdh1, error: ERROR Insufficient Storage (txn: tx259bd0a8026941a595f41-0068c570a9) object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (19 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (20 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (21 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (22 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (23 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (24 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (27 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (28 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (29 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (30 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (31 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (32 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3/sub HTTP/1.0 201 - - t 4 - - tx8bb44fa7a365497da2b36-0068c570a9 - 0.0326 - - 1757769897.040654182 1757769897.073267937 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5a1241b7694e477bbd090-0068c570a9" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx5a1241b7694e477bbd090-0068c570a9 - 0.0123 VW - 1757769897.082969904 1757769897.095235825 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/3/a/0_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3" "tx174b95a4c0214f21a6e30-0068c570a9" "proxy-server 1824535" 0.0103 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a/0_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx174b95a4c0214f21a6e30-0068c570a9 - 0.0131 VW - 1757769897.095798254 1757769897.108885288 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sda1/0/a/0_vc_non_ascii%C2%A3" 200 764 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?prefix=00f0_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "tx8daa8d9ab8184133aa36a-0068c570a9" "proxy-server 1824535" 0.0059 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fprefix%3D00f0_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 764 - tx8daa8d9ab8184133aa36a-0068c570a9 - 0.0216 VW - 1757769897.109498978 1757769897.131118298 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sda1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 200 5 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099?symlink=get" "txb8d6063df36f43e9a03f7-0068c570a9" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 200 5 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099?symlink=get" "txb8d6063df36f43e9a03f7-0068c570a9" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 GET /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769896.69099%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txb8d6063df36f43e9a03f7-0068c570a9 - 0.0280 VW - 1757769897.131691456 1757769897.159698963 0 - (txn: tx9dc4a1da8faa442e8647c-0068c570a9) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx9dc4a1da8faa442e8647c-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx9dc4a1da8faa442e8647c-0068c570a9" "proxy-server 1824535" 0.0139 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx9dc4a1da8faa442e8647c-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3/0_o_non_ascii%C2%A3" "tx9dc4a1da8faa442e8647c-0068c570a9" "proxy-server 1824535" 0.0189 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 PUT /v1/a/0_oc_non_ascii%25C2%25A3/0_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx9dc4a1da8faa442e8647c-0068c570a9 - 0.0307 VW - 1757769897.142359018 1757769897.173072338 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sda1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 204 - "DELETE http://localhost/sda1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" "tx1727a793eb354c7694b5c-0068c570a9" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sdb1/0/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 204 - "DELETE http://localhost/sdb1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" "tx1727a793eb354c7694b5c-0068c570a9" "object-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sda1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 204 - "DELETE http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" "tx1727a793eb354c7694b5c-0068c570a9" "proxy-server 1824535" 0.0155 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sdb1/2/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" 204 - "DELETE http://localhost/v1/a/0_vc_non_ascii%C2%A3/00f0_o_non_ascii%C2%A3/1757769896.69099" "tx1727a793eb354c7694b5c-0068c570a9" "proxy-server 1824535" 0.0100 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 DELETE /v1/a/0_vc_non_ascii%25C2%25A3/00f0_o_non_ascii%25C2%25A3/1757769896.69099 HTTP/1.0 204 - Swift - - - - tx1727a793eb354c7694b5c-0068c570a9 - 0.0237 VW - 1757769897.173567533 1757769897.197270155 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd54aa36db26241679daf8-0068c570a9" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/0/a/0_vc_non_ascii%C2%A3" 200 195 "GET http://localhost/v1/a/0_vc_non_ascii%C2%A3?prefix=0130_o_non_ascii%C2%A3%2Fsub%2F&format=json&states=listing" "txd54aa36db26241679daf8-0068c570a9" "proxy-server 1824535" 0.0082 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 GET /v1/a/0_vc_non_ascii%25C2%25A3%3Fprefix%3D0130_o_non_ascii%25C2%25A3%252Fsub%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 195 - txd54aa36db26241679daf8-0068c570a9 - 0.0198 - - 1757769897.203021049 1757769897.222799540 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4cc57da9840c492d97362-0068c570a9" "proxy-server 1824535" 0.0055 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/1/a/0_oc_non_ascii%C2%A3whoops" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a/0_oc_non_ascii%C2%A3whoops" "tx4cc57da9840c492d97362-0068c570a9" "container-server 1824535" 0.0012 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/1/a/0_oc_non_ascii%C2%A3whoops" 201 - "PUT http://127.0.0.1:38699/sda1/1/a/0_oc_non_ascii%C2%A3whoops" "tx4cc57da9840c492d97362-0068c570a9" "container-server 1824535" 0.0053 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/1/a/0_oc_non_ascii%C2%A3whoops" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops" "tx4cc57da9840c492d97362-0068c570a9" "proxy-server 1824535" 0.0240 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/1/a/0_oc_non_ascii%C2%A3whoops" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops" "tx4cc57da9840c492d97362-0068c570a9" "proxy-server 1824535" 0.0334 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 PUT /v1/a/0_oc_non_ascii%25C2%25A3whoops HTTP/1.0 201 - - t - - - tx4cc57da9840c492d97362-0068c570a9 - 0.0493 - - 1757769897.224665403 1757769897.273941755 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfcccd19002844d82b4f33-0068c570a9" "proxy-server 1824535" 0.0063 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txfcccd19002844d82b4f33-0068c570a9 - 0.0090 VW - 1757769897.279645920 1757769897.288623810 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a/0_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops" "tx853e4a00005242f9ba15c-0068c570a9" "proxy-server 1824535" 0.0055 "-" 1824535 0test.unit.proxy.test_server.TestECMismatchedFA.test_mixing_different_objects_fragment_archives test.unit.proxy.test_server.TestECMismatchedFA.test_mixing_different_objects_fragment_archives ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_one_rnc_absolute_number test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_one_rnc_absolute_number ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_one_rnc_four_replicas test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_one_rnc_four_replicas ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_one_rnc_three_replicas test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_one_rnc_three_replicas ... ok test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8 test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8 ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_one_rnc_two_replicas test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_one_rnc_two_replicas ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_two test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_two ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_two_with_quarantine_age test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_quarantine_threshold_two_with_quarantine_age ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_etag_with_same_timestamp test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_etag_with_same_timestamp ... ok proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a/0_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - tx853e4a00005242f9ba15c-0068c570a9 - 0.0145 VW - 1757769897.289176464 1757769897.303708315 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sda1/3/a/0_oc_non_ascii%C2%A3whoops/foo" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops/foo?symlink=get" "txb7a1e4615ff04d30be997-0068c570a9" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/3/a/0_oc_non_ascii%C2%A3whoops/foo" 404 70 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops/foo?symlink=get" "txb7a1e4615ff04d30be997-0068c570a9" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 GET /v1/a/0_oc_non_ascii%25C2%25A3whoops/foo%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txb7a1e4615ff04d30be997-0068c570a9 - 0.0095 VW - 1757769897.304323435 1757769897.313800097 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/1/a/0_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/sda1/3/a/0_oc_non_ascii%C2%A3whoops/foo" "txf7187cc3040a477d9705d-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/0_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops/foo" "txf7187cc3040a477d9705d-0068c570a9" "proxy-server 1824535" 0.0167 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/1/a/0_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/sdb1/3/a/0_oc_non_ascii%C2%A3whoops/foo" "txf7187cc3040a477d9705d-0068c570a9" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/0_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops/foo" "txf7187cc3040a477d9705d-0068c570a9" "proxy-server 1824535" 0.0197 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 PUT /v1/a/0_oc_non_ascii%25C2%25A3whoops/foo HTTP/1.0 201 - - t 5 - - txf7187cc3040a477d9705d-0068c570a9 - 0.0281 - - 1757769897.314187288 1757769897.342240334 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5d41b2c835c34be6afe7d-0068c570a9" "proxy-server 1824535" 0.0054 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx5d41b2c835c34be6afe7d-0068c570a9 - 0.0081 VW - 1757769897.347926855 1757769897.356017113 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/1/a/0_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops" "tx8944a3b688b54ea49302b-0068c570a9" "proxy-server 1824535" 0.0066 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a/0_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - tx8944a3b688b54ea49302b-0068c570a9 - 0.0094 VW - 1757769897.356546879 1757769897.365904093 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sda1/3/a/0_oc_non_ascii%C2%A3whoops/foo" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops/foo?symlink=get" "txb5e1d31ee3684efeada7f-0068c570a9" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/3/a/0_oc_non_ascii%C2%A3whoops/foo" 200 5 "GET http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops/foo?symlink=get" "txb5e1d31ee3684efeada7f-0068c570a9" "proxy-server 1824535" 0.0087 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx4b93a0a34cc741519f4e1-0068c570a9" "proxy-server 1824535" 0.0003 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx4b93a0a34cc741519f4e1-0068c570a9" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 GET /v1/a/0_oc_non_ascii%25C2%25A3whoops/foo%3Fsymlink%3Dget HTTP/1.0 499 - Swift - - 5 - txb5e1d31ee3684efeada7f-0068c570a9 - 0.0282 VW - 1757769897.366511345 1757769897.394749165 0 - (txn: txddfd2ef58716495d9c6e6-0068c570a9) proxy INFO: - - 13/Sep/2025/13/24/57 PUT /v1/a/none/003foo/1757769897.31892 HTTP/1.0 404 - Swift - - 70 dcddb75469b4b4875094e14561e573d8 txddfd2ef58716495d9c6e6-0068c570a9 - 0.0142 VW - 1757769897.381059647 1757769897.395259380 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx44d0f24cdc6f4c7a80e08-0068c570a9" "proxy-server 1824535" 0.0061 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx44d0f24cdc6f4c7a80e08-0068c570a9 - 0.0088 VW - 1757769897.396891832 1757769897.405647278 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a/0_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops" "txda8df61c50604635be371-0068c570a9" "proxy-server 1824535" 0.0077 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a/0_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - txda8df61c50604635be371-0068c570a9 - 0.0145 VW - 1757769897.406175375 1757769897.420646191 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sda1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txedbb72e7df5144baad3eb-0068c570a9" "proxy-server 1824535" 0.0003 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txedbb72e7df5144baad3eb-0068c570a9" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 GET /v1/a/none%3Fprefix%3D003foo%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 404 - Swift - - 70 - txedbb72e7df5144baad3eb-0068c570a9 - 0.0053 VW - 1757769897.421230078 1757769897.426491499 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sdb1/1/a/0_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/sda1/3/a/0_oc_non_ascii%C2%A3whoops/foo" "txa61aa6d1054146b182740-0068c570a9" "object-server 1824535" 0.0051 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sda1/3/a/0_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops/foo" "txa61aa6d1054146b182740-0068c570a9" "proxy-server 1824535" 0.0148 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sda1/1/a/0_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/sdb1/3/a/0_oc_non_ascii%C2%A3whoops/foo" "txa61aa6d1054146b182740-0068c570a9" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "DELETE /sdb1/3/a/0_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/v1/a/0_oc_non_ascii%C2%A3whoops/foo" "txa61aa6d1054146b182740-0068c570a9" "proxy-server 1824535" 0.0114 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 DELETE /v1/a/0_oc_non_ascii%25C2%25A3whoops/foo HTTP/1.0 204 - - t - - - txa61aa6d1054146b182740-0068c570a9 - 0.0209 - - 1757769897.431054354 1757769897.451994896 0 - proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2f3d3e7ca34d410785b8d-0068c570a9" "proxy-server 1824535" 0.0102 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/1/a/1_oc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/1_oc_non_ascii%C2%A3" "tx2f3d3e7ca34d410785b8d-0068c570a9" "container-server 1824535" 0.0011 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/1/a/1_oc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/1_oc_non_ascii%C2%A3" "tx2f3d3e7ca34d410785b8d-0068c570a9" "container-server 1824535" 0.0092 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx2f3d3e7ca34d410785b8d-0068c570a9" "proxy-server 1824535" 0.0339 "-" 1824535 0 proxy DEBUG: Node is error limited: 127.0.0.1:37375/sdh1 (txn: tx259bd0a8026941a595f41-0068c570a9) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdg1/3/a/ec-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-crazytown/obj" "tx259bd0a8026941a595f41-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 3 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:48623/sdg1, error: ERROR Insufficient Storage (txn: tx259bd0a8026941a595f41-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:48623/sdg1 (txn: tx259bd0a8026941a595f41-0068c570a9) proxy ERROR: Object returning 503 for [] (txn: tx259bd0a8026941a595f41-0068c570a9) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe5d74d9f4e6d4bf4a6c77-0068c570a9" "proxy-server 1824498" 0.0014 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/3/a/ec-crazytown" 204 - "HEAD http://localhost/v1/a/ec-crazytown" "txb2487e5e5f524274b7dbe-0068c570a9" "proxy-server 1824498" 0.0014 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdg1/3/a/ec-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-crazytown/obj" "txcd43e3e9ee2a412c860cb-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdh1/3/a/ec-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-crazytown/obj" "txcd43e3e9ee2a412c860cb-0068c570a9" "proxy-server 1824498" 0.0007 "-" 1824498 3 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:48623/sdg1, error: ERROR Insufficient Storage (txn: txcd43e3e9ee2a412c860cb-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:48623/sdg1 (txn: txcd43e3e9ee2a412c860cb-0068c570a9) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdi1/3/a/ec-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-crazytown/obj" "txcd43e3e9ee2a412c860cb-0068c570a9" "proxy-server 1824498" 0.0126 "-" 1824498 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1f4d22bc16c6473192295-0068c570a9" "proxy-server 1824498" 0.0013 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/3/a/ec-crazytown" 204 - "HEAD http://localhost/v1/a/ec-crazytown" "txd4d4fe2fe2984fec8fd8b-0068c570a9" "proxy-server 1824498" 0.0013 "-" 1824498 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdg1/3/a/ec-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-crazytown/obj" "tx100f065f952e447782026-0068c570a9" "proxy-server 1824498" 0.0007 "-" 1824498 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdh1/3/a/ec-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-crazytown/obj" "tx100f065f952e447782026-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 3 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:37375/sdh1, error: ERROR Insufficient Storage (txn: tx100f065f952e447782026-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:37375/sdh1 (txn: tx100f065f952e447782026-0068c570a9) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdi1/3/a/ec-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-crazytown/obj" "tx100f065f952e447782026-0068c570a9" "proxy-server 1824498" 0.0008 "-" 1824498 3 proxy ERROR: Object returning 503 for [] (txn: tx100f065f952e447782026-0068c570a9) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf4565a48b0724cabad0af-0068c570a9" "proxy-server 1824498" 0.0095 "-" 1824498 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/ec-dup-crazytown" 201 - "PUT http://127.0.0.1:54711/sdb1/3/a/ec-dup-crazytown" "txf4565a48b0724cabad0af-0068c570a9" "container-server 1824498" 0.0086 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/ec-dup-crazytown" 201 - "PUT http://127.0.0.1:33753/sda1/3/a/ec-dup-crazytown" "txf4565a48b0724cabad0af-0068c570a9" "container-server 1824498" 0.0011 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/ec-dup-crazytown" 201 - "PUT http://localhost/v1/a/ec-dup-crazytown" "txf4565a48b0724cabad0af-0068c570a9" "proxy-server 1824498" 0.0279 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/ec-dup-crazytown" 201 - "PUT http://localhost/v1/a/ec-dup-crazytown" "txf4565a48b0724cabad0af-0068c570a9" "proxy-server 1824498" 0.0247 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc13bf10f3f5a4735a6953-0068c570a9" "proxy-server 1824498" 0.0020 "-" 1824498 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/3/a/ec-dup-crazytown" 204 - "HEAD http://localhost/v1/a/ec-dup-crazytown" "tx96ef13a6a9624d188dcf6-0068c570a9" "proxy-server 1824498" 0.0013 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdj1/2/a/ec-dup-crazytown/obj" 507 6 "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txdc89cb2be7c54125887c7-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdl1/2/a/ec-dup-crazytown/obj" 507 6 "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txdc89cb2be7c54125887c7-0068c570a9" "proxy-server 1824498" 0.0000 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdk1/2/a/ec-dup-crazytown/obj" 507 6 "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txdc89cb2be7c54125887c7-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:55583/sdk1, error: ERROR Insufficient Storage (txn: txdc89cb2be7c54125887c7-0068c570a9) proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:33255/sdj1, error: ERROR Insufficient Storage (txn: txdc89cb2be7c54125887c7-0068c570a9) proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:38611/sdl1, error: ERROR Insufficient Storage (txn: txdc89cb2be7c54125887c7-0068c570a9) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdg1/2/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txdc89cb2be7c54125887c7-0068c570a9" "proxy-server 1824498" 0.0288 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/sdh1/2/a/ec-dup-crazytown/obj" "txdc89cb2be7c54125887c7-0068c570a9" "object-server 1824498" 0.0005 "-" 1824498 4 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/sdi1/2/a/ec-dup-crazytown/obj" "txdc89cb2be7c54125887c7-0068c570a9" "object-server 1824498" 0.0046 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdh1/2/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txdc89cb2be7c54125887c7-0068c570a9" "proxy-server 1824498" 0.0369 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdi1/2/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txdc89cb2be7c54125887c7-0068c570a9" "proxy-server 1824498" 0.0359 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd7c6bbd56cdc4f80a3bf9-0068c570a9" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/3/a/ec-dup-crazytown" 204 - "HEAD http://localhost/v1/a/ec-dup-crazytown" "tx31823f0aba864c50a62c0-0068c570a9" "proxy-server 1824498" 0.0069 "-" 1824498 4 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdh1/2/a/ec-dup-crazytown/obj" 507 6 "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txfc1d13e61a2a48f3b8a38-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdg1/2/a/ec-dup-crazytown/obj" 507 6 "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txfc1d13e61a2a48f3b8a38-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdi1/2/a/ec-dup-crazytown/obj" 507 6 "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txfc1d13e61a2a48f3b8a38-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 object-reconstructor ERROR: Unable to get enough responses (33 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (34 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (35 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (36 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (37 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (38 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769896.00000 object-reconstructor ERROR: Unable to get enough responses (39 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpfzfs0nn8/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769896.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769897.00000 object-reconstructor ERROR: Unable to get enough responses (40 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpvv1pqtb7/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769897.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769897.00000 object-reconstructor ERROR: Unable to get enough responses (40 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp0e7surt6/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769897.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 7.3909759521484375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (1/10 from 1 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769897.00000 object-reconstructor ERROR: Unable to get enough responses (26 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpr78o_yxg/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769897.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.4373016357421875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769897.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmpvoz6ncfq/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769897.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 6.67572021484375e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (2/10 from 2 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769897.00000 object-reconstructor ERROR: Unable to get enough responses (25 x 404 error responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor WARNING: Quarantined object /tmp/tmp90rzqsks/devices/sda1/objects/9/267/6890251452682782a8ddd27b8d1c8267/1757769897.00000#2#d.data: Solitary fragment #2 object-reconstructor INFO: Nothing reconstructed for 8.106231689453125e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor ERROR: Mixed Etag (some garbage, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 11] object-reconstructor INFO: Nothing reconstructed for 7.867813110351562e-06 seconds. object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_etags_same_timestamp_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_etags_same_timestamp_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_new_etag test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_new_etag ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_old_etag test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_old_etag ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_timestamps_etags_fail test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_fa_with_mixed_timestamps_etags_fail ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_parity_fa_with_data_node_failure test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_reconstruct_parity_fa_with_data_node_failure ... ok test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_request_node_count_conf test.unit.obj.test_reconstructor.TestReconstructFragmentArchiveUTF8.test_request_node_count_conf ... ok test.unit.obj.test_server.TestTpoolSize.test_default_config test.unit.obj.test_server.TestTpoolSize.test_default_config ... ok test.unit.obj.test_server.TestTpoolSize.test_explicit_setting test.unit.obj.test_server.TestTpoolSize.test_explicit_setting ... ok test.unit.obj.test_server.TestTpoolSize.test_servers_per_port_empty test.unit.obj.test_server.TestTpoolSize.test_servers_per_port_empty ... ok test.unit.obj.test_server.TestTpoolSize.test_servers_per_port_no_explicit_setting test.unit.obj.test_server.TestTpoolSize.test_servers_per_port_no_explicit_setting ... ok test.unit.obj.test_server.TestTpoolSize.test_servers_per_port_with_explicit_setting test.unit.obj.test_server.TestTpoolSize.test_servers_per_port_with_explicit_setting ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_all_found test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_all_found ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx2f3d3e7ca34d410785b8d-0068c570a9" "proxy-server 1824535" 0.0212 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 PUT /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx2f3d3e7ca34d410785b8d-0068c570a9 - 0.0560 - - 1757769897.458389521 1757769897.514381647 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx47e78344df074a94b1cfc-0068c570a9" "proxy-server 1824535" 0.0059 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/2/a/1_oc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3?format=json&states=listing" "tx47e78344df074a94b1cfc-0068c570a9" "proxy-server 1824535" 0.0022 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 GET /v1/a/1_oc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx47e78344df074a94b1cfc-0068c570a9 - 0.0285 - - 1757769897.521747351 1757769897.550254822 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx42ea95778dbe4af789643-0068c570a9" "proxy-server 1824535" 0.0101 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/1/a/1_vc_ascii" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/1_vc_ascii" "tx42ea95778dbe4af789643-0068c570a9" "container-server 1824535" 0.0011 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/1/a/1_vc_ascii" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/1_vc_ascii" "tx42ea95778dbe4af789643-0068c570a9" "container-server 1824535" 0.0010 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/1_vc_ascii" 201 - "PUT http://localhost/v1/a/1_vc_ascii" "tx42ea95778dbe4af789643-0068c570a9" "proxy-server 1824535" 0.0080 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/1_vc_ascii" 201 - "PUT http://localhost/v1/a/1_vc_ascii" "tx42ea95778dbe4af789643-0068c570a9" "proxy-server 1824535" 0.0136 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 PUT /v1/a/1_vc_ascii HTTP/1.0 201 - - t - - - tx42ea95778dbe4af789643-0068c570a9 - 0.0373 - - 1757769897.568406820 1757769897.605664492 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9fa3e693245c43a699a5e-0068c570a9" "proxy-server 1824535" 0.0019 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx9fa3e693245c43a699a5e-0068c570a9 - 0.0045 VW - 1757769897.607172251 1757769897.611707926 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txa230a4f98bed448e90915-0068c570a9" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txa230a4f98bed448e90915-0068c570a9 - 0.0039 VW - 1757769897.612247705 1757769897.616161346 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "txcc053d0b32124752b4763-0068c570a9" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "txcc053d0b32124752b4763-0068c570a9" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txcc053d0b32124752b4763-0068c570a9 - 0.0051 VW - 1757769897.616756201 1757769897.621845484 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx23512f7c86974b128ecbb-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx23512f7c86974b128ecbb-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx23512f7c86974b128ecbb-0068c570a9" "proxy-server 1824535" 0.0089 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx23512f7c86974b128ecbb-0068c570a9" "proxy-server 1824535" 0.0087 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - - t 5 - - tx23512f7c86974b128ecbb-0068c570a9 - 0.0132 - - 1757769897.622205019 1757769897.635454893 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe19144d4c4e34850a15f7-0068c570a9" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txe19144d4c4e34850a15f7-0068c570a9 - 0.0080 VW - 1757769897.647720814 1757769897.655770540 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx905555a62326448f849e0-0068c570a9" "proxy-server 1824535" 0.0066 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx905555a62326448f849e0-0068c570a9 - 0.0095 VW - 1757769897.656301975 1757769897.665760756 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx53cd67d6920a4b118ceb6-0068c570a9" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx53cd67d6920a4b118ceb6-0068c570a9" "proxy-server 1824535" 0.0007 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/0/a/1_vc_ascii" 204 - "HEAD http://localhost/v1/a/1_vc_ascii" "txa02a5f6db44a4cb2876ce-0068c570a9" "proxy-server 1824535" 0.0055 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx53cd67d6920a4b118ceb6-0068c570a9 - 0.0432 VW - 1757769897.666366577 1757769897.709565401 0 - (txn: txcd2cbac3d34849888ac5b-0068c570a9) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 201 - "PUT http://localhost/sda1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" "txcd2cbac3d34849888ac5b-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.62281" "txcd2cbac3d34849888ac5b-0068c570a9" "proxy-server 1824535" 0.0139 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 201 - "PUT http://localhost/sdb1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" "txcd2cbac3d34849888ac5b-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.62281" "txcd2cbac3d34849888ac5b-0068c570a9" "proxy-server 1824535" 0.0207 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 PUT /v1/a/1_vc_ascii/0091_o_ascii/1757769897.62281 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txcd2cbac3d34849888ac5b-0068c570a9 - 0.0452 VW - 1757769897.685035944 1757769897.730243444 0 - proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:37375/sdh1, error: ERROR Insufficient Storage (txn: txfc1d13e61a2a48f3b8a38-0068c570a9) proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:35143/sdi1, error: ERROR Insufficient Storage (txn: txfc1d13e61a2a48f3b8a38-0068c570a9) proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:48623/sdg1, error: ERROR Insufficient Storage (txn: txfc1d13e61a2a48f3b8a38-0068c570a9) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/3/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/sdl1/2/a/ec-dup-crazytown/obj" "txfc1d13e61a2a48f3b8a38-0068c570a9" "object-server 1824498" 0.0005 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdl1/2/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txfc1d13e61a2a48f3b8a38-0068c570a9" "proxy-server 1824498" 0.0606 "-" 1824498 4 obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdk1/2/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txfc1d13e61a2a48f3b8a38-0068c570a9" "proxy-server 1824498" 0.0551 "-" 1824498 4 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/3/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/sdj1/2/a/ec-dup-crazytown/obj" "txfc1d13e61a2a48f3b8a38-0068c570a9" "object-server 1824498" 0.0005 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdj1/2/a/ec-dup-crazytown/obj" 201 - "PUT http://localhost/v1/a/ec-dup-crazytown/obj" "txfc1d13e61a2a48f3b8a38-0068c570a9" "proxy-server 1824498" 0.0592 "-" 1824498 4 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc8db2ba2902049138abe8-0068c570a9" "proxy-server 1824498" 0.0135 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/3/a/ec-dup-crazytown" 204 - "HEAD http://localhost/v1/a/ec-dup-crazytown" "tx9d0c941aba7f489c85f30-0068c570a9" "proxy-server 1824498" 0.0148 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdg1/2/a/ec-dup-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "tx80d72b1ef2d4489db0d6a-0068c570a9" "proxy-server 1824498" 0.0007 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdj1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "tx80d72b1ef2d4489db0d6a-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:33255/sdj1, error: ERROR Insufficient Storage (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:33255/sdj1 (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdh1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "tx80d72b1ef2d4489db0d6a-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:37375/sdh1, error: ERROR Insufficient Storage (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:37375/sdh1 (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdk1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "tx80d72b1ef2d4489db0d6a-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:55583/sdk1, error: ERROR Insufficient Storage (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:55583/sdk1 (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdl1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "tx80d72b1ef2d4489db0d6a-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:38611/sdl1, error: ERROR Insufficient Storage (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:38611/sdl1 (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdi1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "tx80d72b1ef2d4489db0d6a-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:35143/sdi1, error: ERROR Insufficient Storage (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:35143/sdi1 (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) proxy ERROR: Object returning 503 for [] (txn: tx80d72b1ef2d4489db0d6a-0068c570a9) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txad5cdcc324bf4df18b4d8-0068c570a9" "proxy-server 1824498" 0.0013 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/3/a/ec-dup-crazytown" 204 - "HEAD http://localhost/v1/a/ec-dup-crazytown" "txd8427116db8f435b99769-0068c570a9" "proxy-server 1824498" 0.0055 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdg1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txa45b4fcc600f44958500d-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdj1/2/a/ec-dup-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txa45b4fcc600f44958500d-0068c570a9" "proxy-server 1824498" 0.0007 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:48623/sdg1, error: ERROR Insufficient Storage (txn: txa45b4fcc600f44958500d-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:48623/sdg1 (txn: txa45b4fcc600f44958500d-0068c570a9) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdi1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txa45b4fcc600f44958500d-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:35143/sdi1, error: ERROR Insufficient Storage (txn: txa45b4fcc600f44958500d-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:35143/sdi1 (txn: txa45b4fcc600f44958500d-0068c570a9) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdh1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txa45b4fcc600f44958500d-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:37375/sdh1, error: ERROR Insufficient Storage (txn: txa45b4fcc600f44958500d-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:37375/sdh1 (txn: txa45b4fcc600f44958500d-0068c570a9) obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdl1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txa45b4fcc600f44958500d-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:38611/sdl1, error: ERROR Insufficient Storage (txn: txa45b4fcc600f44958500d-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:38611/sdl1 (txn: txa45b4fcc600f44958500d-0068c570a9) obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdk1/2/a/ec-dup-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txa45b4fcc600f44958500d-0068c570a9" "proxy-server 1824498" 0.0050 "-" 1824498 4 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/0/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfd648db064534270a103b-0068c570a9" "proxy-server 1824498" 0.0021 "-" 1824498 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/3/a/ec-dup-crazytown" 204 - "HEAD http://localhost/v1/a/ec-dup-crazytown" "txf42627aab9cf461fa601a-0068c570a9" "proxy-server 1824498" 0.0014 "-" 1824498 4 obj6 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdl1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txdb28321994ea4acf85e80-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdg1/2/a/ec-dup-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txdb28321994ea4acf85e80-0068c570a9" "proxy-server 1824498" 0.0008 "-" 1824498 4test.unit.proxy.test_server.TestECMismatchedFA.test_mixing_different_objects_fragment_archives_with_dup_factor test.unit.proxy.test_server.TestECMismatchedFA.test_mixing_different_objects_fragment_archives_with_dup_factor ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_half_not_found_headers_and_body test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_half_not_found_headers_and_body ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_half_not_found_statuses test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_half_not_found_statuses ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_handoff test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_handoff ... ok test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_PUT_sysmeta_then_GET test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_PUT_sysmeta_then_GET ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_insufficient_found_plus_404_507 test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_insufficient_found_plus_404_507 ... ok test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_PUT_sysmeta_then_HEAD test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_PUT_sysmeta_then_HEAD ... ok object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (c5fb6d138d0e30c1a777a2e70fdf44b8, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Mixed Etag (fb3d200eb5be7226d6ab1839145d575b, f0510d5479985e9523dc1688b0bc7d63) for 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 object-reconstructor ERROR: Unable to get enough responses (5/10 from 13 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769897.00000 object-reconstructor INFO: Nothing reconstructed for 7.867813110351562e-06 seconds. object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 9, 10] object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 3, 4, 5, 6, 7, 8, 9, 10, 11] object-reconstructor INFO: Nothing reconstructed for 7.867813110351562e-06 seconds. object-reconstructor DEBUG: Found existing frag #1 at 10.0.0.9:1009/sdj/0/a/c/oè policy#0 while rebuilding to 10.0.0.1:1001/sdb/0/a/c/oè policy#0 object-reconstructor DEBUG: Reconstruct frag #1 with frag indexes [0, 2, 3, 4, 5, 6, 7, 8, 10, 11] object-reconstructor INFO: Nothing reconstructed for 7.152557373046875e-06 seconds. object-reconstructor ERROR: Unable to get enough responses (5/10 from 5 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag f0510d5479985e9523dc1688b0bc7d63 and timestamp 1757769897.00000 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag c5fb6d138d0e30c1a777a2e70fdf44b8 and timestamp 1757769898.00000 object-reconstructor ERROR: Unable to get enough responses (4/10 from 4 ok responses) to reconstruct non-durable 10.0.0.1:1001/sdb/0/a/c/oè policy#0 frag#1 with ETag fb3d200eb5be7226d6ab1839145d575b and timestamp 1757769899.00000 object-reconstructor INFO: Nothing reconstructed for 6.9141387939453125e-06 seconds. object-reconstructor ERROR: Trying to GET 10.0.0.3:1003/sdd/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 2, 4, 5, 6, 7, 8, 9, 11] object-reconstructor ERROR: Trying to GET 10.0.0.3:1003/sdd/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 2, 4, 6, 7, 8, 9, 11, 12] object-reconstructor ERROR: Trying to GET 10.0.0.3:1003/sdd/0/a/c/oè policy#0: Timeout (Nones) object-reconstructor ERROR: Trying to GET 10.0.0.9:1009/sdj/0/a/c/oè policy#0: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/obj/reconstructor.py", line 392, in _get_response conn = http_connect( node['replication_ip'], node['replication_port'], node['device'], partition, 'GET', path, headers=headers) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! object-reconstructor DEBUG: Reconstruct frag #10 with frag indexes [0, 1, 2, 4, 6, 7, 8, 11, 12, 13] object-reconstructor INFO: Nothing reconstructed for 9.775161743164062e-06 seconds. object-reconstructor INFO: Nothing reconstructed for 1.0728836059570312e-05 seconds. proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.4:1004/sde, error: ERROR Insufficient Storage (txn: tx17bf4b5de15c4498b21f5-0068c570a9) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.7:1007/sdh, error: ERROR Insufficient Storage (txn: txfba92af891ae4a2787aa9-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.5:1005/sdf, error: ERROR Insufficient Storage (txn: txfba92af891ae4a2787aa9-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.12:1012/sdm, error: ERROR Insufficient Storage (txn: txfba92af891ae4a2787aa9-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.1:1001/sdb, error: ERROR Insufficient Storage (txn: txfba92af891ae4a2787aa9-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.3:1003/sdd, error: ERROR Insufficient Storage (txn: txfba92af891ae4a2787aa9-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.8:1008/sdi, error: ERROR Insufficient Storage (txn: txfba92af891ae4a2787aa9-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.6:1006/sdg, error: ERROR Insufficient Storage (txn: txfba92af891ae4a2787aa9-0068c570a9) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.7:1007/sdh, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.0:1000/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.8:1008/sdi, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9)test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_insufficient_found_plus_404_507_and_handoffs_fail test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_insufficient_found_plus_404_507_and_handoffs_fail ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_insufficient_found_plus_507_and_handoffs_fail test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_insufficient_found_plus_507_and_handoffs_fail ... ok proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:38611/sdl1, error: ERROR Insufficient Storage (txn: txdb28321994ea4acf85e80-0068c570a9) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdi1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txdb28321994ea4acf85e80-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:35143/sdi1, error: ERROR Insufficient Storage (txn: txdb28321994ea4acf85e80-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:35143/sdi1 (txn: txdb28321994ea4acf85e80-0068c570a9) obj4 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdj1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txdb28321994ea4acf85e80-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:33255/sdj1, error: ERROR Insufficient Storage (txn: txdb28321994ea4acf85e80-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:33255/sdj1 (txn: txdb28321994ea4acf85e80-0068c570a9) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdh1/2/a/ec-dup-crazytown/obj" 507 6 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txdb28321994ea4acf85e80-0068c570a9" "proxy-server 1824498" 0.0001 "-" 1824498 4 proxy ERROR: Node will be error limited for 60.00s: 127.0.0.1:37375/sdh1, error: ERROR Insufficient Storage (txn: txdb28321994ea4acf85e80-0068c570a9) proxy DEBUG: Node is error limited: 127.0.0.1:37375/sdh1 (txn: txdb28321994ea4acf85e80-0068c570a9) obj5 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdk1/2/a/ec-dup-crazytown/obj" 200 88 "GET http://localhost/v1/a/ec-dup-crazytown/obj" "txdb28321994ea4acf85e80-0068c570a9" "proxy-server 1824498" 0.0007 "-" 1824498 4 proxy ERROR: Object returning 503 for [] (txn: txdb28321994ea4acf85e80-0068c570a9) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) obj-ut DEBUG: Labeled statsd mode: disabled (obj-ut) obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx0d43cbcdc1e4446b939a6-0068c570a9) obj-ut INFO: - - - [13/Sep/2025:13:24:57 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "tx0d43cbcdc1e4446b939a6-0068c570a9" "proxy-server 1824498" 0.0069 "-" 1824498 0 proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txba7c3f1391824a15a247c-0068c570a9) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: txba7c3f1391824a15a247c-0068c570a9) proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx395722ccdee64005ac8a2-0068c570a9) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx395722ccdee64005ac8a2-0068c570a9) obj-ut INFO: - - - [13/Sep/2025:13:24:57 +0000] "GET /sda/0/a/c/o" 200 1 "GET http://localhost/v1/a/c/o" "tx395722ccdee64005ac8a2-0068c570a9" "proxy-server 1824498" 0.0048 "-" 1824498 0 proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx395722ccdee64005ac8a2-0068c570a9) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) obj-ut DEBUG: Labeled statsd mode: disabled (obj-ut) obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx4f5525fe23bf46d987313-0068c570a9) obj-ut INFO: - - - [13/Sep/2025:13:24:57 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "tx4f5525fe23bf46d987313-0068c570a9" "proxy-server 1824498" 0.0070 "-" 1824498 0 proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx08ba30251ea1469b9ba71-0068c570a9) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx08ba30251ea1469b9ba71-0068c570a9) proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txbdad564bf79b41edb690c-0068c570a9) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: txbdad564bf79b41edb690c-0068c570a9) obj-ut INFO: - - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda/0/a/c/o" 200 1 "HEAD http://localhost/v1/a/c/o" "txbdad564bf79b41edb690c-0068c570a9" "proxy-server 1824498" 0.0005 "-" 1824498 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_sysmeta_not_updated_by_POST test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_sysmeta_not_updated_by_POST ... ok proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.1:1001/sdb, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.6:1006/sdg, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.11:1011/sdl, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.14:1014/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.15:1015/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.16:1016/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.17:1017/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.18:1018/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.19:1019/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.20:1020/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.21:1021/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.22:1022/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.23:1023/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.24:1024/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.25:1025/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.26:1026/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.27:1027/sda, error: ERROR Insufficient Storage (txn: txc51a9e6926854163b40b8-0068c570a9) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.5:1005/sdf, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.3:1003/sdd, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.11:1011/sdl, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.7:1007/sdh, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.8:1008/sdi, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.12:1012/sdm, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.9:1009/sdj, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.14:1014/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.15:1015/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.16:1016/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.17:1017/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.18:1018/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.19:1019/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.20:1020/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.21:1021/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.22:1022/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.23:1023/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.24:1024/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.25:1025/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.26:1026/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.27:1027/sda, error: ERROR Insufficient Storage (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server ERROR: Object DELETE returning 503 for (204, 204, 204, 204, 204, 204, 503, 503, 503, 503, 503, 503, 503, 503) (txn: tx77e49095a5dd48cca8af6-0068c570a9) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: tx325504b55f334c78a2b34-0068c570a9) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: tx325504b55f334c78a2b34-0068c570a9) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: tx325504b55f334c78a2b34-0068c570a9) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: tx325504b55f334c78a2b34-0068c570a9) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: tx325504b55f334c78a2b34-0068c570a9) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: tx325504b55f334c78a2b34-0068c570a9) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: tx325504b55f334c78a2b34-0068c570a9)test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_sysmeta_replaced_by_PUT test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_sysmeta_replaced_by_PUT ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_insufficient_found_plus_timeouts test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_insufficient_found_plus_timeouts ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_limits_expirer_queue_updates test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_limits_expirer_queue_updates ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_missing_one test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_missing_one ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_mostly_found test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_mostly_found ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_mostly_not_found test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_mostly_not_found ... ok test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_sysmeta_updated_by_COPY test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_sysmeta_updated_by_COPY ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_none_found test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_none_found ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx88f99040c7634b2ab029c-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx88f99040c7634b2ab029c-0068c570a9" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx88f99040c7634b2ab029c-0068c570a9" "proxy-server 1824535" 0.0254 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx88f99040c7634b2ab029c-0068c570a9" "proxy-server 1824535" 0.0251 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - - t 5 - - tx88f99040c7634b2ab029c-0068c570a9 - 0.0299 - - 1757769897.738948107 1757769897.768799782 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3bb4d78da0b146d3a82b5-0068c570a9" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txa25d39693b2147a1b06dd-0068c570a9" "proxy-server 1824535" 0.0064 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx68dbffb9247a4ea6aeee3-0068c570a9" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 200 - - t - 5 - tx68dbffb9247a4ea6aeee3-0068c570a9 - 0.0375 - - 1757769897.770311356 1757769897.807762861 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx674bce2843884b52971c4-0068c570a9" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx674bce2843884b52971c4-0068c570a9 - 0.0081 VW - 1757769897.819718838 1757769897.827811956 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx9bfd8e8ab42b43f982366-0068c570a9" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx9bfd8e8ab42b43f982366-0068c570a9 - 0.0121 VW - 1757769897.828342676 1757769897.840479851 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx7a3ecdcdc54845aa9a1f9-0068c570a9" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx7a3ecdcdc54845aa9a1f9-0068c570a9" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/0/a/1_vc_ascii" 204 - "HEAD http://localhost/v1/a/1_vc_ascii" "tx9a77764b18294458b6ced-0068c570a9" "proxy-server 1824535" 0.0063 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx7a3ecdcdc54845aa9a1f9-0068c570a9 - 0.0360 VW - 1757769897.841087818 1757769897.877134562 0 - (txn: txd20a18a3bbf9460dada3b-0068c570a9) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 201 - "PUT http://localhost/sdb1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" "txd20a18a3bbf9460dada3b-0068c570a9" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 201 - "PUT http://localhost/sda1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" "txd20a18a3bbf9460dada3b-0068c570a9" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.73953" "txd20a18a3bbf9460dada3b-0068c570a9" "proxy-server 1824535" 0.0127 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.73953" "txd20a18a3bbf9460dada3b-0068c570a9" "proxy-server 1824535" 0.0124 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/57 PUT /v1/a/1_vc_ascii/0091_o_ascii/1757769897.73953 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 txd20a18a3bbf9460dada3b-0068c570a9 - 0.0338 VW - 1757769897.855705738 1757769897.889552832 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txd70737419b8b4bcd80908-0068c570a9" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txd70737419b8b4bcd80908-0068c570a9" "proxy-server 1824535" 0.0201 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txd70737419b8b4bcd80908-0068c570a9" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txd70737419b8b4bcd80908-0068c570a9" "proxy-server 1824535" 0.0220 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - - t 5 - - txd70737419b8b4bcd80908-0068c570a9 - 0.0386 - - 1757769897.889949799 1757769897.928505659 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx345ce754b6ec47769e917-0068c570a9" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txa58a94378ac948008e1db-0068c570a9" "proxy-server 1824535" 0.0074 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx44022faa21bc42f5aa6e6-0068c570a9" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 200 - - t - 5 - tx44022faa21bc42f5aa6e6-0068c570a9 - 0.0332 - - 1757769897.929987907 1757769897.963217497 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa87ff24ad5654d80b1982-0068c570a9" "proxy-server 1824535" 0.0055 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "GET /sdb1/0/a/1_vc_ascii" 200 362 "GET http://localhost/v1/a/1_vc_ascii?format=json&states=listing" "txa87ff24ad5654d80b1982-0068c570a9" "proxy-server 1824535" 0.0098 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/57 GET /v1/a/1_vc_ascii%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 362 - txa87ff24ad5654d80b1982-0068c570a9 - 0.0253 - - 1757769897.964899302 1757769897.990228176 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:57 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txef87d3c32f1749e59ac38-0068c570a9" "proxy-server 1824535" 0.0062 "-" 1824535 -test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_one_found test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_one_found ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_simple test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_simple ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_shard_ranges_state test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_shard_ranges_state ... ok test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_sysmeta_updated_by_COPY_from test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_sysmeta_updated_by_COPY_from ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_write_affinity_after_replication test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_write_affinity_after_replication ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_write_affinity_before_replication test.unit.proxy.controllers.test_obj.TestECObjController.test_DELETE_write_affinity_before_replication ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_newid test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_newid ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_all_primaries_error_limited test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_all_primaries_error_limited ... ok obj-ut DEBUG: Labeled statsd mode: disabled (obj-ut) obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx8333ae1f4b8b435c826b4-0068c570a9) obj-ut INFO: - - - [13/Sep/2025:13:24:57 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "tx8333ae1f4b8b435c826b4-0068c570a9" "proxy-server 1824498" 0.0084 "-" 1824498 0 obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx70a92e297a664f9aa293b-0068c570a9) obj-ut INFO: - - - [13/Sep/2025:13:24:57 +0000] "POST /sda/0/a/c/o" 202 76 "POST http://localhost/v1/a/c/o" "tx70a92e297a664f9aa293b-0068c570a9" "proxy-server 1824498" 0.0069 "-" 1824498 0 obj-ut INFO: - - - [13/Sep/2025:13:24:57 +0000] "GET /sda/0/a/c/o" 200 1 "GET http://localhost/v1/a/c/o" "tx2bed27db85ab444d89ea6-0068c570a9" "proxy-server 1824498" 0.0007 "-" 1824498 0 obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx8ef4d8db728d4576b99d3-0068c570a9) obj-ut INFO: - - - [13/Sep/2025:13:24:57 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "tx8ef4d8db728d4576b99d3-0068c570a9" "proxy-server 1824498" 0.0047 "-" 1824498 0 proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx8ef4d8db728d4576b99d3-0068c570a9) obj-ut INFO: - - - [13/Sep/2025:13:24:57 +0000] "GET /sda/0/a/c/o" 200 1 "GET http://localhost/v1/a/c/o" "txc570101f6ddd4e7aa2002-0068c570a9" "proxy-server 1824498" 0.0047 "-" 1824498 0 proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txc570101f6ddd4e7aa2002-0068c570a9) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) obj-ut DEBUG: Labeled statsd mode: disabled (obj-ut) obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx6bea3496f5a44f41b80cc-0068c570a9) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "tx6bea3496f5a44f41b80cc-0068c570a9" "proxy-server 1824498" 0.0070 "-" 1824498 0 obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx0b38aa17c8324ae2b8b7e-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "tx0b38aa17c8324ae2b8b7e-0068c570aa" "proxy-server 1824498" 0.0068 "-" 1824498 0 obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "GET /sda/0/a/c/o" 200 1 "GET http://localhost/v1/a/c/o" "txe00a3b99bebd47f38919f-0068c570aa" "proxy-server 1824498" 0.0006 "-" 1824498 0 proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txe00a3b99bebd47f38919f-0068c570aa) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) obj-ut DEBUG: Labeled statsd mode: disabled (obj-ut) obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: txc67037bd9fc54e1f8374c-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "txc67037bd9fc54e1f8374c-0068c570aa" "proxy-server 1824498" 0.0036 "-" 1824498 0 obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "GET /sda/0/a/c/o" 200 1 "GET http://localhost/v1/a/c/o" "tx8505affe0921450eaae55-0068c570aa" "proxy-server 1824498" 0.0006 "-" 1824498 0 obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: txf283bfe5a5174799a803d-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "PUT /sda/0/a/c/o2" 201 - "PUT http://localhost/v1/a/c/o2" "txf283bfe5a5174799a803d-0068c570aa" "proxy-server 1824498" 0.0023 "-" 1824498 0 obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "GET /sda/0/a/c/o2" 200 1 "GET http://localhost/v1/a/c/o2" "txce3933c2a4f5426f88349-0068c570aa" "proxy-server 1824498" 0.0007 "-" 1824498 0 proxy-ut INFO: Client disconnected on read of '/a/c/o2' (txn: txce3933c2a4f5426f88349-0068c570aa) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) obj-ut DEBUG: Labeled statsd mode: disabled (obj-ut) obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx1c1c0cf152904ece83f02-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "tx1c1c0cf152904ece83f02-0068c570aa" "proxy-server 1824498" 0.0078 "-" 1824498 0 obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "GET /sda/0/a/c/o" 200 1 "GET http://localhost/v1/a/c/o" "txb052915d4bc84e01ac4e4-0068c570aa" "proxy-server 1824498" 0.0006 "-" 1824498 0 obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx2b6c48e826454ac89020f-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "PUT /sda/0/a/c/o2" 201 - "PUT http://localhost/v1/a/c/o2" "tx2b6c48e826454ac89020f-0068c570aa" "proxy-server 1824498" 0.0023 "-" 1824498 0 obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "GET /sda/0/a/c/o2" 200 1 "GET http://localhost/v1/a/c/o2" "tx55b2d1fb65aa4cf499ee1-0068c570aa" "proxy-server 1824498" 0.0006 "-" 1824498 0 proxy-ut INFO: Client disconnected on read of '/a/c/o2' (txn: tx55b2d1fb65aa4cf499ee1-0068c570aa) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) obj-ut DEBUG: Labeled statsd mode: disabled (obj-ut) obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx65ef549d1f4e412fb55ac-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "tx65ef549d1f4e412fb55ac-0068c570aa" "proxy-server 1824498" 0.0024 "-" 1824498 0 proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx2c09bc9ae9f244a2a56cb-0068c570aa) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx2c09bc9ae9f244a2a56cb-0068c570aa) proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx17b0bff364744361b1b6e-0068c570aa)test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_transient_sysmeta_replaced_by_PUT_or_POST test.unit.proxy.test_sysmeta.TestObjectSysmeta.test_transient_sysmeta_replaced_by_PUT_or_POST ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_object_stats_old_style_root_container test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_object_stats_old_style_root_container ... ok proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to DELETE /a/c/o: Timeout (Nones) (txn: tx325504b55f334c78a2b34-0068c570a9) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Node is error limited: 10.0.0.6:1006/sdg (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.7:1007/sdh (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.3:1003/sdd (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.12:1012/sdm (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.11:1011/sdl (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.8:1008/sdi (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.5:1005/sdf (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.4:1004/sde (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.9:1009/sdj (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.10:1010/sdk (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.13:1013/sdn (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server ERROR: Object returning 503 for [] (txn: tx669d2a594a124131bbba5-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 10.0.0.9:1009/sdj (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 10.0.0.0:1000/sda (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 10.0.0.4:1004/sde (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 10.0.0.10:1010/sdk (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_disconnect test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_disconnect ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_error test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_error ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_object_stats_old_style_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_object_stats_old_style_shard_container ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txbd93b5804ea247f4ba20b-0068c570aa" "proxy-server 1824535" 0.0095 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx596f4c712b504f0c9432a-0068c570aa" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx596f4c712b504f0c9432a-0068c570aa" "proxy-server 1824535" 0.0006 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5b1b950aad35425a9631e-0068c570aa" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx5b1b950aad35425a9631e-0068c570aa - 0.0085 VW - 1757769898.042968988 1757769898.051425695 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx42dde0e4b1f74209a0036-0068c570aa" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx42dde0e4b1f74209a0036-0068c570aa - 0.0122 VW - 1757769898.051966190 1757769898.064205647 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/3/a/1_oc_non_ascii%C2%A3/copied_name" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/copied_name?symlink=get" "txd2eabf20649641108803d-0068c570aa" "proxy-server 1824535" 0.0044 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/3/a/1_oc_non_ascii%C2%A3/copied_name" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/copied_name?symlink=get" "txd2eabf20649641108803d-0068c570aa" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3/copied_name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txd2eabf20649641108803d-0068c570aa - 0.0094 VW - 1757769898.064842701 1757769898.074199438 0 - proxy INFO: - - 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 200 - Swift t - 5 - tx596f4c712b504f0c9432a-0068c570aa - 0.0953 SSC - 1757769897.992198467 1757769898.087457180 0 - (txn: txb28688d14f41417c8bc24-0068c570aa) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/sdb1/3/a/1_oc_non_ascii%C2%A3/copied_name" "txb28688d14f41417c8bc24-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/sda1/3/a/1_oc_non_ascii%C2%A3/copied_name" "txb28688d14f41417c8bc24-0068c570aa" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/3/a/1_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/copied_name" "txb28688d14f41417c8bc24-0068c570aa" "proxy-server 1824535" 0.0168 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/3/a/1_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/copied_name" "txb28688d14f41417c8bc24-0068c570aa" "proxy-server 1824535" 0.0182 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 COPY /v1/a/1_oc_non_ascii%25C2%25A3/copied_name HTTP/1.0 201 - - t 5 - db7282901da891bea2fcd73840caad1c txb28688d14f41417c8bc24-0068c570aa - 0.0263 SSC - 1757769898.074570656 1757769898.100849628 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx46dcfa3c8fbe407591d6b-0068c570aa" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx4dbe2c58079140fb8dbaa-0068c570aa" "proxy-server 1824535" 0.0078 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/3/a/1_oc_non_ascii%C2%A3/copied_name" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/copied_name" "txf1de1a14af6a49bf8888f-0068c570aa" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3/copied_name HTTP/1.0 200 - - t - 5 - txf1de1a14af6a49bf8888f-0068c570aa - 0.0311 - - 1757769898.102375269 1757769898.133516550 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe79ce1b025364bf590a21-0068c570aa" "proxy-server 1824535" 0.0012 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txc88bfc6327e349f5b7d6b-0068c570aa" "proxy-server 1824535" 0.0014 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "POST http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txa2a578e03d444a20aa7ac-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "POST http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txa2a578e03d444a20aa7ac-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "POST /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 202 76 "POST http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txa2a578e03d444a20aa7ac-0068c570aa" "proxy-server 1824535" 0.0174 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "POST /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 202 76 "POST http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txa2a578e03d444a20aa7ac-0068c570aa" "proxy-server 1824535" 0.0232 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 POST /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 202 - - t - 76 - txa2a578e03d444a20aa7ac-0068c570aa - 0.0432 - - 1757769898.139366865 1757769898.182550192 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfbda70616633459abaac5-0068c570aa" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx48d1b1424ad74670a02c2-0068c570aa" "proxy-server 1824535" 0.0069 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx7a8dd1ed462a463fb30b0-0068c570aa" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 200 - - t - 5 - tx7a8dd1ed462a463fb30b0-0068c570aa - 0.0219 - - 1757769898.188329697 1757769898.210274220 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc382e0815330495bb3f39-0068c570aa" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/2/a/1_oc_non_ascii%C2%A3" 200 316 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3?format=json&states=listing" "txc382e0815330495bb3f39-0068c570aa" "proxy-server 1824535" 0.0066 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 316 - txc382e0815330495bb3f39-0068c570aa - 0.0181 - - 1757769898.216071367 1757769898.234201431 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd5f72cfbd3804c9ea7e9a-0068c570aa" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txd5f72cfbd3804c9ea7e9a-0068c570aa - 0.0082 VW - 1757769898.240285873 1757769898.248523712 - -test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_if_match test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_if_match ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_object_stats_root_container test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_object_stats_root_container ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_object_stats_shard_container test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_object_stats_shard_container ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_if_none_match test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_if_none_match ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_old_style_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_old_style_root_account_container_path ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_mismatched_fragment_archives test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_mismatched_fragment_archives ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txf0d87974525d4e4ea434e-0068c570aa" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txf0d87974525d4e4ea434e-0068c570aa - 0.0082 VW - 1757769898.254365206 1757769898.262564421 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/0/a/1_vc_ascii" 200 362 "GET http://localhost/v1/a/1_vc_ascii?prefix=0091_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "txa611cd51e208476baf1ec-0068c570aa" "proxy-server 1824535" 0.0144 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 GET /v1/a/1_vc_ascii%3Fprefix%3D0091_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 362 - txa611cd51e208476baf1ec-0068c570aa - 0.0177 VW - 1757769898.271330357 1757769898.289007425 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 200 5 "GET http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.73953?symlink=get" "tx52d8c85c2af14b1db4b08-0068c570aa" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 200 5 "GET http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.73953?symlink=get" "tx52d8c85c2af14b1db4b08-0068c570aa" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 GET /v1/a/1_vc_ascii/0091_o_ascii/1757769897.73953%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx52d8c85c2af14b1db4b08-0068c570aa - 0.0407 VW - 1757769898.289492130 1757769898.330210924 0 - (txn: txa211d89ec27e4cacadda6-0068c570aa) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txa211d89ec27e4cacadda6-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txa211d89ec27e4cacadda6-0068c570aa" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txa211d89ec27e4cacadda6-0068c570aa" "proxy-server 1824535" 0.0268 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txa211d89ec27e4cacadda6-0068c570aa" "proxy-server 1824535" 0.0288 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 txa211d89ec27e4cacadda6-0068c570aa - 0.0412 VW - 1757769898.316527843 1757769898.357685566 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sda1/0/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 204 - "DELETE http://localhost/sdb1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" "txd82cefb4fdca47d3a3a29-0068c570aa" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sdb1/0/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 204 - "DELETE http://localhost/sda1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" "txd82cefb4fdca47d3a3a29-0068c570aa" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sdb1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 204 - "DELETE http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.73953" "txd82cefb4fdca47d3a3a29-0068c570aa" "proxy-server 1824535" 0.0118 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sda1/2/a/1_vc_ascii/0091_o_ascii/1757769897.73953" 204 - "DELETE http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.73953" "txd82cefb4fdca47d3a3a29-0068c570aa" "proxy-server 1824535" 0.0062 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 DELETE /v1/a/1_vc_ascii/0091_o_ascii/1757769897.73953 HTTP/1.0 204 - Swift - - - - txd82cefb4fdca47d3a3a29-0068c570aa - 0.0200 VW - 1757769898.358212948 1757769898.378168821 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx550f8e01184d44d992832-0068c570aa" "proxy-server 1824535" 0.0056 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx0b63da38e0a14ade8a351-0068c570aa" "proxy-server 1824535" 0.0073 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx2b619d52ee75473f9d3c2-0068c570aa" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 200 - - t - 5 - tx2b619d52ee75473f9d3c2-0068c570aa - 0.0345 - - 1757769898.384042740 1757769898.418563366 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx02294f13924b49cb969ff-0068c570aa" "proxy-server 1824535" 0.0056 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/0/a/1_vc_ascii" 200 181 "GET http://localhost/v1/a/1_vc_ascii?prefix=0091_o_ascii%2F&format=json&states=listing" "tx02294f13924b49cb969ff-0068c570aa" "proxy-server 1824535" 0.0079 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 GET /v1/a/1_vc_ascii%3Fprefix%3D0091_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 181 - tx02294f13924b49cb969ff-0068c570aa - 0.0240 - - 1757769898.424500942 1757769898.448488951 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx19749b45d1ca465fbfab4-0068c570aa" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx19749b45d1ca465fbfab4-0068c570aa - 0.0125 VW - 1757769898.450393200 1757769898.462889433 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx95aae5f653634414afe52-0068c570aa" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx95aae5f653634414afe52-0068c570aa - 0.0084 VW - 1757769898.463517904 1757769898.471961021 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/0/a/1_vc_ascii" 200 181 "GET http://localhost/v1/a/1_vc_ascii?prefix=0091_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "tx827e4fa2091f4b4d83549-0068c570aa" "proxy-server 1824535" 0.0080 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 GET /v1/a/1_vc_ascii%3Fprefix%3D0091_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 181 - tx827e4fa2091f4b4d83549-0068c570aa - 0.0114 VW - 1757769898.472563028 1757769898.483948231 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 200 5 "GET http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.62281?symlink=get" "tx1789855d558243039689f-0068c570aa" "proxy-server 1824535" 0.0048 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 200 5 "GET http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.62281?symlink=get" "tx1789855d558243039689f-0068c570aa" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 GET /v1/a/1_vc_ascii/0091_o_ascii/1757769897.62281%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx1789855d558243039689f-0068c570aa - 0.0247 VW - 1757769898.484454393 1757769898.509130239 0 - (txn: txe91285110d8742cd85af0-0068c570aa) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txe91285110d8742cd85af0-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txe3efca82fcc041abaf141-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 503 Trying to GET /a/c/o From Object Server 10.0.0.9:1009/sdj (txn: txe06749b366d246e191b12-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: tx9dcd138b194647f686f41-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txb714d88c3fb44cce9dc59-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Error decoding fragments for '/a/c/o'. Segments decoded: 3, Lengths: [458, 490, 458, 458, 458, 458, 458, 458, 458, 458]: Invalid fragment payload in ECPyECLibDriver.decode (txn: tx671a132315a84d88b4660-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_mixed_ranged_responses_success test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_mixed_ranged_responses_success ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_mixed_success_with_range test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_mixed_success_with_range ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_ndata_equals_nparity_with_missing_and_errors test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_ndata_equals_nparity_with_missing_and_errors ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_overlap_shard_range_order test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_overlap_shard_range_order ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_no_response_error test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_no_response_error ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_path test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_path ... ok proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0b8e7d13e21246c18fe8a-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0b8e7d13e21246c18fe8a-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0b8e7d13e21246c18fe8a-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 412 from primary (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 412 from primary (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe6cc79a7db5e40848841e-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.14:1014/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.15:1015/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.16:1016/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.17:1017/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.18:1018/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.19:1019/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.20:1020/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.21:1021/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.22:1022/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.23:1023/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.24:1024/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.25:1025/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.26:1026/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.27:1027/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server ERROR: Object returning 503 for [] (txn: txc6e0ba94f92f4b6c8f3fc-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Node is error limited: 10.0.0.13:1013/sdn (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.12:1012/sdm (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.11:1011/sdl (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.14:1014/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.15:1015/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.16:1016/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_nondurable_when_node_iter_runs_out_of_nodes test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_nondurable_when_node_iter_runs_out_of_nodes ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_pending_file_name test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_pending_file_name ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_not_found_when_404_newer test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_not_found_when_404_newer ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_one_short_fragment_archive test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_one_short_fragment_archive ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_policy_stat_tracking test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_policy_stat_tracking ... ok proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx17b0bff364744361b1b6e-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "GET /sda/0/a/c/o" 200 1 "GET http://localhost/v1/a/c/o" "tx17b0bff364744361b1b6e-0068c570aa" "proxy-server 1824498" 0.0006 "-" 1824498 0 proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx17b0bff364744361b1b6e-0068c570aa) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx17b0bff364744361b1b6e-0068c570aa) proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx17b0bff364744361b1b6e-0068c570aa) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx17b0bff364744361b1b6e-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda/0/a/c/o" 200 1 "HEAD http://localhost/v1/a/c/o" "tx17b0bff364744361b1b6e-0068c570aa" "proxy-server 1824498" 0.0005 "-" 1824498 0 obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx16755a01a8ad4190ba315-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "POST /sda/0/a/c/o" 202 76 "POST http://localhost/v1/a/c/o" "tx16755a01a8ad4190ba315-0068c570aa" "proxy-server 1824498" 0.0023 "-" 1824498 0 proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx16755a01a8ad4190ba315-0068c570aa) proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx2a04d1064c5c4621a428b-0068c570aa) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx2a04d1064c5c4621a428b-0068c570aa) proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txab46051339bc4b5789f03-0068c570aa) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: txab46051339bc4b5789f03-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "GET /sda/0/a/c/o" 200 1 "GET http://localhost/v1/a/c/o" "txab46051339bc4b5789f03-0068c570aa" "proxy-server 1824498" 0.0007 "-" 1824498 0 proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txab46051339bc4b5789f03-0068c570aa) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: txab46051339bc4b5789f03-0068c570aa) proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_sysmeta.py", line 102, in http_connect resp = func(ipaddr, port, device, partition, method, path, headers=headers, query_string=query_string) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: txab46051339bc4b5789f03-0068c570aa) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: txab46051339bc4b5789f03-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda/0/a/c/o" 200 1 "HEAD http://localhost/v1/a/c/o" "txab46051339bc4b5789f03-0068c570aa" "proxy-server 1824498" 0.0047 "-" 1824498 0 obj-ut ERROR: ERROR container update failed with 10.0.0.0:1000/sda (saving for async update later): Network unreachable (txn: tx1a839fbaf14548db95065-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "PUT /sda/0/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "tx1a839fbaf14548db95065-0068c570aa" "proxy-server 1824498" 0.0075 "-" 1824498 0 proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx1a839fbaf14548db95065-0068c570aa) obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "GET /sda/0/a/c/o" 200 1 "GET http://localhost/v1/a/c/o" "txe169b0991e78464e95bbe-0068c570aa" "proxy-server 1824498" 0.0048 "-" 1824498 0 obj-ut INFO: - - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda/0/a/c/o" 200 1 "HEAD http://localhost/v1/a/c/o" "txe169b0991e78464e95bbe-0068c570aa" "proxy-server 1824498" 0.0005 "-" 1824498 0 proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txe169b0991e78464e95bbe-0068c570aa) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txe91285110d8742cd85af0-0068c570aa" "proxy-server 1824535" 0.0205 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txe91285110d8742cd85af0-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txe91285110d8742cd85af0-0068c570aa" "proxy-server 1824535" 0.0236 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txe91285110d8742cd85af0-0068c570aa - 0.0329 VW - 1757769898.499610662 1757769898.532531023 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sda1/0/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 204 - "DELETE http://localhost/sda1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" "tx417eeac6cd1e4f00ad660-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sda1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 204 - "DELETE http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.62281" "tx417eeac6cd1e4f00ad660-0068c570aa" "proxy-server 1824535" 0.0087 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sdb1/0/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 204 - "DELETE http://localhost/sdb1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" "tx417eeac6cd1e4f00ad660-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sdb1/3/a/1_vc_ascii/0091_o_ascii/1757769897.62281" 204 - "DELETE http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769897.62281" "tx417eeac6cd1e4f00ad660-0068c570aa" "proxy-server 1824535" 0.0155 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 DELETE /v1/a/1_vc_ascii/0091_o_ascii/1757769897.62281 HTTP/1.0 204 - Swift - - - - tx417eeac6cd1e4f00ad660-0068c570aa - 0.0245 VW - 1757769898.533109665 1757769898.557603598 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd569313d39724a489a482-0068c570aa" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx7184830cc56c4651a78c6-0068c570aa" "proxy-server 1824535" 0.0071 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txe4298607dafa458fb8c59-0068c570aa" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 200 - - t - 5 - txe4298607dafa458fb8c59-0068c570aa - 0.0269 - - 1757769898.559252024 1757769898.586151600 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txac901a3451f84bc48c175-0068c570aa" "proxy-server 1824535" 0.0056 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/0/a/1_vc_ascii" 200 2 "GET http://localhost/v1/a/1_vc_ascii?prefix=0091_o_ascii%2F&format=json&states=listing" "txac901a3451f84bc48c175-0068c570aa" "proxy-server 1824535" 0.0076 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 GET /v1/a/1_vc_ascii%3Fprefix%3D0091_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - txac901a3451f84bc48c175-0068c570aa - 0.0195 - - 1757769898.592111588 1757769898.611598730 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx491116e420d543c9b3dc6-0068c570aa" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/0/a/1_vc_ascii" 200 2 "GET http://localhost/v1/a/1_vc_ascii?prefix=0091_o_ascii%2F&format=json&states=listing" "tx491116e420d543c9b3dc6-0068c570aa" "proxy-server 1824535" 0.0178 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 GET /v1/a/1_vc_ascii%3Fprefix%3D0091_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx491116e420d543c9b3dc6-0068c570aa - 0.0419 - - 1757769898.613525867 1757769898.655447960 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx54654ead8ad6434c95d29-0068c570aa" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx54654ead8ad6434c95d29-0068c570aa - 0.0087 VW - 1757769898.657568455 1757769898.666220903 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx6384629f63bb41bca889f-0068c570aa" "proxy-server 1824535" 0.0028 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx6384629f63bb41bca889f-0068c570aa - 0.0058 VW - 1757769898.670933247 1757769898.676744699 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/0/a/1_vc_ascii" 200 2 "GET http://localhost/v1/a/1_vc_ascii?prefix=0091_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "txbcdc263c032b4ac1acc05-0068c570aa" "proxy-server 1824535" 0.0024 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 GET /v1/a/1_vc_ascii%3Fprefix%3D0091_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 2 - txbcdc263c032b4ac1acc05-0068c570aa - 0.0223 VW - 1757769898.677327394 1757769898.699596882 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 204 - "DELETE http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txc30543b32d1d445a8ea1f-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 204 - "DELETE http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txc30543b32d1d445a8ea1f-0068c570aa" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 204 - "DELETE http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txc30543b32d1d445a8ea1f-0068c570aa" "proxy-server 1824535" 0.0289 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "DELETE /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 204 - "DELETE http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txc30543b32d1d445a8ea1f-0068c570aa" "proxy-server 1824535" 0.0204 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 DELETE /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 204 - - t - - - txc30543b32d1d445a8ea1f-0068c570aa - 0.0333 - - 1757769898.700056553 1757769898.733368874 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txaf4e70e06b114e00a7b8c-0068c570aa" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txe7da68e18a8a49cf86595-0068c570aa" "proxy-server 1824535" 0.0101 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txd6a6cda0eca74888b914c-0068c570aa" "proxy-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txd6a6cda0eca74888b914c-0068c570aa" "proxy-server 1824535" 0.0005 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 404 - - t - 70 - txd6a6cda0eca74888b914c-0068c570aa - 0.0482 - - 1757769898.743274212 1757769898.791430712 0 -test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_misplaced_object_does_not_effect_container_stats test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_misplaced_object_does_not_effect_container_stats ... ok proxy-server DEBUG: Node is error limited: 10.0.0.17:1017/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.18:1018/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.19:1019/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.20:1020/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.21:1021/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.22:1022/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.23:1023/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.24:1024/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.25:1025/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.26:1026/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Node is error limited: 10.0.0.27:1027/sda (txn: tx54047ec33fc74d5fa0924-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txe339914022994a26b197f-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server WARNING: Un-recoverable fragment rebuild. Only received 9/10 fragments for '/a/c/o' (txn: tx26f512ca5c61467e84242-0068c570aa) proxy-server WARNING: Un-recoverable fragment rebuild. Only received 9/10 fragments for '/a/c/o' (txn: tx2594d30e188344d280489-0068c570aa) proxy-server WARNING: Un-recoverable fragment rebuild. Only received 9/10 fragments for '/a/c/o' (txn: tx6cfef30df5304a28ac165-0068c570aa) proxy-server WARNING: Un-recoverable fragment rebuild. Only received 9/10 fragments for '/a/c/o' (txn: tx0e630c140d4745a999905-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa)test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object_multiple_encoded_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object_multiple_encoded_timestamps_using_file ... ok proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa)test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object_multiple_encoded_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object_multiple_encoded_timestamps_using_memory ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa598c8a4f9c348da8b529-0068c570aa" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa598c8a4f9c348da8b529-0068c570aa - 0.0083 VW - 1757769898.807804585 1757769898.816090345 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx2d734ff7d6da4f54a18ae-0068c570aa" "proxy-server 1824535" 0.0055 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx2d734ff7d6da4f54a18ae-0068c570aa - 0.0083 VW - 1757769898.816635609 1757769898.824974060 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx75c711a2464c44cc8498b-0068c570aa" "proxy-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx75c711a2464c44cc8498b-0068c570aa" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx75c711a2464c44cc8498b-0068c570aa - 0.0143 VW - 1757769898.825560093 1757769898.839830875 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txfe8363f06fb641b1aca39-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txfe8363f06fb641b1aca39-0068c570aa" "proxy-server 1824535" 0.0051 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txfe8363f06fb641b1aca39-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txfe8363f06fb641b1aca39-0068c570aa" "proxy-server 1824535" 0.0147 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/58 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - - t - - - txfe8363f06fb641b1aca39-0068c570aa - 0.0346 - - 1757769898.840244770 1757769898.874858141 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4a7e52bda52a48cf80e8d-0068c570aa" "proxy-server 1824535" 0.0094 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx4a7e52bda52a48cf80e8d-0068c570aa - 0.0124 VW - 1757769898.891863823 1757769898.904247761 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx249b2c5346614b63a7dcc-0068c570aa" "proxy-server 1824535" 0.0110 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx249b2c5346614b63a7dcc-0068c570aa - 0.0180 VW - 1757769898.904849768 1757769898.922876596 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 - "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "txa10655b1487647d6a2862-0068c570aa" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 - "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "txa10655b1487647d6a2862-0068c570aa" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/58 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txa10655b1487647d6a2862-0068c570aa - 0.0234 VW - 1757769898.923531532 1757769898.946882486 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "HEAD /sdb1/0/a/1_vc_ascii" 204 - "HEAD http://localhost/v1/a/1_vc_ascii" "tx709a55d7fa6a4d32b5d5a-0068c570aa" "proxy-server 1824535" 0.0015 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/0/a/1_vc_ascii/0091_o_ascii/1757769898.84080" 201 - "PUT http://localhost/sdb1/1/a/1_vc_ascii/0091_o_ascii/1757769898.84080" "tx6add89440adc44a2aebdf-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/0/a/1_vc_ascii/0091_o_ascii/1757769898.84080" 201 - "PUT http://localhost/sda1/1/a/1_vc_ascii/0091_o_ascii/1757769898.84080" "tx6add89440adc44a2aebdf-0068c570aa" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sdb1/1/a/1_vc_ascii/0091_o_ascii/1757769898.84080" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769898.84080" "tx6add89440adc44a2aebdf-0068c570aa" "proxy-server 1824535" 0.0194 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:58 +0000] "PUT /sda1/1/a/1_vc_ascii/0091_o_ascii/1757769898.84080" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769898.84080" "tx6add89440adc44a2aebdf-0068c570aa" "proxy-server 1824535" 0.0210 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 PUT /v1/a/1_vc_ascii/0091_o_ascii/1757769898.84080 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx6add89440adc44a2aebdf-0068c570aa - 0.0553 VW - 1757769898.947560310 1757769899.002815723 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txf9290776cd434001879fa-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txf9290776cd434001879fa-0068c570ab" "proxy-server 1824535" 0.0055 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txf9290776cd434001879fa-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txf9290776cd434001879fa-0068c570ab" "proxy-server 1824535" 0.0200 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - - t - - - txf9290776cd434001879fa-0068c570ab - 0.0281 - - 1757769899.003369331 1757769899.031424999 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx258fc20d635c4605b3f0d-0068c570ab" "proxy-server 1824535" 0.0057 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx258fc20d635c4605b3f0d-0068c570ab - 0.0086 VW - 1757769899.047827005 1757769899.056456804 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txbacb45dc6c80492a99d07-0068c570ab" "proxy-server 1824535" 0.0034 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txbacb45dc6c80492a99d07-0068c570ab - 0.0144 VW - 1757769899.057055235 1757769899.071489334 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 - "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "txb44cc248f06c4f70bbe32-0068c570ab" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 - "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "txb44cc248f06c4f70bbe32-0068c570ab" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa)test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object_multiple_explicit_timestamps_using_file test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object_multiple_explicit_timestamps_using_file ... ok proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa)test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object_multiple_explicit_timestamps_using_memory test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_put_object_multiple_explicit_timestamps_using_memory ... ok proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_primaries_error_during_rebalance test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_primaries_error_during_rebalance ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reclaim test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reclaim ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_simple test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_simple ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_simple_x_newest test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_simple_x_newest ... ok proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txb44cc248f06c4f70bbe32-0068c570ab - 0.0151 VW - 1757769899.072126389 1757769899.087255478 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/0/a/1_vc_ascii" 204 - "HEAD http://localhost/v1/a/1_vc_ascii" "tx9eaa4402bff745d8bd473-0068c570ab" "proxy-server 1824535" 0.0069 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/0/a/1_vc_ascii/0091_o_ascii/1757769899.00400" 201 - "PUT http://localhost/sda1/2/a/1_vc_ascii/0091_o_ascii/1757769899.00400" "txbee127bee0d2418ca4475-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_vc_ascii/0091_o_ascii/1757769899.00400" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.00400" "txbee127bee0d2418ca4475-0068c570ab" "proxy-server 1824535" 0.0121 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/0/a/1_vc_ascii/0091_o_ascii/1757769899.00400" 201 - "PUT http://localhost/sdb1/2/a/1_vc_ascii/0091_o_ascii/1757769899.00400" "txbee127bee0d2418ca4475-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_vc_ascii/0091_o_ascii/1757769899.00400" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.00400" "txbee127bee0d2418ca4475-0068c570ab" "proxy-server 1824535" 0.0210 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 PUT /v1/a/1_vc_ascii/0091_o_ascii/1757769899.00400 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txbee127bee0d2418ca4475-0068c570ab - 0.0387 VW - 1757769899.087885857 1757769899.126560688 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txdf55f21ff7ca4083a5f8f-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txdf55f21ff7ca4083a5f8f-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txdf55f21ff7ca4083a5f8f-0068c570ab" "proxy-server 1824535" 0.0161 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txdf55f21ff7ca4083a5f8f-0068c570ab" "proxy-server 1824535" 0.0221 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - - t - - - txdf55f21ff7ca4083a5f8f-0068c570ab - 0.0262 - - 1757769899.131184816 1757769899.157389879 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0057fcfbeb4f436d92089-0068c570ab" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/0/a/1_vc_ascii" 200 362 "GET http://localhost/v1/a/1_vc_ascii?prefix=0091_o_ascii%2F&format=json&states=listing" "tx0057fcfbeb4f436d92089-0068c570ab" "proxy-server 1824535" 0.0091 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 GET /v1/a/1_vc_ascii%3Fprefix%3D0091_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 362 - tx0057fcfbeb4f436d92089-0068c570ab - 0.0206 - - 1757769899.163199186 1757769899.183753014 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx19c839e1e4e942c0a524a-0068c570ab" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx19c839e1e4e942c0a524a-0068c570ab - 0.0125 VW - 1757769899.185881376 1757769899.198369265 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx7cc3722631464b78bb126-0068c570ab" "proxy-server 1824535" 0.0118 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx7cc3722631464b78bb126-0068c570ab - 0.0148 VW - 1757769899.207152605 1757769899.221930742 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 - "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx279d4f4b1257444abdd53-0068c570ab" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 - "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx279d4f4b1257444abdd53-0068c570ab" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx279d4f4b1257444abdd53-0068c570ab - 0.0149 VW - 1757769899.222558022 1757769899.237503529 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/0/a/1_vc_ascii" 204 - "HEAD http://localhost/v1/a/1_vc_ascii" "txf20fd847aa7046cbb8668-0068c570ab" "proxy-server 1824535" 0.0078 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/0/a/1_vc_ascii/0091_o_ascii/1757769899.13178" 201 - "PUT http://localhost/sdb1/3/a/1_vc_ascii/0091_o_ascii/1757769899.13178" "tx482ebb4fc0834798bd916-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/0/a/1_vc_ascii/0091_o_ascii/1757769899.13178" 201 - "PUT http://localhost/sda1/3/a/1_vc_ascii/0091_o_ascii/1757769899.13178" "tx482ebb4fc0834798bd916-0068c570ab" "object-server 1824535" 0.0087 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/3/a/1_vc_ascii/0091_o_ascii/1757769899.13178" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.13178" "tx482ebb4fc0834798bd916-0068c570ab" "proxy-server 1824535" 0.0326 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/3/a/1_vc_ascii/0091_o_ascii/1757769899.13178" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.13178" "tx482ebb4fc0834798bd916-0068c570ab" "proxy-server 1824535" 0.0169 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 PUT /v1/a/1_vc_ascii/0091_o_ascii/1757769899.13178 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx482ebb4fc0834798bd916-0068c570ab - 0.0600 VW - 1757769899.238098860 1757769899.298141479 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txb21b6f26c4904428919f9-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txb21b6f26c4904428919f9-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txb21b6f26c4904428919f9-0068c570ab" "proxy-server 1824535" 0.0195 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "txb21b6f26c4904428919f9-0068c570ab" "proxy-server 1824535" 0.0190 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - - t 5 - - txb21b6f26c4904428919f9-0068c570ab - 0.0324 - - 1757769899.298560619 1757769899.330913067 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txed20901f78994e0787607-0068c570ab" "proxy-server 1824535" 0.0056 "-" 1824535 -test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_timeout test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_timeout ... ok proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: Object returning 503 for [] (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c/o: Timeout (Nones) (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Ignoring 404 from primary (txn: tx773db9c00b414dc89e38c-0068c570aa) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to GET /v1/a/c/o: Timeout (0.01s) (txn: tx54170739e77642819fa76-0068c570ab) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to GET /v1/a/c/o: Timeout (0.01s) (txn: tx54170739e77642819fa76-0068c570ab) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Error decoding fragments for '/a/c/o'. Segments decoded: 0, Lengths: [490, 490, 490, 490, 490, 490, 490, 490, 490, 490]: pyeclib_c_decode ERROR: Fragment integrity check failed. Please inspect syslog for liberasurecode error report. (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_trigger_ec_metadata_check_failure test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_trigger_ec_metadata_check_failure ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_body test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_body ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_concurrent_ec_extra_requests test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_concurrent_ec_extra_requests ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_duplicate_and_hidden_frag_indexes test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_duplicate_and_hidden_frag_indexes ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_duplicate_but_insufficient_frag_indexes test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_duplicate_but_insufficient_frag_indexes ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_frags_swapped_around test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_frags_swapped_around ... ok proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txed20901f78994e0787607-0068c570ab - 0.0085 VW - 1757769899.332876682 1757769899.341355324 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txc324207f6db343f786c36-0068c570ab" "proxy-server 1824535" 0.0071 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txc324207f6db343f786c36-0068c570ab - 0.0142 VW - 1757769899.341910839 1757769899.356156349 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx45aca75fe0d14da9a4373-0068c570ab" "proxy-server 1824535" 0.0047 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii?symlink=get" "tx45aca75fe0d14da9a4373-0068c570ab" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/0/a/1_vc_ascii" 204 - "HEAD http://localhost/v1/a/1_vc_ascii" "tx1bd8ae70e0074cc8bcc8f-0068c570ab" "proxy-server 1824535" 0.0068 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx45aca75fe0d14da9a4373-0068c570ab - 0.0301 VW - 1757769899.356793165 1757769899.386889458 0 - (txn: tx581baa359a904e7ab98cc-0068c570ab) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/0/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 201 - "PUT http://localhost/sdb1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" "tx581baa359a904e7ab98cc-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/0/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 201 - "PUT http://localhost/sda1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" "tx581baa359a904e7ab98cc-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" "tx581baa359a904e7ab98cc-0068c570ab" "proxy-server 1824535" 0.0177 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 201 - "PUT http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" "tx581baa359a904e7ab98cc-0068c570ab" "proxy-server 1824535" 0.0209 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 PUT /v1/a/1_vc_ascii/0091_o_ascii/1757769899.30334 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx581baa359a904e7ab98cc-0068c570ab - 0.0361 VW - 1757769899.371982336 1757769899.408082247 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx99446621821d424aa28df-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx99446621821d424aa28df-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx99446621821d424aa28df-0068c570ab" "proxy-server 1824535" 0.0087 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx99446621821d424aa28df-0068c570ab" "proxy-server 1824535" 0.0082 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - - t 5 - - tx99446621821d424aa28df-0068c570ab - 0.0353 - - 1757769899.408553123 1757769899.443881989 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx27a31868186b49b48159b-0068c570ab" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx27a31868186b49b48159b-0068c570ab - 0.0125 VW - 1757769899.445661068 1757769899.458170652 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx60c2355d5e714b0c9e02e-0068c570ab" "proxy-server 1824535" 0.0111 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx60c2355d5e714b0c9e02e-0068c570ab - 0.0141 VW - 1757769899.466827631 1757769899.480906010 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub?symlink=get" "tx1fca047be06141bc8e7ef-0068c570ab" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub?symlink=get" "tx1fca047be06141bc8e7ef-0068c570ab" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii/sub%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx1fca047be06141bc8e7ef-0068c570ab - 0.0099 VW - 1757769899.481556416 1757769899.491414070 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 201 - "PUT http://localhost/sdb1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" "txdd26f4e541784adaaecdb-0068c570ab" "object-server 1824535" 0.0007 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 201 - "PUT http://localhost/sda1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" "txdd26f4e541784adaaecdb-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" "txdd26f4e541784adaaecdb-0068c570ab" "proxy-server 1824535" 0.0145 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" "txdd26f4e541784adaaecdb-0068c570ab" "proxy-server 1824535" 0.0160 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii/sub HTTP/1.0 201 - - t 4 - - txdd26f4e541784adaaecdb-0068c570ab - 0.0241 - - 1757769899.491818666 1757769899.515910864 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4ca50697a1034a468fe47-0068c570ab" "proxy-server 1824535" 0.0016 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx4ca50697a1034a468fe47-0068c570ab - 0.0068 VW - 1757769899.517635584 1757769899.524447918 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "tx27d26a45346548feb5214-0068c570ab" "proxy-server 1824535" 0.0035 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx27d26a45346548feb5214-0068c570ab - 0.0069 VW - 1757769899.525098085 1757769899.532034159 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 200 4 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub?symlink=get" "tx58389aa1f5e247a1968fe-0068c570ab" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 200 4 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub?symlink=get" "tx58389aa1f5e247a1968fe-0068c570ab" "proxy-server 1824535" 0.0007 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_invalid_ranges test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_invalid_ranges ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_many_missed_overwrite_will_need_handoff test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_many_missed_overwrite_will_need_handoff ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/0/a/1_vc_ascii" 204 - "HEAD http://localhost/v1/a/1_vc_ascii" "txe6ab824208554021a2821-0068c570ab" "proxy-server 1824535" 0.0078 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii/sub%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 4 - tx58389aa1f5e247a1968fe-0068c570ab - 0.0337 VW - 1757769899.532667160 1757769899.566391468 0 - (txn: tx9da2d71c8aeb4c839e0c8-0068c570ab) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/0/a/1_vc_ascii/00d1_o_ascii/sub/1757769899.49236" 201 - "PUT http://localhost/sdb1/3/a/1_vc_ascii/00d1_o_ascii/sub/1757769899.49236" "tx9da2d71c8aeb4c839e0c8-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/0/a/1_vc_ascii/00d1_o_ascii/sub/1757769899.49236" 201 - "PUT http://localhost/sda1/3/a/1_vc_ascii/00d1_o_ascii/sub/1757769899.49236" "tx9da2d71c8aeb4c839e0c8-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/3/a/1_vc_ascii/00d1_o_ascii/sub/1757769899.49236" 201 - "PUT http://localhost/v1/a/1_vc_ascii/00d1_o_ascii/sub/1757769899.49236" "tx9da2d71c8aeb4c839e0c8-0068c570ab" "proxy-server 1824535" 0.0117 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/3/a/1_vc_ascii/00d1_o_ascii/sub/1757769899.49236" 201 - "PUT http://localhost/v1/a/1_vc_ascii/00d1_o_ascii/sub/1757769899.49236" "tx9da2d71c8aeb4c839e0c8-0068c570ab" "proxy-server 1824535" 0.0169 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 PUT /v1/a/1_vc_ascii/00d1_o_ascii/sub/1757769899.49236 HTTP/1.0 201 - Swift - 4 - 1b52eb8ef2c1875cfdf3ffbe9e3c05da tx9da2d71c8aeb4c839e0c8-0068c570ab - 0.0400 VW - 1757769899.543006420 1757769899.582998037 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 201 - "PUT http://localhost/sdb1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" "tx2a8386c9edb64fefa0d4b-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 201 - "PUT http://localhost/sda1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" "tx2a8386c9edb64fefa0d4b-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" "tx2a8386c9edb64fefa0d4b-0068c570ab" "proxy-server 1824535" 0.0074 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/3/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii/sub" "tx2a8386c9edb64fefa0d4b-0068c570ab" "proxy-server 1824535" 0.0091 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii/sub HTTP/1.0 201 - - t 4 - - tx2a8386c9edb64fefa0d4b-0068c570ab - 0.0130 - - 1757769899.583535910 1757769899.596505642 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf78952e8b5704901908fb-0068c570ab" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txf78952e8b5704901908fb-0068c570ab - 0.0042 VW - 1757769899.598141193 1757769899.602312565 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3" "txe1aecd5e23674f9d9d592-0068c570ab" "proxy-server 1824535" 0.0027 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a/1_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txe1aecd5e23674f9d9d592-0068c570ab - 0.0055 VW - 1757769899.602886438 1757769899.608363628 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/0/a/1_vc_ascii" 200 724 "GET http://localhost/v1/a/1_vc_ascii?prefix=0091_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "tx9ce16d82e59a40bd82ca1-0068c570ab" "proxy-server 1824535" 0.0034 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/1_vc_ascii%3Fprefix%3D0091_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 724 - tx9ce16d82e59a40bd82ca1-0068c570ab - 0.0069 VW - 1757769899.608986855 1757769899.615864038 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 200 5 "GET http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.30334?symlink=get" "txaf11e9511966412583deb-0068c570ab" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 200 5 "GET http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.30334?symlink=get" "txaf11e9511966412583deb-0068c570ab" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/1_vc_ascii/0091_o_ascii/1757769899.30334%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txaf11e9511966412583deb-0068c570ab - 0.0140 VW - 1757769899.616371393 1757769899.630415201 0 - (txn: tx38421ac9104749fda45fd-0068c570ab) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx38421ac9104749fda45fd-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx38421ac9104749fda45fd-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx38421ac9104749fda45fd-0068c570ab" "proxy-server 1824535" 0.0113 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/0/a/1_oc_non_ascii%C2%A3/1_o_ascii" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3/1_o_ascii" "tx38421ac9104749fda45fd-0068c570ab" "proxy-server 1824535" 0.0129 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 PUT /v1/a/1_oc_non_ascii%25C2%25A3/1_o_ascii HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx38421ac9104749fda45fd-0068c570ab - 0.0167 VW - 1757769899.622923613 1757769899.639652014 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "DELETE /sda1/0/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 204 - "DELETE http://localhost/sda1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" "txb6a0146b7b864b519fefd-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "DELETE /sdb1/0/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 204 - "DELETE http://localhost/sdb1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" "txb6a0146b7b864b519fefd-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "DELETE /sda1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 204 - "DELETE http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" "txb6a0146b7b864b519fefd-0068c570ab" "proxy-server 1824535" 0.0065 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "DELETE /sdb1/1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" 204 - "DELETE http://localhost/v1/a/1_vc_ascii/0091_o_ascii/1757769899.30334" "txb6a0146b7b864b519fefd-0068c570ab" "proxy-server 1824535" 0.0055 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 DELETE /v1/a/1_vc_ascii/0091_o_ascii/1757769899.30334 HTTP/1.0 204 - Swift - - - - txb6a0146b7b864b519fefd-0068c570ab - 0.0105 VW - 1757769899.640147924 1757769899.650612116 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf95fba69dda04006b05de-0068c570ab" "proxy-server 1824535" 0.0015 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/0/a/1_vc_ascii" 200 185 "GET http://localhost/v1/a/1_vc_ascii?prefix=00d1_o_ascii%2Fsub%2F&format=json&states=listing" "txf95fba69dda04006b05de-0068c570ab" "proxy-server 1824535" 0.0040 "-" 1824535 0 proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server ERROR: ERROR Unhandled exception in request: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/server.py", line 602, in handle_request return handler(req) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 373, in wrapped return func(*a, **kw) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 275, in GET return self.GETorHEAD(req) ~~~~~~~~~~~~~~^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 263, in GETorHEAD resp = self._get_or_head_response(req, node_iter, partition, policy) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 2918, in _get_or_head_response app_iter.kickoff(req, resp) ~~~~~~~~~~~~~~~~^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1175, in kickoff self.stashed_iter = reiterate(self._real_iter(req, resp.headers)) ~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2511, in reiterate chunk = next(iterator) File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2446, in __next__ return self._get_next_item() ~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 3262, in _get_next_item return super(StringAlong, self)._get_next_item() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2442, in _get_next_item return next(self.wrapped_iter) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1459, in _iter_one_range for i, next_seg in enumerate(segment_iter): ~~~~~~~~~^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1538, in _decode_segments_from_fragments segment = self.policy.pyeclib_driver.decode(fragments) File "/usr/lib/python3/dist-packages/pyeclib/ec_iface.py", line 300, in decode return self.ec_lib_reference.decode(fragment_payloads, ranges, ~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^ force_metadata_checks) ^^^^^^^^^^^^^^^^^^^^^^ File "/usr/lib/python3/dist-packages/pyeclib/core.py", line 91, in decode return pyeclib_c.decode(self.handle, _fragment_payloads, ~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ fragment_len, ranges, force_metadata_checks) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ pyeclib.ec_iface.ECInvalidFragmentMetadata: pyeclib_c_decode ERROR: Fragment integrity check failed. Please inspect syslog for liberasurecode error report. (txn: txbfb38c1b572a473695276-0068c570ab) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server ERROR: Object returning 503 for [] (txn: tx4b81438cd5654f42aeafe-0068c570ab) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_and_mixed_frags_may_503 test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_and_mixed_frags_may_503 ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_and_mixed_frags_will_dig_deep_but_stop test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_and_mixed_frags_will_dig_deep_but_stop ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_and_mixed_frags_will_dig_deep_but_succeed test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_and_mixed_frags_will_dig_deep_but_succeed ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_and_range_unsatisifiable test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_and_range_unsatisifiable ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_durable_files_and_mixed_etags test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_durable_files_and_mixed_etags ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_durables_and_older_durables test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_durables_and_older_durables ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 GET /v1/a/1_vc_ascii%3Fprefix%3D00d1_o_ascii%252Fsub%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 185 - txf95fba69dda04006b05de-0068c570ab - 0.0118 - - 1757769899.652392387 1757769899.664177895 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx33367a71c63c4b558928c-0068c570ab" "proxy-server 1824535" 0.0014 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/1/a/1_oc_non_ascii%C2%A3whoops" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/1_oc_non_ascii%C2%A3whoops" "tx33367a71c63c4b558928c-0068c570ab" "container-server 1824535" 0.0011 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/1/a/1_oc_non_ascii%C2%A3whoops" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/1_oc_non_ascii%C2%A3whoops" "tx33367a71c63c4b558928c-0068c570ab" "container-server 1824535" 0.0010 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3whoops" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops" "tx33367a71c63c4b558928c-0068c570ab" "proxy-server 1824535" 0.0291 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3whoops" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops" "tx33367a71c63c4b558928c-0068c570ab" "proxy-server 1824535" 0.0391 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 PUT /v1/a/1_oc_non_ascii%25C2%25A3whoops HTTP/1.0 201 - - t - - - tx33367a71c63c4b558928c-0068c570ab - 0.0633 - - 1757769899.666100740 1757769899.729446650 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx377910888e724f7eb6c86-0068c570ab" "proxy-server 1824535" 0.0019 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx377910888e724f7eb6c86-0068c570ab - 0.0088 VW - 1757769899.735123158 1757769899.743905306 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/2/a/1_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops" "txf539a8d60f174279b333a-0068c570ab" "proxy-server 1824535" 0.0056 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a/1_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - txf539a8d60f174279b333a-0068c570ab - 0.0083 VW - 1757769899.744465590 1757769899.752815247 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/3/a/1_oc_non_ascii%C2%A3whoops/foo" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops/foo?symlink=get" "txd383e744551449cd84395-0068c570ab" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/3/a/1_oc_non_ascii%C2%A3whoops/foo" 404 70 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops/foo?symlink=get" "txd383e744551449cd84395-0068c570ab" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/1_oc_non_ascii%25C2%25A3whoops/foo%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txd383e744551449cd84395-0068c570ab - 0.0136 VW - 1757769899.753419161 1757769899.766979694 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/2/a/1_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/sda1/3/a/1_oc_non_ascii%C2%A3whoops/foo" "tx54d85d698d4949f3840fa-0068c570ab" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/2/a/1_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/sdb1/3/a/1_oc_non_ascii%C2%A3whoops/foo" "tx54d85d698d4949f3840fa-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/3/a/1_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops/foo" "tx54d85d698d4949f3840fa-0068c570ab" "proxy-server 1824535" 0.0165 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/3/a/1_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops/foo" "tx54d85d698d4949f3840fa-0068c570ab" "proxy-server 1824535" 0.0178 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 PUT /v1/a/1_oc_non_ascii%25C2%25A3whoops/foo HTTP/1.0 201 - - t 5 - - tx54d85d698d4949f3840fa-0068c570ab - 0.0212 - - 1757769899.767415285 1757769899.788656473 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6dd4f34d30744446818c2-0068c570ab" "proxy-server 1824535" 0.0019 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx6dd4f34d30744446818c2-0068c570ab - 0.0128 VW - 1757769899.790127516 1757769899.802976608 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/2/a/1_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops" "txe030df2571074b00b8b1e-0068c570ab" "proxy-server 1824535" 0.0065 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a/1_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - txe030df2571074b00b8b1e-0068c570ab - 0.0091 VW - 1757769899.803563595 1757769899.812711000 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/3/a/1_oc_non_ascii%C2%A3whoops/foo" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx5c2d2ed229fa4a4f9b019-0068c570ab" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/3/a/1_oc_non_ascii%C2%A3whoops/foo" 200 5 "GET http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx5c2d2ed229fa4a4f9b019-0068c570ab" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "txe40a7891d4254053a776f-0068c570ab" "proxy-server 1824535" 0.0003 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "txe40a7891d4254053a776f-0068c570ab" "proxy-server 1824535" 0.0043 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/1_oc_non_ascii%25C2%25A3whoops/foo%3Fsymlink%3Dget HTTP/1.0 499 - Swift - - 5 - tx5c2d2ed229fa4a4f9b019-0068c570ab - 0.0313 VW - 1757769899.813291550 1757769899.844559908 0 - (txn: tx7aa14d3b327d4a4d8e9ca-0068c570ab) proxy INFO: - - 13/Sep/2025/13/24/59 PUT /v1/a/none/003foo/1757769899.76800 HTTP/1.0 404 - Swift - - 70 dcddb75469b4b4875094e14561e573d8 tx7aa14d3b327d4a4d8e9ca-0068c570ab - 0.0172 VW - 1757769899.827819824 1757769899.844980955 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx487a2d46772e4ff78e940-0068c570ab" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx487a2d46772e4ff78e940-0068c570ab - 0.0081 VW - 1757769899.846358061 1757769899.854496717 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/2/a/1_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops" "tx1491664cd9e440e4a9952-0068c570ab" "proxy-server 1824535" 0.0077 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 HEAD /v1/a/1_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - tx1491664cd9e440e4a9952-0068c570ab - 0.0104 VW - 1757769899.858354330 1757769899.868780136 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txe7eb9400bfd84699b3a67-0068c570ab" "proxy-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sda1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txe7eb9400bfd84699b3a67-0068c570ab" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/24/59 GET /v1/a/none%3Fprefix%3D003foo%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 404 - Swift - - 70 - txe7eb9400bfd84699b3a67-0068c570ab - 0.0134 VW - 1757769899.869297981 1757769899.882727861 0 -test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_container test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_container ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_durables_and_older_non_durables test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_durables_and_older_non_durables ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_durables_and_older_obscured_durables test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_missing_durables_and_older_obscured_durables ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_mixed_durable_and_nondurable_frags_will_503 test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_mixed_durable_and_nondurable_frags_will_503 ... ok proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server ERROR: Object returning 503 for [] (txn: tx0732bfdcf5cb4f7e86e41-0068c570ab) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server ERROR: Object returning 503 for [] (txn: txd1ec58434db34c668f33b-0068c570ab) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txe862a3676078410b94c79-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txe862a3676078410b94c79-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txe862a3676078410b94c79-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txe862a3676078410b94c79-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe862a3676078410b94c79-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe862a3676078410b94c79-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe862a3676078410b94c79-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe862a3676078410b94c79-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txe862a3676078410b94c79-0068c570ab) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from primary (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf8286971b1e14e54893ca-0068c570ab) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Object returning 503 for [] (txn: tx9619ea4b844d40ec9c183-0068c570ab) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_mixed_durable_frags_and_no_quorum_will_503 test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_mixed_durable_frags_and_no_quorum_will_503 ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_mixed_etags_at_same_timestamp test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_mixed_etags_at_same_timestamp ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_mixed_nondurable_frags_and_will_404 test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_mixed_nondurable_frags_and_will_404 ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "DELETE /sdb1/2/a/1_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/sdb1/3/a/1_oc_non_ascii%C2%A3whoops/foo" "tx40f9918831f8458c9271a-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "DELETE /sdb1/3/a/1_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops/foo" "tx40f9918831f8458c9271a-0068c570ab" "proxy-server 1824535" 0.0075 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "DELETE /sda1/2/a/1_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/sda1/3/a/1_oc_non_ascii%C2%A3whoops/foo" "tx40f9918831f8458c9271a-0068c570ab" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "DELETE /sda1/3/a/1_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/v1/a/1_oc_non_ascii%C2%A3whoops/foo" "tx40f9918831f8458c9271a-0068c570ab" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 DELETE /v1/a/1_oc_non_ascii%25C2%25A3whoops/foo HTTP/1.0 204 - - t - - - tx40f9918831f8458c9271a-0068c570ab - 0.0138 - - 1757769899.883311033 1757769899.897094965 0 - proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8ca707e8636a4c18a40f1-0068c570ab" "proxy-server 1824535" 0.0055 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:38699/sda1/1/a/6_oc_non_ascii%C2%A3" "tx8ca707e8636a4c18a40f1-0068c570ab" "container-server 1824535" 0.0010 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a/6_oc_non_ascii%C2%A3" "tx8ca707e8636a4c18a40f1-0068c570ab" "container-server 1824535" 0.0052 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx8ca707e8636a4c18a40f1-0068c570ab" "proxy-server 1824535" 0.0298 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx8ca707e8636a4c18a40f1-0068c570ab" "proxy-server 1824535" 0.0175 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 PUT /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx8ca707e8636a4c18a40f1-0068c570ab - 0.0417 - - 1757769899.908085108 1757769899.949767590 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx674ca80190734d1dab4ca-0068c570ab" "proxy-server 1824535" 0.0061 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "GET /sdb1/1/a/6_oc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3?format=json&states=listing" "tx674ca80190734d1dab4ca-0068c570ab" "proxy-server 1824535" 0.0063 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/24/59 GET /v1/a/6_oc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx674ca80190734d1dab4ca-0068c570ab - 0.0184 - - 1757769899.955426931 1757769899.973796606 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:24:59 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3b1db62b79c045c6874dd-0068c570ab" "proxy-server 1824535" 0.0013 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_vc_ascii" 201 - "PUT http://127.0.0.1:44669/sdb1/3/a/6_vc_ascii" "tx3b1db62b79c045c6874dd-0068c570ab" "container-server 1824535" 0.0055 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_vc_ascii" 201 - "PUT http://127.0.0.1:38699/sda1/3/a/6_vc_ascii" "tx3b1db62b79c045c6874dd-0068c570ab" "container-server 1824535" 0.0010 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/3/a/6_vc_ascii" 201 - "PUT http://localhost/v1/a/6_vc_ascii" "tx3b1db62b79c045c6874dd-0068c570ab" "proxy-server 1824535" 0.0206 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/3/a/6_vc_ascii" 201 - "PUT http://localhost/v1/a/6_vc_ascii" "tx3b1db62b79c045c6874dd-0068c570ab" "proxy-server 1824535" 0.0317 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 PUT /v1/a/6_vc_ascii HTTP/1.0 201 - - t - - - tx3b1db62b79c045c6874dd-0068c570ab - 0.0438 - - 1757769899.979788065 1757769900.023540258 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx417c48324f894e178283b-0068c570ac" "proxy-server 1824535" 0.0060 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx417c48324f894e178283b-0068c570ac - 0.0085 VW - 1757769900.025102854 1757769900.033617973 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx72b44b846ec24ff585844-0068c570ac" "proxy-server 1824535" 0.0089 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx72b44b846ec24ff585844-0068c570ac - 0.0153 VW - 1757769900.034133434 1757769900.049420834 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "txe013396b775a4035aaf38-0068c570ac" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "txe013396b775a4035aaf38-0068c570ac" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txe013396b775a4035aaf38-0068c570ac - 0.0132 VW - 1757769900.049998522 1757769900.063245058 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txab18eeb327e8420495280-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txab18eeb327e8420495280-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txab18eeb327e8420495280-0068c570ac" "proxy-server 1824535" 0.0162 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txab18eeb327e8420495280-0068c570ac" "proxy-server 1824535" 0.0174 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - txab18eeb327e8420495280-0068c570ac - 0.0208 - - 1757769900.063643932 1757769900.084402323 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2e23676c537f483e90a50-0068c570ac" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx2e23676c537f483e90a50-0068c570ac - 0.0122 VW - 1757769900.099671841 1757769900.111921549 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txb6a2f75c832143b6801db-0068c570ac" "proxy-server 1824535" 0.0071 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txb6a2f75c832143b6801db-0068c570ac - 0.0099 VW - 1757769900.112464428 1757769900.122328281 0 -test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange_short_resume_body test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange_short_resume_body ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange_slow_body test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange_slow_body ... ok proxy-server ERROR: Object returning 503 for [] (txn: tx43e2dfa5292a48d9bf802-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server ERROR: Problem with fragment response: ETag mismatch (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server ERROR: Object returning 503 for [] (txn: tx2d4d39d7cfa9409db6b8b-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read next part of EC fragment multi-part GET (retrying) 10.0.0.2:1002/sdc (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 10.0.0.4:1004/sde (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server ERROR: Exception fetching fragments for '/a/c/o': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1485, in put_fragments_in_queue for fragment in frag_iter: ^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2446, in __next__ return self._get_next_item() ~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 5231, in _get_next_item return super(CooperativeIterator, self)._get_next_item() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/swift/common/utils/__init__.py", line 2442, in _get_next_item return next(self.wrapped_iter) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 2506, in _iter_bytes_from_response_part raise e File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 2479, in _iter_bytes_from_response_part chunk = part_file.read(self.app.object_chunk_size) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1110, in read raise ShortReadError( "Too few bytes; read %d, expecting %d" % ( self.nbytes - self.bytes_left, self.nbytes)) swift.common.exceptions.ShortReadError: Too few bytes; read 415, expecting 490 (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server WARNING: Un-recoverable fragment rebuild. Only received 9/10 fragments for '/a/c/o' (txn: tx05edd7d4f2f14d3e874f6-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read next part of EC fragment multi-part GET (retrying) 10.0.0.10:1010/sdk (txn: txb97cf19113bc4082a9d81-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange_unable_to_resume test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange_unable_to_resume ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange_unable_to_resume_body_started test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_multirange_unable_to_resume_body_started ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_no_durable_files test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_no_durable_files ... ok proxy-server ERROR: Trying to read next part of EC fragment multi-part GET (retrying) 10.0.0.13:1013/sdn (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to read during GET: ChunkReadTimeout (0.01s after 0.01s) (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server ERROR: ERROR Unhandled exception in request: ChunkReadTimeout (0.01s after 0.01s) (txn: txb4b2c09ea58a42e39c53c-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read next part of EC fragment multi-part GET (retrying) 10.0.0.12:1012/sdm (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to read during GET: ChunkReadTimeout (0.01s after 0.01s) (txn: tx0e61e7b9a55b4d91a800b-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server WARNING: Client disconnected on read of EC frag '/a/c/o' (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx4d53250d08924b518fd4f-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_no_success test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_no_success ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "txa3a4d44cfe50431fb6ee5-0068c570ac" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "txa3a4d44cfe50431fb6ee5-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/3/a/6_vc_ascii" 204 - "HEAD http://localhost/v1/a/6_vc_ascii" "tx49f59808e391468889a96-0068c570ac" "proxy-server 1824535" 0.0014 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txa3a4d44cfe50431fb6ee5-0068c570ac - 0.0366 VW - 1757769900.127096176 1757769900.163701057 0 - (txn: tx28e1cc0f489f4b9b9ab60-0068c570ac) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 201 - "PUT http://localhost/sdb1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" "tx28e1cc0f489f4b9b9ab60-0068c570ac" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 201 - "PUT http://localhost/sda1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" "tx28e1cc0f489f4b9b9ab60-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" "tx28e1cc0f489f4b9b9ab60-0068c570ac" "proxy-server 1824535" 0.0152 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" "tx28e1cc0f489f4b9b9ab60-0068c570ac" "proxy-server 1824535" 0.0165 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 PUT /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769900.06416 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx28e1cc0f489f4b9b9ab60-0068c570ac - 0.0334 VW - 1757769900.142071009 1757769900.175516605 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx147f83f4ef0e4fd69ce6b-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx147f83f4ef0e4fd69ce6b-0068c570ac" "proxy-server 1824535" 0.0220 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx147f83f4ef0e4fd69ce6b-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx147f83f4ef0e4fd69ce6b-0068c570ac" "proxy-server 1824535" 0.0169 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx147f83f4ef0e4fd69ce6b-0068c570ac - 0.0282 - - 1757769900.176076174 1757769900.204303265 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx681920a7d8dc47cb8f492-0068c570ac" "proxy-server 1824535" 0.0080 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx76010640dff3417ba22d4-0068c570ac" "proxy-server 1824535" 0.0131 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx69c7487ec07943048be00-0068c570ac" "proxy-server 1824535" 0.0084 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx69c7487ec07943048be00-0068c570ac - 0.0386 - - 1757769900.205739498 1757769900.244357586 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcb707b2c96b444fa948a9-0068c570ac" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txcb707b2c96b444fa948a9-0068c570ac - 0.0120 VW - 1757769900.259664297 1757769900.271691084 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txed2197b3d6d244dd91dab-0068c570ac" "proxy-server 1824535" 0.0028 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txed2197b3d6d244dd91dab-0068c570ac - 0.0056 VW - 1757769900.272281885 1757769900.277869940 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "tx1fbd9a78fc804077ae588-0068c570ac" "proxy-server 1824535" 0.0031 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "tx1fbd9a78fc804077ae588-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/3/a/6_vc_ascii" 204 - "HEAD http://localhost/v1/a/6_vc_ascii" "tx04f8e61950104e42908c7-0068c570ac" "proxy-server 1824535" 0.0027 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx1fbd9a78fc804077ae588-0068c570ac - 0.0278 VW - 1757769900.278449774 1757769900.306226730 0 - (txn: tx66b0a824b0374f0da14ef-0068c570ac) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 201 - "PUT http://localhost/sda1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" "tx66b0a824b0374f0da14ef-0068c570ac" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 201 - "PUT http://localhost/sdb1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" "tx66b0a824b0374f0da14ef-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" "tx66b0a824b0374f0da14ef-0068c570ac" "proxy-server 1824535" 0.0190 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" "tx66b0a824b0374f0da14ef-0068c570ac" "proxy-server 1824535" 0.0186 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 PUT /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769900.17661 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 tx66b0a824b0374f0da14ef-0068c570ac - 0.0365 VW - 1757769900.288498163 1757769900.325018406 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx36bf8fa41c224f5686bc4-0068c570ac" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx36bf8fa41c224f5686bc4-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx36bf8fa41c224f5686bc4-0068c570ac" "proxy-server 1824535" 0.0213 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx36bf8fa41c224f5686bc4-0068c570ac" "proxy-server 1824535" 0.0230 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx36bf8fa41c224f5686bc4-0068c570ac - 0.0318 - - 1757769900.325440168 1757769900.357197285 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb7aa3a27938c4e3dbcf8a-0068c570ac" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txe60f8847f79d4f8393022-0068c570ac" "proxy-server 1824535" 0.0068 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx9f821e34a4d64995bd5d2-0068c570ac" "proxy-server 1824535" 0.0085 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx9f821e34a4d64995bd5d2-0068c570ac - 0.0337 - - 1757769900.362740517 1757769900.396470308 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx33302424de09438e830b9-0068c570ac" "proxy-server 1824535" 0.0012 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_vc_ascii" 200 382 "GET http://localhost/v1/a/6_vc_ascii?format=json&states=listing" "tx33302424de09438e830b9-0068c570ac" "proxy-server 1824535" 0.0045 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_vc_ascii%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 382 - tx33302424de09438e830b9-0068c570ac - 0.0129 - - 1757769900.398049116 1757769900.410982609 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe3a03ef9e49a45019d570-0068c570ac" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx0633089524c14c479d28f-0068c570ac" "proxy-server 1824535" 0.0013 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx3dc5c7fca6174591ba3e3-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx3dc5c7fca6174591ba3e3-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf3381d33d9de43e09ebe4-0068c570ac" "proxy-server 1824535" 0.0012 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txf3381d33d9de43e09ebe4-0068c570ac - 0.0037 VW - 1757769900.429180384 1757769900.432900429 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx8a917f6836e349c89596b-0068c570ac" "proxy-server 1824535" 0.0012 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx8a917f6836e349c89596b-0068c570ac - 0.0037 VW - 1757769900.433401823 1757769900.437092781 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/2/a/6_oc_non_ascii%C2%A3/copied_name" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/copied_name?symlink=get" "tx3662cba9ecf647f8b42ce-0068c570ac" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/2/a/6_oc_non_ascii%C2%A3/copied_name" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/copied_name?symlink=get" "tx3662cba9ecf647f8b42ce-0068c570ac" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/copied_name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx3662cba9ecf647f8b42ce-0068c570ac - 0.0051 VW - 1757769900.437724829 1757769900.442783833 0 - proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 200 - Swift t - 5 - tx3dc5c7fca6174591ba3e3-0068c570ac - 0.0373 SSC - 1757769900.412914515 1757769900.450165272 0 - (txn: tx7e853a9070df472daebed-0068c570ac) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/sdb1/2/a/6_oc_non_ascii%C2%A3/copied_name" "tx7e853a9070df472daebed-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/sda1/2/a/6_oc_non_ascii%C2%A3/copied_name" "tx7e853a9070df472daebed-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/2/a/6_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/copied_name" "tx7e853a9070df472daebed-0068c570ac" "proxy-server 1824535" 0.0072 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/2/a/6_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/copied_name" "tx7e853a9070df472daebed-0068c570ac" "proxy-server 1824535" 0.0086 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 COPY /v1/a/6_oc_non_ascii%25C2%25A3/copied_name HTTP/1.0 201 - - t 5 - db7282901da891bea2fcd73840caad1c tx7e853a9070df472daebed-0068c570ac - 0.0149 SSC - 1757769900.443151474 1757769900.458068848 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd3e73f6904fb47cd80855-0068c570ac" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txfd6b855af499474cb739d-0068c570ac" "proxy-server 1824535" 0.0026 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/2/a/6_oc_non_ascii%C2%A3/copied_name" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/copied_name" "txbbc111953d8847f886877-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/copied_name HTTP/1.0 200 - - t - 5 - txbbc111953d8847f886877-0068c570ac - 0.0131 - - 1757769900.459758759 1757769900.472872019 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx156b77bbd7494e6a9375b-0068c570ac" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx08ae3b4c0a0845e4b4d87-0068c570ac" "proxy-server 1824535" 0.0020 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "POST http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx0f1cf6bdce284db8867b3-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "POST http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx0f1cf6bdce284db8867b3-0068c570ac" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "POST /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 202 76 "POST http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx0f1cf6bdce284db8867b3-0068c570ac" "proxy-server 1824535" 0.0115 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "POST /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 202 76 "POST http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx0f1cf6bdce284db8867b3-0068c570ac" "proxy-server 1824535" 0.0107 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 POST /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 202 - - t - 76 - tx0f1cf6bdce284db8867b3-0068c570ac - 0.0243 - - 1757769900.474389553 1757769900.498673916 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0bb9f5f91c96426db6eab-0068c570ac" "proxy-server 1824535" 0.0054 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txf0761f38f4f94b72a409a-0068c570ac" "proxy-server 1824535" 0.0109 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txd84f7da1cd8d486792c23-0068c570ac" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - txd84f7da1cd8d486792c23-0068c570ac - 0.0259 - - 1757769900.500158310 1757769900.526008844 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx48fef0994a5c454b94ae9-0068c570ac" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/1/a/6_oc_non_ascii%C2%A3" 200 326 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3?format=json&states=listing" "tx48fef0994a5c454b94ae9-0068c570ac" "proxy-server 1824535" 0.0022 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 326 - tx48fef0994a5c454b94ae9-0068c570ac - 0.0092 - - 1757769900.530679703 1757769900.539916277 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa64bf6cca93348bb99c8b-0068c570ac" "proxy-server 1824535" 0.0012 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa64bf6cca93348bb99c8b-0068c570ac - 0.0038 VW - 1757769900.541781902 1757769900.545602322 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx66cff163606248e29da3e-0068c570ac" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx66cff163606248e29da3e-0068c570ac - 0.0038 VW - 1757769900.546115160 1757769900.549944878 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_vc_ascii" 200 382 "GET http://localhost/v1/a/6_vc_ascii?prefix=00f6_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "tx113a0a1c50594cf88a9c7-0068c570ac" "proxy-server 1824535" 0.0084 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_vc_ascii%3Fprefix%3D00f6_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 382 - tx113a0a1c50594cf88a9c7-0068c570ac - 0.0115 VW - 1757769900.550471067 1757769900.561971664 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 200 5 "GET http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661?symlink=get" "tx01ab1e097ac84d49af7db-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 200 5 "GET http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661?symlink=get" "tx01ab1e097ac84d49af7db-0068c570ac" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769900.17661%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx01ab1e097ac84d49af7db-0068c570ac - 0.0336 VW - 1757769900.562474966 1757769900.596059084 0 - (txn: tx15678a412e304193b8f8d-0068c570ac) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx15678a412e304193b8f8d-0068c570ac" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx15678a412e304193b8f8d-0068c570ac" "proxy-server 1824535" 0.0110 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx15678a412e304193b8f8d-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx15678a412e304193b8f8d-0068c570ac" "proxy-server 1824535" 0.0197 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 tx15678a412e304193b8f8d-0068c570ac - 0.0370 VW - 1757769900.577270746 1757769900.614243031 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 204 - "DELETE http://localhost/sdb1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" "txb9531eae040c47268aa4b-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 204 - "DELETE http://localhost/sda1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" "txb9531eae040c47268aa4b-0068c570ac" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sda1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 204 - "DELETE http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" "txb9531eae040c47268aa4b-0068c570ac" "proxy-server 1824535" 0.0112 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sdb1/0/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" 204 - "DELETE http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.17661" "txb9531eae040c47268aa4b-0068c570ac" "proxy-server 1824535" 0.0109 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 DELETE /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769900.17661 HTTP/1.0 204 - Swift - - - - txb9531eae040c47268aa4b-0068c570ac - 0.0154 VW - 1757769900.622883558 1757769900.638325930 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx01e2b6727750495a80951-0068c570ac" "proxy-server 1824535" 0.0057 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txf23de5332d534248b4ebe-0068c570ac" "proxy-server 1824535" 0.0030 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx05274520dec245ba873cd-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_one_slow_frag_lane test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_one_slow_frag_lane ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_only_handoffs test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_only_handoffs ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx05274520dec245ba873cd-0068c570ac - 0.0238 - - 1757769900.644333124 1757769900.668107748 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx138de7479836427fb5568-0068c570ac" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_vc_ascii" 200 191 "GET http://localhost/v1/a/6_vc_ascii?prefix=00f6_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx138de7479836427fb5568-0068c570ac" "proxy-server 1824535" 0.0090 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_vc_ascii%3Fprefix%3D00f6_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 191 - tx138de7479836427fb5568-0068c570ac - 0.0250 - - 1757769900.669883251 1757769900.694869757 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx889f0aabe26047d885c71-0068c570ac" "proxy-server 1824535" 0.0054 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx889f0aabe26047d885c71-0068c570ac - 0.0082 VW - 1757769900.696810246 1757769900.705000639 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txda0543772a9a4a0592611-0068c570ac" "proxy-server 1824535" 0.0014 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txda0543772a9a4a0592611-0068c570ac - 0.0053 VW - 1757769900.705560684 1757769900.710892200 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_vc_ascii" 200 191 "GET http://localhost/v1/a/6_vc_ascii?prefix=00f6_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "tx2c5bb014f74e4129aff7a-0068c570ac" "proxy-server 1824535" 0.0023 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_vc_ascii%3Fprefix%3D00f6_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 191 - tx2c5bb014f74e4129aff7a-0068c570ac - 0.0057 VW - 1757769900.711468458 1757769900.717119217 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 200 5 "GET http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416?symlink=get" "tx13df462bfa0e42bcbedf3-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 200 5 "GET http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416?symlink=get" "tx13df462bfa0e42bcbedf3-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769900.06416%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx13df462bfa0e42bcbedf3-0068c570ac - 0.0115 VW - 1757769900.717647552 1757769900.729151011 0 - (txn: tx08fc5265a143433dade22-0068c570ac) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx08fc5265a143433dade22-0068c570ac" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx08fc5265a143433dade22-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx08fc5265a143433dade22-0068c570ac" "proxy-server 1824535" 0.0088 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx08fc5265a143433dade22-0068c570ac" "proxy-server 1824535" 0.0083 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx08fc5265a143433dade22-0068c570ac - 0.0131 VW - 1757769900.724326134 1757769900.737475634 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 204 - "DELETE http://localhost/sdb1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" "tx61b668e5ed1247afa1eb2-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sdb1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 204 - "DELETE http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" "tx61b668e5ed1247afa1eb2-0068c570ac" "proxy-server 1824535" 0.0045 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 204 - "DELETE http://localhost/sda1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" "tx61b668e5ed1247afa1eb2-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sda1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" 204 - "DELETE http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.06416" "tx61b668e5ed1247afa1eb2-0068c570ac" "proxy-server 1824535" 0.0068 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 DELETE /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769900.06416 HTTP/1.0 204 - Swift - - - - tx61b668e5ed1247afa1eb2-0068c570ac - 0.0121 VW - 1757769900.737993717 1757769900.750067234 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0dd40e9522d6411383702-0068c570ac" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx831fa440e05147f6951ea-0068c570ac" "proxy-server 1824535" 0.0071 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx4c0e3a530b51484e883fe-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx4c0e3a530b51484e883fe-0068c570ac - 0.0184 - - 1757769900.751667023 1757769900.770022631 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdd093bcf37ab4fdaaa3bf-0068c570ac" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_vc_ascii" 200 2 "GET http://localhost/v1/a/6_vc_ascii?prefix=00f6_o_non_ascii%C2%A3%2F&format=json&states=listing" "txdd093bcf37ab4fdaaa3bf-0068c570ac" "proxy-server 1824535" 0.0034 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_vc_ascii%3Fprefix%3D00f6_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - txdd093bcf37ab4fdaaa3bf-0068c570ac - 0.0164 - - 1757769900.775988817 1757769900.792380095 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0efbfccbc01f4abc98904-0068c570ac" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_vc_ascii" 200 2 "GET http://localhost/v1/a/6_vc_ascii?prefix=00f6_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx0efbfccbc01f4abc98904-0068c570ac" "proxy-server 1824535" 0.0022 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_vc_ascii%3Fprefix%3D00f6_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx0efbfccbc01f4abc98904-0068c570ac - 0.0098 - - 1757769900.794298172 1757769900.804116964 0 -test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_quorum_durable_files test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_quorum_durable_files ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_range_unsatisfiable_mixed_success test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_range_unsatisfiable_mixed_success ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_single_durable_file test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_single_durable_file ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_single_missed_overwrite_does_not_need_handoff test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_single_missed_overwrite_does_not_need_handoff ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx34a46e3f101842dabba23-0068c570ac" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx34a46e3f101842dabba23-0068c570ac - 0.0041 VW - 1757769900.812453270 1757769900.816538811 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txf3a8af19320b4313aa938-0068c570ac" "proxy-server 1824535" 0.0058 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txf3a8af19320b4313aa938-0068c570ac - 0.0126 VW - 1757769900.817093134 1757769900.829725742 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_vc_ascii" 200 2 "GET http://localhost/v1/a/6_vc_ascii?prefix=00f6_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "tx9b9cef791e714d5d8182a-0068c570ac" "proxy-server 1824535" 0.0043 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_vc_ascii%3Fprefix%3D00f6_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 2 - tx9b9cef791e714d5d8182a-0068c570ac - 0.0118 VW - 1757769900.830302477 1757769900.842141867 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txb8740ed7c54e4bada550b-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txb8740ed7c54e4bada550b-0068c570ac" "proxy-server 1824535" 0.0036 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txb8740ed7c54e4bada550b-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "DELETE /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txb8740ed7c54e4bada550b-0068c570ac" "proxy-server 1824535" 0.0149 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 DELETE /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 204 - - t - - - txb8740ed7c54e4bada550b-0068c570ac - 0.0218 - - 1757769900.842595577 1757769900.864377737 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx06985a7540f7439a8b2bb-0068c570ac" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txf27179c42cf54208abfb2-0068c570ac" "proxy-server 1824535" 0.0030 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txe1b9d08fcf1f491bac1c6-0068c570ac" "proxy-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txe1b9d08fcf1f491bac1c6-0068c570ac" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 404 - - t - 70 - txe1b9d08fcf1f491bac1c6-0068c570ac - 0.0167 - - 1757769900.866861582 1757769900.883589029 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx640249e074f7415797ad4-0068c570ac" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx640249e074f7415797ad4-0068c570ac - 0.0085 VW - 1757769900.899715900 1757769900.908175707 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txf680e43297534ffb962a8-0068c570ac" "proxy-server 1824535" 0.0056 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txf680e43297534ffb962a8-0068c570ac - 0.0085 VW - 1757769900.908757210 1757769900.917236805 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "txbe64f6f52ecf446e9eb9a-0068c570ac" "proxy-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "txbe64f6f52ecf446e9eb9a-0068c570ac" "proxy-server 1824535" 0.0045 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txbe64f6f52ecf446e9eb9a-0068c570ac - 0.0143 VW - 1757769900.917853594 1757769900.932168722 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx5981b583bf884dee92e1a-0068c570ac" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx5981b583bf884dee92e1a-0068c570ac" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx5981b583bf884dee92e1a-0068c570ac" "proxy-server 1824535" 0.0108 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx5981b583bf884dee92e1a-0068c570ac" "proxy-server 1824535" 0.0103 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/00 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx5981b583bf884dee92e1a-0068c570ac - 0.0169 - - 1757769900.932574034 1757769900.949443579 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx91550fee85344adebd34a-0068c570ac" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx91550fee85344adebd34a-0068c570ac - 0.0084 VW - 1757769900.963859081 1757769900.972258091 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "HEAD /sdb1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx38a338074c0143028abfe-0068c570ac" "proxy-server 1824535" 0.0069 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/00 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx38a338074c0143028abfe-0068c570ac - 0.0097 VW - 1757769900.972852230 1757769900.982556581 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "tx80257a7d041943b6ab143-0068c570ac" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:00 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "tx80257a7d041943b6ab143-0068c570ac" "proxy-server 1824535" 0.0007 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_slow_nodes_and_failures test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_slow_nodes_and_failures ... ok proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx80257a7d041943b6ab143-0068c570ac - 0.0209 VW - 1757769900.983238935 1757769901.004159689 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/3/a/6_vc_ascii" 204 - "HEAD http://localhost/v1/a/6_vc_ascii" "txfec4951e40184ba7af544-0068c570ad" "proxy-server 1824535" 0.0055 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.93313" 201 - "PUT http://localhost/sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.93313" "tx700ef0a89af241b98c226-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.93313" 201 - "PUT http://localhost/sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.93313" "tx700ef0a89af241b98c226-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.93313" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.93313" "tx700ef0a89af241b98c226-0068c570ad" "proxy-server 1824535" 0.0170 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.93313" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769900.93313" "tx700ef0a89af241b98c226-0068c570ad" "proxy-server 1824535" 0.0166 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 PUT /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769900.93313 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx700ef0a89af241b98c226-0068c570ad - 0.0386 VW - 1757769901.004823208 1757769901.043447971 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txc96148d35fd048b3b2691-0068c570ad" "object-server 1824535" 0.0032 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txc96148d35fd048b3b2691-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txc96148d35fd048b3b2691-0068c570ad" "proxy-server 1824535" 0.0198 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txc96148d35fd048b3b2691-0068c570ad" "proxy-server 1824535" 0.0258 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - txc96148d35fd048b3b2691-0068c570ad - 0.0298 - - 1757769901.043942928 1757769901.073700428 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx18e14e4c1ab84cbba8e79-0068c570ad" "proxy-server 1824535" 0.0057 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx18e14e4c1ab84cbba8e79-0068c570ad - 0.0087 VW - 1757769901.087869883 1757769901.096533060 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx258feb06dbcf43da976a1-0068c570ad" "proxy-server 1824535" 0.0030 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx258feb06dbcf43da976a1-0068c570ad - 0.0101 VW - 1757769901.097121239 1757769901.107190371 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "tx0ddd0e0edf9b4e5797502-0068c570ad" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "tx0ddd0e0edf9b4e5797502-0068c570ad" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx0ddd0e0edf9b4e5797502-0068c570ad - 0.0191 VW - 1757769901.107872725 1757769901.126985788 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/3/a/6_vc_ascii" 204 - "HEAD http://localhost/v1/a/6_vc_ascii" "txd9861dbea1e041a787862-0068c570ad" "proxy-server 1824535" 0.0070 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.04451" 201 - "PUT http://localhost/sda1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.04451" "txc09bed8911504ba39dac7-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.04451" 201 - "PUT http://localhost/sdb1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.04451" "txc09bed8911504ba39dac7-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.04451" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.04451" "txc09bed8911504ba39dac7-0068c570ad" "proxy-server 1824535" 0.0113 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.04451" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.04451" "txc09bed8911504ba39dac7-0068c570ad" "proxy-server 1824535" 0.0128 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 PUT /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769901.04451 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txc09bed8911504ba39dac7-0068c570ad - 0.0309 VW - 1757769901.127680302 1757769901.158627987 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txbe03fca14aa240a28d5fc-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txbe03fca14aa240a28d5fc-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txbe03fca14aa240a28d5fc-0068c570ad" "proxy-server 1824535" 0.0129 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txbe03fca14aa240a28d5fc-0068c570ad" "proxy-server 1824535" 0.0188 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - txbe03fca14aa240a28d5fc-0068c570ad - 0.0228 - - 1757769901.163350821 1757769901.186110497 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx67097d78a5744e3fae8a7-0068c570ad" "proxy-server 1824535" 0.0057 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/3/a/6_vc_ascii" 200 382 "GET http://localhost/v1/a/6_vc_ascii?prefix=00f6_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx67097d78a5744e3fae8a7-0068c570ad" "proxy-server 1824535" 0.0110 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 GET /v1/a/6_vc_ascii%3Fprefix%3D00f6_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 382 - tx67097d78a5744e3fae8a7-0068c570ad - 0.0282 - - 1757769901.191933632 1757769901.220093727 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcadb5796047f40099cb6d-0068c570ad" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txcadb5796047f40099cb6d-0068c570ad - 0.0164 VW - 1757769901.222122192 1757769901.238504648 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txa2ee2832a8734fc5a69a6-0068c570ad" "proxy-server 1824535" 0.0026 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txa2ee2832a8734fc5a69a6-0068c570ad - 0.0054 VW - 1757769901.247256517 1757769901.252691269 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "txc2c60444627445d99ff16-0068c570ad" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "txc2c60444627445d99ff16-0068c570ad" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txc2c60444627445d99ff16-0068c570ad - 0.0151 VW - 1757769901.253314972 1757769901.268371820 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/3/a/6_vc_ascii" 204 - "HEAD http://localhost/v1/a/6_vc_ascii" "tx048e3e99127e496faa10d-0068c570ad" "proxy-server 1824535" 0.0078 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.16395" 201 - "PUT http://localhost/sda1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.16395" "txfacf706089f2435899f1f-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.16395" 201 - "PUT http://localhost/sdb1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.16395" "txfacf706089f2435899f1f-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.16395" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.16395" "txfacf706089f2435899f1f-0068c570ad" "proxy-server 1824535" 0.0241 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.16395" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.16395" "txfacf706089f2435899f1f-0068c570ad" "proxy-server 1824535" 0.0239 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 PUT /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769901.16395 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txfacf706089f2435899f1f-0068c570ad - 0.0479 VW - 1757769901.269046545 1757769901.316900969 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txaa69103ef784480f9ea29-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txaa69103ef784480f9ea29-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txaa69103ef784480f9ea29-0068c570ad" "proxy-server 1824535" 0.0128 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "txaa69103ef784480f9ea29-0068c570ad" "proxy-server 1824535" 0.0123 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - txaa69103ef784480f9ea29-0068c570ad - 0.0260 - - 1757769901.317361832 1757769901.343324900 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5bfd2d88d70e4e10a3c79-0068c570ad" "proxy-server 1824535" 0.0056 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx5bfd2d88d70e4e10a3c79-0068c570ad - 0.0083 VW - 1757769901.345076323 1757769901.353408813 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "txde766b29d6144485a6537-0068c570ad" "proxy-server 1824535" 0.0088 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txde766b29d6144485a6537-0068c570ad - 0.0160 VW - 1757769901.353940248 1757769901.369905233 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "tx9eb74ecc51e34a258658b-0068c570ad" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3?symlink=get" "tx9eb74ecc51e34a258658b-0068c570ad" "proxy-server 1824535" 0.0007 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/3/a/6_vc_ascii" 204 - "HEAD http://localhost/v1/a/6_vc_ascii" "tx3fbebce843f847919cb38-0068c570ad" "proxy-server 1824535" 0.0088 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx9eb74ecc51e34a258658b-0068c570ad - 0.0359 VW - 1757769901.370528221 1757769901.406473398 0 - (txn: tx9fe1d5be5afd44ebad939-0068c570ad) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 201 - "PUT http://localhost/sda1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" "tx9fe1d5be5afd44ebad939-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 201 - "PUT http://localhost/sdb1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" "tx9fe1d5be5afd44ebad939-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" "tx9fe1d5be5afd44ebad939-0068c570ad" "proxy-server 1824535" 0.0132 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 201 - "PUT http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" "tx9fe1d5be5afd44ebad939-0068c570ad" "proxy-server 1824535" 0.0128 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 PUT /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769901.31792 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx9fe1d5be5afd44ebad939-0068c570ad - 0.0422 VW - 1757769901.381645679 1757769901.423796892 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx6893b17fbe234af9a4f6b-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_slow_primaries test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_slow_primaries ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx6893b17fbe234af9a4f6b-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx6893b17fbe234af9a4f6b-0068c570ad" "proxy-server 1824535" 0.0181 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx6893b17fbe234af9a4f6b-0068c570ad" "proxy-server 1824535" 0.0175 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx6893b17fbe234af9a4f6b-0068c570ad - 0.0307 - - 1757769901.424281597 1757769901.454977274 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc649e7308dad4cc99fb1c-0068c570ad" "proxy-server 1824535" 0.0056 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txc649e7308dad4cc99fb1c-0068c570ad - 0.0083 VW - 1757769901.456743956 1757769901.465025902 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx8f03e3ee574f42dc9b34d-0068c570ad" "proxy-server 1824535" 0.0027 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx8f03e3ee574f42dc9b34d-0068c570ad - 0.0139 VW - 1757769901.465595722 1757769901.479512930 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub?symlink=get" "txad49fb1145b34b43b4c06-0068c570ad" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub?symlink=get" "txad49fb1145b34b43b4c06-0068c570ad" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3/sub%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txad49fb1145b34b43b4c06-0068c570ad - 0.0098 VW - 1757769901.480163097 1757769901.489977360 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" "tx4c47c3d7c5484c38b997a-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" "tx4c47c3d7c5484c38b997a-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" "tx4c47c3d7c5484c38b997a-0068c570ad" "proxy-server 1824535" 0.0214 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" "tx4c47c3d7c5484c38b997a-0068c570ad" "proxy-server 1824535" 0.0255 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3/sub HTTP/1.0 201 - - t 4 - - tx4c47c3d7c5484c38b997a-0068c570ad - 0.0345 - - 1757769901.490385771 1757769901.524857044 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc61bfff6b0da401c9b4ba-0068c570ad" "proxy-server 1824535" 0.0015 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txc61bfff6b0da401c9b4ba-0068c570ad - 0.0127 VW - 1757769901.526492596 1757769901.539199829 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx3a91897a693c4b5c9da42-0068c570ad" "proxy-server 1824535" 0.0071 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx3a91897a693c4b5c9da42-0068c570ad - 0.0100 VW - 1757769901.539778471 1757769901.549770355 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 200 4 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub?symlink=get" "txedfd4248e8bb43478f5a5-0068c570ad" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 200 4 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub?symlink=get" "txedfd4248e8bb43478f5a5-0068c570ad" "proxy-server 1824535" 0.0007 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/3/a/6_vc_ascii" 204 - "HEAD http://localhost/v1/a/6_vc_ascii" "tx713e89e6a51343f59eb48-0068c570ad" "proxy-server 1824535" 0.0079 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3/sub%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 4 - txedfd4248e8bb43478f5a5-0068c570ad - 0.0353 VW - 1757769901.550384521 1757769901.585652828 0 - (txn: txacd9a691c5db4b6ebec1d-0068c570ad) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_vc_ascii/0136_o_non_ascii%C2%A3/sub/1757769901.49516" 201 - "PUT http://localhost/sdb1/0/a/6_vc_ascii/0136_o_non_ascii%C2%A3/sub/1757769901.49516" "txacd9a691c5db4b6ebec1d-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_vc_ascii/0136_o_non_ascii%C2%A3/sub/1757769901.49516" 201 - "PUT http://localhost/sda1/0/a/6_vc_ascii/0136_o_non_ascii%C2%A3/sub/1757769901.49516" "txacd9a691c5db4b6ebec1d-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/0/a/6_vc_ascii/0136_o_non_ascii%C2%A3/sub/1757769901.49516" 201 - "PUT http://localhost/v1/a/6_vc_ascii/0136_o_non_ascii%C2%A3/sub/1757769901.49516" "txacd9a691c5db4b6ebec1d-0068c570ad" "proxy-server 1824535" 0.0175 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/0/a/6_vc_ascii/0136_o_non_ascii%C2%A3/sub/1757769901.49516" 201 - "PUT http://localhost/v1/a/6_vc_ascii/0136_o_non_ascii%C2%A3/sub/1757769901.49516" "txacd9a691c5db4b6ebec1d-0068c570ad" "proxy-server 1824535" 0.0172 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 PUT /v1/a/6_vc_ascii/0136_o_non_ascii%25C2%25A3/sub/1757769901.49516 HTTP/1.0 201 - Swift - 4 - 1b52eb8ef2c1875cfdf3ffbe9e3c05da txacd9a691c5db4b6ebec1d-0068c570ad - 0.0416 VW - 1757769901.565819502 1757769901.607398987 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" "txe684216285b047eca1ec8-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" "txe684216285b047eca1ec8-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" "txe684216285b047eca1ec8-0068c570ad" "proxy-server 1824535" 0.0182 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3/sub" "txe684216285b047eca1ec8-0068c570ad" "proxy-server 1824535" 0.0134 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3/sub HTTP/1.0 201 - - t 4 - - txe684216285b047eca1ec8-0068c570ad - 0.0227 - - 1757769901.607903957 1757769901.630586863 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1cc197d788e34486849d6-0068c570ad" "proxy-server 1824535" 0.0057 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx1cc197d788e34486849d6-0068c570ad - 0.0085 VW - 1757769901.636583567 1757769901.645132542 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/1/a/6_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3" "tx1fe0dc501722420ea7143-0068c570ad" "proxy-server 1824535" 0.0082 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a/6_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx1fe0dc501722420ea7143-0068c570ad - 0.0153 VW - 1757769901.645699739 1757769901.660962105 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/3/a/6_vc_ascii" 200 764 "GET http://localhost/v1/a/6_vc_ascii?prefix=00f6_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "txafabeea544b44429bbf02-0068c570ad" "proxy-server 1824535" 0.0037 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_vc_ascii%3Fprefix%3D00f6_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 764 - txafabeea544b44429bbf02-0068c570ad - 0.0113 VW - 1757769901.661556959 1757769901.672812462 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 200 5 "GET http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792?symlink=get" "txc5fe2c5afac74781a3078-0068c570ad" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 200 5 "GET http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792?symlink=get" "txc5fe2c5afac74781a3078-0068c570ad" "proxy-server 1824535" 0.0048 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769901.31792%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txc5fe2c5afac74781a3078-0068c570ad - 0.0248 VW - 1757769901.673372269 1757769901.698181868 0 - (txn: tx8c93bce928024ed391a41-0068c570ad) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx8c93bce928024ed391a41-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx8c93bce928024ed391a41-0068c570ad" "proxy-server 1824535" 0.0149 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx8c93bce928024ed391a41-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3/6_o_non_ascii%C2%A3" "tx8c93bce928024ed391a41-0068c570ad" "proxy-server 1824535" 0.0265 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 PUT /v1/a/6_oc_non_ascii%25C2%25A3/6_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx8c93bce928024ed391a41-0068c570ad - 0.0358 VW - 1757769901.688749313 1757769901.724552870 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "DELETE /sda1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 204 - "DELETE http://localhost/sda1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" "tx4c1c3fbec8ee44e9bf8f5-0068c570ad" "object-server 1824535" 0.0049 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "DELETE /sdb1/3/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 204 - "DELETE http://localhost/sdb1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" "tx4c1c3fbec8ee44e9bf8f5-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "DELETE /sda1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 204 - "DELETE http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" "tx4c1c3fbec8ee44e9bf8f5-0068c570ad" "proxy-server 1824535" 0.0123 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "DELETE /sdb1/2/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" 204 - "DELETE http://localhost/v1/a/6_vc_ascii/00f6_o_non_ascii%C2%A3/1757769901.31792" "tx4c1c3fbec8ee44e9bf8f5-0068c570ad" "proxy-server 1824535" 0.0144 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 DELETE /v1/a/6_vc_ascii/00f6_o_non_ascii%25C2%25A3/1757769901.31792 HTTP/1.0 204 - Swift - - - - tx4c1c3fbec8ee44e9bf8f5-0068c570ad - 0.0264 VW - 1757769901.725155592 1757769901.751553535 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9d87db4ce47a4c59a4bc9-0068c570ad" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/3/a/6_vc_ascii" 200 195 "GET http://localhost/v1/a/6_vc_ascii?prefix=0136_o_non_ascii%C2%A3%2Fsub%2F&format=json&states=listing" "tx9d87db4ce47a4c59a4bc9-0068c570ad" "proxy-server 1824535" 0.0094 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 GET /v1/a/6_vc_ascii%3Fprefix%3D0136_o_non_ascii%25C2%25A3%252Fsub%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 195 - tx9d87db4ce47a4c59a4bc9-0068c570ad - 0.0300 - - 1757769901.753414154 1757769901.783390999 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx056778673bca4d18abef9-0068c570ad" "proxy-server 1824535" 0.0015 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/1/a/6_oc_non_ascii%C2%A3whoops" 201 - "PUT http://127.0.0.1:38699/sda1/3/a/6_oc_non_ascii%C2%A3whoops" "tx056778673bca4d18abef9-0068c570ad" "container-server 1824535" 0.0011 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/1/a/6_oc_non_ascii%C2%A3whoops" 201 - "PUT http://127.0.0.1:44669/sdb1/3/a/6_oc_non_ascii%C2%A3whoops" "tx056778673bca4d18abef9-0068c570ad" "container-server 1824535" 0.0091 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3whoops" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops" "tx056778673bca4d18abef9-0068c570ad" "proxy-server 1824535" 0.0216 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3whoops" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops" "tx056778673bca4d18abef9-0068c570ad" "proxy-server 1824535" 0.0315 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 PUT /v1/a/6_oc_non_ascii%25C2%25A3whoops HTTP/1.0 201 - - t - - - tx056778673bca4d18abef9-0068c570ad - 0.0482 - - 1757769901.785508394 1757769901.833666563 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx71357385ae2e4802be348-0068c570ad" "proxy-server 1824535" 0.0062 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx71357385ae2e4802be348-0068c570ad - 0.0090 VW - 1757769901.839569092 1757769901.848596334 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/3/a/6_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops" "tx21fe6143258f470f89b57-0068c570ad" "proxy-server 1824535" 0.0014 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a/6_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - tx21fe6143258f470f89b57-0068c570ad - 0.0085 VW - 1757769901.849194527 1757769901.857653618 0 -test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_container_utf_object test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_container_utf_object ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_some_slow_primaries test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_some_slow_primaries ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/0/a/6_oc_non_ascii%C2%A3whoops/foo" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx6827d6782961430b94cbc-0068c570ad" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/0/a/6_oc_non_ascii%C2%A3whoops/foo" 404 70 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx6827d6782961430b94cbc-0068c570ad" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_oc_non_ascii%25C2%25A3whoops/foo%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx6827d6782961430b94cbc-0068c570ad - 0.0100 VW - 1757769901.858340979 1757769901.868312836 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/3/a/6_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/sdb1/0/a/6_oc_non_ascii%C2%A3whoops/foo" "tx1929391c27b140d4b1dd7-0068c570ad" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/3/a/6_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/sda1/0/a/6_oc_non_ascii%C2%A3whoops/foo" "tx1929391c27b140d4b1dd7-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sda1/0/a/6_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops/foo" "tx1929391c27b140d4b1dd7-0068c570ad" "proxy-server 1824535" 0.0070 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "PUT /sdb1/0/a/6_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops/foo" "tx1929391c27b140d4b1dd7-0068c570ad" "proxy-server 1824535" 0.0086 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 PUT /v1/a/6_oc_non_ascii%25C2%25A3whoops/foo HTTP/1.0 201 - - t 5 - - tx1929391c27b140d4b1dd7-0068c570ad - 0.0137 - - 1757769901.868740559 1757769901.882413626 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc1e8f31813ad44af9fc57-0068c570ad" "proxy-server 1824535" 0.0020 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txc1e8f31813ad44af9fc57-0068c570ad - 0.0048 VW - 1757769901.884058475 1757769901.888813019 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/3/a/6_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops" "tx5abaf113d909441d83082-0068c570ad" "proxy-server 1824535" 0.0025 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a/6_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - tx5abaf113d909441d83082-0068c570ad - 0.0052 VW - 1757769901.889359474 1757769901.894602060 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/0/a/6_oc_non_ascii%C2%A3whoops/foo" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx9b56b15a93514642ae9ec-0068c570ad" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/0/a/6_oc_non_ascii%C2%A3whoops/foo" 200 5 "GET http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx9b56b15a93514642ae9ec-0068c570ad" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx6e2fc6cb324d441fbf885-0068c570ad" "proxy-server 1824535" 0.0003 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sdb1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx6e2fc6cb324d441fbf885-0068c570ad" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/6_oc_non_ascii%25C2%25A3whoops/foo%3Fsymlink%3Dget HTTP/1.0 499 - Swift - - 5 - tx9b56b15a93514642ae9ec-0068c570ad - 0.0207 VW - 1757769901.895287275 1757769901.915994883 0 - (txn: txe1e8d20d14b142a396a29-0068c570ad) proxy INFO: - - 13/Sep/2025/13/25/01 PUT /v1/a/none/003foo/1757769901.86934 HTTP/1.0 404 - Swift - - 70 dcddb75469b4b4875094e14561e573d8 txe1e8d20d14b142a396a29-0068c570ad - 0.0106 VW - 1757769901.905789614 1757769901.916421890 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc43578a6ea3e45b989f78-0068c570ad" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txc43578a6ea3e45b989f78-0068c570ad - 0.0083 VW - 1757769901.918320179 1757769901.926578760 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/3/a/6_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops" "tx0866ffdffcf34a92a4e62-0068c570ad" "proxy-server 1824535" 0.0059 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 HEAD /v1/a/6_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - tx0866ffdffcf34a92a4e62-0068c570ad - 0.0088 VW - 1757769901.931365967 1757769901.940173388 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sda1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txeed20b4dd7a8412eb32a1-0068c570ad" "proxy-server 1824535" 0.0047 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "GET /sdb1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txeed20b4dd7a8412eb32a1-0068c570ad" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/01 GET /v1/a/none%3Fprefix%3D003foo%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 404 - Swift - - 70 - txeed20b4dd7a8412eb32a1-0068c570ad - 0.0143 VW - 1757769901.940769196 1757769901.955115080 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "DELETE /sda1/3/a/6_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/sdb1/0/a/6_oc_non_ascii%C2%A3whoops/foo" "tx15773561f3ea4e4eb5ffe-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "DELETE /sdb1/3/a/6_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/sda1/0/a/6_oc_non_ascii%C2%A3whoops/foo" "tx15773561f3ea4e4eb5ffe-0068c570ad" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "DELETE /sda1/0/a/6_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops/foo" "tx15773561f3ea4e4eb5ffe-0068c570ad" "proxy-server 1824535" 0.0055 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "DELETE /sdb1/0/a/6_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/v1/a/6_oc_non_ascii%C2%A3whoops/foo" "tx15773561f3ea4e4eb5ffe-0068c570ad" "proxy-server 1824535" 0.0113 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/01 DELETE /v1/a/6_oc_non_ascii%25C2%25A3whoops/foo HTTP/1.0 204 - - t - - - tx15773561f3ea4e4eb5ffe-0068c570ad - 0.0236 - - 1757769901.955554008 1757769901.979189873 0 - proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:01 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdd0d1bb2bb9d43bb952ea-0068c570ad" "proxy-server 1824535" 0.0015 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/1/a/3_oc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/3_oc_non_ascii%C2%A3" "txdd0d1bb2bb9d43bb952ea-0068c570ad" "container-server 1824535" 0.0011 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/1/a/3_oc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/3_oc_non_ascii%C2%A3" "txdd0d1bb2bb9d43bb952ea-0068c570ad" "container-server 1824535" 0.0011 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txdd0d1bb2bb9d43bb952ea-0068c570ad" "proxy-server 1824535" 0.0147 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txdd0d1bb2bb9d43bb952ea-0068c570ad" "proxy-server 1824535" 0.0100 "-" 1824535 0 proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx71d474117df6483da4abb-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Ignoring 404 from primary (txn: txdf6f35ab00ef4abeba575-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txa4a56e2985ee478a89a3b-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR 500 Trying to GET /a/c/o From Object Server 10.0.0.6:1006/sdg (txn: txee77a898060447fe935ec-0068c570ac) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from primary (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from primary (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from primary (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from primary (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae)test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_success_and_404_will_404 test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_success_and_404_will_404 ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_success_and_507_will_503 test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_with_success_and_507_will_503 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reclaim_deadlock test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reclaim_deadlock ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 PUT /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - txdd0d1bb2bb9d43bb952ea-0068c570ad - 0.0276 - - 1757769901.982671022 1757769902.010241508 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9be7d290e5fe4f8198031-0068c570ae" "proxy-server 1824535" 0.0022 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/2/a/3_oc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3?format=json&states=listing" "tx9be7d290e5fe4f8198031-0068c570ae" "proxy-server 1824535" 0.0022 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx9be7d290e5fe4f8198031-0068c570ae - 0.0196 - - 1757769902.016089916 1757769902.035655499 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa566a748baee448aa4501-0068c570ae" "proxy-server 1824535" 0.0015 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:44669/sdb1/1/a/3_vc_non_ascii%C2%A3" "txa566a748baee448aa4501-0068c570ae" "container-server 1824535" 0.0036 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:38699/sda1/1/a/3_vc_non_ascii%C2%A3" "txa566a748baee448aa4501-0068c570ae" "container-server 1824535" 0.0011 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3" "txa566a748baee448aa4501-0068c570ae" "proxy-server 1824535" 0.0138 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3" "txa566a748baee448aa4501-0068c570ae" "proxy-server 1824535" 0.0232 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 PUT /v1/a/3_vc_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - txa566a748baee448aa4501-0068c570ae - 0.0475 - - 1757769902.037678480 1757769902.085177660 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd401476ecbcb429e996b1-0068c570ae" "proxy-server 1824535" 0.0020 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txd401476ecbcb429e996b1-0068c570ae - 0.0049 VW - 1757769902.086817026 1757769902.091759443 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txa5101799a5b14af4a1301-0068c570ae" "proxy-server 1824535" 0.0014 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txa5101799a5b14af4a1301-0068c570ae - 0.0042 VW - 1757769902.092357635 1757769902.096573353 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx919f83337e7d4f0d9298b-0068c570ae" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx919f83337e7d4f0d9298b-0068c570ae" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx919f83337e7d4f0d9298b-0068c570ae - 0.0055 VW - 1757769902.097205162 1757769902.102716923 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx3128cb0a2379420aa4c8a-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx3128cb0a2379420aa4c8a-0068c570ae" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx3128cb0a2379420aa4c8a-0068c570ae" "proxy-server 1824535" 0.0112 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx3128cb0a2379420aa4c8a-0068c570ae" "proxy-server 1824535" 0.0126 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - - t 5 - - tx3128cb0a2379420aa4c8a-0068c570ae - 0.0164 - - 1757769902.103145361 1757769902.119517803 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa8c40d5fb2314f5eabff0-0068c570ae" "proxy-server 1824535" 0.0105 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa8c40d5fb2314f5eabff0-0068c570ae - 0.0135 VW - 1757769902.131701469 1757769902.145157576 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx5bd87f7b6bdf4c6fbd4a9-0068c570ae" "proxy-server 1824535" 0.0029 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx5bd87f7b6bdf4c6fbd4a9-0068c570ae - 0.0100 VW - 1757769902.145736217 1757769902.155751228 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx0f783f52b9bd4ff8bfbd4-0068c570ae" "proxy-server 1824535" 0.0048 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx0f783f52b9bd4ff8bfbd4-0068c570ae" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a/3_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_vc_non_ascii%C2%A3" "txbfd660040bb74ecfa2f84-0068c570ae" "proxy-server 1824535" 0.0057 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx0f783f52b9bd4ff8bfbd4-0068c570ae - 0.0335 VW - 1757769902.156373024 1757769902.189842939 0 - (txn: txe4fe4486573543909c778-0068c570ae) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 201 - "PUT http://localhost/sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" "txe4fe4486573543909c778-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" "txe4fe4486573543909c778-0068c570ae" "proxy-server 1824535" 0.0180 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 201 - "PUT http://localhost/sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" "txe4fe4486573543909c778-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" "txe4fe4486573543909c778-0068c570ae" "proxy-server 1824535" 0.0212 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 PUT /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769902.10369 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txe4fe4486573543909c778-0068c570ae - 0.0433 VW - 1757769902.171896458 1757769902.215187788 0 -test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reclaim_shard_ranges test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reclaim_shard_ranges ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reclaim_with_duplicate_names test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reclaim_with_duplicate_names ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reconciler_sync test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reconciler_sync ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx1e21ff9ca6564201895da-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx1e21ff9ca6564201895da-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx1e21ff9ca6564201895da-0068c570ae" "proxy-server 1824535" 0.0224 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx1e21ff9ca6564201895da-0068c570ae" "proxy-server 1824535" 0.0136 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - - t 5 - - tx1e21ff9ca6564201895da-0068c570ae - 0.0268 - - 1757769902.215752363 1757769902.242571354 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc1a9aa629c884e17b9162-0068c570ae" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx2cc15383cdce43f2aa5d1-0068c570ae" "proxy-server 1824535" 0.0033 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txef5e71ab15d24cf79079e-0068c570ae" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 200 - - t - 5 - txef5e71ab15d24cf79079e-0068c570ae - 0.0221 - - 1757769902.249276400 1757769902.271411657 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4eb615c57e4b442bba744-0068c570ae" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx4eb615c57e4b442bba744-0068c570ae - 0.0084 VW - 1757769902.287698507 1757769902.296080589 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txcf0b1d8f58f849c693e09-0068c570ae" "proxy-server 1824535" 0.0055 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txcf0b1d8f58f849c693e09-0068c570ae - 0.0084 VW - 1757769902.296663761 1757769902.305090189 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx63926aa1683641c78199c-0068c570ae" "proxy-server 1824535" 0.0012 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx63926aa1683641c78199c-0068c570ae" "proxy-server 1824535" 0.0048 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a/3_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_vc_non_ascii%C2%A3" "txd72a4e76707e4ec586a96-0068c570ae" "proxy-server 1824535" 0.0069 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx63926aa1683641c78199c-0068c570ae - 0.0452 VW - 1757769902.305722952 1757769902.350960493 0 - (txn: tx412b0dca9ccf472c88225-0068c570ae) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 201 - "PUT http://localhost/sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" "tx412b0dca9ccf472c88225-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" "tx412b0dca9ccf472c88225-0068c570ae" "proxy-server 1824535" 0.0170 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 201 - "PUT http://localhost/sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" "tx412b0dca9ccf472c88225-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" "tx412b0dca9ccf472c88225-0068c570ae" "proxy-server 1824535" 0.0202 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 PUT /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769902.21632 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 tx412b0dca9ccf472c88225-0068c570ae - 0.0504 VW - 1757769902.320808649 1757769902.371184587 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx7454ea37a78f4ae594110-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx7454ea37a78f4ae594110-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx7454ea37a78f4ae594110-0068c570ae" "proxy-server 1824535" 0.0192 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx7454ea37a78f4ae594110-0068c570ae" "proxy-server 1824535" 0.0145 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - - t 5 - - tx7454ea37a78f4ae594110-0068c570ae - 0.0281 - - 1757769902.371709347 1757769902.399858475 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe66fad1494c04c30a5f11-0068c570ae" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx59910ae14cbf48f187481-0068c570ae" "proxy-server 1824535" 0.0082 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa9263f27ccb34013aa268-0068c570ae" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 200 - - t - 5 - txa9263f27ccb34013aa268-0068c570ae - 0.0284 - - 1757769902.401559353 1757769902.429992914 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txca69dbfc3bc64f64a64b1-0068c570ae" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/1/a/3_vc_non_ascii%C2%A3" 200 362 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?format=json&states=listing" "txca69dbfc3bc64f64a64b1-0068c570ae" "proxy-server 1824535" 0.0111 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 362 - txca69dbfc3bc64f64a64b1-0068c570ae - 0.0274 - - 1757769902.435915232 1757769902.463331938 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx08a8d4653592446a816ce-0068c570ae" "proxy-server 1824535" 0.0014 "-" 1824535 -test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_write_timeout test.unit.proxy.controllers.test_obj.TestECObjController.test_GET_write_timeout ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_if_match test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_if_match ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_if_none_match test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_if_none_match ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_simple test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_simple ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx1f3bb677198346bfbd17f-0068c570ae" "proxy-server 1824535" 0.0056 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx642c013f898c41e3a3d97-0068c570ae" "proxy-server 1824535" 0.0089 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx642c013f898c41e3a3d97-0068c570ae" "proxy-server 1824535" 0.0007 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc900fd649ad24008b6103-0068c570ae" "proxy-server 1824535" 0.0096 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txc900fd649ad24008b6103-0068c570ae - 0.0125 VW - 1757769902.512078524 1757769902.524616003 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txb2d72e5f12134d719e321-0068c570ae" "proxy-server 1824535" 0.0070 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txb2d72e5f12134d719e321-0068c570ae - 0.0172 VW - 1757769902.525223494 1757769902.542426825 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/copied_name" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/copied_name?symlink=get" "txa2241ea1df674c74a5ead-0068c570ae" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/copied_name" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/copied_name?symlink=get" "txa2241ea1df674c74a5ead-0068c570ae" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/copied_name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txa2241ea1df674c74a5ead-0068c570ae - 0.0139 VW - 1757769902.543107748 1757769902.556967497 0 - proxy INFO: - - 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 200 - Swift t - 5 - tx642c013f898c41e3a3d97-0068c570ae - 0.1008 SSC - 1757769902.465546131 1757769902.566372156 0 - (txn: tx3acc237c157d4d299d6a5-0068c570ae) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/copied_name" "tx3acc237c157d4d299d6a5-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/copied_name" "tx3acc237c157d4d299d6a5-0068c570ae" "object-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/copied_name" "tx3acc237c157d4d299d6a5-0068c570ae" "proxy-server 1824535" 0.0238 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/copied_name" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/copied_name" "tx3acc237c157d4d299d6a5-0068c570ae" "proxy-server 1824535" 0.0254 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 COPY /v1/a/3_oc_non_ascii%25C2%25A3/copied_name HTTP/1.0 201 - - t 5 - db7282901da891bea2fcd73840caad1c tx3acc237c157d4d299d6a5-0068c570ae - 0.0378 SSC - 1757769902.557374001 1757769902.595184088 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5e88825874734d48b13dd-0068c570ae" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txa9bd1a6b30614dbbab5c2-0068c570ae" "proxy-server 1824535" 0.0036 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/copied_name" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/copied_name" "tx95a32c1840554d3899a6c-0068c570ae" "proxy-server 1824535" 0.0048 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/copied_name HTTP/1.0 200 - - t - 5 - tx95a32c1840554d3899a6c-0068c570ae - 0.0278 - - 1757769902.597093821 1757769902.624931335 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx519e10cd5ba64a25ab4ee-0068c570ae" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txf1643a822cfc49d580e32-0068c570ae" "proxy-server 1824535" 0.0055 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "POST http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa9d8014003104915ac675-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "POST /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 202 76 "POST http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa9d8014003104915ac675-0068c570ae" "proxy-server 1824535" 0.0104 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "POST http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa9d8014003104915ac675-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "POST /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 202 76 "POST http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa9d8014003104915ac675-0068c570ae" "proxy-server 1824535" 0.0128 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 POST /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 202 - - t - 76 - txa9d8014003104915ac675-0068c570ae - 0.0397 - - 1757769902.630685806 1757769902.670403004 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd78fc042b7274f16b3a2c-0068c570ae" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txb4838b6fc5a84306b8897-0068c570ae" "proxy-server 1824535" 0.0081 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx38d7d4d88baa4002a4296-0068c570ae" "proxy-server 1824535" 0.0008 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 200 - - t - 5 - tx38d7d4d88baa4002a4296-0068c570ae - 0.0330 - - 1757769902.676264286 1757769902.709214449 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9f2d060a7e264039a3a9a-0068c570ae" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/2/a/3_oc_non_ascii%C2%A3" 200 316 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3?format=json&states=listing" "tx9f2d060a7e264039a3a9a-0068c570ae" "proxy-server 1824535" 0.0066 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 316 - tx9f2d060a7e264039a3a9a-0068c570ae - 0.0184 - - 1757769902.715108156 1757769902.733475685 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa35cebbba62c43f6958a9-0068c570ae" "proxy-server 1824535" 0.0021 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa35cebbba62c43f6958a9-0068c570ae - 0.0049 VW - 1757769902.739738464 1757769902.744669914 - -test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_x_newest test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_x_newest ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_remove_objects test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_remove_objects ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_resolve_shard_range_states test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_resolve_shard_range_states ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_x_newest_different_timestamps test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_x_newest_different_timestamps ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_x_newest_with_some_missing test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_x_newest_with_some_missing ... ok proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Ignoring 404 from handoff (txn: txd095c1c2135b4caab338c-0068c570ae) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.9:1009/sdj, error: ERROR Insufficient Storage (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Node is error limited: 10.0.0.9:1009/sdj (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.10:1010/sdk, error: ERROR Insufficient Storage (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Node is error limited: 10.0.0.10:1010/sdk (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.13:1013/sdn, error: ERROR Insufficient Storage (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Node is error limited: 10.0.0.13:1013/sdn (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.11:1011/sdl, error: ERROR Insufficient Storage (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Node is error limited: 10.0.0.11:1011/sdl (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.12:1012/sdm, error: ERROR Insufficient Storage (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Node is error limited: 10.0.0.12:1012/sdm (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Ignoring 507 from handoff (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server ERROR: Object returning 503 for [507, 507, 507, 507, 507] (txn: txf27eaa6e91b540eb8fb55-0068c570ae) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.01s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.01s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.01s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.01s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.01s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.01s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.02s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.02s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.02s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server ERROR: ChunkWriteTimeout feeding fragments for '/a/c/o': ChunkWriteTimeout (0.01s after 0.02s) (txn: tx426ed62dcaff447f9341a-0068c570ae) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_x_newest_with_two_vector_timestamps test.unit.proxy.controllers.test_obj.TestECObjController.test_HEAD_x_newest_with_two_vector_timestamps ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_all_primaries_fail_insufficient_handoff_succeeds test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_all_primaries_fail_insufficient_handoff_succeeds ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reverse_prefix_delim test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_reverse_prefix_delim ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_all_primaries_fail_sufficient_handoff_succeeds test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_all_primaries_fail_sufficient_handoff_succeeds ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_all_primaries_succeed test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_all_primaries_succeed ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_delete_at_in_past test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_delete_at_in_past ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx2ae419fc587742b4bba91-0068c570ae" "proxy-server 1824535" 0.0014 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx2ae419fc587742b4bba91-0068c570ae - 0.0125 VW - 1757769902.745335102 1757769902.757785559 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/1/a/3_vc_non_ascii%C2%A3" 200 362 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?prefix=0093_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "tx2334116ef8054e6a896c3-0068c570ae" "proxy-server 1824535" 0.0106 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fprefix%3D0093_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 362 - tx2334116ef8054e6a896c3-0068c570ae - 0.0224 VW - 1757769902.758404493 1757769902.780822039 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 200 5 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632?symlink=get" "tx9275824055544b8c9e608-0068c570ae" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 200 5 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632?symlink=get" "tx9275824055544b8c9e608-0068c570ae" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 GET /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769902.21632%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx9275824055544b8c9e608-0068c570ae - 0.0460 VW - 1757769902.781403542 1757769902.827427149 0 - (txn: txa1b1ce95c2ce411a8a032-0068c570ae) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa1b1ce95c2ce411a8a032-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa1b1ce95c2ce411a8a032-0068c570ae" "object-server 1824535" 0.0046 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa1b1ce95c2ce411a8a032-0068c570ae" "proxy-server 1824535" 0.0236 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa1b1ce95c2ce411a8a032-0068c570ae" "proxy-server 1824535" 0.0229 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 txa1b1ce95c2ce411a8a032-0068c570ae - 0.0403 VW - 1757769902.805720091 1757769902.846050501 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "DELETE /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 204 - "DELETE http://localhost/sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" "txabf765cd9b8243b8990e7-0068c570ae" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "DELETE /sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 204 - "DELETE http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" "txabf765cd9b8243b8990e7-0068c570ae" "proxy-server 1824535" 0.0081 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "DELETE /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 204 - "DELETE http://localhost/sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" "txabf765cd9b8243b8990e7-0068c570ae" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "DELETE /sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" 204 - "DELETE http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.21632" "txabf765cd9b8243b8990e7-0068c570ae" "proxy-server 1824535" 0.0147 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 DELETE /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769902.21632 HTTP/1.0 204 - Swift - - - - txabf765cd9b8243b8990e7-0068c570ae - 0.0239 VW - 1757769902.846596003 1757769902.870539665 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2c739a46fe5149f8a552a-0068c570ae" "proxy-server 1824535" 0.0057 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx9b54a35be387421e82827-0068c570ae" "proxy-server 1824535" 0.0029 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txe93cd0eae6cf46448c3f1-0068c570ae" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 200 - - t - 5 - txe93cd0eae6cf46448c3f1-0068c570ae - 0.0394 - - 1757769902.876606941 1757769902.916051865 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5e858a117946455aa7767-0068c570ae" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "GET /sdb1/1/a/3_vc_non_ascii%C2%A3" 200 181 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?prefix=0093_o_ascii%2F&format=json&states=listing" "tx5e858a117946455aa7767-0068c570ae" "proxy-server 1824535" 0.0091 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/02 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fprefix%3D0093_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 181 - tx5e858a117946455aa7767-0068c570ae - 0.0416 - - 1757769902.917863131 1757769902.959454298 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5d507a512fdb4e8286a87-0068c570ae" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx5d507a512fdb4e8286a87-0068c570ae - 0.0124 VW - 1757769902.961530209 1757769902.973959446 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:02 +0000] "HEAD /sda1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx63070a45ee514eaa839bf-0068c570ae" "proxy-server 1824535" 0.0113 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/02 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx63070a45ee514eaa839bf-0068c570ae - 0.0224 VW - 1757769902.974513054 1757769902.996948242 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/1/a/3_vc_non_ascii%C2%A3" 200 181 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?prefix=0093_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "tx7b0bc3d23e554508b03dc-0068c570ae" "proxy-server 1824535" 0.0119 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fprefix%3D0093_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 181 - tx7b0bc3d23e554508b03dc-0068c570ae - 0.0236 VW - 1757769902.997612000 1757769903.021183252 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 200 5 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369?symlink=get" "txcf440bee4a704604aa808-0068c570af" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 200 5 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369?symlink=get" "txcf440bee4a704604aa808-0068c570af" "proxy-server 1824535" 0.0089 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_delete_at_non_integer test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_delete_at_non_integer ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_insufficient_primaries_others_fail_handoffs_404 test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_insufficient_primaries_others_fail_handoffs_404 ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_root_account_container_path test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_root_account_container_path ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_save_and_load_record_from_pending_file test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_save_and_load_record_from_pending_file ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx772db81724d348938ae17-0068c570af) proxy-server ERROR: Object POST returning 503 for (202, 202, 202, 202, 202, 202, 503, 503, 503, 503, 503, 503, 503, 503) (txn: tx772db81724d348938ae17-0068c570af) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx8d3f13d33e2445169b2ef-0068c570af) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx655675ba9a21429d999db-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx655675ba9a21429d999db-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx655675ba9a21429d999db-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx655675ba9a21429d999db-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx655675ba9a21429d999db-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.11:1011/sdl re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx655675ba9a21429d999db-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.2:1002/sdc re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx655675ba9a21429d999db-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.8:1008/sdi re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx655675ba9a21429d999db-0068c570af) proxy-server ERROR: Object POST returning 503 for (202, 202, 202, 202, 202, 202, 503, 503, 503, 503, 503, 503, 503, 503) (txn: tx655675ba9a21429d999db-0068c570af) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_insufficient_primaries_others_fail_handoffs_fail test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_insufficient_primaries_others_fail_handoffs_fail ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_insufficient_primaries_succeed_others_404 test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_insufficient_primaries_succeed_others_404 ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_limits_expirer_queue_deletes test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_limits_expirer_queue_deletes ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_negative_delete_after test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_negative_delete_after ... ok test ERROR: Failed to unlink '/tmp/tmpcaa1aobo/containers/part/suffix/hash/container.db': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2235, in set_sharded_state os.unlink(retiring_file) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: 1 test DEBUG: Unlinked retiring db '/tmp/tmpcaa1aobo/containers/part/suffix/hash/container_1757769881.00000.db' test WARNING: Still have multiple db files after unlinking '/tmp/tmpcaa1aobo/containers/part/suffix/hash/container_1757769881.00000.db': ['/tmp/tmpcaa1aobo/containers/part/suffix/hash/container.db', '/tmp/tmpcaa1aobo/containers/part/suffix/hash/container_1757769882.00000.db'] test WARNING: Refusing to delete db file for 'a/c': no fresher db file found in ['/tmp/tmpcaa1aobo/containers/part/suffix/hash/container_1757769882.00000.db']. test ERROR: Failed to set the ROWID of the fresh database for a/c: test ERROR: Failed to sync the container_stat table/view with the fresh database for a/c: test ERROR: Problem finding shard upper in '/tmp/tmp96fz61en/test_container.db': : LockTimeout (Nones) test ERROR: Problem finding shard upper in '/tmp/tmp96fz61en/test_container.db': : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2498, in find_shard_ranges next_shard_upper = sub_broker._get_next_shard_range_upper( shard_size, last_shard_upper) File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect sqlite3.OperationalError test DEBUG: Unlinked retiring db '/tmp/tmpoggh337b/containers/part/suffix/hash/container.db' test WARNING: Unexpected db files will be ignored: ['/tmp/tmpoggh337b/containers/part/suffix/hash/container.db'] Container 'a/c' cannot be set to sharded state while in unsharded state Container 'a/c' cannot be set to sharding state: missing epoch test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_non_int_delete_after test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_non_int_delete_after ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_sufficient_primaries_succeed_others_404 test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_sufficient_primaries_succeed_others_404 ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_sufficient_primaries_succeed_others_fail test.unit.proxy.controllers.test_obj.TestECObjController.test_POST_sufficient_primaries_succeed_others_fail ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_delete_at_in_past test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_delete_at_in_past ... ok Container 'a/c' cannot be set to sharding state while in sharding state proxy INFO: - - 13/Sep/2025/13/25/03 GET /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769902.10369%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txcf440bee4a704604aa808-0068c570af - 0.0407 VW - 1757769903.021738768 1757769903.062471151 0 - (txn: tx5211bab2c1984cc281de7-0068c570af) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx5211bab2c1984cc281de7-0068c570af" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx5211bab2c1984cc281de7-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx5211bab2c1984cc281de7-0068c570af" "proxy-server 1824535" 0.0205 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx5211bab2c1984cc281de7-0068c570af" "proxy-server 1824535" 0.0222 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx5211bab2c1984cc281de7-0068c570af - 0.0778 VW - 1757769903.045148849 1757769903.122929335 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "DELETE /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 204 - "DELETE http://localhost/sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" "txaa34749c9f1344ceb0c18-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "DELETE /sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 204 - "DELETE http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" "txaa34749c9f1344ceb0c18-0068c570af" "proxy-server 1824535" 0.0169 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "DELETE /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 204 - "DELETE http://localhost/sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" "txaa34749c9f1344ceb0c18-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "DELETE /sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" 204 - "DELETE http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769902.10369" "txaa34749c9f1344ceb0c18-0068c570af" "proxy-server 1824535" 0.0189 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 DELETE /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769902.10369 HTTP/1.0 204 - Swift - - - - txaa34749c9f1344ceb0c18-0068c570af - 0.0322 VW - 1757769903.123485088 1757769903.155644655 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2882116a99be433f8b814-0068c570af" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx41552f11ca17424d80510-0068c570af" "proxy-server 1824535" 0.0029 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx59dd6734fd094ef59876f-0068c570af" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 200 - - t - 5 - tx59dd6734fd094ef59876f-0068c570af - 0.0341 - - 1757769903.157251596 1757769903.191329241 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx907e9f4afc544611adb55-0068c570af" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/1/a/3_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?prefix=0093_o_ascii%2F&format=json&states=listing" "tx907e9f4afc544611adb55-0068c570af" "proxy-server 1824535" 0.0038 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fprefix%3D0093_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx907e9f4afc544611adb55-0068c570af - 0.0233 - - 1757769903.193084002 1757769903.216377974 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbaef82e0e3d541bbbf699-0068c570af" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/1/a/3_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?prefix=0093_o_ascii%2F&format=json&states=listing" "txbaef82e0e3d541bbbf699-0068c570af" "proxy-server 1824535" 0.0021 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fprefix%3D0093_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - txbaef82e0e3d541bbbf699-0068c570af - 0.0257 - - 1757769903.218237162 1757769903.243906736 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe95d2de023124bcaa8f31-0068c570af" "proxy-server 1824535" 0.0012 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txe95d2de023124bcaa8f31-0068c570af - 0.0120 VW - 1757769903.245775461 1757769903.257779121 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txdf8222c8770348778259d-0068c570af" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txdf8222c8770348778259d-0068c570af - 0.0080 VW - 1757769903.258308649 1757769903.266290665 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/1/a/3_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?prefix=0093_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "txa7006ca8dd7343e2b434e-0068c570af" "proxy-server 1824535" 0.0084 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fprefix%3D0093_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 2 - txa7006ca8dd7343e2b434e-0068c570af - 0.0157 VW - 1757769903.271008253 1757769903.286714077 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "DELETE /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 204 - "DELETE http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx754258af8d154418bfc09-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "DELETE /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 204 - "DELETE http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx754258af8d154418bfc09-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "DELETE /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 204 - "DELETE http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx754258af8d154418bfc09-0068c570af" "proxy-server 1824535" 0.0150 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "DELETE /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 204 - "DELETE http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx754258af8d154418bfc09-0068c570af" "proxy-server 1824535" 0.0100 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 DELETE /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 204 - - t - - - tx754258af8d154418bfc09-0068c570af - 0.0190 - - 1757769903.287233114 1757769903.306233644 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9208ee0f37414e1198cdd-0068c570af" "proxy-server 1824535" 0.0093 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txd8fefd77cec1470fbc0a6-0068c570af" "proxy-server 1824535" 0.0178 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_delete_at_non_integer test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_delete_at_non_integer ... ok Container 'a/c' cannot be set to sharded state while in sharded state proxy-server ERROR: ERROR with Object server 10.0.0.5:1005/sdf re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.13:1013/sdn re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.10:1010/sdk re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.9:1009/sdj re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.14:1014/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.15:1015/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.16:1016/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.17:1017/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.18:1018/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.19:1019/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.20:1020/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.21:1021/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.22:1022/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.23:1023/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.24:1024/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.25:1025/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.26:1026/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Node will be error limited for 60.00s: 10.0.0.27:1027/sda, error: ERROR Insufficient Storage (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server ERROR: Object POST returning 503 for (202, 202, 202, 202, 202, 202, 503, 503, 503, 503, 503, 503, 503, 503) (txn: tx2e2c958d9c5d44c78f41f-0068c570af) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server 10.0.0.1:1001/sdb re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx03ddddd76055495090064-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.4:1004/sde re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx03ddddd76055495090064-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.0:1000/sda re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx03ddddd76055495090064-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.7:1007/sdh re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx03ddddd76055495090064-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.3:1003/sdd re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx03ddddd76055495090064-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.6:1006/sdg re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx03ddddd76055495090064-0068c570af) proxy-server ERROR: ERROR with Object server 10.0.0.12:1012/sdm re: Trying to POST /a/c/o: Timeout (Nones) (txn: tx03ddddd76055495090064-0068c570af) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_limits_expirer_queue_deletes test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_limits_expirer_queue_deletes ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_negative_delete_after test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_negative_delete_after ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_non_int_delete_after test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_non_int_delete_after ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_requires_length test.unit.proxy.controllers.test_obj.TestECObjController.test_PUT_requires_length ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_connect_put_node_timeout test.unit.proxy.controllers.test_obj.TestECObjController.test_connect_put_node_timeout ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_container_sync_delete test.unit.proxy.controllers.test_obj.TestECObjController.test_container_sync_delete ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx51fc6b551d914e62aa755-0068c570af" "proxy-server 1824535" 0.0086 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx51fc6b551d914e62aa755-0068c570af" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 404 - - t - 70 - tx51fc6b551d914e62aa755-0068c570af - 0.0465 - - 1757769903.319981575 1757769903.366467476 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7d242d9e2a0a4ddf89d9a-0068c570af" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx7d242d9e2a0a4ddf89d9a-0068c570af - 0.0038 VW - 1757769903.386626482 1757769903.390403509 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx2e7ccb1de7684ad59a4b7-0068c570af" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx2e7ccb1de7684ad59a4b7-0068c570af - 0.0081 VW - 1757769903.395071030 1757769903.403194427 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx2d57ed7302cd4203b8f7b-0068c570af" "proxy-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx2d57ed7302cd4203b8f7b-0068c570af" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx2d57ed7302cd4203b8f7b-0068c570af - 0.0176 VW - 1757769903.403805017 1757769903.421380758 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txb162668d68d14890a4ab3-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txb162668d68d14890a4ab3-0068c570af" "proxy-server 1824535" 0.0098 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txb162668d68d14890a4ab3-0068c570af" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txb162668d68d14890a4ab3-0068c570af" "proxy-server 1824535" 0.0168 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - - t - - - txb162668d68d14890a4ab3-0068c570af - 0.0296 - - 1757769903.421750307 1757769903.451349020 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx64de21fafaa84187b98c2-0068c570af" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx64de21fafaa84187b98c2-0068c570af - 0.0081 VW - 1757769903.463346004 1757769903.471492529 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txe3a769517a5a49be8ab6b-0068c570af" "proxy-server 1824535" 0.0069 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txe3a769517a5a49be8ab6b-0068c570af - 0.0095 VW - 1757769903.472043276 1757769903.481587172 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 - "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx7b9c15f795ec41208316c-0068c570af" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 - "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx7b9c15f795ec41208316c-0068c570af" "proxy-server 1824535" 0.0048 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx7b9c15f795ec41208316c-0068c570af - 0.0146 VW - 1757769903.482153177 1757769903.496801138 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a/3_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_vc_non_ascii%C2%A3" "tx99dce7e37e5946249d7f3-0068c570af" "proxy-server 1824535" 0.0013 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.42225" 201 - "PUT http://localhost/sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.42225" "tx706b2aa1e8224c12b8439-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.42225" 201 - "PUT http://localhost/sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.42225" "tx706b2aa1e8224c12b8439-0068c570af" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.42225" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.42225" "tx706b2aa1e8224c12b8439-0068c570af" "proxy-server 1824535" 0.0161 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/2/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.42225" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.42225" "tx706b2aa1e8224c12b8439-0068c570af" "proxy-server 1824535" 0.0158 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 PUT /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769903.42225 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx706b2aa1e8224c12b8439-0068c570af - 0.0328 VW - 1757769903.497426987 1757769903.530254841 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txaff9688c68b740cc80a5f-0068c570af" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txaff9688c68b740cc80a5f-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txaff9688c68b740cc80a5f-0068c570af" "proxy-server 1824535" 0.0156 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txaff9688c68b740cc80a5f-0068c570af" "proxy-server 1824535" 0.0171 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - - t - - - txaff9688c68b740cc80a5f-0068c570af - 0.0253 - - 1757769903.534847498 1757769903.560126781 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcb74909b2d4d45c58a684-0068c570af" "proxy-server 1824535" 0.0054 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txcb74909b2d4d45c58a684-0068c570af - 0.0081 VW - 1757769903.572056532 1757769903.580188990 - -test.unit.proxy.controllers.test_obj.TestECObjController.test_container_update_backend_requests test.unit.proxy.controllers.test_obj.TestECObjController.test_container_update_backend_requests ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_delete_at_backend_requests test.unit.proxy.controllers.test_obj.TestECObjController.test_delete_at_backend_requests ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_db_states test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_db_states ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_determine_chunk_destinations test.unit.proxy.controllers.test_obj.TestECObjController.test_determine_chunk_destinations ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_sharded_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_sharded_state_errors ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_ec_concurrent_GET_with_slow_leaders test.unit.proxy.controllers.test_obj.TestECObjController.test_ec_concurrent_GET_with_slow_leaders ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_expirer_DELETE_suppresses_expirer_queue_updates test.unit.proxy.controllers.test_obj.TestECObjController.test_expirer_DELETE_suppresses_expirer_queue_updates ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx24356ac14a8d4556ba9f8-0068c570af" "proxy-server 1824535" 0.0067 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx24356ac14a8d4556ba9f8-0068c570af - 0.0094 VW - 1757769903.580802202 1757769903.590154648 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 - "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "txf5f46e8fd89b4ab097de2-0068c570af" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 - "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "txf5f46e8fd89b4ab097de2-0068c570af" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txf5f46e8fd89b4ab097de2-0068c570af - 0.0107 VW - 1757769903.594877481 1757769903.605595589 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a/3_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_vc_non_ascii%C2%A3" "txacc1e2e9db8c412abe6b9-0068c570af" "proxy-server 1824535" 0.0028 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.53547" 201 - "PUT http://localhost/sdb1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.53547" "tx7132cb2a994449a1b80f5-0068c570af" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.53547" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.53547" "tx7132cb2a994449a1b80f5-0068c570af" "proxy-server 1824535" 0.0076 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.53547" 201 - "PUT http://localhost/sda1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.53547" "tx7132cb2a994449a1b80f5-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.53547" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.53547" "tx7132cb2a994449a1b80f5-0068c570af" "proxy-server 1824535" 0.0266 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 PUT /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769903.53547 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx7132cb2a994449a1b80f5-0068c570af - 0.0400 VW - 1757769903.606225252 1757769903.646223068 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txf8bfadb288244a299519f-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txf8bfadb288244a299519f-0068c570af" "proxy-server 1824535" 0.0160 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txf8bfadb288244a299519f-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txf8bfadb288244a299519f-0068c570af" "proxy-server 1824535" 0.0178 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - - t - - - txf8bfadb288244a299519f-0068c570af - 0.0224 - - 1757769903.650694609 1757769903.673109055 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcbdbc4c2432743f58da03-0068c570af" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/1/a/3_vc_non_ascii%C2%A3" 200 362 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?prefix=0093_o_ascii%2F&format=json&states=listing" "txcbdbc4c2432743f58da03-0068c570af" "proxy-server 1824535" 0.0086 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fprefix%3D0093_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 362 - txcbdbc4c2432743f58da03-0068c570af - 0.0285 - - 1757769903.674542665 1757769903.703022957 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6be3a9dcf8fd478cb8c74-0068c570af" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx6be3a9dcf8fd478cb8c74-0068c570af - 0.0082 VW - 1757769903.704983950 1757769903.713165522 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sda1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx543e0386486343e1bd0c3-0068c570af" "proxy-server 1824535" 0.0054 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx543e0386486343e1bd0c3-0068c570af - 0.0122 VW - 1757769903.713675499 1757769903.725898027 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 - "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "txdc513ce0e474434b85f2b-0068c570af" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 - "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "txdc513ce0e474434b85f2b-0068c570af" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txdc513ce0e474434b85f2b-0068c570af - 0.0146 VW - 1757769903.726466417 1757769903.741114855 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a/3_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_vc_non_ascii%C2%A3" "tx89d561019f7b45f0abaaf-0068c570af" "proxy-server 1824535" 0.0027 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.65136" 201 - "PUT http://localhost/sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.65136" "txdb7b89d6cbc34234afe6b-0068c570af" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.65136" 201 - "PUT http://localhost/sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.65136" "txdb7b89d6cbc34234afe6b-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.65136" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.65136" "txdb7b89d6cbc34234afe6b-0068c570af" "proxy-server 1824535" 0.0201 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.65136" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.65136" "txdb7b89d6cbc34234afe6b-0068c570af" "proxy-server 1824535" 0.0116 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 PUT /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769903.65136 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txdb7b89d6cbc34234afe6b-0068c570af - 0.0396 VW - 1757769903.741714478 1757769903.781268120 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx085eefc258b74b1d9f434-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_feed_remaining_primaries test.unit.proxy.controllers.test_obj.TestECObjController.test_feed_remaining_primaries ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_fix_response_HEAD test.unit.proxy.controllers.test_obj.TestECObjController.test_fix_response_HEAD ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_handoff_local_first_default test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_handoff_local_first_default ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_handoff_local_first_non_default test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_handoff_local_first_non_default ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_local_first_best_effort test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_local_first_best_effort ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_sharding_state test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_sharding_state ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_local_first_moves_locals_first test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_local_first_moves_locals_first ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_local_first_noops_when_no_affinity test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_local_first_noops_when_no_affinity ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx085eefc258b74b1d9f434-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx085eefc258b74b1d9f434-0068c570af" "proxy-server 1824535" 0.0172 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "tx085eefc258b74b1d9f434-0068c570af" "proxy-server 1824535" 0.0188 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - - t 5 - - tx085eefc258b74b1d9f434-0068c570af - 0.0225 - - 1757769903.782072067 1757769903.804537058 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5fdcaf6e80b84266b03e5-0068c570af" "proxy-server 1824535" 0.0012 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx5fdcaf6e80b84266b03e5-0068c570af - 0.0081 VW - 1757769903.806030750 1757769903.814098597 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx8c59e3980c1c46459b4f5-0068c570af" "proxy-server 1824535" 0.0079 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx8c59e3980c1c46459b4f5-0068c570af - 0.0148 VW - 1757769903.814614534 1757769903.829414606 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx0eff851bcecd41b58cc77-0068c570af" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii?symlink=get" "tx0eff851bcecd41b58cc77-0068c570af" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a/3_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_vc_non_ascii%C2%A3" "tx4c20a96102f04d6e8d1bd-0068c570af" "proxy-server 1824535" 0.0072 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx0eff851bcecd41b58cc77-0068c570af - 0.0362 VW - 1757769903.829993725 1757769903.866150856 0 - (txn: tx2c2bc4fc2944404eb50ab-0068c570af) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 201 - "PUT http://localhost/sdb1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" "tx2c2bc4fc2944404eb50ab-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 201 - "PUT http://localhost/sda1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" "tx2c2bc4fc2944404eb50ab-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" "tx2c2bc4fc2944404eb50ab-0068c570af" "proxy-server 1824535" 0.0168 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" "tx2c2bc4fc2944404eb50ab-0068c570af" "proxy-server 1824535" 0.0164 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 PUT /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769903.78263 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx2c2bc4fc2944404eb50ab-0068c570af - 0.0463 VW - 1757769903.840550423 1757769903.886864901 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa93d243d7c654b50a5d06-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa93d243d7c654b50a5d06-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa93d243d7c654b50a5d06-0068c570af" "proxy-server 1824535" 0.0114 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa93d243d7c654b50a5d06-0068c570af" "proxy-server 1824535" 0.0213 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - - t 5 - - txa93d243d7c654b50a5d06-0068c570af - 0.0251 - - 1757769903.887373686 1757769903.912492037 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx73d88c8b740b402eb3180-0068c570af" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx73d88c8b740b402eb3180-0068c570af - 0.0082 VW - 1757769903.914075851 1757769903.922308207 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sda1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txfad73668e893495e92a50-0068c570af" "proxy-server 1824535" 0.0027 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txfad73668e893495e92a50-0068c570af - 0.0054 VW - 1757769903.927023888 1757769903.932381630 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub?symlink=get" "tx71bff5c14ae3468a8ba4b-0068c570af" "proxy-server 1824535" 0.0044 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub?symlink=get" "tx71bff5c14ae3468a8ba4b-0068c570af" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii/sub%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx71bff5c14ae3468a8ba4b-0068c570af - 0.0093 VW - 1757769903.933006525 1757769903.942313194 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 201 - "PUT http://localhost/sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" "tx657682731f924bce8eb04-0068c570af" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 201 - "PUT http://localhost/sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" "tx657682731f924bce8eb04-0068c570af" "object-server 1824535" 0.0041 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" "tx657682731f924bce8eb04-0068c570af" "proxy-server 1824535" 0.0188 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" "tx657682731f924bce8eb04-0068c570af" "proxy-server 1824535" 0.0186 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/03 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii/sub HTTP/1.0 201 - - t 4 - - tx657682731f924bce8eb04-0068c570af - 0.0231 - - 1757769903.946875095 1757769903.969966173 0 -test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_local_handoff_first_noops_when_no_affinity test.unit.proxy.controllers.test_obj.TestECObjController.test_iter_nodes_local_handoff_first_noops_when_no_affinity ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_non_durable_ec_response_bucket test.unit.proxy.controllers.test_obj.TestECObjController.test_non_durable_ec_response_bucket ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: ERROR with Object server :/ re: Expect: 100-continue on /a/c/o: ConnectionTimeout (0.05s) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECObjController.test_object_DELETE_backend_update_container_ip_default test.unit.proxy.controllers.test_obj.TestECObjController.test_object_DELETE_backend_update_container_ip_default ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_ranged_get test.unit.proxy.controllers.test_obj.TestECObjController.test_ranged_get ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_sharding_state_deleted test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_sharding_state_deleted ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_ranged_get_with_short_resp test.unit.proxy.controllers.test_obj.TestECObjController.test_ranged_get_with_short_resp ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_ranged_get_with_short_resp_timeout test.unit.proxy.controllers.test_obj.TestECObjController.test_ranged_get_with_short_resp_timeout ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_ranged_get_with_slow_resp test.unit.proxy.controllers.test_obj.TestECObjController.test_ranged_get_with_slow_resp ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_repl_object_DELETE_backend_update_container_repl_ip test.unit.proxy.controllers.test_obj.TestECObjController.test_repl_object_DELETE_backend_update_container_repl_ip ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_sharding_state_errors test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_sharding_state_errors ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_smooth_distributed_backend_requests test.unit.proxy.controllers.test_obj.TestECObjController.test_smooth_distributed_backend_requests ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_storage_policy_index test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_storage_policy_index ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_some_404s_and_507s test.unit.proxy.controllers.test_obj.TestECObjController.test_some_404s_and_507s ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3bffa95263fb410db17f2-0068c570af" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx3bffa95263fb410db17f2-0068c570af - 0.0081 VW - 1757769903.975786448 1757769903.983926058 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "HEAD /sdb1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "tx7c615b4153b84878917ba-0068c570af" "proxy-server 1824535" 0.0070 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/03 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - tx7c615b4153b84878917ba-0068c570af - 0.0097 VW - 1757769903.984474659 1757769903.994203568 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:03 +0000] "GET /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 200 4 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub?symlink=get" "tx3b37a9aa01dd4fda91c03-0068c570af" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 200 4 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub?symlink=get" "tx3b37a9aa01dd4fda91c03-0068c570af" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a/3_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_vc_non_ascii%C2%A3" "txf3f9e5b392a740c29c668-0068c570b0" "proxy-server 1824535" 0.0024 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii/sub%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 4 - tx3b37a9aa01dd4fda91c03-0068c570af - 0.0367 VW - 1757769903.994805813 1757769904.031507730 0 - (txn: tx42da128201c94fe4897a7-0068c570b0) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3/00d3_o_ascii/sub/1757769903.94746" 201 - "PUT http://localhost/sdb1/1/a/3_vc_non_ascii%C2%A3/00d3_o_ascii/sub/1757769903.94746" "tx42da128201c94fe4897a7-0068c570b0" "object-server 1824535" 0.0037 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a/3_vc_non_ascii%C2%A3/00d3_o_ascii/sub/1757769903.94746" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/00d3_o_ascii/sub/1757769903.94746" "tx42da128201c94fe4897a7-0068c570b0" "proxy-server 1824535" 0.0140 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3/00d3_o_ascii/sub/1757769903.94746" 201 - "PUT http://localhost/sda1/1/a/3_vc_non_ascii%C2%A3/00d3_o_ascii/sub/1757769903.94746" "tx42da128201c94fe4897a7-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a/3_vc_non_ascii%C2%A3/00d3_o_ascii/sub/1757769903.94746" 201 - "PUT http://localhost/v1/a/3_vc_non_ascii%C2%A3/00d3_o_ascii/sub/1757769903.94746" "tx42da128201c94fe4897a7-0068c570b0" "proxy-server 1824535" 0.0221 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 PUT /v1/a/3_vc_non_ascii%25C2%25A3/00d3_o_ascii/sub/1757769903.94746 HTTP/1.0 201 - Swift - 4 - 1b52eb8ef2c1875cfdf3ffbe9e3c05da tx42da128201c94fe4897a7-0068c570b0 - 0.0392 VW - 1757769904.009370327 1757769904.048537493 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 201 - "PUT http://localhost/sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" "tx09acb55afb924761ac464-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 201 - "PUT http://localhost/sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" "tx09acb55afb924761ac464-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" "tx09acb55afb924761ac464-0068c570b0" "proxy-server 1824535" 0.0195 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii/sub" "tx09acb55afb924761ac464-0068c570b0" "proxy-server 1824535" 0.0195 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii/sub HTTP/1.0 201 - - t 4 - - tx09acb55afb924761ac464-0068c570b0 - 0.0281 - - 1757769904.049010038 1757769904.077066422 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8438908809f547cea8c45-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx8438908809f547cea8c45-0068c570b0 - 0.0122 VW - 1757769904.078548908 1757769904.090745687 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/2/a/3_oc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3" "txf84193f1949348c08f8d2-0068c570b0" "proxy-server 1824535" 0.0067 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a/3_oc_non_ascii%25C2%25A3 HTTP/1.0 204 - Swift - - - - txf84193f1949348c08f8d2-0068c570b0 - 0.0095 VW - 1757769904.091353655 1757769904.100901604 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/1/a/3_vc_non_ascii%C2%A3" 200 724 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?prefix=0093_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "txbcb85553244d4a10b81ad-0068c570b0" "proxy-server 1824535" 0.0087 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fprefix%3D0093_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 724 - txbcb85553244d4a10b81ad-0068c570b0 - 0.0162 VW - 1757769904.101486921 1757769904.117710590 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 200 5 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263?symlink=get" "txec2e558dcdbb42a7884eb-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 200 5 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263?symlink=get" "txec2e558dcdbb42a7884eb-0068c570b0" "proxy-server 1824535" 0.0047 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769903.78263%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txec2e558dcdbb42a7884eb-0068c570b0 - 0.0196 VW - 1757769904.118224382 1757769904.137779951 0 - (txn: txa5a1c1c8437c4d0fa5b26-0068c570b0) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa5a1c1c8437c4d0fa5b26-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/2/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa5a1c1c8437c4d0fa5b26-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa5a1c1c8437c4d0fa5b26-0068c570b0" "proxy-server 1824535" 0.0169 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/3/a/3_oc_non_ascii%C2%A3/3_o_ascii" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3/3_o_ascii" "txa5a1c1c8437c4d0fa5b26-0068c570b0" "proxy-server 1824535" 0.0164 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 PUT /v1/a/3_oc_non_ascii%25C2%25A3/3_o_ascii HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txa5a1c1c8437c4d0fa5b26-0068c570b0 - 0.0254 VW - 1757769904.128681183 1757769904.154074430 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sdb1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 204 - "DELETE http://localhost/sdb1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" "txd2a4ca31723b44a488945-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_write_affinity_not_configured test.unit.proxy.controllers.test_obj.TestECObjController.test_write_affinity_not_configured ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_storage_policy_index_empty test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_storage_policy_index_empty ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_write_affinity_per_policy_config test.unit.proxy.controllers.test_obj.TestECObjController.test_write_affinity_per_policy_config ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_x_syncs test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_set_x_syncs ... ok proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 10.0.0.10:1010/sdk (txn: txbdfa0ae3f62b4739842cb-0068c570b0) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 10.0.0.8:1008/sdi (txn: txb8a6f5d2a5db4fe881c47-0068c570b0) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Trying to read EC fragment during GET (retrying) 10.0.0.9:1009/sdj (txn: tx205d0a61bc1f47739dec8-0068c570b0) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (ec): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (ec): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '5', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2)test.unit.proxy.controllers.test_obj.TestECObjController.test_write_affinity_per_policy_config_overrides_and_inherits test.unit.proxy.controllers.test_obj.TestECObjController.test_write_affinity_per_policy_config_overrides_and_inherits ... ok test.unit.proxy.controllers.test_obj.TestECObjController.test_write_affinity_proxy_server_config test.unit.proxy.controllers.test_obj.TestECObjController.test_write_affinity_proxy_server_config ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sda1/1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 204 - "DELETE http://localhost/sda1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" "txd2a4ca31723b44a488945-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sda1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 204 - "DELETE http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" "txd2a4ca31723b44a488945-0068c570b0" "proxy-server 1824535" 0.0096 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sdb1/3/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" 204 - "DELETE http://localhost/v1/a/3_vc_non_ascii%C2%A3/0093_o_ascii/1757769903.78263" "txd2a4ca31723b44a488945-0068c570b0" "proxy-server 1824535" 0.0163 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 DELETE /v1/a/3_vc_non_ascii%25C2%25A3/0093_o_ascii/1757769903.78263 HTTP/1.0 204 - Swift - - - - txd2a4ca31723b44a488945-0068c570b0 - 0.0239 VW - 1757769904.154563904 1757769904.178426027 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd440a24516ee4345b6c24-0068c570b0" "proxy-server 1824535" 0.0095 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/1/a/3_vc_non_ascii%C2%A3" 200 185 "GET http://localhost/v1/a/3_vc_non_ascii%C2%A3?prefix=00d3_o_ascii%2Fsub%2F&format=json&states=listing" "txd440a24516ee4345b6c24-0068c570b0" "proxy-server 1824535" 0.0115 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 GET /v1/a/3_vc_non_ascii%25C2%25A3%3Fprefix%3D00d3_o_ascii%252Fsub%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 185 - txd440a24516ee4345b6c24-0068c570b0 - 0.0269 - - 1757769904.188280821 1757769904.215143681 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0c82bc23336b4a91b77a0-0068c570b0" "proxy-server 1824535" 0.0090 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a/3_oc_non_ascii%C2%A3whoops" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/3_oc_non_ascii%C2%A3whoops" "tx0c82bc23336b4a91b77a0-0068c570b0" "container-server 1824535" 0.0010 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a/3_oc_non_ascii%C2%A3whoops" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/3_oc_non_ascii%C2%A3whoops" "tx0c82bc23336b4a91b77a0-0068c570b0" "container-server 1824535" 0.0010 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/0/a/3_oc_non_ascii%C2%A3whoops" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops" "tx0c82bc23336b4a91b77a0-0068c570b0" "proxy-server 1824535" 0.0091 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/0/a/3_oc_non_ascii%C2%A3whoops" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops" "tx0c82bc23336b4a91b77a0-0068c570b0" "proxy-server 1824535" 0.0145 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 PUT /v1/a/3_oc_non_ascii%25C2%25A3whoops HTTP/1.0 201 - - t - - - tx0c82bc23336b4a91b77a0-0068c570b0 - 0.0365 - - 1757769904.216984510 1757769904.253511906 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbadac549ecad40d591a3b-0068c570b0" "proxy-server 1824535" 0.0029 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txbadac549ecad40d591a3b-0068c570b0 - 0.0064 VW - 1757769904.255092382 1757769904.261498928 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/0/a/3_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops" "txede0e880da324deca7a84-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a/3_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - txede0e880da324deca7a84-0068c570b0 - 0.0039 VW - 1757769904.262067795 1757769904.265983343 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx5a4c4c636fc7455b89f52-0068c570b0" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 404 70 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx5a4c4c636fc7455b89f52-0068c570b0" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/3_oc_non_ascii%25C2%25A3whoops/foo%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx5a4c4c636fc7455b89f52-0068c570b0 - 0.0112 VW - 1757769904.266570091 1757769904.277784109 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/sdb1/0/a/3_oc_non_ascii%C2%A3whoops/foo" "txa73eea2a610c49d1bba89-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/sda1/0/a/3_oc_non_ascii%C2%A3whoops/foo" "txa73eea2a610c49d1bba89-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops/foo" "txa73eea2a610c49d1bba89-0068c570b0" "proxy-server 1824535" 0.0089 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 201 - "PUT http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops/foo" "txa73eea2a610c49d1bba89-0068c570b0" "proxy-server 1824535" 0.0087 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 PUT /v1/a/3_oc_non_ascii%25C2%25A3whoops/foo HTTP/1.0 201 - - t 5 - - txa73eea2a610c49d1bba89-0068c570b0 - 0.0171 - - 1757769904.278149128 1757769904.295231342 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7e64fbc8c9104ea89dead-0068c570b0" "proxy-server 1824535" 0.0020 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx7e64fbc8c9104ea89dead-0068c570b0 - 0.0047 VW - 1757769904.296867132 1757769904.301553965 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/0/a/3_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops" "tx5945a3efb5cd47fa9320c-0068c570b0" "proxy-server 1824535" 0.0040 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a/3_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - tx5945a3efb5cd47fa9320c-0068c570b0 - 0.0078 VW - 1757769904.302093267 1757769904.309892893 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx423a03b6a39a493d88147-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 200 5 "GET http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops/foo?symlink=get" "tx423a03b6a39a493d88147-0068c570b0" "proxy-server 1824535" 0.0021 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx1a63b9cacb04429b87ae7-0068c570b0" "proxy-server 1824535" 0.0002 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx1a63b9cacb04429b87ae7-0068c570b0" "proxy-server 1824535" 0.0002 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/3_oc_non_ascii%25C2%25A3whoops/foo%3Fsymlink%3Dget HTTP/1.0 499 - Swift - - 5 - tx423a03b6a39a493d88147-0068c570b0 - 0.0131 VW - 1757769904.310480118 1757769904.323601484 0 - (txn: tx38f306dffea54e4081f96-0068c570b0) proxy INFO: - - 13/Sep/2025/13/25/04 PUT /v1/a/none/003foo/1757769904.27880 HTTP/1.0 404 - Swift - - 70 dcddb75469b4b4875094e14561e573d8 tx38f306dffea54e4081f96-0068c570b0 - 0.0057 VW - 1757769904.318295002 1757769904.323999166 0 -test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_containers test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_containers ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx234f5a5331514c889101b-0068c570b0" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx234f5a5331514c889101b-0068c570b0 - 0.0045 VW - 1757769904.325500011 1757769904.330016613 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/0/a/3_oc_non_ascii%C2%A3whoops" 204 - "HEAD http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops" "tx2d84818d22ff446b98caf-0068c570b0" "proxy-server 1824535" 0.0077 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a/3_oc_non_ascii%25C2%25A3whoops HTTP/1.0 204 - Swift - - - - tx2d84818d22ff446b98caf-0068c570b0 - 0.0104 VW - 1757769904.330530167 1757769904.340950012 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txb2267c0e62b64c58a12b1-0068c570b0" "proxy-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txb2267c0e62b64c58a12b1-0068c570b0" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/none%3Fprefix%3D003foo%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 404 - Swift - - 70 - txb2267c0e62b64c58a12b1-0068c570b0 - 0.0108 VW - 1757769904.341499805 1757769904.352348566 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sdb1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/sdb1/0/a/3_oc_non_ascii%C2%A3whoops/foo" "tx3a0b4fd0f35c4b5cacc62-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sda1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/sda1/0/a/3_oc_non_ascii%C2%A3whoops/foo" "tx3a0b4fd0f35c4b5cacc62-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sda1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops/foo" "tx3a0b4fd0f35c4b5cacc62-0068c570b0" "proxy-server 1824535" 0.0101 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sdb1/0/a/3_oc_non_ascii%C2%A3whoops/foo" 204 - "DELETE http://localhost/v1/a/3_oc_non_ascii%C2%A3whoops/foo" "tx3a0b4fd0f35c4b5cacc62-0068c570b0" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 DELETE /v1/a/3_oc_non_ascii%25C2%25A3whoops/foo HTTP/1.0 204 - - t - - - tx3a0b4fd0f35c4b5cacc62-0068c570b0 - 0.0141 - - 1757769904.352760077 1757769904.366811037 0 - proxy DEBUG: Labeled statsd mode: disabled (proxy) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx80291ecbd2764b03a33be-0068c570b0" "proxy-server 1824535" 0.0020 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a/4_oc_ascii" 201 - "PUT http://127.0.0.1:38699/sda1/3/a/4_oc_ascii" "tx80291ecbd2764b03a33be-0068c570b0" "container-server 1824535" 0.0010 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a/4_oc_ascii" 201 - "PUT http://127.0.0.1:44669/sdb1/3/a/4_oc_ascii" "tx80291ecbd2764b03a33be-0068c570b0" "container-server 1824535" 0.0010 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/3/a/4_oc_ascii" 201 - "PUT http://localhost/v1/a/4_oc_ascii" "tx80291ecbd2764b03a33be-0068c570b0" "proxy-server 1824535" 0.0085 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/3/a/4_oc_ascii" 201 - "PUT http://localhost/v1/a/4_oc_ascii" "tx80291ecbd2764b03a33be-0068c570b0" "proxy-server 1824535" 0.0153 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 PUT /v1/a/4_oc_ascii HTTP/1.0 201 - - t - - - tx80291ecbd2764b03a33be-0068c570b0 - 0.0238 - - 1757769904.369529486 1757769904.393329620 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx99079664f3ed41c5a3b12-0068c570b0" "proxy-server 1824535" 0.0019 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/3/a/4_oc_ascii" 200 2 "GET http://localhost/v1/a/4_oc_ascii?format=json&states=listing" "tx99079664f3ed41c5a3b12-0068c570b0" "proxy-server 1824535" 0.0026 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx99079664f3ed41c5a3b12-0068c570b0 - 0.0120 - - 1757769904.394669533 1757769904.406653643 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx54cdd7303a254f8fbecb4-0068c570b0" "proxy-server 1824535" 0.0018 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a/4_vc_ascii" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/4_vc_ascii" "tx54cdd7303a254f8fbecb4-0068c570b0" "container-server 1824535" 0.0017 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a/4_vc_ascii" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/4_vc_ascii" "tx54cdd7303a254f8fbecb4-0068c570b0" "container-server 1824535" 0.0010 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/0/a/4_vc_ascii" 201 - "PUT http://localhost/v1/a/4_vc_ascii" "tx54cdd7303a254f8fbecb4-0068c570b0" "proxy-server 1824535" 0.0137 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/0/a/4_vc_ascii" 201 - "PUT http://localhost/v1/a/4_vc_ascii" "tx54cdd7303a254f8fbecb4-0068c570b0" "proxy-server 1824535" 0.0228 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 PUT /v1/a/4_vc_ascii HTTP/1.0 201 - - t - - - tx54cdd7303a254f8fbecb4-0068c570b0 - 0.0337 - - 1757769904.408352375 1757769904.442075491 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txff3567c14b964d0985fb9-0068c570b0" "proxy-server 1824535" 0.0019 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txff3567c14b964d0985fb9-0068c570b0 - 0.0046 VW - 1757769904.445409536 1757769904.450053930 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txf40489944b6d4e52a2590-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - txf40489944b6d4e52a2590-0068c570b0 - 0.0043 VW - 1757769904.450556517 1757769904.454887152 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "txe42a19785d3d4c02a3dbe-0068c570b0" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "txe42a19785d3d4c02a3dbe-0068c570b0" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txe42a19785d3d4c02a3dbe-0068c570b0 - 0.0069 VW - 1757769904.455492258 1757769904.462405205 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx86562522d72e422ab11c6-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx86562522d72e422ab11c6-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx86562522d72e422ab11c6-0068c570b0" "proxy-server 1824535" 0.0082 "-" 1824535 0test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_sharding_initiated_and_required test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_sharding_initiated_and_required ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx86562522d72e422ab11c6-0068c570b0" "proxy-server 1824535" 0.0080 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx86562522d72e422ab11c6-0068c570b0 - 0.0168 - - 1757769904.462807178 1757769904.479635239 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa3f0904f8e734706aa3fb-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa3f0904f8e734706aa3fb-0068c570b0 - 0.0040 VW - 1757769904.492065430 1757769904.496065140 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx46090970a01e43558db65-0068c570b0" "proxy-server 1824535" 0.0064 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - tx46090970a01e43558db65-0068c570b0 - 0.0090 VW - 1757769904.496533871 1757769904.505516529 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx2f3c03769a1e49dba7914-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx2f3c03769a1e49dba7914-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/0/a/4_vc_ascii" 204 - "HEAD http://localhost/v1/a/4_vc_ascii" "txbcd5683442454a6c930a5-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx2f3c03769a1e49dba7914-0068c570b0 - 0.0188 VW - 1757769904.506060362 1757769904.524829149 0 - (txn: txc8c7d1c75e124698a91c2-0068c570b0) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 201 - "PUT http://localhost/sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" "txc8c7d1c75e124698a91c2-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 201 - "PUT http://localhost/sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" "txc8c7d1c75e124698a91c2-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" "txc8c7d1c75e124698a91c2-0068c570b0" "proxy-server 1824535" 0.0081 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" "txc8c7d1c75e124698a91c2-0068c570b0" "proxy-server 1824535" 0.0079 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 PUT /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769904.46332 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txc8c7d1c75e124698a91c2-0068c570b0 - 0.0163 VW - 1757769904.516584158 1757769904.532863855 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx89127e57248b4dc3b6236-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx89127e57248b4dc3b6236-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx89127e57248b4dc3b6236-0068c570b0" "proxy-server 1824535" 0.0068 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx89127e57248b4dc3b6236-0068c570b0" "proxy-server 1824535" 0.0083 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx89127e57248b4dc3b6236-0068c570b0 - 0.0119 - - 1757769904.533282757 1757769904.545169830 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa6b383e60d3046009ae32-0068c570b0" "proxy-server 1824535" 0.0021 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txceadb1f015604b0fb7e32-0068c570b0" "proxy-server 1824535" 0.0099 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx50f12dcf1c6d480d92525-0068c570b0" "proxy-server 1824535" 0.0048 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx50f12dcf1c6d480d92525-0068c570b0 - 0.0261 - - 1757769904.546576500 1757769904.572699785 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0fdfc6b578994cc78c119-0068c570b0" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx0fdfc6b578994cc78c119-0068c570b0 - 0.0081 VW - 1757769904.584870815 1757769904.593004465 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txf66933acd5904c4eabda9-0068c570b0" "proxy-server 1824535" 0.0056 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - txf66933acd5904c4eabda9-0068c570b0 - 0.0159 VW - 1757769904.593501806 1757769904.609431744 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx0f39867731fc47348c120-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx0f39867731fc47348c120-0068c570b0" "proxy-server 1824535" 0.0047 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/0/a/4_vc_ascii" 204 - "HEAD http://localhost/v1/a/4_vc_ascii" "tx76ba0b08608b4332b1735-0068c570b0" "proxy-server 1824535" 0.0067 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx0f39867731fc47348c120-0068c570b0 - 0.0371 VW - 1757769904.609997511 1757769904.647079706 0 - (txn: txe2ad16b2cfa7401cb8662-0068c570b0) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 201 - "PUT http://localhost/sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" "txe2ad16b2cfa7401cb8662-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 201 - "PUT http://localhost/sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" "txe2ad16b2cfa7401cb8662-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" "txe2ad16b2cfa7401cb8662-0068c570b0" "proxy-server 1824535" 0.0159 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_x_open_expired_custom_config test.unit.proxy.controllers.test_obj.TestECObjController.test_x_open_expired_custom_config ... ok proxy-server DEBUG: Loaded override config for policy 0 (ec): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '3 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 0 (ec): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for policy 1 (unu): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '3 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '1 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5b811ec4157740bd9aa60-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" "txe2ad16b2cfa7401cb8662-0068c570b0" "proxy-server 1824535" 0.0262 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 PUT /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769904.53379 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 txe2ad16b2cfa7401cb8662-0068c570b0 - 0.0437 VW - 1757769904.624823093 1757769904.668572664 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txbec96ee134fa4d43b2394-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txbec96ee134fa4d43b2394-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txbec96ee134fa4d43b2394-0068c570b0" "proxy-server 1824535" 0.0165 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txbec96ee134fa4d43b2394-0068c570b0" "proxy-server 1824535" 0.0160 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - txbec96ee134fa4d43b2394-0068c570b0 - 0.0288 - - 1757769904.669054031 1757769904.697876215 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx329882ed5c584767807b6-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txdbe3eec39a874d4a8371e-0068c570b0" "proxy-server 1824535" 0.0024 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx01c7fcea8d4841fdb4892-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx01c7fcea8d4841fdb4892-0068c570b0 - 0.0141 - - 1757769904.703308344 1757769904.717371225 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa7162858f8a14a568f65f-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/0/a/4_vc_ascii" 200 382 "GET http://localhost/v1/a/4_vc_ascii?format=json&states=listing" "txa7162858f8a14a568f65f-0068c570b0" "proxy-server 1824535" 0.0044 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 GET /v1/a/4_vc_ascii%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 382 - txa7162858f8a14a568f65f-0068c570b0 - 0.0121 - - 1757769904.718891382 1757769904.730978251 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9bc76dc8579446c0a631a-0068c570b0" "proxy-server 1824535" 0.0018 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txfbcf8102a6bd49dca2d4e-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx7570679adb2141b3bae53-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx7570679adb2141b3bae53-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa86612c58aef4460812d3-0068c570b0" "proxy-server 1824535" 0.0019 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa86612c58aef4460812d3-0068c570b0 - 0.0056 VW - 1757769904.752103567 1757769904.757704735 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx3da4e415dcd64e71819d5-0068c570b0" "proxy-server 1824535" 0.0029 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - tx3da4e415dcd64e71819d5-0068c570b0 - 0.0069 VW - 1757769904.758187294 1757769904.765070677 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/2/a/4_oc_ascii/copied_name" 404 70 "GET http://localhost/v1/a/4_oc_ascii/copied_name?symlink=get" "tx757f00e171fa4b309bd39-0068c570b0" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/2/a/4_oc_ascii/copied_name" 404 70 "GET http://localhost/v1/a/4_oc_ascii/copied_name?symlink=get" "tx757f00e171fa4b309bd39-0068c570b0" "proxy-server 1824535" 0.0008 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/copied_name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx757f00e171fa4b309bd39-0068c570b0 - 0.0083 VW - 1757769904.765563250 1757769904.773881912 0 - proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 200 - Swift t - 5 - tx7570679adb2141b3bae53-0068c570b0 - 0.0507 SSC - 1757769904.732870340 1757769904.783522606 0 - (txn: tx361954681d8840ca9ce15-0068c570b0) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/3/a/4_oc_ascii/copied_name" 201 - "PUT http://localhost/sda1/2/a/4_oc_ascii/copied_name" "tx361954681d8840ca9ce15-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/3/a/4_oc_ascii/copied_name" 201 - "PUT http://localhost/sdb1/2/a/4_oc_ascii/copied_name" "tx361954681d8840ca9ce15-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/2/a/4_oc_ascii/copied_name" 201 - "PUT http://localhost/v1/a/4_oc_ascii/copied_name" "tx361954681d8840ca9ce15-0068c570b0" "proxy-server 1824535" 0.0086 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/2/a/4_oc_ascii/copied_name" 201 - "PUT http://localhost/v1/a/4_oc_ascii/copied_name" "tx361954681d8840ca9ce15-0068c570b0" "proxy-server 1824535" 0.0101 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 COPY /v1/a/4_oc_ascii/copied_name HTTP/1.0 201 - - t 5 - db7282901da891bea2fcd73840caad1c tx361954681d8840ca9ce15-0068c570b0 - 0.0185 SSC - 1757769904.774251223 1757769904.792775869 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6f2fca0f57bf437d83146-0068c570b0" "proxy-server 1824535" 0.0024 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx97d5cb8465294b6596505-0068c570b0" "proxy-server 1824535" 0.0029 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/2/a/4_oc_ascii/copied_name" 200 5 "GET http://localhost/v1/a/4_oc_ascii/copied_name" "tx64afb59988214948b3f59-0068c570b0" "proxy-server 1824535" 0.0010 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/copied_name HTTP/1.0 200 - - t - 5 - tx64afb59988214948b3f59-0068c570b0 - 0.0168 - - 1757769904.794445276 1757769904.811290026 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7a76b80097c942ac9ff65-0068c570b0" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx876b480540da400d808be-0068c570b0" "proxy-server 1824535" 0.0025 "-" 1824535 0test.unit.proxy.controllers.test_obj.TestECObjController.test_x_open_expired_default_config test.unit.proxy.controllers.test_obj.TestECObjController.test_x_open_expired_default_config ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_cache_not_available test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_cache_not_available ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_cache_reading test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_cache_reading ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_cache_recheck_time_zero test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_cache_recheck_time_zero ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_sharding_state_is_not_reclaimable test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_sharding_state_is_not_reclaimable ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_cache_writing test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_cache_writing ... ok test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_empty_body test.unit.proxy.controllers.test_obj.TestGetUpdateShardLegacy.test_get_update_shard_empty_body ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_sharding_sysmeta test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_sharding_sysmeta ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "POST http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx8640a4c229d64f208f805-0068c570b0" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "POST http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx8640a4c229d64f208f805-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "POST /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 202 76 "POST http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx8640a4c229d64f208f805-0068c570b0" "proxy-server 1824535" 0.0060 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "POST /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 202 76 "POST http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx8640a4c229d64f208f805-0068c570b0" "proxy-server 1824535" 0.0141 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 POST /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 202 - - t - 76 - tx8640a4c229d64f208f805-0068c570b0 - 0.0337 - - 1757769904.812890291 1757769904.846564770 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7a5d01b075d34d4aabf68-0068c570b0" "proxy-server 1824535" 0.0056 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx54de5bd7d11e433f863d1-0068c570b0" "proxy-server 1824535" 0.0153 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txa99d83c4eadf482caaa5c-0068c570b0" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - txa99d83c4eadf482caaa5c-0068c570b0 - 0.0400 - - 1757769904.852117062 1757769904.892113447 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfa0a5b3d93784df8939f2-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/3/a/4_oc_ascii" 200 326 "GET http://localhost/v1/a/4_oc_ascii?format=json&states=listing" "txfa0a5b3d93784df8939f2-0068c570b0" "proxy-server 1824535" 0.0046 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 326 - txfa0a5b3d93784df8939f2-0068c570b0 - 0.0123 - - 1757769904.894667864 1757769904.906943321 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfd611ad69749427191b92-0068c570b0" "proxy-server 1824535" 0.0012 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txfd611ad69749427191b92-0068c570b0 - 0.0039 VW - 1757769904.909548521 1757769904.913462877 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx66c1c507575446e194dfb-0068c570b0" "proxy-server 1824535" 0.0028 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - tx66c1c507575446e194dfb-0068c570b0 - 0.0054 VW - 1757769904.913929939 1757769904.919353962 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/0/a/4_vc_ascii" 200 382 "GET http://localhost/v1/a/4_vc_ascii?prefix=00f4_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "txb559eb796c074ab084d74-0068c570b0" "proxy-server 1824535" 0.0035 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/4_vc_ascii%3Fprefix%3D00f4_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 382 - txb559eb796c074ab084d74-0068c570b0 - 0.0066 VW - 1757769904.919883251 1757769904.926480055 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 200 5 "GET http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379?symlink=get" "tx233eddec4a2d4f5084695-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 200 5 "GET http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379?symlink=get" "tx233eddec4a2d4f5084695-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 GET /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769904.53379%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx233eddec4a2d4f5084695-0068c570b0 - 0.0146 VW - 1757769904.927004576 1757769904.941604137 0 - (txn: tx185937c54d214a5fab096-0068c570b0) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx185937c54d214a5fab096-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx185937c54d214a5fab096-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx185937c54d214a5fab096-0068c570b0" "proxy-server 1824535" 0.0089 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx185937c54d214a5fab096-0068c570b0" "proxy-server 1824535" 0.0083 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 tx185937c54d214a5fab096-0068c570b0 - 0.0165 VW - 1757769904.933297634 1757769904.949815273 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 204 - "DELETE http://localhost/sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" "tx22d9adfe37b24ad4a926e-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 204 - "DELETE http://localhost/sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" "tx22d9adfe37b24ad4a926e-0068c570b0" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 204 - "DELETE http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" "tx22d9adfe37b24ad4a926e-0068c570b0" "proxy-server 1824535" 0.0061 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "DELETE /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" 204 - "DELETE http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.53379" "tx22d9adfe37b24ad4a926e-0068c570b0" "proxy-server 1824535" 0.0053 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/04 DELETE /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769904.53379 HTTP/1.0 204 - Swift - - - - tx22d9adfe37b24ad4a926e-0068c570b0 - 0.0099 VW - 1757769904.950317860 1757769904.960218906 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7d648025e09942188e583-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx4f6f24b4260840d492b72-0068c570b0" "proxy-server 1824535" 0.0027 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txa8233d49fd514d56aca72-0068c570b0" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: txf72bc0f445154fe8ac0cf-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from primary (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Ignoring 404 from handoff (txn: tx5191b99e85714037aa809-0068c570b0) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=x1_test {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx89456d3cf2df4061ad386-0068c570b0) proxy-server DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 1.0, 'concurrent_ec_extra_requests': 0}, app) (txn: txn1) (client_ip: 127.0.0.2) proxy-server DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txn1) (client_ip: 127.0.0.2) proxy-server ERROR: Problem with container shard listing response from /v1/a/c?format=json&states=updating: JSONDecodeError('Expecting value: line 1 column 1 (char 0)') (txn: tx238f0c06919342beb0fd2-0068c570b0) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmps0znyj4w/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmps0znyj4w/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmps0znyj4w/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmps0znyj4w/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0029 "-" 1824536 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0064 "-" 1824536 -/usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_mem_server.TestAccountController.test_DELETE test.unit.proxy.test_mem_server.TestAccountController.test_DELETE ... ok test.unit.proxy.test_mem_server.TestAccountController.test_DELETE_with_query_string test.unit.proxy.test_mem_server.TestAccountController.test_DELETE_with_query_string ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_storage_policy_property test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_storage_policy_property ... ok test.unit.proxy.test_mem_server.TestAccountController.test_GET test.unit.proxy.test_mem_server.TestAccountController.test_GET ... ok test.unit.proxy.test_mem_server.TestAccountController.test_GET_autocreate test.unit.proxy.test_mem_server.TestAccountController.test_GET_autocreate ... ok test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_sync_merging test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_sync_merging ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_epoch_reset test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_epoch_reset ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_none test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_none ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_merge_reported test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_merge_reported ... ok test.unit.proxy.test_mem_server.TestAccountController.test_HEAD test.unit.proxy.test_mem_server.TestAccountController.test_HEAD ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_meta_ts_gte test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_meta_ts_gte ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_meta_ts_lt test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_meta_ts_lt ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_retain_bounds test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_retain_bounds ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_retain_deleted test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_retain_deleted ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_state_ts_eq test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_state_ts_eq ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_state_ts_gt test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_state_ts_gt ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_state_ts_lt test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_eq_state_ts_lt ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_gt test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_gt ... ok test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_lt test.unit.container.test_backend.TestModuleFunctions.test_merge_shards_existing_ts_lt ... ok test.unit.container.test_backend.TestModuleFunctions.test_sift_shard_ranges test.unit.container.test_backend.TestModuleFunctions.test_sift_shard_ranges ... ok test.unit.container.test_sync.TestContainerSync.test_FileLikeIter test.unit.container.test_sync.TestContainerSync.test_FileLikeIter ... ok test.unit.container.test_sync.TestContainerSync.test_container_first_loop test.unit.container.test_sync.TestContainerSync.test_container_first_loop ... ok test.unit.container.test_sync.TestContainerSync.test_container_report test.unit.container.test_sync.TestContainerSync.test_container_report ... ok test.unit.container.test_sync.TestContainerSync.test_container_second_loop test.unit.container.test_sync.TestContainerSync.test_container_second_loop ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/04 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - txa8233d49fd514d56aca72-0068c570b0 - 0.0183 - - 1757769904.961709023 1757769904.979967833 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx937e2d1c36f64c8480b5e-0068c570b0" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/0/a/4_vc_ascii" 200 191 "GET http://localhost/v1/a/4_vc_ascii?prefix=00f4_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx937e2d1c36f64c8480b5e-0068c570b0" "proxy-server 1824535" 0.0091 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 GET /v1/a/4_vc_ascii%3Fprefix%3D00f4_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 191 - tx937e2d1c36f64c8480b5e-0068c570b0 - 0.0239 - - 1757769904.981636763 1757769905.005511761 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txedbcf9bd6dcb42ee910dd-0068c570b1" "proxy-server 1824535" 0.0012 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txedbcf9bd6dcb42ee910dd-0068c570b1 - 0.0120 VW - 1757769905.015575647 1757769905.027591228 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx3d8344af683f4ad6b9e2c-0068c570b1" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - tx3d8344af683f4ad6b9e2c-0068c570b1 - 0.0200 VW - 1757769905.035112858 1757769905.055077791 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/0/a/4_vc_ascii" 200 191 "GET http://localhost/v1/a/4_vc_ascii?prefix=00f4_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "tx09272163b1874407afa08-0068c570b1" "proxy-server 1824535" 0.0029 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 GET /v1/a/4_vc_ascii%3Fprefix%3D00f4_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 191 - tx09272163b1874407afa08-0068c570b1 - 0.0061 VW - 1757769905.055644989 1757769905.061760664 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 200 5 "GET http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332?symlink=get" "tx82ce70d46c594ca885af5-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 200 5 "GET http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332?symlink=get" "tx82ce70d46c594ca885af5-0068c570b1" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 GET /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769904.46332%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx82ce70d46c594ca885af5-0068c570b1 - 0.0238 VW - 1757769905.062284231 1757769905.086098909 0 - (txn: tx7ecfad5a11d64656b95a3-0068c570b1) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx7ecfad5a11d64656b95a3-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx7ecfad5a11d64656b95a3-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx7ecfad5a11d64656b95a3-0068c570b1" "proxy-server 1824535" 0.0155 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx7ecfad5a11d64656b95a3-0068c570b1" "proxy-server 1824535" 0.0172 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx7ecfad5a11d64656b95a3-0068c570b1 - 0.0251 VW - 1757769905.077149153 1757769905.102267027 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "DELETE /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 204 - "DELETE http://localhost/sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" "txed03e0ab3f6d4681b9256-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "DELETE /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 204 - "DELETE http://localhost/sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" "txed03e0ab3f6d4681b9256-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "DELETE /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 204 - "DELETE http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" "txed03e0ab3f6d4681b9256-0068c570b1" "proxy-server 1824535" 0.0162 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "DELETE /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" 204 - "DELETE http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769904.46332" "txed03e0ab3f6d4681b9256-0068c570b1" "proxy-server 1824535" 0.0227 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 DELETE /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769904.46332 HTTP/1.0 204 - Swift - - - - txed03e0ab3f6d4681b9256-0068c570b1 - 0.0262 VW - 1757769905.106916904 1757769905.133132458 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx56864b8454414233bbd05-0068c570b1" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx6a771d3511df4be3b8c5e-0068c570b1" "proxy-server 1824535" 0.0093 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx0c3f5ce386ef417fbd091-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx0c3f5ce386ef417fbd091-0068c570b1 - 0.0227 - - 1757769905.138679028 1757769905.161424398 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8a5dd934391a4339aa708-0068c570b1" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/0/a/4_vc_ascii" 200 2 "GET http://localhost/v1/a/4_vc_ascii?prefix=00f4_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx8a5dd934391a4339aa708-0068c570b1" "proxy-server 1824535" 0.0079 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 GET /v1/a/4_vc_ascii%3Fprefix%3D00f4_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx8a5dd934391a4339aa708-0068c570b1 - 0.0193 - - 1757769905.167224407 1757769905.186531782 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx03fb1c8015444957aca00-0068c570b1" "proxy-server 1824535" 0.0054 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/0/a/4_vc_ascii" 200 2 "GET http://localhost/v1/a/4_vc_ascii?prefix=00f4_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx03fb1c8015444957aca00-0068c570b1" "proxy-server 1824535" 0.0067 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 GET /v1/a/4_vc_ascii%3Fprefix%3D00f4_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx03fb1c8015444957aca00-0068c570b1 - 0.0179 - - 1757769905.192588806 1757769905.210478544 0 -test.unit.container.test_sync.TestContainerSync.test_container_stop_at test.unit.container.test_sync.TestContainerSync.test_container_stop_at ... ok test.unit.container.test_sync.TestContainerSync.test_container_sync_deleted test.unit.container.test_sync.TestContainerSync.test_container_sync_deleted ... ok test.unit.container.test_sync.TestContainerSync.test_container_sync_missing_db test.unit.container.test_sync.TestContainerSync.test_container_sync_missing_db ... ok test.unit.proxy.test_mem_server.TestAccountController.test_HEAD_autocreate test.unit.proxy.test_mem_server.TestAccountController.test_HEAD_autocreate ... ok test.unit.container.test_sync.TestContainerSync.test_container_sync_no_to_or_key test.unit.container.test_sync.TestContainerSync.test_container_sync_no_to_or_key ... ok test.unit.proxy.test_mem_server.TestAccountController.test_OPTIONS test.unit.proxy.test_mem_server.TestAccountController.test_OPTIONS ... ok test.unit.container.test_sync.TestContainerSync.test_container_sync_not_db test.unit.container.test_sync.TestContainerSync.test_container_sync_not_db ... ok test.unit.container.test_sync.TestContainerSync.test_container_sync_not_my_db test.unit.container.test_sync.TestContainerSync.test_container_sync_not_my_db ... ok test.unit.container.test_sync.TestContainerSync.test_container_sync_row_delete test.unit.container.test_sync.TestContainerSync.test_container_sync_row_delete ... ok test.unit.container.test_sync.TestContainerSync.test_container_sync_row_delete_using_realms test.unit.container.test_sync.TestContainerSync.test_container_sync_row_delete_using_realms ... ok test.unit.proxy.test_mem_server.TestAccountController.test_POST_autocreate test.unit.proxy.test_mem_server.TestAccountController.test_POST_autocreate ... ok test ERROR: Failed to unlink '/tmp/tmp0umhbsr_/containers/part/suffix/hash/container.db': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/backend.py", line 2235, in set_sharded_state os.unlink(retiring_file) ~~~~~~~~~^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1169, in __call__ return self._mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1173, in _mock_call return self._execute_mock_call(*args, **kwargs) ~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ File "/usr/lib/python3.13/unittest/mock.py", line 1228, in _execute_mock_call raise effect OSError: 1 test DEBUG: Unlinked retiring db '/tmp/tmp0umhbsr_/containers/part/suffix/hash/container_1757769904.00000.db' test WARNING: Still have multiple db files after unlinking '/tmp/tmp0umhbsr_/containers/part/suffix/hash/container_1757769904.00000.db': ['/tmp/tmp0umhbsr_/containers/part/suffix/hash/container.db', '/tmp/tmp0umhbsr_/containers/part/suffix/hash/container_1757769905.00000.db'] test WARNING: Refusing to delete db file for 'a/c': no fresher db file found in ['/tmp/tmp0umhbsr_/containers/part/suffix/hash/container_1757769905.00000.db']. test ERROR: Failed to set the ROWID of the fresh database for a/c: test ERROR: Failed to sync the container_stat table/view with the fresh database for a/c: test-container-sync DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test-container-sync WARNING: Configuration option internal_client_conf_path not defined. Using default configuration, See internal-client.conf-sample for options test-container-sync INFO: Container sync report: a/c, time window start: 1757769905.2459326, time window end: 1757769905.2459326, puts: 0, posts: 0, deletes: 0, bytes: 0, sync_point1: 5, sync_point2: None, total_rows: 1 test-container-sync ERROR: ERROR Syncing : Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 389, in container_sync if not self.container_sync_row( ~~~~~~~~~~~~~~~~~~~~~~~^ row, sync_to, user_key, broker, info, realm, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ realm_key): ^^^^^^^^^^ TypeError: TestContainerSync.test_container_report..fake_container_sync_row() missing 1 required positional argument: 'realm_key' test-container-sync DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test-container-sync WARNING: Configuration option internal_client_conf_path not defined. Using default configuration, See internal-client.conf-sample for options test-container-sync INFO: Container sync report: a/c, time window start: 1757769905.2521677, time window end: 1757769905.2521775, puts: 0, posts: 0, deletes: 0, bytes: 0, sync_point1: 1, sync_point2: -1, total_rows: 1 test-container-sync ERROR: ERROR Syncing {'ROWID': 1, 'name': 'o'}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 535, in container_sync_row row['created_at']) ~~~^^^^^^^^^^^^^^ KeyError: 'created_at' test-container-sync INFO: Container sync report: a/c, time window start: 1757769905.2523193, time window end: 1757769905.2608354, puts: 0, posts: 0, deletes: 0, bytes: 0, sync_point1: 1, sync_point2: -1, total_rows: 1 test-container-sync INFO: Container sync report: a/c, time window start: 1757769905.261013, time window end: 1757769905.261072, puts: 0, posts: 0, deletes: 1, bytes: 0, sync_point1: 1, sync_point2: -1, total_rows: 1 test-container-sync DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test-container-sync WARNING: Configuration option internal_client_conf_path not defined. Using default configuration, See internal-client.conf-sample for options test-container-sync ERROR: ERROR Syncing {'deleted': True, 'name': 'object', 'created_at': '1.2'}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 544, in container_sync_row delete_object(sync_to, name=row['name'], headers=headers, ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ proxy=self.select_http_proxy(), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ logger=self.logger, ^^^^^^^^^^^^^^^^^^^ timeout=self.conn_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 883, in fake_delete_object raise exc[-1] Exception: test exception test-container-sync ERROR: ERROR Syncing {'deleted': True, 'name': 'object', 'created_at': '1.2'}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 544, in container_sync_row delete_object(sync_to, name=row['name'], headers=headers, ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ proxy=self.select_http_proxy(), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ logger=self.logger, ^^^^^^^^^^^^^^^^^^^ timeout=self.conn_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 900, in fake_delete_object raise exc[-1] swift.common.exceptions.ClientException: test client exception test-container-sync DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test-container-sync WARNING: Configuration option internal_client_conf_path not defined. Using default configuration, See internal-client.conf-sample for options test-container-sync ERROR: ERROR Syncing {'deleted': True, 'name': 'object', 'created_at': '1.2'}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 544, in container_sync_row delete_object(sync_to, name=row['name'], headers=headers, ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ proxy=self.select_http_proxy(), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ logger=self.logger, ^^^^^^^^^^^^^^^^^^^ timeout=self.conn_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 883, in fake_delete_object raise exc[-1] Exception: test exception test-container-sync ERROR: ERROR Syncing {'deleted': True, 'name': 'object', 'created_at': '1.2'}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 544, in container_sync_row delete_object(sync_to, name=row['name'], headers=headers, ~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ proxy=self.select_http_proxy(), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ logger=self.logger, ^^^^^^^^^^^^^^^^^^^ timeout=self.conn_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 900, in fake_delete_object raise exc[-1] swift.common.exceptions.ClientException: test client exception test-container-sync DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf'test.unit.container.test_sync.TestContainerSync.test_container_sync_row_put test.unit.container.test_sync.TestContainerSync.test_container_sync_row_put ... ok test.unit.proxy.test_mem_server.TestAccountController.test_POST_autocreate_with_sysmeta test.unit.proxy.test_mem_server.TestAccountController.test_POST_autocreate_with_sysmeta ... ok test.unit.proxy.test_mem_server.TestAccountController.test_POST_bad_metadata test.unit.proxy.test_mem_server.TestAccountController.test_POST_bad_metadata ... ok test-container-sync WARNING: Configuration option internal_client_conf_path not defined. Using default configuration, See internal-client.conf-sample for options test-container-sync ERROR: ERROR Syncing {'deleted': False, 'name': 'object', 'created_at': '0000000001.20000', 'size': 70}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 596, in container_sync_row raise exc File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 573, in container_sync_row self.swift.get_object(info['account'], ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ info['container'], row['name'], ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers_out, ^^^^^^^^^^^^^^^^^^^^ acceptable_statuses=(2, 4), ^^^^^^^^^^^^^^^^^^^^^^^^^^^ params={'symlink': 'get'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 1146, in fake_get_object raise exc[-1] Exception: test exception test-container-sync ERROR: ERROR Syncing {'deleted': False, 'name': 'object', 'created_at': '0000000001.20000', 'size': 80}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 596, in container_sync_row raise exc File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 573, in container_sync_row self.swift.get_object(info['account'], ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ info['container'], row['name'], ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers_out, ^^^^^^^^^^^^^^^^^^^^ acceptable_statuses=(2, 4), ^^^^^^^^^^^^^^^^^^^^^^^^^^^ params={'symlink': 'get'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 1173, in fake_get_object raise exc[-1] swift.common.exceptions.ClientException: test client exception test-container-sync INFO: Unauth 'a/c' => 'http://sync/to/path' test-container-sync INFO: Not found 'a/c' => 'http://sync/to/path' - object 'object' test-container-sync ERROR: ERROR Syncing {'deleted': False, 'name': 'object', 'created_at': '0000000001.20000', 'size': 50}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 613, in container_sync_row put_object(sync_to, name=row['name'], headers=headers, ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ contents=FileLikeIter(body), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ proxy=self.select_http_proxy(), logger=self.logger, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ timeout=self.conn_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 1239, in fake_put_object raise ClientException('test client exception', http_status=503) swift.common.exceptions.ClientException: test client exception: 503 test-container-sync DEBUG: remote obj timestamp 0000000001.20000 local obj 0000000001.20000 test-container-sync DEBUG: remote obj timestamp 0000000001.20000 local obj 0000000001.30000 test-container-sync INFO: Unauth 'a/c' => 'http://sync/to/path' test-container-sync ERROR: ERROR Syncing {'deleted': False, 'name': 'object', 'created_at': '0000000001.20000', 'etag': '1111', 'size': 10}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 559, in container_sync_row if self._object_in_remote_container(row['name'], ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ sync_to, user_key, realm, ^^^^^^^^^^^^^^^^^^^^^^^^^ realm_key, ts_meta): ^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 491, in _object_in_remote_container metadata, _ = head_object(sync_to, name=name, ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ proxy=self.select_http_proxy(), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ logger=self.logger, ^^^^^^^^^^^^^^^^^^^ retries=0) ^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 1338, in fake_head_object raise Exception() Exception test-container-sync DEBUG: remote obj timestamp 0000000001.20000 local obj 0000000001.10000 test-container-sync DEBUG: Could not load '/etc/swift/container-sync-realms.conf': [Errno 2] No such file or directory: '/etc/swift/container-sync-realms.conf' test-container-sync WARNING: Configuration option internal_client_conf_path not defined. Using default configuration, See internal-client.conf-sample for options test-container-sync ERROR: ERROR Syncing {'deleted': False, 'name': 'object', 'created_at': '0000000001.20000', 'size': 70}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 596, in container_sync_row raise exc File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 573, in container_sync_row self.swift.get_object(info['account'], ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ info['container'], row['name'], ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers_out, ^^^^^^^^^^^^^^^^^^^^ acceptable_statuses=(2, 4), ^^^^^^^^^^^^^^^^^^^^^^^^^^^ params={'symlink': 'get'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 1146, in fake_get_object raise exc[-1] Exception: test exception test-container-sync ERROR: ERROR Syncing {'deleted': False, 'name': 'object', 'created_at': '0000000001.20000', 'size': 80}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 596, in container_sync_row raise exc File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 573, in container_sync_row self.swift.get_object(info['account'], ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^ info['container'], row['name'], ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ headers=headers_out, ^^^^^^^^^^^^^^^^^^^^ acceptable_statuses=(2, 4), ^^^^^^^^^^^^^^^^^^^^^^^^^^^ params={'symlink': 'get'}) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 1173, in fake_get_object raise exc[-1] swift.common.exceptions.ClientException: test client exception test-container-sync INFO: Unauth 'a/c' => 'http://sync/to/path' test-container-sync INFO: Not found 'a/c' => 'http://sync/to/path' - object 'object'test.unit.container.test_sync.TestContainerSync.test_container_sync_row_put_using_realms test.unit.container.test_sync.TestContainerSync.test_container_sync_row_put_using_realms ... ok test.unit.container.test_sync.TestContainerSync.test_run_forever test.unit.container.test_sync.TestContainerSync.test_run_forever ... ok test.unit.container.test_sync.TestContainerSync.test_run_once test.unit.container.test_sync.TestContainerSync.test_run_once ... ok test.unit.container.test_sync.TestContainerSync.test_select_http_proxy_None test.unit.container.test_sync.TestContainerSync.test_select_http_proxy_None ... ok test.unit.container.test_sync.TestContainerSync.test_select_http_proxy_multiple test.unit.container.test_sync.TestContainerSync.test_select_http_proxy_multiple ... ok test.unit.container.test_sync.TestContainerSync.test_select_http_proxy_one test.unit.container.test_sync.TestContainerSync.test_select_http_proxy_one ... ok test.unit.container.test_sync_store.TestContainerSyncStore.test_add_synced_container test.unit.container.test_sync_store.TestContainerSyncStore.test_add_synced_container ... ok test.unit.container.test_sync_store.TestContainerSyncStore.test_container_to_synced_container_path_conversion test.unit.container.test_sync_store.TestContainerSyncStore.test_container_to_synced_container_path_conversion ... ok test.unit.container.test_sync_store.TestContainerSyncStore.test_iterate_synced_containers test.unit.container.test_sync_store.TestContainerSyncStore.test_iterate_synced_containers ... ok test.unit.container.test_sync_store.TestContainerSyncStore.test_remove_synced_container test.unit.container.test_sync_store.TestContainerSyncStore.test_remove_synced_container ... ok test.unit.proxy.test_mem_server.TestAccountController.test_POST_metadata test.unit.proxy.test_mem_server.TestAccountController.test_POST_metadata ... ok test.unit.container.test_sync_store.TestContainerSyncStore.test_synced_container_to_container_path_conversion test.unit.container.test_sync_store.TestContainerSyncStore.test_synced_container_to_container_path_conversion ... ok test.unit.container.test_sync_store.TestContainerSyncStore.test_unhandled_exceptions_in_add_remove test.unit.container.test_sync_store.TestContainerSyncStore.test_unhandled_exceptions_in_add_remove ... ok test.unit.proxy.test_mem_server.TestAccountController.test_PUT test.unit.proxy.test_mem_server.TestAccountController.test_PUT ... ok test.unit.container.test_sync_store.TestContainerSyncStore.test_update_sync_store_according_to_metadata_and_deleted test.unit.container.test_sync_store.TestContainerSyncStore.test_update_sync_store_according_to_metadata_and_deleted ... ok test.unit.proxy.test_mem_server.TestAccountController.test_PUT_bad_metadata test.unit.proxy.test_mem_server.TestAccountController.test_PUT_bad_metadata ... ok test.unit.obj.test_server.TestConfigOptionHandling.test_default test.unit.obj.test_server.TestConfigOptionHandling.test_default ... ok test.unit.obj.test_server.TestConfigOptionHandling.test_option_in_app test.unit.obj.test_server.TestConfigOptionHandling.test_option_in_app ... ok test.unit.proxy.test_mem_server.TestAccountController.test_PUT_connect_exceptions test.unit.proxy.test_mem_server.TestAccountController.test_PUT_connect_exceptions ... ok test.unit.obj.test_server.TestConfigOptionHandling.test_option_in_both test.unit.obj.test_server.TestConfigOptionHandling.test_option_in_both ... ok test.unit.obj.test_server.TestConfigOptionHandling.test_option_in_default test.unit.obj.test_server.TestConfigOptionHandling.test_option_in_default ... ok test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_read_line test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_read_line ... ok test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_read_line_chunk_read_error test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_read_line_chunk_read_error ... ok test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_read_line_protocol_error test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_read_line_protocol_error ... ok test.unit.proxy.test_mem_server.TestAccountController.test_PUT_max_account_name_length test.unit.proxy.test_mem_server.TestAccountController.test_PUT_max_account_name_length ... ok test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_read_line_timeout test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_read_line_timeout ... ok test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input ... ok test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input_content_length_less_than_body test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input_content_length_less_than_body ... ok test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input_content_length_more_than_body test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input_content_length_more_than_body ... ok test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input_early_termination test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input_early_termination ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf8855b709b10407e8003f-0068c570b1" "proxy-server 1824535" 0.0095 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txf8855b709b10407e8003f-0068c570b1 - 0.0121 VW - 1757769905.216573715 1757769905.228710890 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txa40613ab433c4f909e190-0068c570b1" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - txa40613ab433c4f909e190-0068c570b1 - 0.0080 VW - 1757769905.229236126 1757769905.237278461 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/0/a/4_vc_ascii" 200 2 "GET http://localhost/v1/a/4_vc_ascii?prefix=00f4_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "txf18b2504044f4468a456d-0068c570b1" "proxy-server 1824535" 0.0052 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 GET /v1/a/4_vc_ascii%3Fprefix%3D00f4_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 2 - txf18b2504044f4468a456d-0068c570b1 - 0.0126 VW - 1757769905.237807512 1757769905.250409126 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "DELETE /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx03469e5adcb54e4da79b8-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "DELETE /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx03469e5adcb54e4da79b8-0068c570b1" "object-server 1824535" 0.0045 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "DELETE /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx03469e5adcb54e4da79b8-0068c570b1" "proxy-server 1824535" 0.0145 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "DELETE /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx03469e5adcb54e4da79b8-0068c570b1" "proxy-server 1824535" 0.0101 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 DELETE /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 204 - - t - - - tx03469e5adcb54e4da79b8-0068c570b1 - 0.0188 - - 1757769905.255020380 1757769905.273843050 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5b7eae9bdbef41968b5dc-0068c570b1" "proxy-server 1824535" 0.0032 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txb4b77938d6a14302a8546-0068c570b1" "proxy-server 1824535" 0.0024 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx38ba3c1906834bf1ad3fd-0068c570b1" "proxy-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx38ba3c1906834bf1ad3fd-0068c570b1" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 404 - - t - 70 - tx38ba3c1906834bf1ad3fd-0068c570b1 - 0.0292 - - 1757769905.279558897 1757769905.308713198 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb869d8eb4aaa4f3295cd0-0068c570b1" "proxy-server 1824535" 0.0012 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txb869d8eb4aaa4f3295cd0-0068c570b1 - 0.0079 VW - 1757769905.323695898 1757769905.331620932 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txc0bd2abcb9f04e549f12a-0068c570b1" "proxy-server 1824535" 0.0042 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - txc0bd2abcb9f04e549f12a-0068c570b1 - 0.0071 VW - 1757769905.332102537 1757769905.339159012 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx27fcbe635b004d27bcb68-0068c570b1" "proxy-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx27fcbe635b004d27bcb68-0068c570b1" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx27fcbe635b004d27bcb68-0068c570b1 - 0.0220 VW - 1757769905.339714766 1757769905.361704588 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx95e8e8158541409292dc5-0068c570b1" "object-server 1824535" 0.0013 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx95e8e8158541409292dc5-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx95e8e8158541409292dc5-0068c570b1" "proxy-server 1824535" 0.0139 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx95e8e8158541409292dc5-0068c570b1" "proxy-server 1824535" 0.0135 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx95e8e8158541409292dc5-0068c570b1 - 0.0290 - - 1757769905.362091303 1757769905.391106606 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx77241dcce313472ead656-0068c570b1" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx77241dcce313472ead656-0068c570b1 - 0.0085 VW - 1757769905.403718472 1757769905.412240028 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txf6f014104b0046be9e648-0068c570b1" "proxy-server 1824535" 0.0068 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - txf6f014104b0046be9e648-0068c570b1 - 0.0095 VW - 1757769905.412766695 1757769905.422225237 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx63d8f98d3b104987869cf-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx63d8f98d3b104987869cf-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx63d8f98d3b104987869cf-0068c570b1 - 0.0160 VW - 1757769905.422861814 1757769905.438866854 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/0/a/4_vc_ascii" 204 - "HEAD http://localhost/v1/a/4_vc_ascii" "tx14521e3837c749679ddf5-0068c570b1" "proxy-server 1824535" 0.0014 "-" 1824535 0test.unit.proxy.test_mem_server.TestAccountController.test_PUT_metadata test.unit.proxy.test_mem_server.TestAccountController.test_PUT_metadata ... ok test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input_timeout test.unit.obj.test_ssync_receiver.TestSsyncInputProxy.test_subreq_input_timeout ... ok test.unit.proxy.test_mem_server.TestAccountController.test_PUT_status test.unit.proxy.test_mem_server.TestAccountController.test_PUT_status ... ok test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_GET_bad_requests test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_GET_bad_requests ... ok test.unit.proxy.test_mem_server.TestAccountController.test_auto_create_account_listing_response_is_json test.unit.proxy.test_mem_server.TestAccountController.test_auto_create_account_listing_response_is_json ... ok test.unit.proxy.test_mem_server.TestAccountController.test_connection_refused test.unit.proxy.test_mem_server.TestAccountController.test_connection_refused ... ok test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_container_cache_cleared_after_PUT test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_container_cache_cleared_after_PUT ... ok test.unit.proxy.test_mem_server.TestAccountController.test_other_socket_error test.unit.proxy.test_mem_server.TestAccountController.test_other_socket_error ... ok test.unit.proxy.test_mem_server.TestAccountController.test_response_get_accept_ranges_header test.unit.proxy.test_mem_server.TestAccountController.test_response_get_accept_ranges_header ... ok test.unit.proxy.test_mem_server.TestAccountController.test_response_head_accept_ranges_header test.unit.proxy.test_mem_server.TestAccountController.test_response_head_accept_ranges_header ... ok test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_container_info_got_cached test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_container_info_got_cached ... ok test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_handoff_has_deleted_database test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_handoff_has_deleted_database ... ok test-container-sync ERROR: ERROR Syncing {'deleted': False, 'name': 'object', 'created_at': '0000000001.20000', 'size': 50}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 613, in container_sync_row put_object(sync_to, name=row['name'], headers=headers, ~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ contents=FileLikeIter(body), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ proxy=self.select_http_proxy(), logger=self.logger, ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ timeout=self.conn_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 1239, in fake_put_object raise ClientException('test client exception', http_status=503) swift.common.exceptions.ClientException: test client exception: 503 test-container-sync DEBUG: remote obj timestamp 0000000001.20000 local obj 0000000001.20000 test-container-sync DEBUG: remote obj timestamp 0000000001.20000 local obj 0000000001.30000 test-container-sync INFO: Unauth 'a/c' => 'http://sync/to/path' test-container-sync ERROR: ERROR Syncing {'deleted': False, 'name': 'object', 'created_at': '0000000001.20000', 'etag': '1111', 'size': 10}: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 559, in container_sync_row if self._object_in_remote_container(row['name'], ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^ sync_to, user_key, realm, ^^^^^^^^^^^^^^^^^^^^^^^^^ realm_key, ts_meta): ^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/container/sync.py", line 491, in _object_in_remote_container metadata, _ = head_object(sync_to, name=name, ~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^ headers=headers, ^^^^^^^^^^^^^^^^ proxy=self.select_http_proxy(), ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ logger=self.logger, ^^^^^^^^^^^^^^^^^^^ retries=0) ^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/container/test_sync.py", line 1338, in fake_head_object raise Exception() Exception test-container-sync DEBUG: remote obj timestamp 0000000001.20000 local obj 0000000001.10000 test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:1001/sdb (txn: txb40051918e3f401bb6d3b-0068c570b1) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.3:1003/sdd (txn: txb40051918e3f401bb6d3b-0068c570b1) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:1002/sdc (txn: txb40051918e3f401bb6d3b-0068c570b1) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:1000/sda (txn: txb40051918e3f401bb6d3b-0068c570b1) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.4:1004/sda (txn: txb40051918e3f401bb6d3b-0068c570b1) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.5:1005/sda (txn: txb40051918e3f401bb6d3b-0068c570b1) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.6:1006/sda (txn: txb40051918e3f401bb6d3b-0068c570b1) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.7:1007/sda (txn: txb40051918e3f401bb6d3b-0068c570b1) test ERROR: Container GET returning 503 for [500, 500, 500, 500, 500, 500, 500, 500] (txn: txb40051918e3f401bb6d3b-0068c570b1) test INFO: Client disconnected on read of '/a/c' (txn: txb40051918e3f401bb6d3b-0068c570b1) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx75d52975ecf2467a8f33c-0068c570b1) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx75d52975ecf2467a8f33c-0068c570b1) test ERROR: ERROR with Container server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx75d52975ecf2467a8f33c-0068c570b1) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx75d52975ecf2467a8f33c-0068c570b1) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda (txn: tx5883fc70ed894156ac34d-0068c570b1) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb (txn: tx4da2ae00c5b8498e87d27-0068c570b1) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc (txn: tx357d0e74672a480bb1002-0068c570b1) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.3:1003/sdd (txn: txfd9676571acb4a3986402-0068c570b1) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to PUT /a/c: Timeout (Nones) (txn: tx5dd6dff274634457ba738-0068c570b1) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: txcd98a6fc65fe4ebb93eb7-0068c570b1) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.36260" 201 - "PUT http://localhost/sdb1/2/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.36260" "txc5bf5e6c7eff40739675f-0068c570b1" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/2/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.36260" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.36260" "txc5bf5e6c7eff40739675f-0068c570b1" "proxy-server 1824535" 0.0231 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.36260" 201 - "PUT http://localhost/sda1/2/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.36260" "txc5bf5e6c7eff40739675f-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/2/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.36260" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.36260" "txc5bf5e6c7eff40739675f-0068c570b1" "proxy-server 1824535" 0.0176 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 PUT /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769905.36260 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txc5bf5e6c7eff40739675f-0068c570b1 - 0.0426 VW - 1757769905.439524651 1757769905.482112885 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx1f69045f5ed1412293005-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx1f69045f5ed1412293005-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx1f69045f5ed1412293005-0068c570b1" "proxy-server 1824535" 0.0256 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx1f69045f5ed1412293005-0068c570b1" "proxy-server 1824535" 0.0254 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx1f69045f5ed1412293005-0068c570b1 - 0.0383 - - 1757769905.482529640 1757769905.520812511 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx336bbfcfaca243738ca34-0068c570b1" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx336bbfcfaca243738ca34-0068c570b1 - 0.0081 VW - 1757769905.532841206 1757769905.540986300 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx36983ccaeb57439cad835-0068c570b1" "proxy-server 1824535" 0.0026 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - tx36983ccaeb57439cad835-0068c570b1 - 0.0094 VW - 1757769905.541508913 1757769905.550880194 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "txc1bff6e2d04a4c53b6198-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "txc1bff6e2d04a4c53b6198-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txc1bff6e2d04a4c53b6198-0068c570b1 - 0.0066 VW - 1757769905.551444054 1757769905.558014870 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/0/a/4_vc_ascii" 204 - "HEAD http://localhost/v1/a/4_vc_ascii" "tx5809cbb8e11a49c18ac0d-0068c570b1" "proxy-server 1824535" 0.0023 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.49121" 201 - "PUT http://localhost/sda1/2/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.49121" "tx674ca111b891436890584-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.49121" 201 - "PUT http://localhost/sdb1/2/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.49121" "tx674ca111b891436890584-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/2/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.49121" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.49121" "tx674ca111b891436890584-0068c570b1" "proxy-server 1824535" 0.0165 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/2/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.49121" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.49121" "tx674ca111b891436890584-0068c570b1" "proxy-server 1824535" 0.0220 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 PUT /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769905.49121 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx674ca111b891436890584-0068c570b1 - 0.0310 VW - 1757769905.558604717 1757769905.589645147 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx596c16bee26644d1a4dd5-0068c570b1" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx596c16bee26644d1a4dd5-0068c570b1" "proxy-server 1824535" 0.0143 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx596c16bee26644d1a4dd5-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx596c16bee26644d1a4dd5-0068c570b1" "proxy-server 1824535" 0.0167 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx596c16bee26644d1a4dd5-0068c570b1 - 0.0296 - - 1757769905.590070724 1757769905.619675159 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1375530ff53546338180b-0068c570b1" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/0/a/4_vc_ascii" 200 382 "GET http://localhost/v1/a/4_vc_ascii?prefix=00f4_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx1375530ff53546338180b-0068c570b1" "proxy-server 1824535" 0.0080 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 GET /v1/a/4_vc_ascii%3Fprefix%3D00f4_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 382 - tx1375530ff53546338180b-0068c570b1 - 0.0235 - - 1757769905.621170759 1757769905.644714594 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4054b6b93dfa43b9b4f9d-0068c570b1" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx4054b6b93dfa43b9b4f9d-0068c570b1 - 0.0123 VW - 1757769905.646580696 1757769905.658867598 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "txed2131288c5d427087eb3-0068c570b1" "proxy-server 1824535" 0.0026 "-" 1824535 0test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_node_errors test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_node_errors ... ok test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_reseller_admin test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_reseller_admin ... ok acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:04 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0065 "-" 1824536 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0028 "-" 1824536 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5af2f26fc5ad479983f99-0068c570b1" "proxy-server 1824536" 0.0012 "-" 1824536 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:47447/sdb1/1/a/c" "tx5af2f26fc5ad479983f99-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:49353/sda1/1/a/c" "tx5af2f26fc5ad479983f99-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx5af2f26fc5ad479983f99-0068c570b1" "proxy-server 1824536" 0.0150 "-" 1824536 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx5af2f26fc5ad479983f99-0068c570b1" "proxy-server 1824536" 0.0220 "-" 1824536 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx5af2f26fc5ad479983f99-0068c570b1 - 0.0313 - - 1757769905.001749039 1757769905.033052921 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx71df037027ea4e1a94758-0068c570b1" "proxy-server 1824536" 0.0011 "-" 1824536 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:49353/sda1/1/a1/c1" "tx71df037027ea4e1a94758-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:47447/sdb1/1/a1/c1" "tx71df037027ea4e1a94758-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx71df037027ea4e1a94758-0068c570b1" "proxy-server 1824536" 0.0162 "-" 1824536 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx71df037027ea4e1a94758-0068c570b1" "proxy-server 1824536" 0.0127 "-" 1824536 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx71df037027ea4e1a94758-0068c570b1 - 0.0301 - - 1757769905.034399748 1757769905.064487934 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx99e5ab4f83cd4dd2abdf7-0068c570b1" "proxy-server 1824536" 0.0019 "-" 1824536 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:49353/sda1/2/a/c1" "tx99e5ab4f83cd4dd2abdf7-0068c570b1" "container-server 1824536" 0.0017 "-" 1824536 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:47447/sdb1/2/a/c1" "tx99e5ab4f83cd4dd2abdf7-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx99e5ab4f83cd4dd2abdf7-0068c570b1" "proxy-server 1824536" 0.0113 "-" 1824536 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx99e5ab4f83cd4dd2abdf7-0068c570b1" "proxy-server 1824536" 0.0161 "-" 1824536 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx99e5ab4f83cd4dd2abdf7-0068c570b1 - 0.0300 - - 1757769905.065842867 1757769905.095861435 1 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9369b3f7e22d464a8273e-0068c570b1" "proxy-server 1824536" 0.0020 "-" 1824536 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:49353/sda1/1/a/c2" "tx9369b3f7e22d464a8273e-0068c570b1" "container-server 1824536" 0.0015 "-" 1824536 2 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:47447/sdb1/1/a/c2" "tx9369b3f7e22d464a8273e-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx9369b3f7e22d464a8273e-0068c570b1" "proxy-server 1824536" 0.0120 "-" 1824536 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx9369b3f7e22d464a8273e-0068c570b1" "proxy-server 1824536" 0.0165 "-" 1824536 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - tx9369b3f7e22d464a8273e-0068c570b1 - 0.0265 - - 1757769905.098291636 1757769905.124776125 2 - proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmpij9nac2r/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpij9nac2r/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmpij9nac2r/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpij9nac2r/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0111 "-" 1824536 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0071 "-" 1824536 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0077 "-" 1824536 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0028 "-" 1824536 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3ec89198a68f4f218956a-0068c570b1" "proxy-server 1824536" 0.0012 "-" 1824536 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:40993/sdb1/1/a/c" "tx3ec89198a68f4f218956a-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:33775/sda1/1/a/c" "tx3ec89198a68f4f218956a-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx3ec89198a68f4f218956a-0068c570b1" "proxy-server 1824536" 0.0170 "-" 1824536 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx3ec89198a68f4f218956a-0068c570b1" "proxy-server 1824536" 0.0264 "-" 1824536 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx3ec89198a68f4f218956a-0068c570b1 - 0.0473 - - 1757769905.715842485 1757769905.763190508 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx267b757ac13645a4a7fd3-0068c570b1" "proxy-server 1824536" 0.0012 "-" 1824536 -/usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", test.unit.proxy.test_server.TestProxyServerConfiguration.test_auto_create_account test.unit.proxy.test_server.TestProxyServerConfiguration.test_auto_create_account ... ok proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - txed2131288c5d427087eb3-0068c570b1 - 0.0162 VW - 1757769905.659409046 1757769905.675643444 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx5f1dd16a595149198d7b0-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx5f1dd16a595149198d7b0-0068c570b1" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx5f1dd16a595149198d7b0-0068c570b1 - 0.0187 VW - 1757769905.676210642 1757769905.694908142 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/0/a/4_vc_ascii" 204 - "HEAD http://localhost/v1/a/4_vc_ascii" "tx64b3f93e76604f1db73f0-0068c570b1" "proxy-server 1824535" 0.0063 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.59060" 201 - "PUT http://localhost/sda1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.59060" "txa124ce06897e442282751-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.59060" 201 - "PUT http://localhost/sdb1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.59060" "txa124ce06897e442282751-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.59060" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.59060" "txa124ce06897e442282751-0068c570b1" "proxy-server 1824535" 0.0144 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.59060" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.59060" "txa124ce06897e442282751-0068c570b1" "proxy-server 1824535" 0.0201 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 PUT /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769905.59060 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txa124ce06897e442282751-0068c570b1 - 0.0411 VW - 1757769905.695549965 1757769905.736677647 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx65afc13bd36541799c6a9-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx65afc13bd36541799c6a9-0068c570b1" "proxy-server 1824535" 0.0094 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx65afc13bd36541799c6a9-0068c570b1" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx65afc13bd36541799c6a9-0068c570b1" "proxy-server 1824535" 0.0185 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx65afc13bd36541799c6a9-0068c570b1 - 0.0304 - - 1757769905.737157106 1757769905.767602682 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc88a1aa4fd2848ba9a412-0068c570b1" "proxy-server 1824535" 0.0054 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txc88a1aa4fd2848ba9a412-0068c570b1 - 0.0080 VW - 1757769905.769285917 1757769905.777322054 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx022d12e8c04746c680165-0068c570b1" "proxy-server 1824535" 0.0026 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - tx022d12e8c04746c680165-0068c570b1 - 0.0094 VW - 1757769905.777836084 1757769905.787232876 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx6b9e18efc8d145cbac17a-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3?symlink=get" "tx6b9e18efc8d145cbac17a-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/0/a/4_vc_ascii" 204 - "HEAD http://localhost/v1/a/4_vc_ascii" "tx30e409c1dad44f4f83832-0068c570b1" "proxy-server 1824535" 0.0025 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx6b9e18efc8d145cbac17a-0068c570b1 - 0.0436 VW - 1757769905.787785053 1757769905.831418037 0 - (txn: tx65ad58f46b8944649bb74-0068c570b1) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 201 - "PUT http://localhost/sda1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" "tx65ad58f46b8944649bb74-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 201 - "PUT http://localhost/sdb1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" "tx65ad58f46b8944649bb74-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" "tx65ad58f46b8944649bb74-0068c570b1" "proxy-server 1824535" 0.0115 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 201 - "PUT http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" "tx65ad58f46b8944649bb74-0068c570b1" "proxy-server 1824535" 0.0129 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 PUT /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769905.73767 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx65ad58f46b8944649bb74-0068c570b1 - 0.0414 VW - 1757769905.802350283 1757769905.843744516 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx8044ab2f545141559050b-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx8044ab2f545141559050b-0068c570b1" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx8044ab2f545141559050b-0068c570b1" "proxy-server 1824535" 0.0218 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "tx8044ab2f545141559050b-0068c570b1" "proxy-server 1824535" 0.0172 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx8044ab2f545141559050b-0068c570b1 - 0.0260 - - 1757769905.844216347 1757769905.870246410 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx80dc93ed53744b2982893-0068c570b1" "proxy-server 1824535" 0.0054 "-" 1824535 -test.unit.proxy.test_server.TestProxyServerConfiguration.test_cors_options test.unit.proxy.test_server.TestProxyServerConfiguration.test_cors_options ... ok test.unit.proxy.test_server.TestProxyServerConfiguration.test_memcache_recheck_options test.unit.proxy.test_server.TestProxyServerConfiguration.test_memcache_recheck_options ... ok test ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx674b26816d964fb48339a-0068c570b1) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:1000/sda (txn: txe2ea79094c3241fca32ec-0068c570b1) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb (txn: txfa9e73623ca648bc9c473-0068c570b1) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc (txn: txdfba3341b37d4e0f8c31c-0068c570b1) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.3:1003/sdd (txn: txb1dde1f01aab4f50b7c84-0068c570b1) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to DELETE /a/c: Timeout (Nones) (txn: tx51d1d3ec93824dc0a02dc-0068c570b1) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: tx9a5624ac315841a7bb4b0-0068c570b1) test ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: tx701397192dba4602904c6-0068c570b1) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda (txn: tx8cc3b43ae539491ebcb26-0068c570b1) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb (txn: txb1683f3471a74114b8c92-0068c570b1) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc (txn: txfd5cec72f5fe45e2afe46-0068c570b1) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.3:1003/sdd (txn: txfe0e4a935f84439f87814-0068c570b1) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to POST /a/c: Timeout (Nones) (txn: tx33fc9bc3b31e4ecba92ef-0068c570b1) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception: kaboom! (txn: txf8e0ef3ef57d4e44bf906-0068c570b1) test ERROR: Node will be error limited for 60.00s: 10.0.0.2:1002/sdc, error: ERROR Insufficient Storage (txn: txe9b3a52f55ba4cf7bf246-0068c570b1) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: tx8450065a66df4dce834cf-0068c570b1) test INFO: Client disconnected on read of '/a/c' (txn: tx9d0791547767420283694-0068c570b1) test INFO: Client disconnected on read of '/a/c' (txn: tx760f716e5e5f4bb7aa120-0068c570b1) test INFO: Client disconnected on read of '/a/c' (txn: tx760f716e5e5f4bb7aa120-0068c570b1) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: Container GET returning 503 for (204, 404, 503, 503) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: Container GET returning 503 for (204, 503, 503, 503) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIterationtest.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_response_code_for_DELETE test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_response_code_for_DELETE ... ok test.unit.proxy.test_server.TestProxyServerConfiguration.test_memcache_skip_options test.unit.proxy.test_server.TestProxyServerConfiguration.test_memcache_skip_options ... ok test.unit.proxy.test_server.TestProxyServerConfiguration.test_node_timeout test.unit.proxy.test_server.TestProxyServerConfiguration.test_node_timeout ... ok test.unit.proxy.test_server.TestSwiftInfo.test_registered_defaults test.unit.proxy.test_server.TestSwiftInfo.test_registered_defaults ... ok proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx80dc93ed53744b2982893-0068c570b1 - 0.0081 VW - 1757769905.876020670 1757769905.884121418 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx9202b4dbcae746b7890f5-0068c570b1" "proxy-server 1824535" 0.0109 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - tx9202b4dbcae746b7890f5-0068c570b1 - 0.0134 VW - 1757769905.884629488 1757769905.898066998 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 404 70 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub?symlink=get" "tx1993e1658d5a4fd1a9ad7-0068c570b1" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 404 70 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub?symlink=get" "tx1993e1658d5a4fd1a9ad7-0068c570b1" "proxy-server 1824535" 0.0026 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3/sub%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx1993e1658d5a4fd1a9ad7-0068c570b1 - 0.0076 VW - 1757769905.898658037 1757769905.906267405 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sda1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" "txb2669e5ae5c54e7999a58-0068c570b1" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sdb1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" "txb2669e5ae5c54e7999a58-0068c570b1" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" "txb2669e5ae5c54e7999a58-0068c570b1" "proxy-server 1824535" 0.0249 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" "txb2669e5ae5c54e7999a58-0068c570b1" "proxy-server 1824535" 0.0264 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3/sub HTTP/1.0 201 - - t 4 - - txb2669e5ae5c54e7999a58-0068c570b1 - 0.0382 - - 1757769905.906686544 1757769905.944850206 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa0ffa4a9ffb746d39054e-0068c570b1" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa0ffa4a9ffb746d39054e-0068c570b1 - 0.0122 VW - 1757769905.946330309 1757769905.958500147 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx90bd57dd272d4bd293b44-0068c570b1" "proxy-server 1824535" 0.0061 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/05 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - tx90bd57dd272d4bd293b44-0068c570b1 - 0.0088 VW - 1757769905.967218161 1757769905.976012707 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sda1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 200 4 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub?symlink=get" "tx963d2d59f7c1404e85839-0068c570b1" "proxy-server 1824535" 0.0087 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "GET /sdb1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 200 4 "GET http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub?symlink=get" "tx963d2d59f7c1404e85839-0068c570b1" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/0/a/4_vc_ascii" 204 - "HEAD http://localhost/v1/a/4_vc_ascii" "txf9ccf33153d44b5890259-0068c570b1" "proxy-server 1824535" 0.0027 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 GET /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3/sub%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 4 - tx963d2d59f7c1404e85839-0068c570b1 - 0.0358 VW - 1757769905.976562738 1757769906.012356281 0 - (txn: tx9e82965aadc8444088e2e-0068c570b2) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/0/a/4_vc_ascii/0134_o_non_ascii%C2%A3/sub/1757769905.91531" 201 - "PUT http://localhost/sda1/3/a/4_vc_ascii/0134_o_non_ascii%C2%A3/sub/1757769905.91531" "tx9e82965aadc8444088e2e-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/0/a/4_vc_ascii/0134_o_non_ascii%C2%A3/sub/1757769905.91531" 201 - "PUT http://localhost/sdb1/3/a/4_vc_ascii/0134_o_non_ascii%C2%A3/sub/1757769905.91531" "tx9e82965aadc8444088e2e-0068c570b2" "object-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/3/a/4_vc_ascii/0134_o_non_ascii%C2%A3/sub/1757769905.91531" 201 - "PUT http://localhost/v1/a/4_vc_ascii/0134_o_non_ascii%C2%A3/sub/1757769905.91531" "tx9e82965aadc8444088e2e-0068c570b2" "proxy-server 1824535" 0.0239 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/3/a/4_vc_ascii/0134_o_non_ascii%C2%A3/sub/1757769905.91531" 201 - "PUT http://localhost/v1/a/4_vc_ascii/0134_o_non_ascii%C2%A3/sub/1757769905.91531" "tx9e82965aadc8444088e2e-0068c570b2" "proxy-server 1824535" 0.0206 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 PUT /v1/a/4_vc_ascii/0134_o_non_ascii%25C2%25A3/sub/1757769905.91531 HTTP/1.0 201 - Swift - 4 - 1b52eb8ef2c1875cfdf3ffbe9e3c05da tx9e82965aadc8444088e2e-0068c570b2 - 0.0379 VW - 1757769905.995184183 1757769906.033054352 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sdb1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" "tx379d6fa5ff964ba984059-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sda1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" "tx379d6fa5ff964ba984059-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" "tx379d6fa5ff964ba984059-0068c570b2" "proxy-server 1824535" 0.0129 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/0/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3/sub" "tx379d6fa5ff964ba984059-0068c570b2" "proxy-server 1824535" 0.0145 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3/sub HTTP/1.0 201 - - t 4 - - tx379d6fa5ff964ba984059-0068c570b2 - 0.0267 - - 1757769906.033486843 1757769906.060140848 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx921376b49f034a0b9e5c7-0068c570b2" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx921376b49f034a0b9e5c7-0068c570b2 - 0.0122 VW - 1757769906.061676979 1757769906.073912859 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/3/a/4_oc_ascii" 204 - "HEAD http://localhost/v1/a/4_oc_ascii" "tx7a8bc80001a045ab88b32-0068c570b2" "proxy-server 1824535" 0.0028 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a/4_oc_ascii HTTP/1.0 204 - Swift - - - - tx7a8bc80001a045ab88b32-0068c570b2 - 0.0096 VW - 1757769906.074409008 1757769906.084005117 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/0/a/4_vc_ascii" 200 764 "GET http://localhost/v1/a/4_vc_ascii?prefix=00f4_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "txd286fb10b86b48ecb5e72-0068c570b2" "proxy-server 1824535" 0.0116 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 GET /v1/a/4_vc_ascii%3Fprefix%3D00f4_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 764 - txd286fb10b86b48ecb5e72-0068c570b2 - 0.0148 VW - 1757769906.084544659 1757769906.099313736 0 - test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: Container GET returning 503 for (404, 503, 503, 503) test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to DELETE /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR 503 Trying to DELETE /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: Container GET returning 503 for (503, 503, 503, 503) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: Container GET returning 503 for (204, 404, 503, 503) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: Container GET returning 503 for (204, 503, 503, 503) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.3:1003/sddtest.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_response_code_for_POST test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_response_code_for_POST ... ok test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: Container GET returning 503 for (404, 503, 503, 503) test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR 503 Trying to POST /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: Container GET returning 503 for (503, 503, 503, 503) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda test ERROR: Container GET returning 503 for (201, 404, 503, 503) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: Container GET returning 503 for (201, 503, 503, 503) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda test ERROR: Container GET returning 503 for (404, 503, 503, 503) test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.2:1002/sdc test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIterationtest.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_response_code_for_PUT test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_response_code_for_PUT ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 200 5 "GET http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767?symlink=get" "tx538653178fb544a89a11f-0068c570b2" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sda1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 200 5 "GET http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767?symlink=get" "tx538653178fb544a89a11f-0068c570b2" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 GET /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769905.73767%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx538653178fb544a89a11f-0068c570b2 - 0.0358 VW - 1757769906.103057861 1757769906.138810158 0 - (txn: txc87a6f59a57049daba859-0068c570b2) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txc87a6f59a57049daba859-0068c570b2" "object-server 1824535" 0.0086 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/3/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txc87a6f59a57049daba859-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txc87a6f59a57049daba859-0068c570b2" "proxy-server 1824535" 0.0249 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/4_oc_ascii/4_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/4_oc_ascii/4_o_non_ascii%C2%A3" "txc87a6f59a57049daba859-0068c570b2" "proxy-server 1824535" 0.0244 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 PUT /v1/a/4_oc_ascii/4_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txc87a6f59a57049daba859-0068c570b2 - 0.0416 VW - 1757769906.121757030 1757769906.163365841 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "DELETE /sda1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 204 - "DELETE http://localhost/sda1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" "tx64fcc741cc014f239901f-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "DELETE /sdb1/0/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 204 - "DELETE http://localhost/sdb1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" "tx64fcc741cc014f239901f-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "DELETE /sda1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 204 - "DELETE http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" "tx64fcc741cc014f239901f-0068c570b2" "proxy-server 1824535" 0.0158 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "DELETE /sdb1/3/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" 204 - "DELETE http://localhost/v1/a/4_vc_ascii/00f4_o_non_ascii%C2%A3/1757769905.73767" "tx64fcc741cc014f239901f-0068c570b2" "proxy-server 1824535" 0.0255 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 DELETE /v1/a/4_vc_ascii/00f4_o_non_ascii%25C2%25A3/1757769905.73767 HTTP/1.0 204 - Swift - - - - tx64fcc741cc014f239901f-0068c570b2 - 0.0289 VW - 1757769906.163913727 1757769906.192826271 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx855f9c5bd34744ebb0930-0068c570b2" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sda1/0/a/4_vc_ascii" 200 195 "GET http://localhost/v1/a/4_vc_ascii?prefix=0134_o_non_ascii%C2%A3%2Fsub%2F&format=json&states=listing" "tx855f9c5bd34744ebb0930-0068c570b2" "proxy-server 1824535" 0.0087 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 GET /v1/a/4_vc_ascii%3Fprefix%3D0134_o_non_ascii%25C2%25A3%252Fsub%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 195 - tx855f9c5bd34744ebb0930-0068c570b2 - 0.0279 - - 1757769906.194411039 1757769906.222318888 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4cf9ae271bdd47848ec73-0068c570b2" "proxy-server 1824535" 0.0055 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/4_oc_asciiwhoops" 201 - "PUT http://127.0.0.1:44669/sdb1/3/a/4_oc_asciiwhoops" "tx4cf9ae271bdd47848ec73-0068c570b2" "container-server 1824535" 0.0010 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/4_oc_asciiwhoops" 201 - "PUT http://127.0.0.1:38699/sda1/3/a/4_oc_asciiwhoops" "tx4cf9ae271bdd47848ec73-0068c570b2" "container-server 1824535" 0.0011 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/3/a/4_oc_asciiwhoops" 201 - "PUT http://localhost/v1/a/4_oc_asciiwhoops" "tx4cf9ae271bdd47848ec73-0068c570b2" "proxy-server 1824535" 0.0177 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/3/a/4_oc_asciiwhoops" 201 - "PUT http://localhost/v1/a/4_oc_asciiwhoops" "tx4cf9ae271bdd47848ec73-0068c570b2" "proxy-server 1824535" 0.0313 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/4_oc_asciiwhoops HTTP/1.0 201 - - t - - - tx4cf9ae271bdd47848ec73-0068c570b2 - 0.0465 - - 1757769906.224162817 1757769906.270630121 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf35936469c044c0db8ddf-0068c570b2" "proxy-server 1824535" 0.0061 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txf35936469c044c0db8ddf-0068c570b2 - 0.0088 VW - 1757769906.276469231 1757769906.285249949 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/3/a/4_oc_asciiwhoops" 204 - "HEAD http://localhost/v1/a/4_oc_asciiwhoops" "txd83414d461104219b3924-0068c570b2" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a/4_oc_asciiwhoops HTTP/1.0 204 - Swift - - - - txd83414d461104219b3924-0068c570b2 - 0.0081 VW - 1757769906.285760403 1757769906.293818951 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/1/a/4_oc_asciiwhoops/foo" 404 70 "GET http://localhost/v1/a/4_oc_asciiwhoops/foo?symlink=get" "txc4a9bbb6975c4ec68cab8-0068c570b2" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sda1/1/a/4_oc_asciiwhoops/foo" 404 70 "GET http://localhost/v1/a/4_oc_asciiwhoops/foo?symlink=get" "txc4a9bbb6975c4ec68cab8-0068c570b2" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 GET /v1/a/4_oc_asciiwhoops/foo%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - txc4a9bbb6975c4ec68cab8-0068c570b2 - 0.0134 VW - 1757769906.294339418 1757769906.307730198 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/3/a/4_oc_asciiwhoops/foo" 201 - "PUT http://localhost/sda1/1/a/4_oc_asciiwhoops/foo" "txe38148ce9bd14308aa825-0068c570b2" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/3/a/4_oc_asciiwhoops/foo" 201 - "PUT http://localhost/sdb1/1/a/4_oc_asciiwhoops/foo" "txe38148ce9bd14308aa825-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/4_oc_asciiwhoops/foo" 201 - "PUT http://localhost/v1/a/4_oc_asciiwhoops/foo" "txe38148ce9bd14308aa825-0068c570b2" "proxy-server 1824535" 0.0111 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/4_oc_asciiwhoops/foo" 201 - "PUT http://localhost/v1/a/4_oc_asciiwhoops/foo" "txe38148ce9bd14308aa825-0068c570b2" "proxy-server 1824535" 0.0250 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/4_oc_asciiwhoops/foo HTTP/1.0 201 - - t 5 - - txe38148ce9bd14308aa825-0068c570b2 - 0.0287 - - 1757769906.308105946 1757769906.336797476 0 -test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_object test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_object ... ok test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.3:1003/sdd test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.0:1000/sda test ERROR: ERROR 503 Trying to PUT /a/c From Container Server 10.0.0.1:1001/sdb test ERROR: Container GET returning 503 for (503, 503, 503, 503) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: tx54715e6644d643b084a2d-0068c570b2) test ERROR: ERROR with Container server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: tx54715e6644d643b084a2d-0068c570b2) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: tx54715e6644d643b084a2d-0068c570b2) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: tx54715e6644d643b084a2d-0068c570b2) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: tx54715e6644d643b084a2d-0068c570b2) test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: tx54715e6644d643b084a2d-0068c570b2) test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: tx54715e6644d643b084a2d-0068c570b2) test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to GET /v1/a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1524, in _make_node_request conn = http_connect( ip, port, node['device'], self.partition, self.req.method, self.path, headers=req_headers, query_string=self.req.query_string) File "/build/reproducible-path/swift-2.36.0/swift/common/bufferedhttp.py", line 248, in http_connect return http_connect_raw( ipaddr, port, method, path, headers, query_string, ssl) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status OSError (txn: tx54715e6644d643b084a2d-0068c570b2)test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_response_codes_for_GET test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_response_codes_for_GET ... ok test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_swift_owner test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_swift_owner ... ok test ERROR: Container GET returning 503 for [] (txn: tx54715e6644d643b084a2d-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:1002/sdc (txn: txd6bc752c801f4cc89d43a-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.3:1003/sdd (txn: txd6bc752c801f4cc89d43a-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:1000/sda (txn: txd6bc752c801f4cc89d43a-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.1:1001/sdb (txn: txd6bc752c801f4cc89d43a-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.4:1004/sda (txn: txd6bc752c801f4cc89d43a-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.5:1005/sda (txn: txd6bc752c801f4cc89d43a-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.6:1006/sda (txn: txd6bc752c801f4cc89d43a-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.7:1007/sda (txn: txd6bc752c801f4cc89d43a-0068c570b2) test ERROR: Container GET returning 503 for [500, 500, 500, 500, 500, 500, 500, 500] (txn: txd6bc752c801f4cc89d43a-0068c570b2) test INFO: Client disconnected on read of '/a/c' (txn: txf3d16cb0ae174912a6b26-0068c570b2) test INFO: Client disconnected on read of '/a/c' (txn: tx6e59014e72fb4cbaae0bb-0068c570b2) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx7bf81a8eff6a468ea0e58-0068c570b2) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx7bf81a8eff6a468ea0e58-0068c570b2) test ERROR: ERROR with Container server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx7bf81a8eff6a468ea0e58-0068c570b2) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx7bf81a8eff6a468ea0e58-0068c570b2) test ERROR: Container GET returning 503 for [] (txn: tx7bf81a8eff6a468ea0e58-0068c570b2) test INFO: Client disconnected on read of '/a/c' (txn: tx7bf81a8eff6a468ea0e58-0068c570b2) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txab8a61f0720f4e47a8055-0068c570b2) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txab8a61f0720f4e47a8055-0068c570b2) test ERROR: ERROR with Container server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txab8a61f0720f4e47a8055-0068c570b2) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txab8a61f0720f4e47a8055-0068c570b2) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txab8a61f0720f4e47a8055-0068c570b2) test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txab8a61f0720f4e47a8055-0068c570b2) test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txab8a61f0720f4e47a8055-0068c570b2) test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txab8a61f0720f4e47a8055-0068c570b2) test ERROR: Container GET returning 503 for [] (txn: txab8a61f0720f4e47a8055-0068c570b2) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txcbe45a50daa54837a0a46-0068c570b2) test ERROR: ERROR with Container server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txcbe45a50daa54837a0a46-0068c570b2) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txcbe45a50daa54837a0a46-0068c570b2) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txcbe45a50daa54837a0a46-0068c570b2) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txcbe45a50daa54837a0a46-0068c570b2) test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txcbe45a50daa54837a0a46-0068c570b2) test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: txcbe45a50daa54837a0a46-0068c570b2) test ERROR: Container GET returning 503 for [] (txn: txcbe45a50daa54837a0a46-0068c570b2) test ERROR: ERROR with Container server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx96fedc6e5b754c0f8765c-0068c570b2) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx96fedc6e5b754c0f8765c-0068c570b2) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx96fedc6e5b754c0f8765c-0068c570b2) test ERROR: Container GET returning 503 for [] (txn: tx96fedc6e5b754c0f8765c-0068c570b2) test ERROR: ERROR with Container server 10.0.0.3:1003/sdd re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx03ab3505bba64bd3a0eed-0068c570b2) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to GET /v1/a/c: Timeout (Nones) (txn: tx03ab3505bba64bd3a0eed-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.0:1000/sda (txn: tx942b99f65f2b446e9e778-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.3:1003/sdd (txn: tx942b99f65f2b446e9e778-0068c570b2) test ERROR: ERROR 500 b'' Trying to GET /a/c From Container Server 10.0.0.2:1002/sdc (txn: tx942b99f65f2b446e9e778-0068c570b2) test ERROR: Container GET returning 503 for [500, 500, 500] (txn: tx942b99f65f2b446e9e778-0068c570b2) test ERROR: ERROR 503 b'' Trying to GET /a/c From Container Server 10.0.0.2:1002/sdc (txn: tx1f9ca1217f434bfea3a86-0068c570b2) test ERROR: Node will be error limited for 60.00s: 10.0.0.1:1001/sdb, error: ERROR Insufficient Storage (txn: tx5e2c06f480284f958a2cc-0068c570b2) test DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx5e2c06f480284f958a2cc-0068c570b2) test INFO: Client disconnected on read of '/a/c' (txn: tx5e2c06f480284f958a2cc-0068c570b2) test ERROR: Container GET returning 503 for [] (txn: txd764318f74e64825813b6-0068c570b2) test INFO: Client disconnected on read of '/a/c' (txn: txd764318f74e64825813b6-0068c570b2) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test INFO: Client disconnected on read of '/a/c' (txn: txf4e05eb9b1404e9bb8778-0068c570b2) test INFO: Client disconnected on read of '/a/c' (txn: txf4e05eb9b1404e9bb8778-0068c570b2) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx1214c5d190074c3594038-0068c570b2) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx1214c5d190074c3594038-0068c570b2)test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_sys_meta_headers_POST test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_sys_meta_headers_POST ... ok test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_sys_meta_headers_PUT test.unit.proxy.controllers.test_container.TestContainerController4Replicas.test_sys_meta_headers_PUT ... ok test.unit.proxy.controllers.test_obj.TestECFunctions.test_chunk_transformer test.unit.proxy.controllers.test_obj.TestECFunctions.test_chunk_transformer ... ok test.unit.proxy.controllers.test_obj.TestECFunctions.test_chunk_transformer_non_aligned_last_chunk test.unit.proxy.controllers.test_obj.TestECFunctions.test_chunk_transformer_non_aligned_last_chunk ... ok test.unit.proxy.controllers.test_obj.TestECFunctions.test_client_range_to_segment_range test.unit.proxy.controllers.test_obj.TestECFunctions.test_client_range_to_segment_range ... ok test.unit.proxy.controllers.test_obj.TestECFunctions.test_segment_range_to_fragment_range test.unit.proxy.controllers.test_obj.TestECFunctions.test_segment_range_to_fragment_range ... ok test ERROR: ERROR with Container server 10.0.0.3:1003/sdd re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx1214c5d190074c3594038-0068c570b2) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx1214c5d190074c3594038-0068c570b2) test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx1214c5d190074c3594038-0068c570b2) test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx1214c5d190074c3594038-0068c570b2) test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to POST /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx1214c5d190074c3594038-0068c570b2) test ERROR: Container GET returning 503 for (200, 503, 503, 503) (txn: tx1214c5d190074c3594038-0068c570b2) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx3c9b4810447a4d7b98793-0068c570b2) test ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx3c9b4810447a4d7b98793-0068c570b2) test ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx3c9b4810447a4d7b98793-0068c570b2) test ERROR: ERROR with Container server 10.0.0.4:1004/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx3c9b4810447a4d7b98793-0068c570b2) test ERROR: ERROR with Container server 10.0.0.5:1005/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx3c9b4810447a4d7b98793-0068c570b2) test ERROR: ERROR with Container server 10.0.0.6:1006/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx3c9b4810447a4d7b98793-0068c570b2) test ERROR: ERROR with Container server 10.0.0.7:1007/sda re: Trying to PUT /a/c: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 2051, in _make_request conn = http_connect( ip, port, node['device'], part, method, path, headers=headers, query_string=query) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx3c9b4810447a4d7b98793-0068c570b2) test ERROR: Container GET returning 503 for (200, 503, 503, 503) (txn: tx3c9b4810447a4d7b98793-0068c570b2) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmpmt2lueaw/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpmt2lueaw/tmp_test_proxy_server_chunked/container-sync-realms.conf' acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1a7500b043914ed984c2b-0068c570b2" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx1a7500b043914ed984c2b-0068c570b2 - 0.0112 VW - 1757769906.350787401 1757769906.361969471 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/3/a/4_oc_asciiwhoops" 204 - "HEAD http://localhost/v1/a/4_oc_asciiwhoops" "tx6de04379da074c4bb03e7-0068c570b2" "proxy-server 1824535" 0.0100 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a/4_oc_asciiwhoops HTTP/1.0 204 - Swift - - - - tx6de04379da074c4bb03e7-0068c570b2 - 0.0128 VW - 1757769906.362502575 1757769906.375303030 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/1/a/4_oc_asciiwhoops/foo" 200 5 "GET http://localhost/v1/a/4_oc_asciiwhoops/foo?symlink=get" "tx406048ab710a489092e59-0068c570b2" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sda1/1/a/4_oc_asciiwhoops/foo" 200 5 "GET http://localhost/v1/a/4_oc_asciiwhoops/foo?symlink=get" "tx406048ab710a489092e59-0068c570b2" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx451e610c151e4088be4a1-0068c570b2" "proxy-server 1824535" 0.0002 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx451e610c151e4088be4a1-0068c570b2" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 GET /v1/a/4_oc_asciiwhoops/foo%3Fsymlink%3Dget HTTP/1.0 499 - Swift - - 5 - tx406048ab710a489092e59-0068c570b2 - 0.0424 VW - 1757769906.375873089 1757769906.418234587 0 - (txn: tx2e22b7fb70494c0e8f326-0068c570b2) proxy INFO: - - 13/Sep/2025/13/25/06 PUT /v1/a/none/003foo/1757769906.30863 HTTP/1.0 404 - Swift - - 70 dcddb75469b4b4875094e14561e573d8 tx2e22b7fb70494c0e8f326-0068c570b2 - 0.0107 VW - 1757769906.411967278 1757769906.422710419 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5e4d6d2ed96744049d51b-0068c570b2" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx5e4d6d2ed96744049d51b-0068c570b2 - 0.0083 VW - 1757769906.424631119 1757769906.432885408 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/3/a/4_oc_asciiwhoops" 204 - "HEAD http://localhost/v1/a/4_oc_asciiwhoops" "txb9e7e03986ef4fd2b2e4d-0068c570b2" "proxy-server 1824535" 0.0142 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a/4_oc_asciiwhoops HTTP/1.0 204 - Swift - - - - txb9e7e03986ef4fd2b2e4d-0068c570b2 - 0.0193 VW - 1757769906.433389425 1757769906.452693939 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "tx29bc4f65031a4977b49f2-0068c570b2" "proxy-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sda1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "tx29bc4f65031a4977b49f2-0068c570b2" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 GET /v1/a/none%3Fprefix%3D003foo%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 404 - Swift - - 70 - tx29bc4f65031a4977b49f2-0068c570b2 - 0.0137 VW - 1757769906.453243494 1757769906.466953993 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "DELETE /sdb1/3/a/4_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/sdb1/1/a/4_oc_asciiwhoops/foo" "tx1375cc7be84c489c9fbe5-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "DELETE /sda1/3/a/4_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/sda1/1/a/4_oc_asciiwhoops/foo" "tx1375cc7be84c489c9fbe5-0068c570b2" "object-server 1824535" 0.0044 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "DELETE /sdb1/1/a/4_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/v1/a/4_oc_asciiwhoops/foo" "tx1375cc7be84c489c9fbe5-0068c570b2" "proxy-server 1824535" 0.0144 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "DELETE /sda1/1/a/4_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/v1/a/4_oc_asciiwhoops/foo" "tx1375cc7be84c489c9fbe5-0068c570b2" "proxy-server 1824535" 0.0099 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 DELETE /v1/a/4_oc_asciiwhoops/foo HTTP/1.0 204 - - t - - - tx1375cc7be84c489c9fbe5-0068c570b2 - 0.0185 - - 1757769906.467374563 1757769906.485870838 0 - proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx72dd13c7a22d445480bfc-0068c570b2" "proxy-server 1824535" 0.0018 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/2_oc_ascii" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/2_oc_ascii" "tx72dd13c7a22d445480bfc-0068c570b2" "container-server 1824535" 0.0058 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/2_oc_ascii" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/2_oc_ascii" "tx72dd13c7a22d445480bfc-0068c570b2" "container-server 1824535" 0.0010 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a/2_oc_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii" "tx72dd13c7a22d445480bfc-0068c570b2" "proxy-server 1824535" 0.0307 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/2_oc_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii" "tx72dd13c7a22d445480bfc-0068c570b2" "proxy-server 1824535" 0.0224 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/2_oc_ascii HTTP/1.0 201 - - t - - - tx72dd13c7a22d445480bfc-0068c570b2 - 0.0477 - - 1757769906.493168354 1757769906.540862560 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx368e577e6f934b068f491-0068c570b2" "proxy-server 1824535" 0.0019 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/2/a/2_oc_ascii" 200 2 "GET http://localhost/v1/a/2_oc_ascii?format=json&states=listing" "tx368e577e6f934b068f491-0068c570b2" "proxy-server 1824535" 0.0063 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 GET /v1/a/2_oc_ascii%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx368e577e6f934b068f491-0068c570b2 - 0.0226 - - 1757769906.542239428 1757769906.564878941 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx15aee215db034882bdc38-0068c570b2" "proxy-server 1824535" 0.0013 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/2_vc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:38699/sda1/3/a/2_vc_non_ascii%C2%A3" "tx15aee215db034882bdc38-0068c570b2" "container-server 1824535" 0.0091 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/2_vc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:44669/sdb1/3/a/2_vc_non_ascii%C2%A3" "tx15aee215db034882bdc38-0068c570b2" "container-server 1824535" 0.0016 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/3/a/2_vc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3" "tx15aee215db034882bdc38-0068c570b2" "proxy-server 1824535" 0.0292 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/3/a/2_vc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3" "tx15aee215db034882bdc38-0068c570b2" "proxy-server 1824535" 0.0383 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/2_vc_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx15aee215db034882bdc38-0068c570b2 - 0.0501 - - 1757769906.570820093 1757769906.620956421 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:33775/sda1/1/a1/c1" "tx267b757ac13645a4a7fd3-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:40993/sdb1/1/a1/c1" "tx267b757ac13645a4a7fd3-0068c570b1" "container-server 1824536" 0.0052 "-" 1824536 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx267b757ac13645a4a7fd3-0068c570b1" "proxy-server 1824536" 0.0250 "-" 1824536 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx267b757ac13645a4a7fd3-0068c570b1" "proxy-server 1824536" 0.0174 "-" 1824536 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx267b757ac13645a4a7fd3-0068c570b1 - 0.0496 - - 1757769905.764857531 1757769905.814472198 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx24afd12da8354e7e8b73d-0068c570b1" "proxy-server 1824536" 0.0101 "-" 1824536 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:40993/sdb1/2/a/c1" "tx24afd12da8354e7e8b73d-0068c570b1" "container-server 1824536" 0.0011 "-" 1824536 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:33775/sda1/2/a/c1" "tx24afd12da8354e7e8b73d-0068c570b1" "container-server 1824536" 0.0017 "-" 1824536 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx24afd12da8354e7e8b73d-0068c570b1" "proxy-server 1824536" 0.0253 "-" 1824536 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx24afd12da8354e7e8b73d-0068c570b1" "proxy-server 1824536" 0.0384 "-" 1824536 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx24afd12da8354e7e8b73d-0068c570b1 - 0.0751 - - 1757769905.820240736 1757769905.895347595 1 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc939c474224942c09e764-0068c570b1" "proxy-server 1824536" 0.0020 "-" 1824536 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:33775/sda1/1/a/c2" "txc939c474224942c09e764-0068c570b1" "container-server 1824536" 0.0010 "-" 1824536 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:40993/sdb1/1/a/c2" "txc939c474224942c09e764-0068c570b1" "container-server 1824536" 0.0097 "-" 1824536 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txc939c474224942c09e764-0068c570b1" "proxy-server 1824536" 0.0370 "-" 1824536 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:05 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txc939c474224942c09e764-0068c570b1" "proxy-server 1824536" 0.0255 "-" 1824536 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/05 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txc939c474224942c09e764-0068c570b1 - 0.0583 - - 1757769905.896916151 1757769905.955178976 2 - test-proxy-config DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test-proxy-config DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test-proxy-config DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test-proxy-config DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test-proxy-config DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test-proxy-config DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test-proxy-config DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test-proxy-config DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test-proxy-config DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) /usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmpmt2lueaw/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpmt2lueaw/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0072 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0071 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0027 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0070 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8cf955e6b50f45ba89d80-0068c570b2" "proxy-server 1824502" 0.0012 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:37953/sdb1/1/a/c" "tx8cf955e6b50f45ba89d80-0068c570b2" "container-server 1824502" 0.0052 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:35165/sda1/1/a/c" "tx8cf955e6b50f45ba89d80-0068c570b2" "container-server 1824502" 0.0011 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx8cf955e6b50f45ba89d80-0068c570b2" "proxy-server 1824502" 0.0166 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx8cf955e6b50f45ba89d80-0068c570b2" "proxy-server 1824502" 0.0259 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx8cf955e6b50f45ba89d80-0068c570b2 - 0.0462 - - 1757769906.505931616 1757769906.552118540 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx395d3d8a8aa144ed96f14-0068c570b2" "proxy-server 1824502" 0.0011 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:37953/sdb1/1/a1/c1" "tx395d3d8a8aa144ed96f14-0068c570b2" "container-server 1824502" 0.0010 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:35165/sda1/1/a1/c1" "tx395d3d8a8aa144ed96f14-0068c570b2" "container-server 1824502" 0.0052 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx395d3d8a8aa144ed96f14-0068c570b2" "proxy-server 1824502" 0.0164 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx395d3d8a8aa144ed96f14-0068c570b2" "proxy-server 1824502" 0.0254 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx395d3d8a8aa144ed96f14-0068c570b2 - 0.0408 - - 1757769906.553565741 1757769906.594343662 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1253c2f0f6ca4637b2ff1-0068c570b2" "proxy-server 1824502" 0.0101 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/c1" "tx1253c2f0f6ca4637b2ff1-0068c570b2" "container-server 1824502" 0.0100 "-" 1824502 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/c1" "tx1253c2f0f6ca4637b2ff1-0068c570b2" "container-server 1824502" 0.0011 "-" 1824502 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx1253c2f0f6ca4637b2ff1-0068c570b2" "proxy-server 1824502" 0.0259 "-" 1824502 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx1253c2f0f6ca4637b2ff1-0068c570b2" "proxy-server 1824502" 0.0482 "-" 1824502 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx1253c2f0f6ca4637b2ff1-0068c570b2 - 0.0805 - - 1757769906.604125023 1757769906.684633493 1 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2fd1eee098de45229639b-0068c570b2" "proxy-server 1824502" 0.0020 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:35165/sda1/1/a/c2" "tx2fd1eee098de45229639b-0068c570b2" "container-server 1824502" 0.0011 "-" 1824502 2 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:37953/sdb1/1/a/c2" "tx2fd1eee098de45229639b-0068c570b2" "container-server 1824502" 0.0095 "-" 1824502 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx2fd1eee098de45229639b-0068c570b2" "proxy-server 1824502" 0.0378 "-" 1824502 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "tx2fd1eee098de45229639b-0068c570b2" "proxy-server 1824502" 0.0300 "-" 1824502 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - tx2fd1eee098de45229639b-0068c570b2 - 0.0593 - - 1757769906.686115980 1757769906.745453358 2 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx42a95dd6645444e0af1a0-0068c570b2" "proxy-server 1824502" 0.0064 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/ec" "tx42a95dd6645444e0af1a0-0068c570b2" "container-server 1824502" 0.0011 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/ec" "tx42a95dd6645444e0af1a0-0068c570b2" "container-server 1824502" 0.0018 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a/ec" 201 - "PUT http://localhost/v1/a/ec" "tx42a95dd6645444e0af1a0-0068c570b2" "proxy-server 1824502" 0.0178 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/ec" 201 - "PUT http://localhost/v1/a/ec" "tx42a95dd6645444e0af1a0-0068c570b2" "proxy-server 1824502" 0.0272 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/ec HTTP/1.0 201 - - t - - - tx42a95dd6645444e0af1a0-0068c570b2 - 0.0484 - - 1757769906.751826286 1757769906.800236225 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx82f209f1db244171aca5d-0068c570b2" "proxy-server 1824502" 0.0021 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx85330342ff9c47c59941f-0068c570b2" "proxy-server 1824502" 0.0014 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdg1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "tx61d1ab05c8e143dd80cee-0068c570b2" "proxy-server 1824502" 0.0158 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a/ec/go-get-it" 201 - "PUT http://localhost/sdh1/3/a/ec/go-get-it" "tx61d1ab05c8e143dd80cee-0068c570b2" "object-server 1824502" 0.0047 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/ec/go-get-it" 201 - "PUT http://localhost/sdi1/3/a/ec/go-get-it" "tx61d1ab05c8e143dd80cee-0068c570b2" "object-server 1824502" 0.0005 "-" 1824502 3test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8291b91b34634c5d93578-0068c570b2" "proxy-server 1824535" 0.0181 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx8291b91b34634c5d93578-0068c570b2 - 0.0208 VW - 1757769906.628198385 1757769906.649017572 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx54e2612c266a48ab817f0-0068c570b2" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx54e2612c266a48ab817f0-0068c570b2 - 0.0070 VW - 1757769906.649587154 1757769906.656613350 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 404 70 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx0000062af6d24a47a3092-0068c570b2" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 404 70 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx0000062af6d24a47a3092-0068c570b2" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 GET /v1/a/2_oc_ascii/2_o_ascii%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx0000062af6d24a47a3092-0068c570b2 - 0.0092 VW - 1757769906.657209396 1757769906.666436672 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "txad56c099a4ed409f8a302-0068c570b2" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "txad56c099a4ed409f8a302-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txad56c099a4ed409f8a302-0068c570b2" "proxy-server 1824535" 0.0115 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txad56c099a4ed409f8a302-0068c570b2" "proxy-server 1824535" 0.0129 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - - t 5 - - txad56c099a4ed409f8a302-0068c570b2 - 0.0179 - - 1757769906.670878649 1757769906.688782692 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx50bcdac1deb7407dac5c1-0068c570b2" "proxy-server 1824535" 0.0063 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx50bcdac1deb7407dac5c1-0068c570b2 - 0.0091 VW - 1757769906.703705311 1757769906.712813854 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx7859ed581396476692a6c-0068c570b2" "proxy-server 1824535" 0.0026 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx7859ed581396476692a6c-0068c570b2 - 0.0145 VW - 1757769906.713331223 1757769906.727848768 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx3f8853e503094573b6d71-0068c570b2" "proxy-server 1824535" 0.0088 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx3f8853e503094573b6d71-0068c570b2" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/3/a/2_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/2_vc_non_ascii%C2%A3" "txc95502c982324cc7ac76b-0068c570b2" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 GET /v1/a/2_oc_ascii/2_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx3f8853e503094573b6d71-0068c570b2 - 0.0486 VW - 1757769906.728488207 1757769906.777045965 0 - (txn: tx2f1cfb173e374c4db4c7c-0068c570b2) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 201 - "PUT http://localhost/sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" "tx2f1cfb173e374c4db4c7c-0068c570b2" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 201 - "PUT http://localhost/sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" "tx2f1cfb173e374c4db4c7c-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" "tx2f1cfb173e374c4db4c7c-0068c570b2" "proxy-server 1824535" 0.0118 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" "tx2f1cfb173e374c4db4c7c-0068c570b2" "proxy-server 1824535" 0.0218 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 PUT /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769906.67142 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx2f1cfb173e374c4db4c7c-0068c570b2 - 0.0381 VW - 1757769906.751502752 1757769906.789630413 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "txf20f34dbd4a04a818e663-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txf20f34dbd4a04a818e663-0068c570b2" "proxy-server 1824535" 0.0101 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "txf20f34dbd4a04a818e663-0068c570b2" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txf20f34dbd4a04a818e663-0068c570b2" "proxy-server 1824535" 0.0214 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - - t 5 - - txf20f34dbd4a04a818e663-0068c570b2 - 0.0301 - - 1757769906.790074348 1757769906.820128918 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx20d61d4f39e643a08a7d9-0068c570b2" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx380ad14b253746a08995d-0068c570b2" "proxy-server 1824535" 0.0025 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txe55b090aee6040448ef80-0068c570b2" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 GET /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 200 - - t - 5 - txe55b090aee6040448ef80-0068c570b2 - 0.0299 - - 1757769906.821655989 1757769906.851588011 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx39fb13f8e16f4fefab679-0068c570b2" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx39fb13f8e16f4fefab679-0068c570b2 - 0.0081 VW - 1757769906.863592386 1757769906.871721745 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx4b8497ee3e2f431d93a2b-0068c570b2" "proxy-server 1824535" 0.0068 "-" 1824535 0test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec_404 test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec_404 ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdi1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "tx61d1ab05c8e143dd80cee-0068c570b2" "proxy-server 1824502" 0.0303 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdh1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "tx61d1ab05c8e143dd80cee-0068c570b2" "proxy-server 1824502" 0.0317 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/ec/go-get-it HTTP/1.0 201 - - t 1309 - - tx61d1ab05c8e143dd80cee-0068c570b2 - 0.0638 - - 1757769906.801815510 1757769906.865617037 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx02a94bbc8e2e4d4dbe84c-0068c570b2" "proxy-server 1824502" 0.0014 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txcbe36c273f77432aa520a-0068c570b2" "proxy-server 1824502" 0.0067 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdh1/3/a/ec/go-get-it" 200 736 "GET http://localhost/v1/a/ec/go-get-it" "txac5a354f18784d27a09ce-0068c570b2" "proxy-server 1824502" 0.0004 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdi1/3/a/ec/go-get-it" 200 736 "GET http://localhost/v1/a/ec/go-get-it" "txac5a354f18784d27a09ce-0068c570b2" "proxy-server 1824502" 0.0004 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 GET /v1/a/ec/go-get-it HTTP/1.0 200 - - t - 1309 - txac5a354f18784d27a09ce-0068c570b2 - 0.0290 - - 1757769906.875371933 1757769906.904350996 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8478be54c6784fa8aa500-0068c570b2" "proxy-server 1824502" 0.0057 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/ec" "tx8478be54c6784fa8aa500-0068c570b2" "container-server 1824502" 0.0011 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx8478be54c6784fa8aa500-0068c570b2" "proxy-server 1824502" 0.0194 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/ec" "tx8478be54c6784fa8aa500-0068c570b2" "container-server 1824502" 0.0019 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx8478be54c6784fa8aa500-0068c570b2" "proxy-server 1824502" 0.0333 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/06 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx8478be54c6784fa8aa500-0068c570b2 - 0.0452 - - 1757769906.911860228 1757769906.957040071 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx842ad2985da443b1b1705-0068c570b2" "proxy-server 1824502" 0.0022 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txe3c7fb78b92343929803c-0068c570b2" "proxy-server 1824502" 0.0057 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdh1/2/a/ec/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec/yes-we-have-no-bananas" "txea451c1b2061422f8e448-0068c570b2" "proxy-server 1824502" 0.0002 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdi1/2/a/ec/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec/yes-we-have-no-bananas" "txea451c1b2061422f8e448-0068c570b2" "proxy-server 1824502" 0.0002 "-" 1824502 3 proxy DEBUG: Ignoring 404 from primary (txn: txea451c1b2061422f8e448-0068c570b2) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: txea451c1b2061422f8e448-0068c570b2) (client_ip: 127.0.0.1) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdg1/2/a/ec/yes-we-have-no-bananas" 404 70 "GET http://localhost/v1/a/ec/yes-we-have-no-bananas" "txea451c1b2061422f8e448-0068c570b2" "proxy-server 1824502" 0.0002 "-" 1824502 3 proxy DEBUG: Ignoring 404 from primary (txn: txea451c1b2061422f8e448-0068c570b2) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/ec/yes-we-have-no-bananas HTTP/1.0 404 - - t - 70 - txea451c1b2061422f8e448-0068c570b2 - 0.0431 - - 1757769906.958505630 1757769907.001624823 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txef5091ab74c44b8d9b02e-0068c570b3" "proxy-server 1824502" 0.0064 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/ec" "txef5091ab74c44b8d9b02e-0068c570b3" "container-server 1824502" 0.0011 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/ec" "txef5091ab74c44b8d9b02e-0068c570b3" "container-server 1824502" 0.0011 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txef5091ab74c44b8d9b02e-0068c570b3" "proxy-server 1824502" 0.0179 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txef5091ab74c44b8d9b02e-0068c570b3" "proxy-server 1824502" 0.0160 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - txef5091ab74c44b8d9b02e-0068c570b3 - 0.0398 - - 1757769907.007810354 1757769907.047598839 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx12359fcf7dcc46d6842ed-0068c570b3" "proxy-server 1824502" 0.0022 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx376500f335444fb1aee71-0068c570b3" "proxy-server 1824502" 0.0014 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdi1/3/a/ec/big-obj-get" 201 - "PUT http://localhost/v1/a/ec/big-obj-get" "txe3aae0de14b34547a951e-0068c570b3" "proxy-server 1824502" 0.0152 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/ec/big-obj-get" 201 - "PUT http://localhost/sdh1/3/a/ec/big-obj-get" "txe3aae0de14b34547a951e-0068c570b3" "object-server 1824502" 0.0005 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/ec/big-obj-get" 201 - "PUT http://localhost/sdg1/3/a/ec/big-obj-get" "txe3aae0de14b34547a951e-0068c570b3" "object-server 1824502" 0.0004 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdh1/3/a/ec/big-obj-get" 201 - "PUT http://localhost/v1/a/ec/big-obj-get" "txe3aae0de14b34547a951e-0068c570b3" "proxy-server 1824502" 0.0236 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdg1/3/a/ec/big-obj-get" 201 - "PUT http://localhost/v1/a/ec/big-obj-get" "txe3aae0de14b34547a951e-0068c570b3" "proxy-server 1824502" 0.0248 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 PUT /v1/a/ec/big-obj-get HTTP/1.0 201 - - t 10400 - - txe3aae0de14b34547a951e-0068c570b3 - 0.0564 - - 1757769907.049221516 1757769907.105591059 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa7442248e7714e59b737c-0068c570b3" "proxy-server 1824502" 0.0065 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx27d722f4fc4e44e7a8063-0068c570b3" "proxy-server 1824502" 0.0068 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdi1/3/a/ec/big-obj-get" 200 5440 "GET http://localhost/v1/a/ec/big-obj-get" "tx2cdc11873fb64ab9a1eea-0068c570b3" "proxy-server 1824502" 0.0004 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdh1/3/a/ec/big-obj-get" 200 5440 "GET http://localhost/v1/a/ec/big-obj-get" "tx2cdc11873fb64ab9a1eea-0068c570b3" "proxy-server 1824502" 0.0045 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/ec/big-obj-get HTTP/1.0 200 - - t - 10400 - tx2cdc11873fb64ab9a1eea-0068c570b3 - 0.0426 - - 1757769907.111255646 1757769907.153876066 3 -test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec_big test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec_big ... ok proxy INFO: - - 13/Sep/2025/13/25/06 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx4b8497ee3e2f431d93a2b-0068c570b2 - 0.0154 VW - 1757769906.872261524 1757769906.887683630 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx29c90cfc5a514a71ac2f7-0068c570b2" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx29c90cfc5a514a71ac2f7-0068c570b2" "proxy-server 1824535" 0.0007 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "HEAD /sdb1/3/a/2_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/2_vc_non_ascii%C2%A3" "txb9d46cc614ec43cfaaff5-0068c570b2" "proxy-server 1824535" 0.0024 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 GET /v1/a/2_oc_ascii/2_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx29c90cfc5a514a71ac2f7-0068c570b2 - 0.0447 VW - 1757769906.888283253 1757769906.932994843 0 - (txn: txdc6ad682369e493d8190b-0068c570b2) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 201 - "PUT http://localhost/sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" "txdc6ad682369e493d8190b-0068c570b2" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 201 - "PUT http://localhost/sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" "txdc6ad682369e493d8190b-0068c570b2" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" "txdc6ad682369e493d8190b-0068c570b2" "proxy-server 1824535" 0.0353 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" "txdc6ad682369e493d8190b-0068c570b2" "proxy-server 1824535" 0.0391 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/06 PUT /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769906.79057 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 txdc6ad682369e493d8190b-0068c570b2 - 0.0655 VW - 1757769906.907102108 1757769906.972573280 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "tx41e012d8cd9641409c2c7-0068c570b2" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:06 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx41e012d8cd9641409c2c7-0068c570b2" "proxy-server 1824535" 0.0140 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "tx41e012d8cd9641409c2c7-0068c570b2" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx41e012d8cd9641409c2c7-0068c570b2" "proxy-server 1824535" 0.0245 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - - t 5 - - tx41e012d8cd9641409c2c7-0068c570b2 - 0.0372 - - 1757769906.973104477 1757769907.010297537 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx616063772fbe4f988421c-0068c570b3" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx3ccd51462f7f4d08a97ff-0068c570b3" "proxy-server 1824535" 0.0051 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx7055a3c610d44c09b0cfd-0068c570b3" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 200 - - t - 5 - tx7055a3c610d44c09b0cfd-0068c570b3 - 0.0200 - - 1757769907.017686129 1757769907.037645102 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txebe59bc0d6534b5da9177-0068c570b3" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/3/a/2_vc_non_ascii%C2%A3" 200 362 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?format=json&states=listing" "txebe59bc0d6534b5da9177-0068c570b3" "proxy-server 1824535" 0.0077 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 362 - txebe59bc0d6534b5da9177-0068c570b3 - 0.0194 - - 1757769907.044374704 1757769907.063734770 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx48309f8099e94bc1a3a3c-0068c570b3" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx677def881fb24d20942e1-0068c570b3" "proxy-server 1824535" 0.0068 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txdd8b5d9ca7404fce92012-0068c570b3" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txdd8b5d9ca7404fce92012-0068c570b3" "proxy-server 1824535" 0.0048 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8af81b17a3604ddb982a1-0068c570b3" "proxy-server 1824535" 0.0054 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx8af81b17a3604ddb982a1-0068c570b3 - 0.0081 VW - 1757769907.108856201 1757769907.116991282 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx763a26cbc5584bbb8e38b-0068c570b3" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx763a26cbc5584bbb8e38b-0068c570b3 - 0.0081 VW - 1757769907.117504597 1757769907.125646353 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/2/a/2_oc_ascii/copied_name" 404 70 "GET http://localhost/v1/a/2_oc_ascii/copied_name?symlink=get" "tx790ba455c3164b7badf97-0068c570b3" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/2/a/2_oc_ascii/copied_name" 404 70 "GET http://localhost/v1/a/2_oc_ascii/copied_name?symlink=get" "tx790ba455c3164b7badf97-0068c570b3" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/copied_name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx790ba455c3164b7badf97-0068c570b3 - 0.0135 VW - 1757769907.126183510 1757769907.139690161 0 - proxy INFO: - - 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 200 - Swift t - 5 - txdd8b5d9ca7404fce92012-0068c570b3 - 0.0831 SSC - 1757769907.065683365 1757769907.148756266 0 - (txn: txa84c81f94fd543cda617d-0068c570b3) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/2_oc_ascii/copied_name" 201 - "PUT http://localhost/sdb1/2/a/2_oc_ascii/copied_name" "txa84c81f94fd543cda617d-0068c570b3" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/2_oc_ascii/copied_name" 201 - "PUT http://localhost/sda1/2/a/2_oc_ascii/copied_name" "txa84c81f94fd543cda617d-0068c570b3" "object-server 1824535" 0.0004 "-" 1824535 0test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec_deleted test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec_deleted ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/2_oc_ascii/copied_name" 201 - "PUT http://localhost/v1/a/2_oc_ascii/copied_name" "txa84c81f94fd543cda617d-0068c570b3" "proxy-server 1824535" 0.0176 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/2_oc_ascii/copied_name" 201 - "PUT http://localhost/v1/a/2_oc_ascii/copied_name" "txa84c81f94fd543cda617d-0068c570b3" "proxy-server 1824535" 0.0131 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 COPY /v1/a/2_oc_ascii/copied_name HTTP/1.0 201 - - t 5 - db7282901da891bea2fcd73840caad1c txa84c81f94fd543cda617d-0068c570b3 - 0.0218 SSC - 1757769907.140094042 1757769907.161890745 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx163d4c3b3d05429b99a74-0068c570b3" "proxy-server 1824535" 0.0012 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx87ab89e87a864d05aec56-0068c570b3" "proxy-server 1824535" 0.0068 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/2/a/2_oc_ascii/copied_name" 200 5 "GET http://localhost/v1/a/2_oc_ascii/copied_name" "txa44f4afeee6a47c8a51d0-0068c570b3" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/copied_name HTTP/1.0 200 - - t - 5 - txa44f4afeee6a47c8a51d0-0068c570b3 - 0.0257 - - 1757769907.167635202 1757769907.193349361 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc546e4743d3645828aa62-0068c570b3" "proxy-server 1824535" 0.0013 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "txbd16e5cae09846fe8c65e-0068c570b3" "proxy-server 1824535" 0.0053 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "POST http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "tx0cd7f5549d6d464cbe855-0068c570b3" "object-server 1824535" 0.0046 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "POST http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "tx0cd7f5549d6d464cbe855-0068c570b3" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "POST /sda1/1/a/2_oc_ascii/2_o_ascii" 202 76 "POST http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx0cd7f5549d6d464cbe855-0068c570b3" "proxy-server 1824535" 0.0156 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "POST /sdb1/1/a/2_oc_ascii/2_o_ascii" 202 76 "POST http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx0cd7f5549d6d464cbe855-0068c570b3" "proxy-server 1824535" 0.0101 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 POST /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 202 - - t - 76 - tx0cd7f5549d6d464cbe855-0068c570b3 - 0.0481 - - 1757769907.199070215 1757769907.247194052 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx216449a430244d628ab83-0068c570b3" "proxy-server 1824535" 0.0056 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "txa3aa4de347164350ac1ab-0068c570b3" "proxy-server 1824535" 0.0027 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx23e595c7f1f54e0596a9d-0068c570b3" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 200 - - t - 5 - tx23e595c7f1f54e0596a9d-0068c570b3 - 0.0259 - - 1757769907.248685122 1757769907.274554729 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe9e61b29e86546d4bb691-0068c570b3" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/2/a/2_oc_ascii" 200 316 "GET http://localhost/v1/a/2_oc_ascii?format=json&states=listing" "txe9e61b29e86546d4bb691-0068c570b3" "proxy-server 1824535" 0.0075 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 316 - txe9e61b29e86546d4bb691-0068c570b3 - 0.0232 - - 1757769907.280394316 1757769907.303568840 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbd7720ca819546368bf4b-0068c570b3" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txbd7720ca819546368bf4b-0068c570b3 - 0.0081 VW - 1757769907.305481195 1757769907.313587666 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "txa280e6d1839b48ffbe5f0-0068c570b3" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - txa280e6d1839b48ffbe5f0-0068c570b3 - 0.0080 VW - 1757769907.314070463 1757769907.322109699 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/3/a/2_vc_non_ascii%C2%A3" 200 362 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?prefix=0092_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "tx370203b0d2af442983dc7-0068c570b3" "proxy-server 1824535" 0.0087 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fprefix%3D0092_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 362 - tx370203b0d2af442983dc7-0068c570b3 - 0.0120 VW - 1757769907.326798916 1757769907.338756800 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 200 5 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057?symlink=get" "tx9b9068cbb42d4826b511d-0068c570b3" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 200 5 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057?symlink=get" "tx9b9068cbb42d4826b511d-0068c570b3" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 GET /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769906.79057%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx9b9068cbb42d4826b511d-0068c570b3 - 0.0235 VW - 1757769907.339282990 1757769907.362766027 0 - (txn: txc9fe38d225ad4f1e94652-0068c570b3) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "txc9fe38d225ad4f1e94652-0068c570b3" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "txc9fe38d225ad4f1e94652-0068c570b3" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txc9fe38d225ad4f1e94652-0068c570b3" "proxy-server 1824535" 0.0205 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txc9fe38d225ad4f1e94652-0068c570b3" "proxy-server 1824535" 0.0199 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 txc9fe38d225ad4f1e94652-0068c570b3 - 0.0288 VW - 1757769907.349628448 1757769907.378469467 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 204 - "DELETE http://localhost/sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" "txcf6f86707cac49e1ac7ae-0068c570b3" "object-server 1824535" 0.0004 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe5c88c2c00364910aa453-0068c570b3" "proxy-server 1824502" 0.0067 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/ec_deleted" 201 - "PUT http://127.0.0.1:35165/sda1/1/a/ec_deleted" "txe5c88c2c00364910aa453-0068c570b3" "container-server 1824502" 0.0011 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/1/a/ec_deleted" 201 - "PUT http://127.0.0.1:37953/sdb1/1/a/ec_deleted" "txe5c88c2c00364910aa453-0068c570b3" "container-server 1824502" 0.0012 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/1/a/ec_deleted" 201 - "PUT http://localhost/v1/a/ec_deleted" "txe5c88c2c00364910aa453-0068c570b3" "proxy-server 1824502" 0.0323 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/ec_deleted" 201 - "PUT http://localhost/v1/a/ec_deleted" "txe5c88c2c00364910aa453-0068c570b3" "proxy-server 1824502" 0.0176 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 PUT /v1/a/ec_deleted HTTP/1.0 201 - - t - - - txe5c88c2c00364910aa453-0068c570b3 - 0.0535 - - 1757769907.160368681 1757769907.213851213 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txecfa73da56724fcb83e13-0068c570b3" "proxy-server 1824502" 0.0102 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/ec_deleted" 204 - "DELETE http://127.0.0.1:37953/sdb1/1/a/ec_deleted" "txecfa73da56724fcb83e13-0068c570b3" "container-server 1824502" 0.0011 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/1/a/ec_deleted" 204 - "DELETE http://127.0.0.1:35165/sda1/1/a/ec_deleted" "txecfa73da56724fcb83e13-0068c570b3" "container-server 1824502" 0.0100 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sdb1/1/a/ec_deleted" 204 - "DELETE http://localhost/v1/a/ec_deleted" "txecfa73da56724fcb83e13-0068c570b3" "proxy-server 1824502" 0.0211 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sda1/1/a/ec_deleted" 204 - "DELETE http://localhost/v1/a/ec_deleted" "txecfa73da56724fcb83e13-0068c570b3" "proxy-server 1824502" 0.0362 "-" 1824502 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 DELETE /v1/a/ec_deleted HTTP/1.0 204 - - - - - - txecfa73da56724fcb83e13-0068c570b3 - 0.0624 - - 1757769907.216719151 1757769907.279071331 - - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx81de8ef263c744c78e832-0068c570b3" "proxy-server 1824502" 0.0103 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a/ec_deleted" 404 - "HEAD http://localhost/v1/a/ec_deleted" "tx6ce903133d064a82ac98c-0068c570b3" "proxy-server 1824502" 0.0012 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a/ec_deleted" 404 - "HEAD http://localhost/v1/a/ec_deleted" "tx6ce903133d064a82ac98c-0068c570b3" "proxy-server 1824502" 0.0012 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdh1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "tx3615bd98e17348a7be3b4-0068c570b3" "proxy-server 1824502" 0.0002 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdg1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "tx3615bd98e17348a7be3b4-0068c570b3" "proxy-server 1824502" 0.0002 "-" 1824502 3 proxy DEBUG: Ignoring 404 from primary (txn: tx3615bd98e17348a7be3b4-0068c570b3) (client_ip: 127.0.0.1) proxy DEBUG: Ignoring 404 from primary (txn: tx3615bd98e17348a7be3b4-0068c570b3) (client_ip: 127.0.0.1) obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdi1/3/a/ec_deleted/no-object-there" 404 70 "GET http://localhost/v1/a/ec_deleted/no-object-there" "tx3615bd98e17348a7be3b4-0068c570b3" "proxy-server 1824502" 0.0002 "-" 1824502 3 proxy DEBUG: Ignoring 404 from primary (txn: tx3615bd98e17348a7be3b4-0068c570b3) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/ec_deleted/no-object-there HTTP/1.0 404 - - t - 70 - tx3615bd98e17348a7be3b4-0068c570b3 - 0.0620 - - 1757769907.280546904 1757769907.342509985 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txed311a5d6ce54b99a7d5c-0068c570b3" "proxy-server 1824502" 0.0095 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/ec" "txed311a5d6ce54b99a7d5c-0068c570b3" "container-server 1824502" 0.0010 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txed311a5d6ce54b99a7d5c-0068c570b3" "proxy-server 1824502" 0.0265 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/ec" "txed311a5d6ce54b99a7d5c-0068c570b3" "container-server 1824502" 0.0019 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txed311a5d6ce54b99a7d5c-0068c570b3" "proxy-server 1824502" 0.0402 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - txed311a5d6ce54b99a7d5c-0068c570b3 - 0.0642 - - 1757769907.352589369 1757769907.416806698 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx66fb38a1a14045508974b-0068c570b3" "proxy-server 1824502" 0.0020 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx2b3b12fda50f4e9eaf38f-0068c570b3" "proxy-server 1824502" 0.0094 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdg1/1/a/ec/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec/crash-test-dummy" "txd5b517e55e164dc5bec4e-0068c570b3" "proxy-server 1824502" 0.0058 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/ec/crash-test-dummy" 201 - "PUT http://localhost/sdi1/1/a/ec/crash-test-dummy" "txd5b517e55e164dc5bec4e-0068c570b3" "object-server 1824502" 0.0004 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/ec/crash-test-dummy" 201 - "PUT http://localhost/sdh1/1/a/ec/crash-test-dummy" "txd5b517e55e164dc5bec4e-0068c570b3" "object-server 1824502" 0.0005 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdi1/1/a/ec/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec/crash-test-dummy" "txd5b517e55e164dc5bec4e-0068c570b3" "proxy-server 1824502" 0.0124 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdh1/1/a/ec/crash-test-dummy" 201 - "PUT http://localhost/v1/a/ec/crash-test-dummy" "txd5b517e55e164dc5bec4e-0068c570b3" "proxy-server 1824502" 0.0123 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 PUT /v1/a/ec/crash-test-dummy HTTP/1.0 201 - - t 21000 - - txd5b517e55e164dc5bec4e-0068c570b3 - 0.0607 - - 1757769907.418297291 1757769907.479032278 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1af9aa9d3422478b87d54-0068c570b3" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx36abd0e1f51044acb9d5b-0068c570b3" "proxy-server 1824502" 0.0059 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdi1/1/a/ec/crash-test-dummy" 200 10980 "GET http://localhost/v1/a/ec/crash-test-dummy" "txb98b8c912db04212b9c7f-0068c570b3" "proxy-server 1824502" 0.0004 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdg1/1/a/ec/crash-test-dummy" 200 10980 "GET http://localhost/v1/a/ec/crash-test-dummy" "txb98b8c912db04212b9c7f-0068c570b3" "proxy-server 1824502" 0.0003 "-" 1824502 3 proxy ERROR: Exception fetching fragments for '/a/ec/crash-test-dummy': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1485, in put_fragments_in_queue for fragment in frag_iter: ^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 8297, in explodey_iter raise Exception("doom ba doom") Exception: doom ba doom (txn: txb98b8c912db04212b9c7f-0068c570b3) (client_ip: 127.0.0.1)test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec_failure_handling test.unit.proxy.test_mem_server.TestECObjectController.test_GET_ec_failure_handling ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 204 - "DELETE http://localhost/sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" "txcf6f86707cac49e1ac7ae-0068c570b3" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 204 - "DELETE http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" "txcf6f86707cac49e1ac7ae-0068c570b3" "proxy-server 1824535" 0.0109 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" 204 - "DELETE http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.79057" "txcf6f86707cac49e1ac7ae-0068c570b3" "proxy-server 1824535" 0.0059 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 DELETE /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769906.79057 HTTP/1.0 204 - Swift - - - - txcf6f86707cac49e1ac7ae-0068c570b3 - 0.0149 VW - 1757769907.383200884 1757769907.398060083 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4a39534ceab34080aabff-0068c570b3" "proxy-server 1824535" 0.0012 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx49c166d4efae4b768d8f9-0068c570b3" "proxy-server 1824535" 0.0108 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txda6056fd01934a7c83725-0068c570b3" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 200 - - t - 5 - txda6056fd01934a7c83725-0068c570b3 - 0.0344 - - 1757769907.411777973 1757769907.446193457 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb9d11dbf51844300887e9-0068c570b3" "proxy-server 1824535" 0.0019 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/3/a/2_vc_non_ascii%C2%A3" 200 181 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?prefix=0092_o_ascii%2F&format=json&states=listing" "txb9d11dbf51844300887e9-0068c570b3" "proxy-server 1824535" 0.0062 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fprefix%3D0092_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 181 - txb9d11dbf51844300887e9-0068c570b3 - 0.0173 - - 1757769907.452451944 1757769907.469797850 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx82e6914903b14ddf96480-0068c570b3" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx82e6914903b14ddf96480-0068c570b3 - 0.0040 VW - 1757769907.471901894 1757769907.475872040 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx497e30bb4dce4e6d96e50-0068c570b3" "proxy-server 1824535" 0.0014 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx497e30bb4dce4e6d96e50-0068c570b3 - 0.0040 VW - 1757769907.476351023 1757769907.480345964 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/3/a/2_vc_non_ascii%C2%A3" 200 181 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?prefix=0092_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "tx9dbbc2a9dc254543a9947-0068c570b3" "proxy-server 1824535" 0.0034 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fprefix%3D0092_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 181 - tx9dbbc2a9dc254543a9947-0068c570b3 - 0.0066 VW - 1757769907.480964661 1757769907.487556458 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 200 5 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142?symlink=get" "tx540b6004fd00423d9e1af-0068c570b3" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 200 5 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142?symlink=get" "tx540b6004fd00423d9e1af-0068c570b3" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 GET /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769906.67142%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx540b6004fd00423d9e1af-0068c570b3 - 0.0214 VW - 1757769907.488092899 1757769907.509484291 0 - (txn: tx1c4898a809654deb862da-0068c570b3) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "tx1c4898a809654deb862da-0068c570b3" "object-server 1824535" 0.0014 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx1c4898a809654deb862da-0068c570b3" "proxy-server 1824535" 0.0100 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "tx1c4898a809654deb862da-0068c570b3" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx1c4898a809654deb862da-0068c570b3" "proxy-server 1824535" 0.0250 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx1c4898a809654deb862da-0068c570b3 - 0.0397 VW - 1757769907.494409561 1757769907.534146547 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 204 - "DELETE http://localhost/sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" "tx3fa374247c4442949b1b2-0068c570b3" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 204 - "DELETE http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" "tx3fa374247c4442949b1b2-0068c570b3" "proxy-server 1824535" 0.0043 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 204 - "DELETE http://localhost/sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" "tx3fa374247c4442949b1b2-0068c570b3" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" 204 - "DELETE http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769906.67142" "tx3fa374247c4442949b1b2-0068c570b3" "proxy-server 1824535" 0.0177 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 DELETE /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769906.67142 HTTP/1.0 204 - Swift - - - - tx3fa374247c4442949b1b2-0068c570b3 - 0.0235 VW - 1757769907.534620762 1757769907.558125257 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0cc842e37acc41bab75e3-0068c570b3" "proxy-server 1824535" 0.0012 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx0390ca63f2bb416083d41-0068c570b3" "proxy-server 1824535" 0.0158 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txfa247151ee3a438c8c6ec-0068c570b3" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 200 - - t - 5 - txfa247151ee3a438c8c6ec-0068c570b3 - 0.0344 - - 1757769907.567854881 1757769907.602268219 0 -test.unit.proxy.test_mem_server.TestECObjectController.test_GET_pipeline test.unit.proxy.test_mem_server.TestECObjectController.test_GET_pipeline ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx47588d0a6f674b47817c2-0068c570b3" "proxy-server 1824535" 0.0095 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/3/a/2_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?prefix=0092_o_ascii%2F&format=json&states=listing" "tx47588d0a6f674b47817c2-0068c570b3" "proxy-server 1824535" 0.0117 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fprefix%3D0092_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx47588d0a6f674b47817c2-0068c570b3 - 0.0273 - - 1757769907.620236397 1757769907.647511244 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfa54e3c5d05541469cab1-0068c570b3" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/3/a/2_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?prefix=0092_o_ascii%2F&format=json&states=listing" "txfa54e3c5d05541469cab1-0068c570b3" "proxy-server 1824535" 0.0022 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fprefix%3D0092_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - txfa54e3c5d05541469cab1-0068c570b3 - 0.0460 - - 1757769907.649322987 1757769907.695369720 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa4d90e62dbe241e181261-0068c570b3" "proxy-server 1824535" 0.0094 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa4d90e62dbe241e181261-0068c570b3 - 0.0121 VW - 1757769907.697280884 1757769907.709362745 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx0b9e041f620e4384a58c0-0068c570b3" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx0b9e041f620e4384a58c0-0068c570b3 - 0.0121 VW - 1757769907.709857941 1757769907.721941948 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/3/a/2_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?prefix=0092_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "tx025b9e42a1aa42bc9ab42-0068c570b3" "proxy-server 1824535" 0.0106 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fprefix%3D0092_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 2 - tx025b9e42a1aa42bc9ab42-0068c570b3 - 0.0382 VW - 1757769907.722497702 1757769907.760743856 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sdb1/2/a/2_oc_ascii/2_o_ascii" 204 - "DELETE http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "tx2bc09187ecd74cc8af6a6-0068c570b3" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sda1/2/a/2_oc_ascii/2_o_ascii" 204 - "DELETE http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "tx2bc09187ecd74cc8af6a6-0068c570b3" "object-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sda1/1/a/2_oc_ascii/2_o_ascii" 204 - "DELETE http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx2bc09187ecd74cc8af6a6-0068c570b3" "proxy-server 1824535" 0.0075 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "DELETE /sdb1/1/a/2_oc_ascii/2_o_ascii" 204 - "DELETE http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx2bc09187ecd74cc8af6a6-0068c570b3" "proxy-server 1824535" 0.0237 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 DELETE /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 204 - - t - - - tx2bc09187ecd74cc8af6a6-0068c570b3 - 0.0354 - - 1757769907.761190176 1757769907.796611309 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4efd61e8d59c4e04a0b2e-0068c570b3" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx8c3e7511f785439cb4fc3-0068c570b3" "proxy-server 1824535" 0.0070 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 404 70 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txf2202b59811940bab7fac-0068c570b3" "proxy-server 1824535" 0.0046 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 404 70 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txf2202b59811940bab7fac-0068c570b3" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 404 - - t - 70 - txf2202b59811940bab7fac-0068c570b3 - 0.0448 - - 1757769907.798073053 1757769907.842833042 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx691d9ad65adb4589b2aeb-0068c570b3" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx691d9ad65adb4589b2aeb-0068c570b3 - 0.0124 VW - 1757769907.854906321 1757769907.867348194 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx393c0f15a9cd4535bc1f5-0068c570b3" "proxy-server 1824535" 0.0069 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx393c0f15a9cd4535bc1f5-0068c570b3 - 0.0098 VW - 1757769907.867936611 1757769907.877776146 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 404 70 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx143ef63b39ee40afa22ad-0068c570b3" "proxy-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 404 70 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx143ef63b39ee40afa22ad-0068c570b3" "proxy-server 1824535" 0.0005 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/2_o_ascii%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx143ef63b39ee40afa22ad-0068c570b3 - 0.0142 VW - 1757769907.878374577 1757769907.892593384 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "tx2d55297a249b466dbb229-0068c570b3" "object-server 1824535" 0.0032 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx2d55297a249b466dbb229-0068c570b3" "proxy-server 1824535" 0.0088 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "tx2d55297a249b466dbb229-0068c570b3" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx2d55297a249b466dbb229-0068c570b3" "proxy-server 1824535" 0.0241 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - - t - - - tx2d55297a249b466dbb229-0068c570b3 - 0.0318 - - 1757769907.893015146 1757769907.924814939 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx918a33e55fef4f5594376-0068c570b3" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx918a33e55fef4f5594376-0068c570b3 - 0.0083 VW - 1757769907.939746141 1757769907.948058844 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sdb1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx78d2efd2cc4e4eb588849-0068c570b3" "proxy-server 1824535" 0.0071 "-" 1824535 0 proxy ERROR: Exception fetching fragments for '/a/ec/crash-test-dummy': Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1485, in put_fragments_in_queue for fragment in frag_iter: ^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/test/unit/proxy/test_server.py", line 8297, in explodey_iter raise Exception("doom ba doom") Exception: doom ba doom (txn: txb98b8c912db04212b9c7f-0068c570b3) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/07 GET /v1/a/ec/crash-test-dummy HTTP/1.0 500 - - t - 4096 - txb98b8c912db04212b9c7f-0068c570b3 - 0.0396 - - 1757769907.480519056 1757769907.520155191 3 - proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: (1824502) wsgi starting up on http://127.0.0.1:37067 proxy DEBUG: (1824502) accepted ('127.0.0.1', 37522) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3731c2357edd427499ab7-0068c570b3" "proxy-server 1824502" 0.0103 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/ec" "tx3731c2357edd427499ab7-0068c570b3" "container-server 1824502" 0.0010 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx3731c2357edd427499ab7-0068c570b3" "proxy-server 1824502" 0.0188 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/ec" "tx3731c2357edd427499ab7-0068c570b3" "container-server 1824502" 0.0010 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx3731c2357edd427499ab7-0068c570b3" "proxy-server 1824502" 0.0210 "-" 1824502 3 proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:25:07] "PUT /v1/a/ec HTTP/1.1" 202 252 0.051845 (txn: tx3731c2357edd427499ab7-0068c570b3) proxy DEBUG: (1824502) accepted ('127.0.0.1', 37526) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8abf648fffb847908d11d-0068c570b3" "proxy-server 1824502" 0.0063 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txbb6127c6178449bf8eb0e-0068c570b3" "proxy-server 1824502" 0.0013 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdg1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "txf1398c4c174f4aeeb4a51-0068c570b3" "proxy-server 1824502" 0.0217 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sda1/2/a/ec/go-get-it" 201 - "PUT http://localhost/sdi1/3/a/ec/go-get-it" "txf1398c4c174f4aeeb4a51-0068c570b3" "object-server 1824502" 0.0046 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdb1/2/a/ec/go-get-it" 201 - "PUT http://localhost/sdh1/3/a/ec/go-get-it" "txf1398c4c174f4aeeb4a51-0068c570b3" "object-server 1824502" 0.0004 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdi1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "txf1398c4c174f4aeeb4a51-0068c570b3" "proxy-server 1824502" 0.0302 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "PUT /sdh1/3/a/ec/go-get-it" 201 - "PUT http://localhost/v1/a/ec/go-get-it" "txf1398c4c174f4aeeb4a51-0068c570b3" "proxy-server 1824502" 0.0302 "-" 1824502 3 proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:25:07] "PUT /v1/a/ec/go-get-it HTTP/1.1" 201 206 0.058951 (txn: txf1398c4c174f4aeeb4a51-0068c570b3) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf3d605a9559e4e979b11e-0068c570b3" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txaf804371de6e4753a7194-0068c570b3" "proxy-server 1824502" 0.0069 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdg1/3/a/ec/go-get-it" 200 736 "GET http://localhost/v1/a/ec/go-get-it" "tx1ab3825e54c946aa8c951-0068c570b3" "proxy-server 1824502" 0.0004 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdh1/3/a/ec/go-get-it" 200 736 "GET http://localhost/v1/a/ec/go-get-it" "tx1ab3825e54c946aa8c951-0068c570b3" "proxy-server 1824502" 0.0003 "-" 1824502 3 proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:25:07] "GET /v1/a/ec/go-get-it HTTP/1.1" 200 1729 0.032087 (txn: tx1ab3825e54c946aa8c951-0068c570b3) proxy DEBUG: (1824502) timed out ('127.0.0.1', 37526) (txn: tx1ab3825e54c946aa8c951-0068c570b3) proxy INFO: (1824502) wsgi exited, is_accepting=True acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe3a78f41cc7147ab80124-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/ec" "txe3a78f41cc7147ab80124-0068c570b4" "container-server 1824502" 0.0010 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txe3a78f41cc7147ab80124-0068c570b4" "proxy-server 1824502" 0.0143 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/ec" "txe3a78f41cc7147ab80124-0068c570b4" "container-server 1824502" 0.0060 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "txe3a78f41cc7147ab80124-0068c570b4" "proxy-server 1824502" 0.0276 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - txe3a78f41cc7147ab80124-0068c570b4 - 0.0527 - - 1757769908.000847340 1757769908.053561449 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4a7523dd09f845bc871cb-0068c570b4" "proxy-server 1824502" 0.0071 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx3c5c85f655bf48c7bfe57-0068c570b4" "proxy-server 1824502" 0.0054 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdi1/3/a/ec/go-head-it" 201 - "PUT http://localhost/v1/a/ec/go-head-it" "tx4b7472e02370480a8a42e-0068c570b4" "proxy-server 1824502" 0.0133 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/ec/go-head-it" 201 - "PUT http://localhost/sdh1/3/a/ec/go-head-it" "tx4b7472e02370480a8a42e-0068c570b4" "object-server 1824502" 0.0004 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/ec/go-head-it" 201 - "PUT http://localhost/sdg1/3/a/ec/go-head-it" "tx4b7472e02370480a8a42e-0068c570b4" "object-server 1824502" 0.0004 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdg1/3/a/ec/go-head-it" 201 - "PUT http://localhost/v1/a/ec/go-head-it" "tx4b7472e02370480a8a42e-0068c570b4" "proxy-server 1824502" 0.0233 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdh1/3/a/ec/go-head-it" 201 - "PUT http://localhost/v1/a/ec/go-head-it" "tx4b7472e02370480a8a42e-0068c570b4" "proxy-server 1824502" 0.0233 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec/go-head-it HTTP/1.0 201 - - t 1309 - - tx4b7472e02370480a8a42e-0068c570b4 - 0.0503 - - 1757769908.059153557 1757769908.109496593 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe8e081d24a77407baa844-0068c570b4" "proxy-server 1824502" 0.0020 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx20607f82ec2c438d90193-0068c570b4" "proxy-server 1824502" 0.0067 "-" 1824502 3test.unit.proxy.test_mem_server.TestECObjectController.test_HEAD_ec test.unit.proxy.test_mem_server.TestECObjectController.test_HEAD_ec ... ok test.unit.proxy.test_mem_server.TestECObjectController.test_HEAD_ec_404 test.unit.proxy.test_mem_server.TestECObjectController.test_HEAD_ec_404 ... ok test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec ... ok test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_fragment_archive_etag_mismatch test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_fragment_archive_etag_mismatch ... ok proxy INFO: - - 13/Sep/2025/13/25/07 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx78d2efd2cc4e4eb588849-0068c570b3 - 0.0152 VW - 1757769907.948583364 1757769907.963746309 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 - "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx174e9471d0634794a1675-0068c570b3" "proxy-server 1824535" 0.0128 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:07 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 200 - "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx174e9471d0634794a1675-0068c570b3" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/07 GET /v1/a/2_oc_ascii/2_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx174e9471d0634794a1675-0068c570b3 - 0.0269 VW - 1757769907.964375734 1757769907.991241693 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/3/a/2_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/2_vc_non_ascii%C2%A3" "tx9b91b38b95c34ea79876e-0068c570b3" "proxy-server 1824535" 0.0149 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769907.89352" 201 - "PUT http://localhost/sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769907.89352" "tx5b5e3f62fb754aa19a831-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769907.89352" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769907.89352" "tx5b5e3f62fb754aa19a831-0068c570b4" "proxy-server 1824535" 0.0169 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769907.89352" 201 - "PUT http://localhost/sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769907.89352" "tx5b5e3f62fb754aa19a831-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769907.89352" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769907.89352" "tx5b5e3f62fb754aa19a831-0068c570b4" "proxy-server 1824535" 0.0301 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 PUT /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769907.89352 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx5b5e3f62fb754aa19a831-0068c570b4 - 0.0600 VW - 1757769907.991902828 1757769908.051912308 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "tx568503e7dc4041329b632-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "tx568503e7dc4041329b632-0068c570b4" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx568503e7dc4041329b632-0068c570b4" "proxy-server 1824535" 0.0191 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx568503e7dc4041329b632-0068c570b4" "proxy-server 1824535" 0.0209 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - - t - - - tx568503e7dc4041329b632-0068c570b4 - 0.0290 - - 1757769908.052398920 1757769908.081354141 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfb6233ebe6734fdfb845b-0068c570b4" "proxy-server 1824535" 0.0056 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txfb6233ebe6734fdfb845b-0068c570b4 - 0.0086 VW - 1757769908.095685482 1757769908.104267836 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx4f2b89d8c7324718a505c-0068c570b4" "proxy-server 1824535" 0.0030 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx4f2b89d8c7324718a505c-0068c570b4 - 0.0110 VW - 1757769908.104848623 1757769908.115844965 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 200 - "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx8b903a1b51ce40169b7c6-0068c570b4" "proxy-server 1824535" 0.0087 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 - "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx8b903a1b51ce40169b7c6-0068c570b4" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 GET /v1/a/2_oc_ascii/2_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx8b903a1b51ce40169b7c6-0068c570b4 - 0.0188 VW - 1757769908.116429806 1757769908.135262966 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/3/a/2_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/2_vc_non_ascii%C2%A3" "txe6073184d5ec4995962c5-0068c570b4" "proxy-server 1824535" 0.0107 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.05295" 201 - "PUT http://localhost/sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.05295" "tx303ccc5666e34e74b0f3d-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.05295" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.05295" "tx303ccc5666e34e74b0f3d-0068c570b4" "proxy-server 1824535" 0.0100 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.05295" 201 - "PUT http://localhost/sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.05295" "tx303ccc5666e34e74b0f3d-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.05295" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.05295" "tx303ccc5666e34e74b0f3d-0068c570b4" "proxy-server 1824535" 0.0172 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 PUT /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769908.05295 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx303ccc5666e34e74b0f3d-0068c570b4 - 0.0439 VW - 1757769908.135914087 1757769908.179857254 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "txa382248bc7224e0c9009e-0068c570b4" "object-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "txa382248bc7224e0c9009e-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txa382248bc7224e0c9009e-0068c570b4" "proxy-server 1824535" 0.0171 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txa382248bc7224e0c9009e-0068c570b4" "proxy-server 1824535" 0.0159 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - - t - - - txa382248bc7224e0c9009e-0068c570b4 - 0.0296 - - 1757769908.180343866 1757769908.209931374 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb0f88c67888949c78a62b-0068c570b4" "proxy-server 1824535" 0.0095 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdb1/3/a/2_vc_non_ascii%C2%A3" 200 362 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?prefix=0092_o_ascii%2F&format=json&states=listing" "txb0f88c67888949c78a62b-0068c570b4" "proxy-server 1824535" 0.0076 "-" 1824535 0test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_fragment_quorum_archive_etag_mismatch test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_fragment_quorum_archive_etag_mismatch ... ok test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_fragment_quorum_bad_request test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_fragment_quorum_bad_request ... ok obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdi1/3/a/ec/go-head-it" 200 736 "HEAD http://localhost/v1/a/ec/go-head-it" "txc59279d7aaa345cdafa02-0068c570b4" "proxy-server 1824502" 0.0003 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 HEAD /v1/a/ec/go-head-it HTTP/1.0 200 - - t - - - txc59279d7aaa345cdafa02-0068c570b4 - 0.0256 - - 1757769908.115009308 1757769908.140602112 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx423fc018585441249c7d1-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/ec" "tx423fc018585441249c7d1-0068c570b4" "container-server 1824502" 0.0011 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx423fc018585441249c7d1-0068c570b4" "proxy-server 1824502" 0.0151 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/ec" "tx423fc018585441249c7d1-0068c570b4" "container-server 1824502" 0.0009 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx423fc018585441249c7d1-0068c570b4" "proxy-server 1824502" 0.0140 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx423fc018585441249c7d1-0068c570b4 - 0.0759 - - 1757769908.142418623 1757769908.218365908 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8a716039ec78423795484-0068c570b4" "proxy-server 1824502" 0.0062 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx45ffadfd75734c599432b-0068c570b4" "proxy-server 1824502" 0.0054 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdg1/2/a/ec/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec/yes-we-have-no-bananas" "tx8dd2468b945f47b380884-0068c570b4" "proxy-server 1824502" 0.0002 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdh1/2/a/ec/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec/yes-we-have-no-bananas" "tx8dd2468b945f47b380884-0068c570b4" "proxy-server 1824502" 0.0002 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdi1/2/a/ec/yes-we-have-no-bananas" 404 - "HEAD http://localhost/v1/a/ec/yes-we-have-no-bananas" "tx8dd2468b945f47b380884-0068c570b4" "proxy-server 1824502" 0.0002 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 HEAD /v1/a/ec/yes-we-have-no-bananas HTTP/1.0 404 - - t - - - tx8dd2468b945f47b380884-0068c570b4 - 0.0328 - - 1757769908.224003792 1757769908.256783962 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7054d47cb8f04bb59c1ea-0068c570b4" "proxy-server 1824502" 0.0041 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/ec-con" 201 - "PUT http://127.0.0.1:35165/sda1/0/a/ec-con" "tx7054d47cb8f04bb59c1ea-0068c570b4" "container-server 1824502" 0.0010 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/ec-con" 201 - "PUT http://127.0.0.1:37953/sdb1/0/a/ec-con" "tx7054d47cb8f04bb59c1ea-0068c570b4" "container-server 1824502" 0.0059 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/0/a/ec-con" 201 - "PUT http://localhost/v1/a/ec-con" "tx7054d47cb8f04bb59c1ea-0068c570b4" "proxy-server 1824502" 0.0170 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/0/a/ec-con" 201 - "PUT http://localhost/v1/a/ec-con" "tx7054d47cb8f04bb59c1ea-0068c570b4" "proxy-server 1824502" 0.0320 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec-con HTTP/1.0 201 - - t - - - tx7054d47cb8f04bb59c1ea-0068c570b4 - 0.0420 - - 1757769908.263822556 1757769908.305871725 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx69b3bd942e8c4b5a9d6c7-0068c570b4" "proxy-server 1824502" 0.0061 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "tx98211853530e41fd97dea-0068c570b4" "proxy-server 1824502" 0.0054 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdg1/2/a/ec-con/quorum" 422 93 "PUT http://localhost/v1/a/ec-con/quorum" "tx7ea91ee5891b4044aa1d2-0068c570b4" "proxy-server 1824502" 0.0077 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdh1/2/a/ec-con/quorum" 422 93 "PUT http://localhost/v1/a/ec-con/quorum" "tx7ea91ee5891b4044aa1d2-0068c570b4" "proxy-server 1824502" 0.0081 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdi1/2/a/ec-con/quorum" 422 93 "PUT http://localhost/v1/a/ec-con/quorum" "tx7ea91ee5891b4044aa1d2-0068c570b4" "proxy-server 1824502" 0.0085 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec-con/quorum HTTP/1.0 503 - - t 37 118 fc0b2c2af9909d00a8d840b38247222f tx7ea91ee5891b4044aa1d2-0068c570b4 - 0.0403 - - 1757769908.311705112 1757769908.351990223 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx02b5cc81c4b64ab9984a2-0068c570b4" "proxy-server 1824502" 0.0054 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/ec-con" 201 - "PUT http://127.0.0.1:37953/sdb1/0/a/ec-con" "tx02b5cc81c4b64ab9984a2-0068c570b4" "container-server 1824502" 0.0010 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/ec-con" 201 - "PUT http://127.0.0.1:35165/sda1/0/a/ec-con" "tx02b5cc81c4b64ab9984a2-0068c570b4" "container-server 1824502" 0.0098 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/0/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "tx02b5cc81c4b64ab9984a2-0068c570b4" "proxy-server 1824502" 0.0217 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/0/a/ec-con" 202 - "PUT http://localhost/v1/a/ec-con" "tx02b5cc81c4b64ab9984a2-0068c570b4" "proxy-server 1824502" 0.0199 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec-con HTTP/1.0 202 - - t - 76 - tx02b5cc81c4b64ab9984a2-0068c570b4 - 0.0426 - - 1757769908.368843794 1757769908.411487818 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1914752cb2144095901b8-0068c570b4" "proxy-server 1824502" 0.0020 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/0/a/ec-con" 204 - "HEAD http://localhost/v1/a/ec-con" "txa0a4eb3ddefd482ab416c-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdi1/2/a/ec-con/quorum" 400 29 "PUT http://localhost/v1/a/ec-con/quorum" "tx77d8b004209e45268e073-0068c570b4" "proxy-server 1824502" 0.0076 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdh1/2/a/ec-con/quorum" 400 29 "PUT http://localhost/v1/a/ec-con/quorum" "tx77d8b004209e45268e073-0068c570b4" "proxy-server 1824502" 0.0031 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdg1/2/a/ec-con/quorum" 400 29 "PUT http://localhost/v1/a/ec-con/quorum" "tx77d8b004209e45268e073-0068c570b4" "proxy-server 1824502" 0.0128 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec-con/quorum HTTP/1.0 503 - - t 37 118 fc0b2c2af9909d00a8d840b38247222f tx77d8b004209e45268e073-0068c570b4 - 0.0397 - - 1757769908.413518906 1757769908.453198433 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx700abf2682ae44f2a8d83-0068c570b4" "proxy-server 1824502" 0.0062 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/ec" "tx700abf2682ae44f2a8d83-0068c570b4" "container-server 1824502" 0.0010 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fprefix%3D0092_o_ascii%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 362 - txb0f88c67888949c78a62b-0068c570b4 - 0.0284 - - 1757769908.215618372 1757769908.244063854 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa980b6d6fa19444c929ce-0068c570b4" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txa980b6d6fa19444c929ce-0068c570b4 - 0.0153 VW - 1757769908.246082306 1757769908.261337996 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "txe7e26e1d2bfc4ac2a8e40-0068c570b4" "proxy-server 1824535" 0.0121 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - txe7e26e1d2bfc4ac2a8e40-0068c570b4 - 0.0270 VW - 1757769908.261852503 1757769908.288854122 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 - "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "txdbcc27566eca4e1ca6aea-0068c570b4" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 200 - "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "txdbcc27566eca4e1ca6aea-0068c570b4" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 GET /v1/a/2_oc_ascii/2_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txdbcc27566eca4e1ca6aea-0068c570b4 - 0.0248 VW - 1757769908.289428473 1757769908.314255953 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/3/a/2_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/2_vc_non_ascii%C2%A3" "txb8a63f4784644632b757f-0068c570b4" "proxy-server 1824535" 0.0076 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.18088" 201 - "PUT http://localhost/sdb1/1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.18088" "txd6885743c4164d4c96ba5-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.18088" 201 - "PUT http://localhost/sda1/1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.18088" "txd6885743c4164d4c96ba5-0068c570b4" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.18088" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.18088" "txd6885743c4164d4c96ba5-0068c570b4" "proxy-server 1824535" 0.0152 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.18088" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.18088" "txd6885743c4164d4c96ba5-0068c570b4" "proxy-server 1824535" 0.0167 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 PUT /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769908.18088 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txd6885743c4164d4c96ba5-0068c570b4 - 0.0354 VW - 1757769908.319067240 1757769908.354465246 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "txcd9bbeae79594973a07eb-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "txcd9bbeae79594973a07eb-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txcd9bbeae79594973a07eb-0068c570b4" "proxy-server 1824535" 0.0227 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "txcd9bbeae79594973a07eb-0068c570b4" "proxy-server 1824535" 0.0175 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - - t 5 - - txcd9bbeae79594973a07eb-0068c570b4 - 0.0272 - - 1757769908.363129854 1757769908.390285015 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcfd9ca2092f94469aeef4-0068c570b4" "proxy-server 1824535" 0.0056 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txcfd9ca2092f94469aeef4-0068c570b4 - 0.0084 VW - 1757769908.396104336 1757769908.404492378 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx55db6c82d4e64024b597b-0068c570b4" "proxy-server 1824535" 0.0131 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx55db6c82d4e64024b597b-0068c570b4 - 0.0158 VW - 1757769908.405042648 1757769908.420887709 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdb1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx92d2dd16d4cb43a7820ed-0068c570b4" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sda1/1/a/2_oc_ascii/2_o_ascii" 200 5 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii?symlink=get" "tx92d2dd16d4cb43a7820ed-0068c570b4" "proxy-server 1824535" 0.0006 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/3/a/2_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/2_vc_non_ascii%C2%A3" "txf84934f8e5024fe5a89f0-0068c570b4" "proxy-server 1824535" 0.0106 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 GET /v1/a/2_oc_ascii/2_o_ascii%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx92d2dd16d4cb43a7820ed-0068c570b4 - 0.0412 VW - 1757769908.421461582 1757769908.462687731 0 - (txn: tx3d471c5ace1241c982596-0068c570b4) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 201 - "PUT http://localhost/sda1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" "tx3d471c5ace1241c982596-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" "tx3d471c5ace1241c982596-0068c570b4" "proxy-server 1824535" 0.0207 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 201 - "PUT http://localhost/sdb1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" "tx3d471c5ace1241c982596-0068c570b4" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" "tx3d471c5ace1241c982596-0068c570b4" "proxy-server 1824535" 0.0249 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 PUT /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769908.36367 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx3d471c5ace1241c982596-0068c570b4 - 0.0421 VW - 1757769908.436413288 1757769908.478559732 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "tx47e2c17069a34742a1710-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx47e2c17069a34742a1710-0068c570b4" "proxy-server 1824535" 0.0185 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "tx47e2c17069a34742a1710-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_if_none_match test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_if_none_match ... ok test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_multiple_segments test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_multiple_segments ... ok test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_object_etag_mismatch test.unit.proxy.test_mem_server.TestECObjectController.test_PUT_ec_object_etag_mismatch ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx47e2c17069a34742a1710-0068c570b4" "proxy-server 1824535" 0.0186 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - - t 5 - - tx47e2c17069a34742a1710-0068c570b4 - 0.0312 - - 1757769908.483158827 1757769908.514376640 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8d24ae9a4509434da991b-0068c570b4" "proxy-server 1824535" 0.0094 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx8d24ae9a4509434da991b-0068c570b4 - 0.0121 VW - 1757769908.515966415 1757769908.528092384 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "tx8fbe8d4222bd4745a7da9-0068c570b4" "proxy-server 1824535" 0.0068 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - tx8fbe8d4222bd4745a7da9-0068c570b4 - 0.0095 VW - 1757769908.528605223 1757769908.538091421 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdb1/0/a/2_oc_ascii/2_o_ascii/sub" 404 70 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii/sub?symlink=get" "tx1dbbd3904eb4408ba4075-0068c570b4" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sda1/0/a/2_oc_ascii/2_o_ascii/sub" 404 70 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii/sub?symlink=get" "tx1dbbd3904eb4408ba4075-0068c570b4" "proxy-server 1824535" 0.0044 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 GET /v1/a/2_oc_ascii/2_o_ascii/sub%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx1dbbd3904eb4408ba4075-0068c570b4 - 0.0096 VW - 1757769908.542754650 1757769908.552306175 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii/sub" 201 - "PUT http://localhost/sda1/0/a/2_oc_ascii/2_o_ascii/sub" "tx7e5eca9bcc924d51bad81-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii/sub" 201 - "PUT http://localhost/sdb1/0/a/2_oc_ascii/2_o_ascii/sub" "tx7e5eca9bcc924d51bad81-0068c570b4" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/0/a/2_oc_ascii/2_o_ascii/sub" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii/sub" "tx7e5eca9bcc924d51bad81-0068c570b4" "proxy-server 1824535" 0.0213 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/0/a/2_oc_ascii/2_o_ascii/sub" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii/sub" "tx7e5eca9bcc924d51bad81-0068c570b4" "proxy-server 1824535" 0.0170 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/2_oc_ascii/2_o_ascii/sub HTTP/1.0 201 - - t 4 - - tx7e5eca9bcc924d51bad81-0068c570b4 - 0.0366 - - 1757769908.552754164 1757769908.589306831 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf8b842a0988d4de6aaaae-0068c570b4" "proxy-server 1824535" 0.0015 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txf8b842a0988d4de6aaaae-0068c570b4 - 0.0090 VW - 1757769908.595004559 1757769908.604047060 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "txc21377055fad404dbcca5-0068c570b4" "proxy-server 1824535" 0.0104 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - txc21377055fad404dbcca5-0068c570b4 - 0.0132 VW - 1757769908.604607344 1757769908.617811918 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdb1/0/a/2_oc_ascii/2_o_ascii/sub" 200 4 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii/sub?symlink=get" "txa3f57a61957c4180a7b1c-0068c570b4" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sda1/0/a/2_oc_ascii/2_o_ascii/sub" 200 4 "GET http://localhost/v1/a/2_oc_ascii/2_o_ascii/sub?symlink=get" "txa3f57a61957c4180a7b1c-0068c570b4" "proxy-server 1824535" 0.0007 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/3/a/2_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/2_vc_non_ascii%C2%A3" "txf44955c2d1da47af8d12b-0068c570b4" "proxy-server 1824535" 0.0079 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 GET /v1/a/2_oc_ascii/2_o_ascii/sub%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 4 - txa3f57a61957c4180a7b1c-0068c570b4 - 0.0398 VW - 1757769908.618396044 1757769908.658185005 0 - (txn: txb2be99fbbb314629a4a82-0068c570b4) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/3/a/2_vc_non_ascii%C2%A3/00d2_o_ascii/sub/1757769908.56402" 201 - "PUT http://localhost/sdb1/0/a/2_vc_non_ascii%C2%A3/00d2_o_ascii/sub/1757769908.56402" "txb2be99fbbb314629a4a82-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/0/a/2_vc_non_ascii%C2%A3/00d2_o_ascii/sub/1757769908.56402" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/00d2_o_ascii/sub/1757769908.56402" "txb2be99fbbb314629a4a82-0068c570b4" "proxy-server 1824535" 0.0158 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/3/a/2_vc_non_ascii%C2%A3/00d2_o_ascii/sub/1757769908.56402" 201 - "PUT http://localhost/sda1/0/a/2_vc_non_ascii%C2%A3/00d2_o_ascii/sub/1757769908.56402" "txb2be99fbbb314629a4a82-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/0/a/2_vc_non_ascii%C2%A3/00d2_o_ascii/sub/1757769908.56402" 201 - "PUT http://localhost/v1/a/2_vc_non_ascii%C2%A3/00d2_o_ascii/sub/1757769908.56402" "txb2be99fbbb314629a4a82-0068c570b4" "proxy-server 1824535" 0.0190 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 PUT /v1/a/2_vc_non_ascii%25C2%25A3/00d2_o_ascii/sub/1757769908.56402 HTTP/1.0 201 - Swift - 4 - 1b52eb8ef2c1875cfdf3ffbe9e3c05da txb2be99fbbb314629a4a82-0068c570b4 - 0.0435 VW - 1757769908.633626699 1757769908.677122831 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii/sub" 201 - "PUT http://localhost/sdb1/0/a/2_oc_ascii/2_o_ascii/sub" "tx630fb691b21346e8b1085-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii/sub" 201 - "PUT http://localhost/sda1/0/a/2_oc_ascii/2_o_ascii/sub" "tx630fb691b21346e8b1085-0068c570b4" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/0/a/2_oc_ascii/2_o_ascii/sub" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii/sub" "tx630fb691b21346e8b1085-0068c570b4" "proxy-server 1824535" 0.0167 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/0/a/2_oc_ascii/2_o_ascii/sub" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii/sub" "tx630fb691b21346e8b1085-0068c570b4" "proxy-server 1824535" 0.0162 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/2_oc_ascii/2_o_ascii/sub HTTP/1.0 201 - - t 4 - - tx630fb691b21346e8b1085-0068c570b4 - 0.0372 - - 1757769908.677573919 1757769908.714724302 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8e4423f9264541a295de1-0068c570b4" "proxy-server 1824535" 0.0056 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx8e4423f9264541a295de1-0068c570b4 - 0.0084 VW - 1757769908.716532469 1757769908.724961281 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/2/a/2_oc_ascii" 204 - "HEAD http://localhost/v1/a/2_oc_ascii" "txf78a11729f4a4b009cf39-0068c570b4" "proxy-server 1824535" 0.0078 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a/2_oc_ascii HTTP/1.0 204 - Swift - - - - txf78a11729f4a4b009cf39-0068c570b4 - 0.0151 VW - 1757769908.725509405 1757769908.740649700 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/ec" "tx700abf2682ae44f2a8d83-0068c570b4" "container-server 1824502" 0.0010 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx700abf2682ae44f2a8d83-0068c570b4" "proxy-server 1824502" 0.0228 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx700abf2682ae44f2a8d83-0068c570b4" "proxy-server 1824502" 0.0259 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx700abf2682ae44f2a8d83-0068c570b4 - 0.0503 - - 1757769908.468578339 1757769908.518833637 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx39344608aec149a9a070a-0068c570b4" "proxy-server 1824502" 0.0102 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txccf9e8374a6842c8b133b-0068c570b4" "proxy-server 1824502" 0.0044 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdg1/3/a/ec/inm" 201 - "PUT http://localhost/v1/a/ec/inm" "tx439b3468e24344d3b31c3-0068c570b4" "proxy-server 1824502" 0.0110 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/ec/inm" 201 - "PUT http://localhost/sdi1/3/a/ec/inm" "tx439b3468e24344d3b31c3-0068c570b4" "object-server 1824502" 0.0005 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/ec/inm" 201 - "PUT http://localhost/sdh1/3/a/ec/inm" "tx439b3468e24344d3b31c3-0068c570b4" "object-server 1824502" 0.0005 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdi1/3/a/ec/inm" 201 - "PUT http://localhost/v1/a/ec/inm" "tx439b3468e24344d3b31c3-0068c570b4" "proxy-server 1824502" 0.0235 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdh1/3/a/ec/inm" 201 - "PUT http://localhost/v1/a/ec/inm" "tx439b3468e24344d3b31c3-0068c570b4" "proxy-server 1824502" 0.0252 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec/inm HTTP/1.0 201 - - t 48 - %22478884f627ab2565c2e752741f8e34cc%22 tx439b3468e24344d3b31c3-0068c570b4 - 0.0658 - - 1757769908.520363569 1757769908.586209297 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx673a0fa2a56d4de382502-0068c570b4" "proxy-server 1824502" 0.0062 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "tx90bb3d7f74e343479c262-0068c570b4" "proxy-server 1824502" 0.0100 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdg1/3/a/ec/inm" 412 92 "PUT http://localhost/v1/a/ec/inm" "txc4ff9f301cb545588391f-0068c570b4" "proxy-server 1824502" 0.0003 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdi1/3/a/ec/inm" 412 92 "PUT http://localhost/v1/a/ec/inm" "txc4ff9f301cb545588391f-0068c570b4" "proxy-server 1824502" 0.0002 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdh1/3/a/ec/inm" 412 92 "PUT http://localhost/v1/a/ec/inm" "txc4ff9f301cb545588391f-0068c570b4" "proxy-server 1824502" 0.0003 "-" 1824502 3 proxy DEBUG: Object PUT returning 412, [412, 412, 412] (txn: txc4ff9f301cb545588391f-0068c570b4) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec/inm HTTP/1.0 412 - - t - 92 %22478884f627ab2565c2e752741f8e34cc%22 txc4ff9f301cb545588391f-0068c570b4 - 0.0374 - - 1757769908.591786385 1757769908.629207611 3 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2924a96d6a074c6087ebd-0068c570b4" "proxy-server 1824502" 0.0053 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/ec" 201 - "PUT http://127.0.0.1:35165/sda1/2/a/ec" "tx2924a96d6a074c6087ebd-0068c570b4" "container-server 1824502" 0.0045 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx2924a96d6a074c6087ebd-0068c570b4" "proxy-server 1824502" 0.0187 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/ec" 201 - "PUT http://127.0.0.1:37953/sdb1/2/a/ec" "tx2924a96d6a074c6087ebd-0068c570b4" "container-server 1824502" 0.0010 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/ec" 202 - "PUT http://localhost/v1/a/ec" "tx2924a96d6a074c6087ebd-0068c570b4" "proxy-server 1824502" 0.0211 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec HTTP/1.0 202 - - t - 76 - tx2924a96d6a074c6087ebd-0068c570b4 - 0.0386 - - 1757769908.635783911 1757769908.674423456 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3ca2c3873be14465a2a9d-0068c570b4" "proxy-server 1824502" 0.0062 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/2/a/ec" 204 - "HEAD http://localhost/v1/a/ec" "txe5bc350701034b3a9819a-0068c570b4" "proxy-server 1824502" 0.0054 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/ec/o3 HTTP/1.0 422 - - t 50 93 6c7ba9c5a141421e1c03cb9807c97c74 txbf33cfdc4b444005a5917-0068c570b4 - 0.0314 - - 1757769908.680044889 1757769908.711459637 3 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdh1/0/a/ec/o3" 499 89 "PUT http://localhost/v1/a/ec/o3" "txbf33cfdc4b444005a5917-0068c570b4" "proxy-server 1824502" 0.0078 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdg1/0/a/ec/o3" 499 89 "PUT http://localhost/v1/a/ec/o3" "txbf33cfdc4b444005a5917-0068c570b4" "proxy-server 1824502" 0.0217 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdi1/0/a/ec/o3" 499 89 "PUT http://localhost/v1/a/ec/o3" "txbf33cfdc4b444005a5917-0068c570b4" "proxy-server 1824502" 0.0229 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2d882c19680c41b298da7-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/29039e87969d488b9df76a1873ff4e5b" 201 - "PUT http://127.0.0.1:37953/sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" "tx2d882c19680c41b298da7-0068c570b4" "container-server 1824502" 0.0017 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/29039e87969d488b9df76a1873ff4e5b" 201 - "PUT http://127.0.0.1:35165/sda1/3/a/29039e87969d488b9df76a1873ff4e5b" "tx2d882c19680c41b298da7-0068c570b4" "container-server 1824502" 0.0011 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/3/a/29039e87969d488b9df76a1873ff4e5b" 201 - "PUT http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "tx2d882c19680c41b298da7-0068c570b4" "proxy-server 1824502" 0.0255 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" 201 - "PUT http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "tx2d882c19680c41b298da7-0068c570b4" "proxy-server 1824502" 0.0178 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/29039e87969d488b9df76a1873ff4e5b HTTP/1.0 201 - - t - - - tx2d882c19680c41b298da7-0068c570b4 - 0.0419 - - 1757769908.729119778 1757769908.771018744 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5fdda3f690e64cb890aa1-0068c570b4" "proxy-server 1824502" 0.0061 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "txa2989eda94b4442f8126f-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 201 - "PUT http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txc421539b75fc4e7e9ce7f-0068c570b4" "proxy-server 1824502" 0.0178 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sda1/3/a/2_vc_non_ascii%C2%A3" 200 724 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?prefix=0092_o_ascii%2F&marker=&reverse=on&format=json&states=listing" "tx90db662b7647484b8d884-0068c570b4" "proxy-server 1824535" 0.0099 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fprefix%3D0092_o_ascii%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 724 - tx90db662b7647484b8d884-0068c570b4 - 0.0256 VW - 1757769908.741401672 1757769908.767009020 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sda1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 200 5 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367?symlink=get" "tx8ef82245def9413994c70-0068c570b4" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdb1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 200 5 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367?symlink=get" "tx8ef82245def9413994c70-0068c570b4" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 GET /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769908.36367%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx8ef82245def9413994c70-0068c570b4 - 0.0270 VW - 1757769908.767599821 1757769908.794553995 0 - (txn: tx8f695587fe3e474ba31ac-0068c570b4) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sdb1/1/a/2_oc_ascii/2_o_ascii" "tx8f695587fe3e474ba31ac-0068c570b4" "object-server 1824535" 0.0040 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/sda1/1/a/2_oc_ascii/2_o_ascii" "tx8f695587fe3e474ba31ac-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx8f695587fe3e474ba31ac-0068c570b4" "proxy-server 1824535" 0.0229 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/2_oc_ascii/2_o_ascii" 201 - "PUT http://localhost/v1/a/2_oc_ascii/2_o_ascii" "tx8f695587fe3e474ba31ac-0068c570b4" "proxy-server 1824535" 0.0245 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 PUT /v1/a/2_oc_ascii/2_o_ascii HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 tx8f695587fe3e474ba31ac-0068c570b4 - 0.0368 VW - 1757769908.778542519 1757769908.815362215 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "DELETE /sda1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 204 - "DELETE http://localhost/sdb1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" "tx403c073b0ba444bb92d79-0068c570b4" "object-server 1824535" 0.0046 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "DELETE /sdb1/3/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 204 - "DELETE http://localhost/sda1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" "tx403c073b0ba444bb92d79-0068c570b4" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "DELETE /sdb1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 204 - "DELETE http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" "tx403c073b0ba444bb92d79-0068c570b4" "proxy-server 1824535" 0.0151 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "DELETE /sda1/0/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" 204 - "DELETE http://localhost/v1/a/2_vc_non_ascii%C2%A3/0092_o_ascii/1757769908.36367" "tx403c073b0ba444bb92d79-0068c570b4" "proxy-server 1824535" 0.0105 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 DELETE /v1/a/2_vc_non_ascii%25C2%25A3/0092_o_ascii/1757769908.36367 HTTP/1.0 204 - Swift - - - - tx403c073b0ba444bb92d79-0068c570b4 - 0.0235 VW - 1757769908.815952539 1757769908.839470863 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdea242e09d0f459fb276c-0068c570b4" "proxy-server 1824535" 0.0015 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdb1/3/a/2_vc_non_ascii%C2%A3" 200 185 "GET http://localhost/v1/a/2_vc_non_ascii%C2%A3?prefix=00d2_o_ascii%2Fsub%2F&format=json&states=listing" "txdea242e09d0f459fb276c-0068c570b4" "proxy-server 1824535" 0.0038 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 GET /v1/a/2_vc_non_ascii%25C2%25A3%3Fprefix%3D00d2_o_ascii%252Fsub%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 185 - txdea242e09d0f459fb276c-0068c570b4 - 0.0200 - - 1757769908.841407299 1757769908.861374140 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfe41e0884e824552bc766-0068c570b4" "proxy-server 1824535" 0.0059 "-" 1824535 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/1/a/2_oc_asciiwhoops" 201 - "PUT http://127.0.0.1:44669/sdb1/0/a/2_oc_asciiwhoops" "txfe41e0884e824552bc766-0068c570b4" "container-server 1824535" 0.0011 "-" 1824535 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/1/a/2_oc_asciiwhoops" 201 - "PUT http://127.0.0.1:38699/sda1/0/a/2_oc_asciiwhoops" "txfe41e0884e824552bc766-0068c570b4" "container-server 1824535" 0.0011 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/0/a/2_oc_asciiwhoops" 201 - "PUT http://localhost/v1/a/2_oc_asciiwhoops" "txfe41e0884e824552bc766-0068c570b4" "proxy-server 1824535" 0.0307 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/0/a/2_oc_asciiwhoops" 201 - "PUT http://localhost/v1/a/2_oc_asciiwhoops" "txfe41e0884e824552bc766-0068c570b4" "proxy-server 1824535" 0.0183 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/2_oc_asciiwhoops HTTP/1.0 201 - - t - - - txfe41e0884e824552bc766-0068c570b4 - 0.0479 - - 1757769908.867598295 1757769908.915515661 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe0effedb3d864f2f8492c-0068c570b4" "proxy-server 1824535" 0.0062 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txe0effedb3d864f2f8492c-0068c570b4 - 0.0089 VW - 1757769908.917186975 1757769908.926085949 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/0/a/2_oc_asciiwhoops" 204 - "HEAD http://localhost/v1/a/2_oc_asciiwhoops" "tx9938f78cae9a4856bbd77-0068c570b4" "proxy-server 1824535" 0.0014 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a/2_oc_asciiwhoops HTTP/1.0 204 - Swift - - - - tx9938f78cae9a4856bbd77-0068c570b4 - 0.0127 VW - 1757769908.926594973 1757769908.939289570 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdb1/2/a/2_oc_asciiwhoops/foo" 404 70 "GET http://localhost/v1/a/2_oc_asciiwhoops/foo?symlink=get" "tx87ad1669754942e3ba7d4-0068c570b4" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sda1/2/a/2_oc_asciiwhoops/foo" 404 70 "GET http://localhost/v1/a/2_oc_asciiwhoops/foo?symlink=get" "tx87ad1669754942e3ba7d4-0068c570b4" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/08 GET /v1/a/2_oc_asciiwhoops/foo%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx87ad1669754942e3ba7d4-0068c570b4 - 0.0095 VW - 1757769908.939886332 1757769908.949401140 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/0/a/2_oc_asciiwhoops/foo" 201 - "PUT http://localhost/sdb1/2/a/2_oc_asciiwhoops/foo" "tx4bda5b82d31349489235b-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/2/a/2_oc_asciiwhoops/foo" 201 - "PUT http://localhost/v1/a/2_oc_asciiwhoops/foo" "tx4bda5b82d31349489235b-0068c570b4" "proxy-server 1824535" 0.0133 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/0/a/2_oc_asciiwhoops/foo" 201 - "PUT http://localhost/sda1/2/a/2_oc_asciiwhoops/foo" "tx4bda5b82d31349489235b-0068c570b4" "object-server 1824535" 0.0005 "-" 1824535 0test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_version_container test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_version_container ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/3/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 201 - "PUT http://localhost/sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txc421539b75fc4e7e9ce7f-0068c570b4" "object-server 1824502" 0.0005 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 201 - "PUT http://localhost/sdh1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txc421539b75fc4e7e9ce7f-0068c570b4" "object-server 1824502" 0.0005 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdh1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 201 - "PUT http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txc421539b75fc4e7e9ce7f-0068c570b4" "proxy-server 1824502" 0.0380 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 201 - "PUT http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txc421539b75fc4e7e9ce7f-0068c570b4" "proxy-server 1824502" 0.0311 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals HTTP/1.0 201 - - t 52 - - txc421539b75fc4e7e9ce7f-0068c570b4 - 0.0648 - - 1757769908.772518158 1757769908.837347031 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcd3914c34bb84d4e9201b-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "txdead92a5626a491aa8f6a-0068c570b4" "proxy-server 1824502" 0.0123 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 200 106 "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txafb4312011a6423cbcf78-0068c570b4" "proxy-server 1824502" 0.0004 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 200 106 "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txafb4312011a6423cbcf78-0068c570b4" "proxy-server 1824502" 0.0004 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx53bd8587becf4392b50c8-0068c570b4" "proxy-server 1824502" 0.0053 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "tx0e9e2cc9ad074a6ab030a-0068c570b4" "proxy-server 1824502" 0.0055 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 412 - "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx2a1206fae3df4e77a9d8d-0068c570b4" "proxy-server 1824502" 0.0045 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 412 - "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx2a1206fae3df4e77a9d8d-0068c570b4" "proxy-server 1824502" 0.0003 "-" 1824502 3 proxy DEBUG: Ignoring 412 from primary (txn: tx2a1206fae3df4e77a9d8d-0068c570b4) proxy DEBUG: Ignoring 412 from primary (txn: tx2a1206fae3df4e77a9d8d-0068c570b4) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdh1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 412 - "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx2a1206fae3df4e77a9d8d-0068c570b4" "proxy-server 1824502" 0.0004 "-" 1824502 3 proxy DEBUG: Ignoring 412 from primary (txn: tx2a1206fae3df4e77a9d8d-0068c570b4) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdeacea3c914c4f32a052e-0068c570b4" "proxy-server 1824502" 0.0019 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "txf27b271f361d42d88f977-0068c570b4" "proxy-server 1824502" 0.0076 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 200 106 "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx6ac267526a04461aa2e0a-0068c570b4" "proxy-server 1824502" 0.0045 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 200 106 "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx6ac267526a04461aa2e0a-0068c570b4" "proxy-server 1824502" 0.0003 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe6f2dbbf1291468387c78-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "txc91d839d091d4d4fbc7ce-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 304 - "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx3e7751117ff74b05b7543-0068c570b4" "proxy-server 1824502" 0.0003 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdh1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 304 - "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx3e7751117ff74b05b7543-0068c570b4" "proxy-server 1824502" 0.0003 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "GET /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 304 - "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx3e7751117ff74b05b7543-0068c570b4" "proxy-server 1824502" 0.0004 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3cd416bd0d8b4543b8dd6-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "tx5e3ff51641f6496ca5063-0068c570b4" "proxy-server 1824502" 0.0013 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdh1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 200 106 "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txe5ec5b37309d486b8c512-0068c570b5" "proxy-server 1824502" 0.0004 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 200 106 "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txe5ec5b37309d486b8c512-0068c570b5" "proxy-server 1824502" 0.0003 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx776272181df141df9ca17-0068c570b5" "proxy-server 1824502" 0.0054 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "txb25a0723ed3b46f3ab70f-0068c570b5" "proxy-server 1824502" 0.0055 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 304 - "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx7b48306772234ecfa500e-0068c570b5" "proxy-server 1824502" 0.0004 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdh1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 304 - "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx7b48306772234ecfa500e-0068c570b5" "proxy-server 1824502" 0.0003 "-" 1824502 3test.unit.proxy.test_mem_server.TestECObjectController.test_conditional_GET_ec test.unit.proxy.test_mem_server.TestECObjectController.test_conditional_GET_ec ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "PUT /sda1/2/a/2_oc_asciiwhoops/foo" 201 - "PUT http://localhost/v1/a/2_oc_asciiwhoops/foo" "tx4bda5b82d31349489235b-0068c570b4" "proxy-server 1824535" 0.0202 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/08 PUT /v1/a/2_oc_asciiwhoops/foo HTTP/1.0 201 - - t 5 - - tx4bda5b82d31349489235b-0068c570b4 - 0.0287 - - 1757769908.949783564 1757769908.978479624 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:08 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2b37af2778b546db86f94-0068c570b4" "proxy-server 1824535" 0.0063 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/08 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx2b37af2778b546db86f94-0068c570b4 - 0.0092 VW - 1757769908.984399796 1757769908.993550301 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/0/a/2_oc_asciiwhoops" 204 - "HEAD http://localhost/v1/a/2_oc_asciiwhoops" "tx89ab6fa6c7c54839b65ec-0068c570b4" "proxy-server 1824535" 0.0025 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a/2_oc_asciiwhoops HTTP/1.0 204 - Swift - - - - tx89ab6fa6c7c54839b65ec-0068c570b4 - 0.0136 VW - 1757769908.994095802 1757769909.007720470 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/2/a/2_oc_asciiwhoops/foo" 200 5 "GET http://localhost/v1/a/2_oc_asciiwhoops/foo?symlink=get" "tx9ad1fe14a18f44409292c-0068c570b5" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/2/a/2_oc_asciiwhoops/foo" 200 5 "GET http://localhost/v1/a/2_oc_asciiwhoops/foo?symlink=get" "tx9ad1fe14a18f44409292c-0068c570b5" "proxy-server 1824535" 0.0007 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx73d0778ba6ab457e94681-0068c570b5" "proxy-server 1824535" 0.0003 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx73d0778ba6ab457e94681-0068c570b5" "proxy-server 1824535" 0.0045 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 GET /v1/a/2_oc_asciiwhoops/foo%3Fsymlink%3Dget HTTP/1.0 499 - Swift - - 5 - tx9ad1fe14a18f44409292c-0068c570b5 - 0.0331 VW - 1757769909.008295774 1757769909.041376114 0 - (txn: tx1a65c3b8463a440a88b55-0068c570b5) proxy INFO: - - 13/Sep/2025/13/25/09 PUT /v1/a/none/003foo/1757769908.95029 HTTP/1.0 404 - Swift - - 70 dcddb75469b4b4875094e14561e573d8 tx1a65c3b8463a440a88b55-0068c570b5 - 0.0187 VW - 1757769909.023122072 1757769909.041818142 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7988f4b34c674d308ee65-0068c570b5" "proxy-server 1824535" 0.0015 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx7988f4b34c674d308ee65-0068c570b5 - 0.0086 VW - 1757769909.043447256 1757769909.052031994 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/0/a/2_oc_asciiwhoops" 204 - "HEAD http://localhost/v1/a/2_oc_asciiwhoops" "txd91586f4198c423ca3939-0068c570b5" "proxy-server 1824535" 0.0103 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a/2_oc_asciiwhoops HTTP/1.0 204 - Swift - - - - txd91586f4198c423ca3939-0068c570b5 - 0.0131 VW - 1757769909.052573204 1757769909.065687180 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txc02db82cf18841ccb76df-0068c570b5" "proxy-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txc02db82cf18841ccb76df-0068c570b5" "proxy-server 1824535" 0.0045 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 GET /v1/a/none%3Fprefix%3D003foo%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 404 - Swift - - 70 - txc02db82cf18841ccb76df-0068c570b5 - 0.0142 VW - 1757769909.066240788 1757769909.080439806 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "DELETE /sdb1/0/a/2_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/sda1/2/a/2_oc_asciiwhoops/foo" "txb348ae86c07e47a19f81f-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "DELETE /sda1/0/a/2_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/sdb1/2/a/2_oc_asciiwhoops/foo" "txb348ae86c07e47a19f81f-0068c570b5" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "DELETE /sdb1/2/a/2_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/v1/a/2_oc_asciiwhoops/foo" "txb348ae86c07e47a19f81f-0068c570b5" "proxy-server 1824535" 0.0115 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "DELETE /sda1/2/a/2_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/v1/a/2_oc_asciiwhoops/foo" "txb348ae86c07e47a19f81f-0068c570b5" "proxy-server 1824535" 0.0112 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 DELETE /v1/a/2_oc_asciiwhoops/foo HTTP/1.0 204 - - t - - - txb348ae86c07e47a19f81f-0068c570b5 - 0.0199 - - 1757769909.080895901 1757769909.100829363 0 - proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx65405e1206da4bafa7900-0068c570b5" "proxy-server 1824535" 0.0042 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/1/a/5_oc_ascii" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/5_oc_ascii" "tx65405e1206da4bafa7900-0068c570b5" "container-server 1824535" 0.0011 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/1/a/5_oc_ascii" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/5_oc_ascii" "tx65405e1206da4bafa7900-0068c570b5" "container-server 1824535" 0.0011 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/2/a/5_oc_ascii" 201 - "PUT http://localhost/v1/a/5_oc_ascii" "tx65405e1206da4bafa7900-0068c570b5" "proxy-server 1824535" 0.0350 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/2/a/5_oc_ascii" 201 - "PUT http://localhost/v1/a/5_oc_ascii" "tx65405e1206da4bafa7900-0068c570b5" "proxy-server 1824535" 0.0184 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/5_oc_ascii HTTP/1.0 201 - - t - - - tx65405e1206da4bafa7900-0068c570b5 - 0.0505 - - 1757769909.108775377 1757769909.159261703 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf5c06afe05514c9a95e37-0068c570b5" "proxy-server 1824535" 0.0021 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/2/a/5_oc_ascii" 200 2 "GET http://localhost/v1/a/5_oc_ascii?format=json&states=listing" "txf5c06afe05514c9a95e37-0068c570b5" "proxy-server 1824535" 0.0022 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - txf5c06afe05514c9a95e37-0068c570b5 - 0.0229 - - 1757769909.160901308 1757769909.183835506 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3c4d137818c445cebca5c-0068c570b5" "proxy-server 1824535" 0.0014 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/1/a/5_vc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:38699/sda1/3/a/5_vc_non_ascii%C2%A3" "tx3c4d137818c445cebca5c-0068c570b5" "container-server 1824535" 0.0053 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/1/a/5_vc_non_ascii%C2%A3" 201 - "PUT http://127.0.0.1:44669/sdb1/3/a/5_vc_non_ascii%C2%A3" "tx3c4d137818c445cebca5c-0068c570b5" "container-server 1824535" 0.0017 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3" "tx3c4d137818c445cebca5c-0068c570b5" "proxy-server 1824535" 0.0309 "-" 1824535 0 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 304 - "GET http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx7b48306772234ecfa500e-0068c570b5" "proxy-server 1824502" 0.0085 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1cbf692911c94b38974bd-0068c570b5" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "tx0376c766b7ea452a92365-0068c570b5" "proxy-server 1824502" 0.0013 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 200 106 "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx46bf847f10984874b12e8-0068c570b5" "proxy-server 1824502" 0.0003 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx626df879684c44909d595-0068c570b5" "proxy-server 1824502" 0.0095 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "txde90f17414f449a5995c3-0068c570b5" "proxy-server 1824502" 0.0100 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 412 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txe783cf2ae8cb4ac789e6c-0068c570b5" "proxy-server 1824502" 0.0003 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 412 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txe783cf2ae8cb4ac789e6c-0068c570b5" "proxy-server 1824502" 0.0003 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdh1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 412 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txe783cf2ae8cb4ac789e6c-0068c570b5" "proxy-server 1824502" 0.0003 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbe685853f1304bc4927af-0068c570b5" "proxy-server 1824502" 0.0053 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "tx9171668f50694a369e49c-0068c570b5" "proxy-server 1824502" 0.0014 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 200 106 "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx204518033afb4a5291e90-0068c570b5" "proxy-server 1824502" 0.0003 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf4b4d36486b9423bacd37-0068c570b5" "proxy-server 1824502" 0.0055 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "txb5652898c88e4ea69c91b-0068c570b5" "proxy-server 1824502" 0.0054 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdg1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 304 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx646287a31d3240cf99863-0068c570b5" "proxy-server 1824502" 0.0043 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf71714a70b024a69a1187-0068c570b5" "proxy-server 1824502" 0.0053 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "tx4ae0eb8e7aa34582b2587-0068c570b5" "proxy-server 1824502" 0.0055 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 200 106 "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "txf1085bf64caa4a32ab73f-0068c570b5" "proxy-server 1824502" 0.0002 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx30aac1ba5b3842fa83a3d-0068c570b5" "proxy-server 1824502" 0.0012 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/3/a/29039e87969d488b9df76a1873ff4e5b" 204 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b" "tx4071f0ba4d0440f9844fe-0068c570b5" "proxy-server 1824502" 0.0012 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdi1/0/a/29039e87969d488b9df76a1873ff4e5b/conditionals" 304 - "HEAD http://localhost/v1/a/29039e87969d488b9df76a1873ff4e5b/conditionals" "tx3e07b158d2144d4bb20f1-0068c570b5" "proxy-server 1824502" 0.0003 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx558c87f115de4239ae7be-0068c570b5" "proxy-server 1824502" 0.0055 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/1/a/ec-discon" 201 - "PUT http://127.0.0.1:35165/sda1/1/a/ec-discon" "tx558c87f115de4239ae7be-0068c570b5" "container-server 1824502" 0.0081 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/1/a/ec-discon" 201 - "PUT http://127.0.0.1:37953/sdb1/1/a/ec-discon" "tx558c87f115de4239ae7be-0068c570b5" "container-server 1824502" 0.0010 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/1/a/ec-discon" 201 - "PUT http://localhost/v1/a/ec-discon" "tx558c87f115de4239ae7be-0068c570b5" "proxy-server 1824502" 0.0232 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/1/a/ec-discon" 201 - "PUT http://localhost/v1/a/ec-discon" "tx558c87f115de4239ae7be-0068c570b5" "proxy-server 1824502" 0.0319 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/ec-discon HTTP/1.0 201 - - t - - - tx558c87f115de4239ae7be-0068c570b5 - 0.0475 - - 1757769909.228091717 1757769909.275553465 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7dcdf7f629d04d72bbc02-0068c570b5" "proxy-server 1824502" 0.0062 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx61ecec23d8d14924919fe-0068c570b5" "proxy-server 1824502" 0.0013 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdi1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "tx6b9c431414194ed09fc7b-0068c570b5" "proxy-server 1824502" 0.0225 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/1/a/ec-discon/test" 201 - "PUT http://localhost/sdg1/1/a/ec-discon/test" "tx6b9c431414194ed09fc7b-0068c570b5" "object-server 1824502" 0.0005 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/1/a/ec-discon/test" 201 - "PUT http://localhost/sdh1/1/a/ec-discon/test" "tx6b9c431414194ed09fc7b-0068c570b5" "object-server 1824502" 0.0005 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdg1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "tx6b9c431414194ed09fc7b-0068c570b5" "proxy-server 1824502" 0.0327 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdh1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "tx6b9c431414194ed09fc7b-0068c570b5" "proxy-server 1824502" 0.0322 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/ec-discon/test HTTP/1.0 201 - - t 262144 - - tx6b9c431414194ed09fc7b-0068c570b5 - 0.0632 - - 1757769909.276553154 1757769909.339802265 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4544200a8b9d47b290c72-0068c570b5" "proxy-server 1824502" 0.0055 "-" 1824502 -test.unit.proxy.test_mem_server.TestECObjectController.test_ec_client_disconnect test.unit.proxy.test_mem_server.TestECObjectController.test_ec_client_disconnect ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3" "tx3c4d137818c445cebca5c-0068c570b5" "proxy-server 1824535" 0.0299 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/5_vc_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx3c4d137818c445cebca5c-0068c570b5 - 0.0548 - - 1757769909.185861111 1757769909.240693569 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx48b81fc0c45f40109ddee-0068c570b5" "proxy-server 1824535" 0.0020 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx48b81fc0c45f40109ddee-0068c570b5 - 0.0172 VW - 1757769909.242362022 1757769909.259569168 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx1e9f10c5e15647e2a708d-0068c570b5" "proxy-server 1824535" 0.0095 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - tx1e9f10c5e15647e2a708d-0068c570b5 - 0.0124 VW - 1757769909.260164261 1757769909.272514343 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx1c1cb2279929455197487-0068c570b5" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx1c1cb2279929455197487-0068c570b5" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx1c1cb2279929455197487-0068c570b5 - 0.0267 VW - 1757769909.273176908 1757769909.299889565 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx4e2137032a7544269ce6c-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx4e2137032a7544269ce6c-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx4e2137032a7544269ce6c-0068c570b5" "proxy-server 1824535" 0.0129 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx4e2137032a7544269ce6c-0068c570b5" "proxy-server 1824535" 0.0145 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx4e2137032a7544269ce6c-0068c570b5 - 0.0223 - - 1757769909.300313234 1757769909.322571993 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4e07f8c0dd884cddb88cf-0068c570b5" "proxy-server 1824535" 0.0015 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx4e07f8c0dd884cddb88cf-0068c570b5 - 0.0126 VW - 1757769909.338915586 1757769909.351495743 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx1b379d5d273b46b880700-0068c570b5" "proxy-server 1824535" 0.0069 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - tx1b379d5d273b46b880700-0068c570b5 - 0.0097 VW - 1757769909.352049828 1757769909.361769438 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx1e17ae96815f45ef8266a-0068c570b5" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx1e17ae96815f45ef8266a-0068c570b5" "proxy-server 1824535" 0.0007 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/3/a/5_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/5_vc_non_ascii%C2%A3" "tx18edfde6789741d0af986-0068c570b5" "proxy-server 1824535" 0.0015 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx1e17ae96815f45ef8266a-0068c570b5 - 0.0372 VW - 1757769909.362370968 1757769909.399595022 0 - (txn: txd21e993151924a2987e69-0068c570b5) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 201 - "PUT http://localhost/sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" "txd21e993151924a2987e69-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 201 - "PUT http://localhost/sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" "txd21e993151924a2987e69-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" "txd21e993151924a2987e69-0068c570b5" "proxy-server 1824535" 0.0171 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" "txd21e993151924a2987e69-0068c570b5" "proxy-server 1824535" 0.0188 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 PUT /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769909.30088 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txd21e993151924a2987e69-0068c570b5 - 0.0357 VW - 1757769909.377752066 1757769909.413405657 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txdcd5c15c5cca4102b9d84-0068c570b5" "object-server 1824535" 0.0046 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txdcd5c15c5cca4102b9d84-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txdcd5c15c5cca4102b9d84-0068c570b5" "proxy-server 1824535" 0.0200 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txdcd5c15c5cca4102b9d84-0068c570b5" "proxy-server 1824535" 0.0217 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - txdcd5c15c5cca4102b9d84-0068c570b5 - 0.0342 - - 1757769909.413884401 1757769909.448045254 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe9db43b2d9ef478db1fe5-0068c570b5" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx5fa2145e99a743ad86d87-0068c570b5" "proxy-server 1824535" 0.0080 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb64530a9d0864662a5a22-0068c570b5" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - txb64530a9d0864662a5a22-0068c570b5 - 0.0343 - - 1757769909.449700117 1757769909.484050035 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx26fddc16f37b45a299ffe-0068c570b5" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx26fddc16f37b45a299ffe-0068c570b5 - 0.0081 VW - 1757769909.499773026 1757769909.507887363 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx3295f3d947b2448985834-0068c570b5" "proxy-server 1824535" 0.0108 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - tx3295f3d947b2448985834-0068c570b5 - 0.0136 VW - 1757769909.508425713 1757769909.522027254 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx08b02d104dff42b08f237-0068c570b5" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx08b02d104dff42b08f237-0068c570b5" "proxy-server 1824535" 0.0055 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/3/a/5_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/5_vc_non_ascii%C2%A3" "txd341bbfa71254a0ea8385-0068c570b5" "proxy-server 1824535" 0.0081 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - tx08b02d104dff42b08f237-0068c570b5 - 0.0507 VW - 1757769909.522610188 1757769909.573358536 0 - (txn: tx103bc1d9add0409296dbc-0068c570b5) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 201 - "PUT http://localhost/sda1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" "tx103bc1d9add0409296dbc-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 201 - "PUT http://localhost/sdb1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" "tx103bc1d9add0409296dbc-0068c570b5" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" "tx103bc1d9add0409296dbc-0068c570b5" "proxy-server 1824535" 0.0139 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" "tx103bc1d9add0409296dbc-0068c570b5" "proxy-server 1824535" 0.0135 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 PUT /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769909.41443 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 tx103bc1d9add0409296dbc-0068c570b5 - 0.0492 VW - 1757769909.541757584 1757769909.590972662 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx33cfb65e8f9b48f2938ca-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx33cfb65e8f9b48f2938ca-0068c570b5" "proxy-server 1824535" 0.0235 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx33cfb65e8f9b48f2938ca-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx33cfb65e8f9b48f2938ca-0068c570b5" "proxy-server 1824535" 0.0211 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx33cfb65e8f9b48f2938ca-0068c570b5 - 0.0299 - - 1757769909.591504574 1757769909.621371508 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx804d78e2e1564ae0be2bd-0068c570b5" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx630684ead44048bf94ab7-0068c570b5" "proxy-server 1824535" 0.0073 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb3d05071c45b4b4fa59b7-0068c570b5" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - txb3d05071c45b4b4fa59b7-0068c570b5 - 0.0270 - - 1757769909.626990795 1757769909.653946400 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5c2dd1b823fe46f4b54c4-0068c570b5" "proxy-server 1824535" 0.0056 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/3/a/5_vc_non_ascii%C2%A3" 200 382 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?format=json&states=listing" "tx5c2dd1b823fe46f4b54c4-0068c570b5" "proxy-server 1824535" 0.0077 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 382 - tx5c2dd1b823fe46f4b54c4-0068c570b5 - 0.0238 - - 1757769909.659832478 1757769909.683605671 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1e4847ed9670440cbfa73-0068c570b5" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx18be59c8b514464b9b9ee-0068c570b5" "proxy-server 1824535" 0.0014 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx14fcd9ad5e10440095c37-0068c570b5" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx14fcd9ad5e10440095c37-0068c570b5" "proxy-server 1824535" 0.0006 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf3a9f07e1abe4056bc133-0068c570b5" "proxy-server 1824535" 0.0020 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txf3a9f07e1abe4056bc133-0068c570b5 - 0.0134 VW - 1757769909.718522787 1757769909.731880426 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx06c802d8d94f4be59839e-0068c570b5" "proxy-server 1824535" 0.0056 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - tx06c802d8d94f4be59839e-0068c570b5 - 0.0084 VW - 1757769909.732419252 1757769909.740784883 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/1/a/5_oc_ascii/copied_name" 404 70 "GET http://localhost/v1/a/5_oc_ascii/copied_name?symlink=get" "tx728cce48b26c4b48a0eaa-0068c570b5" "proxy-server 1824535" 0.0003 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx8788e80dfd7a4eb193a24-0068c570b5" "proxy-server 1824502" 0.0102 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdg1/1/a/ec-discon/test" 200 136192 "GET http://localhost/v1/a/ec-discon/test" "tx84e981f56cca478097a31-0068c570b5" "proxy-server 1824502" 0.0004 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdi1/1/a/ec-discon/test" 200 136192 "GET http://localhost/v1/a/ec-discon/test" "tx84e981f56cca478097a31-0068c570b5" "proxy-server 1824502" 0.0004 "-" 1824502 3 proxy WARNING: Client disconnected on read of EC frag '/a/ec-discon/test' (txn: tx84e981f56cca478097a31-0068c570b5) (client_ip: 127.0.0.1) proxy WARNING: Client disconnected on read of EC frag '/a/ec-discon/test' (txn: tx84e981f56cca478097a31-0068c570b5) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 GET /v1/a/ec-discon/test HTTP/1.0 499 - - t - 12288 - tx84e981f56cca478097a31-0068c570b5 - 0.0582 - - 1757769909.340817213 1757769909.398990631 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx71faaa9bb99745ddb221b-0068c570b5" "proxy-server 1824502" 0.0013 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/1/a/ec-discon" 201 - "PUT http://127.0.0.1:35165/sda1/1/a/ec-discon" "tx71faaa9bb99745ddb221b-0068c570b5" "container-server 1824502" 0.0052 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/1/a/ec-discon" 202 - "PUT http://localhost/v1/a/ec-discon" "tx71faaa9bb99745ddb221b-0068c570b5" "proxy-server 1824502" 0.0102 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/1/a/ec-discon" 201 - "PUT http://127.0.0.1:37953/sdb1/1/a/ec-discon" "tx71faaa9bb99745ddb221b-0068c570b5" "container-server 1824502" 0.0017 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/1/a/ec-discon" 202 - "PUT http://localhost/v1/a/ec-discon" "tx71faaa9bb99745ddb221b-0068c570b5" "proxy-server 1824502" 0.0251 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/ec-discon HTTP/1.0 202 - - t - 76 - tx71faaa9bb99745ddb221b-0068c570b5 - 0.0407 - - 1757769909.490741968 1757769909.531486988 3 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx276d719d8fc1403394581-0068c570b5" "proxy-server 1824502" 0.0062 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx44a1184d91da487aa342f-0068c570b5" "proxy-server 1824502" 0.0013 "-" 1824502 3 proxy WARNING: Client disconnected without sending enough data (txn: txc9152ece36b14e63979ac-0068c570b5) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/ec-discon/test HTTP/1.0 499 - - t 262134 89 - txc9152ece36b14e63979ac-0068c570b5 - 0.0337 - - 1757769909.532525301 1757769909.566182375 3 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdg1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txc9152ece36b14e63979ac-0068c570b5" "proxy-server 1824502" 0.0133 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdh1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txc9152ece36b14e63979ac-0068c570b5" "proxy-server 1824502" 0.0165 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdi1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txc9152ece36b14e63979ac-0068c570b5" "proxy-server 1824502" 0.0213 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdec44bca209c482a82b4d-0068c570b5" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "txa0a51927d6e442f3ba5ca-0068c570b5" "proxy-server 1824502" 0.0012 "-" 1824502 3 proxy WARNING: Client disconnected without sending last chunk (txn: txbd8e2a9e808f42dd8a9b9-0068c570b5) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/ec-discon/test HTTP/1.0 499 - - t 65536 89 - txbd8e2a9e808f42dd8a9b9-0068c570b5 - 0.0269 - - 1757769909.634216785 1757769909.661127567 3 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdg1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txbd8e2a9e808f42dd8a9b9-0068c570b5" "proxy-server 1824502" 0.0072 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdh1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txbd8e2a9e808f42dd8a9b9-0068c570b5" "proxy-server 1824502" 0.0089 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdi1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "txbd8e2a9e808f42dd8a9b9-0068c570b5" "proxy-server 1824502" 0.0132 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbc4ee095bbd7435eb6aa1-0068c570b5" "proxy-server 1824502" 0.0054 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "txe5fada98d0db4a3f82c37-0068c570b5" "proxy-server 1824502" 0.0055 "-" 1824502 3 proxy WARNING: Client disconnected without sending last chunk (txn: tx79c0e8d4ea02425587cee-0068c570b5) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/ec-discon/test HTTP/1.0 499 - - t - 89 - tx79c0e8d4ea02425587cee-0068c570b5 - 0.0397 - - 1757769909.735835314 1757769909.775567532 3 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdg1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx79c0e8d4ea02425587cee-0068c570b5" "proxy-server 1824502" 0.0067 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdh1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx79c0e8d4ea02425587cee-0068c570b5" "proxy-server 1824502" 0.0171 "-" 1824502 3 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdi1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx79c0e8d4ea02425587cee-0068c570b5" "proxy-server 1824502" 0.0084 "-" 1824502 3 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7d3ed0e13b6d4741aa9c8-0068c570b5" "proxy-server 1824502" 0.0022 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx28d72e2a1f3945f3b2fbf-0068c570b5" "proxy-server 1824502" 0.0014 "-" 1824502 3 proxy WARNING: Client disconnected without sending last chunk (txn: tx3160762f204c4c4cbdcea-0068c570b5) (client_ip: 127.0.0.1) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 PUT /v1/a/ec-discon/test HTTP/1.0 499 - - t - 89 - tx3160762f204c4c4cbdcea-0068c570b5 - 0.0278 - - 1757769909.837246656 1757769909.865090609 3 - obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdi1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx3160762f204c4c4cbdcea-0068c570b5" "proxy-server 1824502" 0.0079 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdh1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx3160762f204c4c4cbdcea-0068c570b5" "proxy-server 1824502" 0.0030 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdg1/1/a/ec-discon/test" 499 89 "PUT http://localhost/v1/a/ec-discon/test" "tx3160762f204c4c4cbdcea-0068c570b5" "proxy-server 1824502" 0.0126 "-" 1824502 3 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc803ca6078a845a4b44df-0068c570b5" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a/ec-discon" 204 - "HEAD http://localhost/v1/a/ec-discon" "tx625dbb973f4a40d382157-0068c570b5" "proxy-server 1824502" 0.0013 "-" 1824502 3test.unit.proxy.test_mem_server.TestECObjectController.test_ec_client_put_disconnect test.unit.proxy.test_mem_server.TestECObjectController.test_ec_client_put_disconnect ... ok test.unit.proxy.test_mem_server.TestECObjectController.test_reload_ring_ec test.unit.proxy.test_mem_server.TestECObjectController.test_reload_ring_ec ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/1/a/5_oc_ascii/copied_name" 404 70 "GET http://localhost/v1/a/5_oc_ascii/copied_name?symlink=get" "tx728cce48b26c4b48a0eaa-0068c570b5" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii/copied_name%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx728cce48b26c4b48a0eaa-0068c570b5 - 0.0178 VW - 1757769909.741368771 1757769909.759140968 0 - proxy INFO: - - 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 200 - Swift t - 5 - tx14fcd9ad5e10440095c37-0068c570b5 - 0.0866 SSC - 1757769909.685704708 1757769909.772351265 0 - (txn: tx3eb78865e3034b918a647-0068c570b5) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/2/a/5_oc_ascii/copied_name" 201 - "PUT http://localhost/sda1/1/a/5_oc_ascii/copied_name" "tx3eb78865e3034b918a647-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/2/a/5_oc_ascii/copied_name" 201 - "PUT http://localhost/sdb1/1/a/5_oc_ascii/copied_name" "tx3eb78865e3034b918a647-0068c570b5" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/1/a/5_oc_ascii/copied_name" 201 - "PUT http://localhost/v1/a/5_oc_ascii/copied_name" "tx3eb78865e3034b918a647-0068c570b5" "proxy-server 1824535" 0.0378 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/1/a/5_oc_ascii/copied_name" 201 - "PUT http://localhost/v1/a/5_oc_ascii/copied_name" "tx3eb78865e3034b918a647-0068c570b5" "proxy-server 1824535" 0.0293 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 COPY /v1/a/5_oc_ascii/copied_name HTTP/1.0 201 - - t 5 - db7282901da891bea2fcd73840caad1c tx3eb78865e3034b918a647-0068c570b5 - 0.0471 SSC - 1757769909.759577751 1757769909.806704521 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx92e7b3c27c804fd0a63e0-0068c570b5" "proxy-server 1824535" 0.0057 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx3e4637dbf4594894b70ae-0068c570b5" "proxy-server 1824535" 0.0029 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/1/a/5_oc_ascii/copied_name" 200 5 "GET http://localhost/v1/a/5_oc_ascii/copied_name" "tx131b2343dea54156b3e8e-0068c570b5" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii/copied_name HTTP/1.0 200 - - t - 5 - tx131b2343dea54156b3e8e-0068c570b5 - 0.0268 - - 1757769909.808605671 1757769909.835422516 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4336f7f6a7604eb48d85a-0068c570b5" "proxy-server 1824535" 0.0015 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx34873b3f723343348c7a3-0068c570b5" "proxy-server 1824535" 0.0015 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "POST http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txc4b7b8dc541c42aeb31f8-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "POST /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 202 76 "POST http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txc4b7b8dc541c42aeb31f8-0068c570b5" "proxy-server 1824535" 0.0124 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "POST http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txc4b7b8dc541c42aeb31f8-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "POST /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 202 76 "POST http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txc4b7b8dc541c42aeb31f8-0068c570b5" "proxy-server 1824535" 0.0184 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 POST /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 202 - - t - 76 - txc4b7b8dc541c42aeb31f8-0068c570b5 - 0.0484 - - 1757769909.837110043 1757769909.885557652 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa23b09b17a4e4cc1ac777-0068c570b5" "proxy-server 1824535" 0.0013 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "txeb4ad27ba386454da3218-0068c570b5" "proxy-server 1824535" 0.0071 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx3a390a1fb0714d279ac94-0068c570b5" "proxy-server 1824535" 0.0008 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx3a390a1fb0714d279ac94-0068c570b5 - 0.0269 - - 1757769909.891250372 1757769909.918137074 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3c0c223277724e878dbde-0068c570b5" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/2/a/5_oc_ascii" 200 326 "GET http://localhost/v1/a/5_oc_ascii?format=json&states=listing" "tx3c0c223277724e878dbde-0068c570b5" "proxy-server 1824535" 0.0078 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/09 GET /v1/a/5_oc_ascii%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 326 - tx3c0c223277724e878dbde-0068c570b5 - 0.0195 - - 1757769909.924027205 1757769909.943571806 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcb3cf917bcc54d8d92515-0068c570b5" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txcb3cf917bcc54d8d92515-0068c570b5 - 0.0135 VW - 1757769909.945514917 1757769909.958997250 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx4164ce0f71ea4d1986ba6-0068c570b5" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - tx4164ce0f71ea4d1986ba6-0068c570b5 - 0.0082 VW - 1757769909.959574461 1757769909.967757940 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/3/a/5_vc_non_ascii%C2%A3" 200 382 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?prefix=00f5_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "txc7a6dc41b3ae44dab4b4e-0068c570b5" "proxy-server 1824535" 0.0076 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/09 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fprefix%3D00f5_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 382 - txc7a6dc41b3ae44dab4b4e-0068c570b5 - 0.0153 VW - 1757769909.968360424 1757769909.983635426 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sda1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 200 5 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443?symlink=get" "txc7a525e20a2c41a98ce15-0068c570b5" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "GET /sdb1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 200 5 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443?symlink=get" "txc7a525e20a2c41a98ce15-0068c570b5" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 GET /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769909.41443%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txc7a525e20a2c41a98ce15-0068c570b5 - 0.0391 VW - 1757769909.984197378 1757769910.023337364 0 - (txn: tx1bc5e4a843a6429390292-0068c570b5) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx1bc5e4a843a6429390292-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx1bc5e4a843a6429390292-0068c570b5" "proxy-server 1824535" 0.0172 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx1bc5e4a843a6429390292-0068c570b5" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx1bc5e4a843a6429390292-0068c570b5" "proxy-server 1824535" 0.0200 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - 4c68cea7e58591b579fd074bcdaff740 tx1bc5e4a843a6429390292-0068c570b5 - 0.0433 VW - 1757769909.999400616 1757769910.042717695 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 204 - "DELETE http://localhost/sdb1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" "tx7d6fae171343486cac012-0068c570b6" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 204 - "DELETE http://localhost/sda1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" "tx7d6fae171343486cac012-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sda1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 204 - "DELETE http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" "tx7d6fae171343486cac012-0068c570b6" "proxy-server 1824535" 0.0099 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sdb1/0/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" 204 - "DELETE http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.41443" "tx7d6fae171343486cac012-0068c570b6" "proxy-server 1824535" 0.0159 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 DELETE /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769909.41443 HTTP/1.0 204 - Swift - - - - tx7d6fae171343486cac012-0068c570b6 - 0.0236 VW - 1757769910.043434858 1757769910.067020655 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe05c288baad2443dbefc1-0068c570b6" "proxy-server 1824535" 0.0056 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx2b28fface75e467f960aa-0068c570b6" "proxy-server 1824535" 0.0029 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txcb4dfe369e09402eb0b63-0068c570b6" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - txcb4dfe369e09402eb0b63-0068c570b6 - 0.0272 - - 1757769910.068827152 1757769910.096039772 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb6d43529276744138e9af-0068c570b6" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/3/a/5_vc_non_ascii%C2%A3" 200 191 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?prefix=00f5_o_non_ascii%C2%A3%2F&format=json&states=listing" "txb6d43529276744138e9af-0068c570b6" "proxy-server 1824535" 0.0091 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fprefix%3D00f5_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 191 - txb6d43529276744138e9af-0068c570b6 - 0.0293 - - 1757769910.097802401 1757769910.127151251 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx19e5421bbd114c54ad3b3-0068c570b6" "proxy-server 1824535" 0.0055 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx19e5421bbd114c54ad3b3-0068c570b6 - 0.0083 VW - 1757769910.129106283 1757769910.137372255 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx40127e04e3394eaa8a58f-0068c570b6" "proxy-server 1824535" 0.0015 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - tx40127e04e3394eaa8a58f-0068c570b6 - 0.0084 VW - 1757769910.137879372 1757769910.146263599 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/3/a/5_vc_non_ascii%C2%A3" 200 191 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?prefix=00f5_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "tx84d0a94d69d54ad48eb7f-0068c570b6" "proxy-server 1824535" 0.0085 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fprefix%3D00f5_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 191 - tx84d0a94d69d54ad48eb7f-0068c570b6 - 0.0121 VW - 1757769910.151043415 1757769910.163121462 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 200 5 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088?symlink=get" "txb69a09cb042247f49589f-0068c570b6" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 200 5 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088?symlink=get" "txb69a09cb042247f49589f-0068c570b6" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 GET /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769909.30088%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txb69a09cb042247f49589f-0068c570b6 - 0.0245 VW - 1757769910.163701773 1757769910.188248396 0 - (txn: txb24531d979724de7b7621-0068c570b6) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb24531d979724de7b7621-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb24531d979724de7b7621-0068c570b6" "proxy-server 1824535" 0.0239 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb24531d979724de7b7621-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb24531d979724de7b7621-0068c570b6" "proxy-server 1824535" 0.0216 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txb24531d979724de7b7621-0068c570b6 - 0.0305 VW - 1757769910.178883076 1757769910.209387064 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 204 - "DELETE http://localhost/sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" "txe36ddddfb06e41ebaa9ed-0068c570b6" "object-server 1824535" 0.0004 "-" 1824535 0 obj3 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sdi1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "tx68b1ecac503a47a3a485a-0068c570b5" "proxy-server 1824502" 0.0144 "-" 1824502 3 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:09 +0000] "PUT /sda1/1/a/ec-discon/test" 201 - "PUT http://localhost/sdh1/1/a/ec-discon/test" "tx68b1ecac503a47a3a485a-0068c570b5" "object-server 1824502" 0.0005 "-" 1824502 3 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a/ec-discon/test" 201 - "PUT http://localhost/sdg1/1/a/ec-discon/test" "tx68b1ecac503a47a3a485a-0068c570b5" "object-server 1824502" 0.0046 "-" 1824502 3 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdh1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "tx68b1ecac503a47a3a485a-0068c570b5" "proxy-server 1824502" 0.0285 "-" 1824502 3 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdg1/1/a/ec-discon/test" 201 - "PUT http://localhost/v1/a/ec-discon/test" "tx68b1ecac503a47a3a485a-0068c570b5" "proxy-server 1824502" 0.0299 "-" 1824502 3 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/ec-discon/test HTTP/1.0 201 - - t 65536 - - tx68b1ecac503a47a3a485a-0068c570b5 - 0.0669 - - 1757769909.939172506 1757769910.006034374 3 - proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) cont1 DEBUG: Could not load '/tmp/tmpsnqg2uij/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpsnqg2uij/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont1 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. cont2 DEBUG: Could not load '/tmp/tmpsnqg2uij/tmp_test_proxy_server_chunked/container-sync-realms.conf': [Errno 2] No such file or directory: '/tmp/tmpsnqg2uij/tmp_test_proxy_server_chunked/container-sync-realms.conf' cont2 WARNING: Option allow_versions is deprecated. Configure the versioned_writes middleware in the proxy-server instead. This option will be ignored in a future release. obj1 DEBUG: Labeled statsd mode: disabled (obj1) obj2 DEBUG: Labeled statsd mode: disabled (obj2) obj3 DEBUG: Labeled statsd mode: disabled (obj3) obj4 DEBUG: Labeled statsd mode: disabled (obj4) obj5 DEBUG: Labeled statsd mode: disabled (obj5) obj6 DEBUG: Labeled statsd mode: disabled (obj6) proxy DEBUG: Labeled statsd mode: disabled (proxy) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a" 201 - "-" "test" "-" 0.0070 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a" 201 - "-" "test" "-" 0.0070 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a1" 201 - "-" "test" "-" 0.0069 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a1" 201 - "-" "test" "-" 0.0069 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx472a87807bd34219bd018-0068c570b6" "proxy-server 1824502" 0.0010 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://127.0.0.1:44059/sda1/1/a/c" "tx472a87807bd34219bd018-0068c570b6" "container-server 1824502" 0.0010 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://127.0.0.1:39613/sdb1/1/a/c" "tx472a87807bd34219bd018-0068c570b6" "container-server 1824502" 0.0011 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx472a87807bd34219bd018-0068c570b6" "proxy-server 1824502" 0.0166 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a/c" 201 - "PUT http://localhost/v1/a/c" "tx472a87807bd34219bd018-0068c570b6" "proxy-server 1824502" 0.0257 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/c HTTP/1.0 201 - - t - - - tx472a87807bd34219bd018-0068c570b6 - 0.0409 - - 1757769910.129725933 1757769910.170593739 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/2/a1" 204 - "HEAD http://localhost/v1/a1?format=json" "tx059654faf02f46eeb66b0-0068c570b6" "proxy-server 1824502" 0.0054 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a1/c1" 201 - "PUT http://127.0.0.1:39613/sdb1/1/a1/c1" "tx059654faf02f46eeb66b0-0068c570b6" "container-server 1824502" 0.0010 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a1/c1" 201 - "PUT http://127.0.0.1:44059/sda1/1/a1/c1" "tx059654faf02f46eeb66b0-0068c570b6" "container-server 1824502" 0.0010 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx059654faf02f46eeb66b0-0068c570b6" "proxy-server 1824502" 0.0167 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a1/c1" 201 - "PUT http://localhost/v1/a1/c1" "tx059654faf02f46eeb66b0-0068c570b6" "proxy-server 1824502" 0.0318 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a1/c1 HTTP/1.0 201 - - t - - - tx059654faf02f46eeb66b0-0068c570b6 - 0.0473 - - 1757769910.176181793 1757769910.223472834 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx30e9b3caf18048deac047-0068c570b6" "proxy-server 1824502" 0.0019 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a/c1" 201 - "PUT http://127.0.0.1:44059/sda1/2/a/c1" "tx30e9b3caf18048deac047-0068c570b6" "container-server 1824502" 0.0059 "-" 1824502 1 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a/c1" 201 - "PUT http://127.0.0.1:39613/sdb1/2/a/c1" "tx30e9b3caf18048deac047-0068c570b6" "container-server 1824502" 0.0010 "-" 1824502 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx30e9b3caf18048deac047-0068c570b6" "proxy-server 1824502" 0.0295 "-" 1824502 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/c1" 201 - "PUT http://localhost/v1/a/c1" "tx30e9b3caf18048deac047-0068c570b6" "proxy-server 1824502" 0.0219 "-" 1824502 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/c1 HTTP/1.0 201 - - t - - - tx30e9b3caf18048deac047-0068c570b6 - 0.0555 - - 1757769910.224881172 1757769910.280396700 1 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfee99e7c53a744eba2713-0068c570b6" "proxy-server 1824502" 0.0019 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://127.0.0.1:39613/sdb1/1/a/c2" "txfee99e7c53a744eba2713-0068c570b6" "container-server 1824502" 0.0010 "-" 1824502 2 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://127.0.0.1:44059/sda1/1/a/c2" "txfee99e7c53a744eba2713-0068c570b6" "container-server 1824502" 0.0016 "-" 1824502 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txfee99e7c53a744eba2713-0068c570b6" "proxy-server 1824502" 0.0168 "-" 1824502 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a/c2" 201 - "PUT http://localhost/v1/a/c2" "txfee99e7c53a744eba2713-0068c570b6" "proxy-server 1824502" 0.0257 "-" 1824502 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/c2 HTTP/1.0 201 - - t - - - txfee99e7c53a744eba2713-0068c570b6 - 0.0459 - - 1757769910.281833410 1757769910.327721119 2 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx261e99c14eda4a1191364-0068c570b6" "proxy-server 1824502" 0.0019 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txd71ec1f0fb0846bc9719a-0068c570b6" "proxy-server 1824502" 0.0012 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 204 - "DELETE http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" "txe36ddddfb06e41ebaa9ed-0068c570b6" "proxy-server 1824535" 0.0098 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 204 - "DELETE http://localhost/sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" "txe36ddddfb06e41ebaa9ed-0068c570b6" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" 204 - "DELETE http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769909.30088" "txe36ddddfb06e41ebaa9ed-0068c570b6" "proxy-server 1824535" 0.0071 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 DELETE /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769909.30088 HTTP/1.0 204 - Swift - - - - txe36ddddfb06e41ebaa9ed-0068c570b6 - 0.0254 VW - 1757769910.209923744 1757769910.235287189 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx13337357ec5347318b87f-0068c570b6" "proxy-server 1824535" 0.0055 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx7aef0c36ed874d72a249e-0068c570b6" "proxy-server 1824535" 0.0079 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx5b660f42427e4bd8b23b5-0068c570b6" "proxy-server 1824535" 0.0006 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 200 - - t - 5 - tx5b660f42427e4bd8b23b5-0068c570b6 - 0.0273 - - 1757769910.237081289 1757769910.264364243 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3fb9f10a6553412bb9611-0068c570b6" "proxy-server 1824535" 0.0014 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/3/a/5_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?prefix=00f5_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx3fb9f10a6553412bb9611-0068c570b6" "proxy-server 1824535" 0.0090 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fprefix%3D00f5_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx3fb9f10a6553412bb9611-0068c570b6 - 0.0373 - - 1757769910.266103029 1757769910.303401947 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4e16143c6a3b44c0a48a4-0068c570b6" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/3/a/5_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?prefix=00f5_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx4e16143c6a3b44c0a48a4-0068c570b6" "proxy-server 1824535" 0.0078 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fprefix%3D00f5_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 2 - tx4e16143c6a3b44c0a48a4-0068c570b6 - 0.0238 - - 1757769910.305387497 1757769910.329201221 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0e2929c533eb4fcaa8fdd-0068c570b6" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx0e2929c533eb4fcaa8fdd-0068c570b6 - 0.0083 VW - 1757769910.335368872 1757769910.343693018 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "txfed02f10f0cf4a7ab02ba-0068c570b6" "proxy-server 1824535" 0.0056 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - txfed02f10f0cf4a7ab02ba-0068c570b6 - 0.0083 VW - 1757769910.344235420 1757769910.352579832 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/3/a/5_vc_non_ascii%C2%A3" 200 2 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?prefix=00f5_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "tx0b888d4a8238449ba5b7b-0068c570b6" "proxy-server 1824535" 0.0022 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fprefix%3D00f5_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 2 - tx0b888d4a8238449ba5b7b-0068c570b6 - 0.0141 VW - 1757769910.353226662 1757769910.367354870 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txe2935fef4372463fadb70-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txe2935fef4372463fadb70-0068c570b6" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txe2935fef4372463fadb70-0068c570b6" "proxy-server 1824535" 0.0108 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "DELETE /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 204 - "DELETE http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txe2935fef4372463fadb70-0068c570b6" "proxy-server 1824535" 0.0062 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 DELETE /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 204 - - t - - - txe2935fef4372463fadb70-0068c570b6 - 0.0190 - - 1757769910.367851496 1757769910.386893988 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txecd2453117f74730a0cd3-0068c570b6" "proxy-server 1824535" 0.0057 "-" 1824535 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx02192c5832b7498787e76-0068c570b6" "proxy-server 1824535" 0.0071 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx059c1bfecfd74afa861b6-0068c570b6" "proxy-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx059c1bfecfd74afa861b6-0068c570b6" "proxy-server 1824535" 0.0005 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 404 - - t - 70 - tx059c1bfecfd74afa861b6-0068c570b6 - 0.0331 - - 1757769910.391932487 1757769910.425005913 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe11a058fb1f1400dbbc52-0068c570b6" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txe11a058fb1f1400dbbc52-0068c570b6 - 0.0042 VW - 1757769910.437109232 1757769910.441352606 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "txfe1b3f6d294a491f84e12-0068c570b6" "proxy-server 1824535" 0.0014 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - txfe1b3f6d294a491f84e12-0068c570b6 - 0.0122 VW - 1757769910.441872358 1757769910.454096317 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx5eaa4e7121934186a6f23-0068c570b6" "proxy-server 1824535" 0.0005 "-" 1824535 0/usr/lib/python3.13/unittest/case.py:597: RuntimeWarning: TestResult has no addDuration method warnings.warn("TestResult has no addDuration method", cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a/c/o.large" 201 - "PUT http://localhost/sdb1/2/a/c/o.large" "txcaf6c10639c4459894aba-0068c570b6" "object-server 1824502" 0.0005 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a/c/o.large" 201 - "PUT http://localhost/sda1/2/a/c/o.large" "txcaf6c10639c4459894aba-0068c570b6" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/c/o.large" 201 - "PUT http://localhost/v1/a/c/o.large" "txcaf6c10639c4459894aba-0068c570b6" "proxy-server 1824502" 0.0223 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/c/o.large" 201 - "PUT http://localhost/v1/a/c/o.large" "txcaf6c10639c4459894aba-0068c570b6" "proxy-server 1824502" 0.0405 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/c/o.large HTTP/1.0 201 - - t 131072 - - txcaf6c10639c4459894aba-0068c570b6 - 0.0705 - - 1757769910.329439640 1757769910.399897337 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbd63523fc0ff43f38e2bf-0068c570b6" "proxy-server 1824502" 0.0019 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx43f5b2b9a53f45c48975d-0068c570b6" "proxy-server 1824502" 0.0077 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "tx400263ac174541b485b4a-0068c570b6" "proxy-server 1824502" 0.0011 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - tx400263ac174541b485b4a-0068c570b6 - 0.0280 - - 1757769910.401400089 1757769910.429427147 0 - Run 00 took 000.030 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4dfb779b61904d90a107f-0068c570b6" "proxy-server 1824502" 0.0012 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txb17a1c47de8d49b388fa9-0068c570b6" "proxy-server 1824502" 0.0012 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "txd9fa11b2cfcf44608a8e7-0068c570b6" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - txd9fa11b2cfcf44608a8e7-0068c570b6 - 0.0247 - - 1757769910.435222626 1757769910.459908009 0 - Run 01 took 000.031 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc61c6df99f634380b06ac-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx4d57799eb0c84bfa98ecf-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "txd08cb5d7b1214c998b60c-0068c570b6" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - txd08cb5d7b1214c998b60c-0068c570b6 - 0.0326 - - 1757769910.461533070 1757769910.494112253 0 - Run 02 took 000.038 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1b73463622cd492b9734d-0068c570b6" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txb26d8af5c92d4cf39bb17-0068c570b6" "proxy-server 1824502" 0.0067 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "tx050df6f3508241d4b514f-0068c570b6" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - tx050df6f3508241d4b514f-0068c570b6 - 0.0260 - - 1757769910.499838829 1757769910.525836468 0 - Run 03 took 000.028 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx034ca59b89ba4c79b9595-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txc9a35ef2fa7340c69df1c-0068c570b6" "proxy-server 1824502" 0.0056 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "tx83d60c206ed341cba27cd-0068c570b6" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - tx83d60c206ed341cba27cd-0068c570b6 - 0.0251 - - 1757769910.531628132 1757769910.556680918 0 - Run 04 took 000.031 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcce0eee3a28941128791e-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txc38aa8992adf410cb22a4-0068c570b6" "proxy-server 1824502" 0.0014 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "txf68eb269a7de44a38dd4b-0068c570b6" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - txf68eb269a7de44a38dd4b-0068c570b6 - 0.0290 - - 1757769910.558300495 1757769910.587332249 0 - Run 05 took 000.031 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc47b8f822b584d72b755a-0068c570b6" "proxy-server 1824502" 0.0055 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txc3182abde5a9457fab814-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "tx336751a5786a424cbb227-0068c570b6" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - tx336751a5786a424cbb227-0068c570b6 - 0.0246 - - 1757769910.588933945 1757769910.613530397 0 - Run 06 took 000.026 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7472c5cb9e0d4cbfb1680-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx1be5cfe64718480397c8f-0068c570b6" "proxy-server 1824502" 0.0012 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "tx50af9d56b92748b3ad016-0068c570b6" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - tx50af9d56b92748b3ad016-0068c570b6 - 0.0249 - - 1757769910.619214535 1757769910.644106150 0 - Run 07 took 000.031 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa6e3295bfdd24b389388d-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txb97afa6d2ff84e07b55d6-0068c570b6" "proxy-server 1824502" 0.0014 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "tx8a94b65ae4ce4f44b3e81-0068c570b6" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - tx8a94b65ae4ce4f44b3e81-0068c570b6 - 0.0293 - - 1757769910.645706177 1757769910.674997807 0 -test.unit.proxy.test_server.TestProxyObjectPerformance.test_GET_debug_large_file test.unit.proxy.test_server.TestProxyObjectPerformance.test_GET_debug_large_file ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_CORS_expose_headers test.unit.proxy.test_server.TestReplicatedObjectController.test_CORS_expose_headers ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_CORS_valid_non_strict test.unit.proxy.test_server.TestReplicatedObjectController.test_CORS_valid_non_strict ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_CORS_valid_strict test.unit.proxy.test_server.TestReplicatedObjectController.test_CORS_valid_strict ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_CORS_valid_with_obj_headers test.unit.proxy.test_server.TestReplicatedObjectController.test_CORS_valid_with_obj_headers ... ok obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 404 70 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx5eaa4e7121934186a6f23-0068c570b6" "proxy-server 1824535" 0.0005 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx5eaa4e7121934186a6f23-0068c570b6 - 0.0103 VW - 1757769910.458806038 1757769910.469132662 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx3e4ca8e1d96d4f3cb93cd-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx3e4ca8e1d96d4f3cb93cd-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx3e4ca8e1d96d4f3cb93cd-0068c570b6" "proxy-server 1824535" 0.0158 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx3e4ca8e1d96d4f3cb93cd-0068c570b6" "proxy-server 1824535" 0.0175 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx3e4ca8e1d96d4f3cb93cd-0068c570b6 - 0.0297 - - 1757769910.469520569 1757769910.499192238 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0a1ab21041c34727987e0-0068c570b6" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx0a1ab21041c34727987e0-0068c570b6 - 0.0083 VW - 1757769910.511170149 1757769910.519513369 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx17c03e7cd2d643b1a8b93-0068c570b6" "proxy-server 1824535" 0.0069 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - tx17c03e7cd2d643b1a8b93-0068c570b6 - 0.0098 VW - 1757769910.520061970 1757769910.529868364 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx73a8e82f876848c789352-0068c570b6" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx73a8e82f876848c789352-0068c570b6" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx73a8e82f876848c789352-0068c570b6 - 0.0234 VW - 1757769910.530465603 1757769910.553877592 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/3/a/5_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/5_vc_non_ascii%C2%A3" "txa289ddfc81954b0eb108e-0068c570b6" "proxy-server 1824535" 0.0015 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.47004" 201 - "PUT http://localhost/sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.47004" "txbd2d892209724b0882652-0068c570b6" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.47004" 201 - "PUT http://localhost/sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.47004" "txbd2d892209724b0882652-0068c570b6" "object-server 1824535" 0.0046 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.47004" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.47004" "txbd2d892209724b0882652-0068c570b6" "proxy-server 1824535" 0.0128 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.47004" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.47004" "txbd2d892209724b0882652-0068c570b6" "proxy-server 1824535" 0.0187 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 PUT /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769910.47004 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txbd2d892209724b0882652-0068c570b6 - 0.0358 VW - 1757769910.554512739 1757769910.590319633 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txafb453ff4e974dac91a56-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txafb453ff4e974dac91a56-0068c570b6" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txafb453ff4e974dac91a56-0068c570b6" "proxy-server 1824535" 0.0128 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txafb453ff4e974dac91a56-0068c570b6" "proxy-server 1824535" 0.0186 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - txafb453ff4e974dac91a56-0068c570b6 - 0.0225 - - 1757769910.595012665 1757769910.617523670 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc86bba521724494aa2ac8-0068c570b6" "proxy-server 1824535" 0.0058 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txc86bba521724494aa2ac8-0068c570b6 - 0.0087 VW - 1757769910.631805182 1757769910.640546799 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx92a5361dc7e9451c92d6c-0068c570b6" "proxy-server 1824535" 0.0029 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - tx92a5361dc7e9451c92d6c-0068c570b6 - 0.0141 VW - 1757769910.641149044 1757769910.655204773 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "txe8dba11513e344aea3375-0068c570b6" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "txe8dba11513e344aea3375-0068c570b6" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - txe8dba11513e344aea3375-0068c570b6 - 0.0150 VW - 1757769910.655837774 1757769910.670847178 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/3/a/5_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/5_vc_non_ascii%C2%A3" "txfe66ef415e2c4a7c901ef-0068c570b6" "proxy-server 1824535" 0.0070 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.59561" 201 - "PUT http://localhost/sdb1/1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.59561" "txab6b9cf122cb4a109f10a-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0test.unit.proxy.test_server.TestReplicatedObjectController.test_DELETE test.unit.proxy.test_server.TestReplicatedObjectController.test_DELETE ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_DELETE_x_container_headers_with_more_container_replicas test.unit.proxy.test_server.TestReplicatedObjectController.test_DELETE_x_container_headers_with_more_container_replicas ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_bad_range_zero_byte test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_bad_range_zero_byte ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_calls_authorize test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_calls_authorize ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.59561" 201 - "PUT http://localhost/sda1/1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.59561" "txab6b9cf122cb4a109f10a-0068c570b6" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.59561" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.59561" "txab6b9cf122cb4a109f10a-0068c570b6" "proxy-server 1824535" 0.0157 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.59561" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.59561" "txab6b9cf122cb4a109f10a-0068c570b6" "proxy-server 1824535" 0.0154 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 PUT /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769910.59561 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e txab6b9cf122cb4a109f10a-0068c570b6 - 0.0346 VW - 1757769910.671553612 1757769910.706173897 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx6317165e29f64b41b3d19-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx6317165e29f64b41b3d19-0068c570b6" "proxy-server 1824535" 0.0177 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx6317165e29f64b41b3d19-0068c570b6" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx6317165e29f64b41b3d19-0068c570b6" "proxy-server 1824535" 0.0147 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t - - - tx6317165e29f64b41b3d19-0068c570b6 - 0.0331 - - 1757769910.710708380 1757769910.743782997 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2779694c8dae4c01aa396-0068c570b6" "proxy-server 1824535" 0.0014 "-" 1824535 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/3/a/5_vc_non_ascii%C2%A3" 200 382 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?prefix=00f5_o_non_ascii%C2%A3%2F&format=json&states=listing" "tx2779694c8dae4c01aa396-0068c570b6" "proxy-server 1824535" 0.0078 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fprefix%3D00f5_o_non_ascii%25C2%25A3%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 382 - tx2779694c8dae4c01aa396-0068c570b6 - 0.0238 - - 1757769910.745438814 1757769910.769243479 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx24ae708237b441e3b9b24-0068c570b6" "proxy-server 1824535" 0.0013 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx24ae708237b441e3b9b24-0068c570b6 - 0.0062 VW - 1757769910.775684118 1757769910.781900406 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "tx5a39e2f7b7ae43df80491-0068c570b6" "proxy-server 1824535" 0.0029 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - tx5a39e2f7b7ae43df80491-0068c570b6 - 0.0166 VW - 1757769910.782463074 1757769910.799063444 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx63c57307a9164d3894b6b-0068c570b6" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 - "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "tx63c57307a9164d3894b6b-0068c570b6" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - - - tx63c57307a9164d3894b6b-0068c570b6 - 0.0109 VW - 1757769910.799659729 1757769910.810561180 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/3/a/5_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/5_vc_non_ascii%C2%A3" "txa177d157a4f24c439a2ad-0068c570b6" "proxy-server 1824535" 0.0072 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.71146" 201 - "PUT http://localhost/sdb1/2/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.71146" "tx96c44093f44b4da39b376-0068c570b6" "object-server 1824535" 0.0004 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.71146" 201 - "PUT http://localhost/sda1/2/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.71146" "tx96c44093f44b4da39b376-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.71146" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.71146" "tx96c44093f44b4da39b376-0068c570b6" "proxy-server 1824535" 0.0155 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.71146" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.71146" "tx96c44093f44b4da39b376-0068c570b6" "proxy-server 1824535" 0.0170 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 PUT /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769910.71146 HTTP/1.0 201 - Swift - - - d41d8cd98f00b204e9800998ecf8427e tx96c44093f44b4da39b376-0068c570b6 - 0.0397 VW - 1757769910.815439939 1757769910.855160475 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx91ce55d66aab48149a9ee-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx91ce55d66aab48149a9ee-0068c570b6" "proxy-server 1824535" 0.0107 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx91ce55d66aab48149a9ee-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "tx91ce55d66aab48149a9ee-0068c570b6" "proxy-server 1824535" 0.0201 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - tx91ce55d66aab48149a9ee-0068c570b6 - 0.0281 - - 1757769910.855679035 1757769910.883732080 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txca42005ad81d408c9692b-0068c570b6" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txca42005ad81d408c9692b-0068c570b6 - 0.0082 VW - 1757769910.885465384 1757769910.893708229 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "txd624f2ae029a47a887d2b-0068c570b6" "proxy-server 1824535" 0.0080 "-" 1824535 0test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_newest test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_newest ... ok Run 08 took 000.034 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2409e70496e14178ae1c4-0068c570b6" "proxy-server 1824502" 0.0095 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx08809250fa92499b82eab-0068c570b6" "proxy-server 1824502" 0.0092 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/c/o.large" 200 131072 "GET http://localhost/v1/a/c/o.large" "tx9cb5197a6a5d42c8a3521-0068c570b6" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 GET /v1/a/c/o.large HTTP/1.0 200 - - t - 131072 - tx9cb5197a6a5d42c8a3521-0068c570b6 - 0.0327 - - 1757769910.680099726 1757769910.712795734 0 - Run 09 took 000.034 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 500 Trying to DELETE /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx589555a7b46b4bff909a0-0068c570b6) proxy-ut ERROR: ERROR 500 Trying to DELETE /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txfb70b6b3ecd140ffa34d0-0068c570b6) proxy-ut ERROR: ERROR 500 Trying to DELETE /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txfb70b6b3ecd140ffa34d0-0068c570b6) proxy-ut ERROR: Object DELETE returning 503 for (204, 503, 503) (txn: txfb70b6b3ecd140ffa34d0-0068c570b6) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txddb8e96333a741d18ced4-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx562c751b9b654bfea05a0-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/1/a/c/o.zerobyte" 201 - "PUT http://localhost/sdb1/0/a/c/o.zerobyte" "txbcd08ebe8b2745309ed3d-0068c570b6" "object-server 1824502" 0.0005 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/1/a/c/o.zerobyte" 201 - "PUT http://localhost/sda1/0/a/c/o.zerobyte" "txbcd08ebe8b2745309ed3d-0068c570b6" "object-server 1824502" 0.0005 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/0/a/c/o.zerobyte" 201 - "PUT http://localhost/v1/a/c/o.zerobyte" "txbcd08ebe8b2745309ed3d-0068c570b6" "proxy-server 1824502" 0.0144 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/0/a/c/o.zerobyte" 201 - "PUT http://localhost/v1/a/c/o.zerobyte" "txbcd08ebe8b2745309ed3d-0068c570b6" "proxy-server 1824502" 0.0142 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/c/o.zerobyte HTTP/1.0 201 - - t - - - txbcd08ebe8b2745309ed3d-0068c570b6 - 0.0267 - - 1757769910.841929913 1757769910.868654490 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe2a571d876bc4626a3a15-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx1233ca03a97a4f8ca73aa-0068c570b6" "proxy-server 1824502" 0.0024 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/0/a/c/o.zerobyte" 200 - "GET http://localhost/v1/a/c/o.zerobyte" "tx1333a65cd6514828a6a72-0068c570b6" "proxy-server 1824502" 0.0007 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2f142518948e4f5e8bd39-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx0f5a4b09189f4624a99ac-0068c570b6" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/0/a/c/o.zerobyte" 200 - "GET http://localhost/v1/a/c/o.zerobyte" "tx3a7a8e1271174a95ae768-0068c570b6" "proxy-server 1824502" 0.0010 "-" 1824502 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx5189a2f65d114a4fae997-0068c570b6) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx0a9144c2e1a042dfabc4d-0068c570b6) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx8a5568933f7c49c5b642f-0068c570b6) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx834400d6a04e485baf69f-0068c570b6) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx94e4c4a3843c4a3481cd1-0068c570b6) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx4a68b24e21bf45d8a3bbe-0068c570b6) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_newest_large_file test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_newest_large_file ... ok proxy INFO: - - 13/Sep/2025/13/25/10 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - txd624f2ae029a47a887d2b-0068c570b6 - 0.0150 VW - 1757769910.894206524 1757769910.909171343 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "txa5397b541c8943cb873fd-0068c570b6" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "GET /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 200 5 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3?symlink=get" "txa5397b541c8943cb873fd-0068c570b6" "proxy-server 1824535" 0.0048 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/3/a/5_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/5_vc_non_ascii%C2%A3" "tx8fc4142c5dbf428fb43be-0068c570b6" "proxy-server 1824535" 0.0099 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txa5397b541c8943cb873fd-0068c570b6 - 0.0370 VW - 1757769910.909769773 1757769910.946727514 0 - (txn: txc22e47407e5542a1bd08b-0068c570b6) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 201 - "PUT http://localhost/sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" "txc22e47407e5542a1bd08b-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 201 - "PUT http://localhost/sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" "txc22e47407e5542a1bd08b-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" "txc22e47407e5542a1bd08b-0068c570b6" "proxy-server 1824535" 0.0164 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" "txc22e47407e5542a1bd08b-0068c570b6" "proxy-server 1824535" 0.0181 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/10 PUT /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769910.85626 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txc22e47407e5542a1bd08b-0068c570b6 - 0.0436 VW - 1757769910.920764923 1757769910.964328051 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txe64d09b4bae04f8095039-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txe64d09b4bae04f8095039-0068c570b6" "proxy-server 1824535" 0.0099 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txe64d09b4bae04f8095039-0068c570b6" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txe64d09b4bae04f8095039-0068c570b6" "proxy-server 1824535" 0.0168 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/10 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - - t 5 - - txe64d09b4bae04f8095039-0068c570b6 - 0.0257 - - 1757769910.964854240 1757769910.990545750 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx96f11013513544bf9f3b0-0068c570b6" "proxy-server 1824535" 0.0056 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx96f11013513544bf9f3b0-0068c570b6 - 0.0084 VW - 1757769910.996517181 1757769911.004946709 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "txab7fe5b83675430194630-0068c570b7" "proxy-server 1824535" 0.0027 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - txab7fe5b83675430194630-0068c570b7 - 0.0097 VW - 1757769911.005473852 1757769911.015165091 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 404 70 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub?symlink=get" "tx15ed0ccf6f1145679f66f-0068c570b7" "proxy-server 1824535" 0.0111 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 404 70 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub?symlink=get" "tx15ed0ccf6f1145679f66f-0068c570b7" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3/sub%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx15ed0ccf6f1145679f66f-0068c570b7 - 0.0210 VW - 1757769911.015802860 1757769911.036767960 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sda1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" "tx6a876dd164fb4802a50c4-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" "tx6a876dd164fb4802a50c4-0068c570b7" "proxy-server 1824535" 0.0098 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sdb1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" "tx6a876dd164fb4802a50c4-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" "tx6a876dd164fb4802a50c4-0068c570b7" "proxy-server 1824535" 0.0168 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/11 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3/sub HTTP/1.0 201 - - t 4 - - tx6a876dd164fb4802a50c4-0068c570b7 - 0.0253 - - 1757769911.037174225 1757769911.062508583 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8e86c6097a8548f8b2bc4-0068c570b7" "proxy-server 1824535" 0.0058 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx8e86c6097a8548f8b2bc4-0068c570b7 - 0.0086 VW - 1757769911.068456650 1757769911.077073336 - - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "txa73d5ccd659945f2b8353-0068c570b7" "proxy-server 1824535" 0.0026 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - txa73d5ccd659945f2b8353-0068c570b7 - 0.0096 VW - 1757769911.077583790 1757769911.087167263 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 200 4 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub?symlink=get" "tx84e07966f90541549354d-0068c570b7" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 200 4 "GET http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub?symlink=get" "tx84e07966f90541549354d-0068c570b7" "proxy-server 1824535" 0.0007 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/3/a/5_vc_non_ascii%C2%A3" 204 - "HEAD http://localhost/v1/a/5_vc_non_ascii%C2%A3" "txdc6f6e66cdbe4802b6a5e-0068c570b7" "proxy-server 1824535" 0.0077 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 GET /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3/sub%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 4 - tx84e07966f90541549354d-0068c570b7 - 0.0391 VW - 1757769911.087777615 1757769911.126860142 0 - (txn: tx3b4f9dfa0815468dac266-0068c570b7) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/0135_o_non_ascii%C2%A3/sub/1757769911.03769" 201 - "PUT http://localhost/sda1/3/a/5_vc_non_ascii%C2%A3/0135_o_non_ascii%C2%A3/sub/1757769911.03769" "tx3b4f9dfa0815468dac266-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/0135_o_non_ascii%C2%A3/sub/1757769911.03769" 201 - "PUT http://localhost/sdb1/3/a/5_vc_non_ascii%C2%A3/0135_o_non_ascii%C2%A3/sub/1757769911.03769" "tx3b4f9dfa0815468dac266-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/3/a/5_vc_non_ascii%C2%A3/0135_o_non_ascii%C2%A3/sub/1757769911.03769" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/0135_o_non_ascii%C2%A3/sub/1757769911.03769" "tx3b4f9dfa0815468dac266-0068c570b7" "proxy-server 1824535" 0.0168 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/3/a/5_vc_non_ascii%C2%A3/0135_o_non_ascii%C2%A3/sub/1757769911.03769" 201 - "PUT http://localhost/v1/a/5_vc_non_ascii%C2%A3/0135_o_non_ascii%C2%A3/sub/1757769911.03769" "tx3b4f9dfa0815468dac266-0068c570b7" "proxy-server 1824535" 0.0227 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 PUT /v1/a/5_vc_non_ascii%25C2%25A3/0135_o_non_ascii%25C2%25A3/sub/1757769911.03769 HTTP/1.0 201 - Swift - 4 - 1b52eb8ef2c1875cfdf3ffbe9e3c05da tx3b4f9dfa0815468dac266-0068c570b7 - 0.0421 VW - 1757769911.102809191 1757769911.144898415 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sdb1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" "tx592503fa4d6e44b9ab265-0068c570b7" "object-server 1824535" 0.0047 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/sda1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" "tx592503fa4d6e44b9ab265-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" "tx592503fa4d6e44b9ab265-0068c570b7" "proxy-server 1824535" 0.0172 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3/sub" "tx592503fa4d6e44b9ab265-0068c570b7" "proxy-server 1824535" 0.0166 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/11 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3/sub HTTP/1.0 201 - - t 4 - - tx592503fa4d6e44b9ab265-0068c570b7 - 0.0303 - - 1757769911.145416498 1757769911.175759792 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5224a542ef084ddcb5454-0068c570b7" "proxy-server 1824535" 0.0014 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx5224a542ef084ddcb5454-0068c570b7 - 0.0084 VW - 1757769911.177529812 1757769911.185976982 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/2/a/5_oc_ascii" 204 - "HEAD http://localhost/v1/a/5_oc_ascii" "txdeb5d99fcbb94dc387a20-0068c570b7" "proxy-server 1824535" 0.0028 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a/5_oc_ascii HTTP/1.0 204 - Swift - - - - txdeb5d99fcbb94dc387a20-0068c570b7 - 0.0099 VW - 1757769911.186488628 1757769911.196362972 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/3/a/5_vc_non_ascii%C2%A3" 200 764 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?prefix=00f5_o_non_ascii%C2%A3%2F&marker=&reverse=on&format=json&states=listing" "tx2921897d7e7143e9bf392-0068c570b7" "proxy-server 1824535" 0.0090 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fprefix%3D00f5_o_non_ascii%25C2%25A3%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - Swift - - 764 - tx2921897d7e7143e9bf392-0068c570b7 - 0.0166 VW - 1757769911.196985245 1757769911.213575602 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 200 5 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626?symlink=get" "txf482c8029eed45ddaaff8-0068c570b7" "proxy-server 1824535" 0.0007 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 200 5 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626?symlink=get" "txf482c8029eed45ddaaff8-0068c570b7" "proxy-server 1824535" 0.0007 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 GET /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769910.85626%3Fsymlink%3Dget HTTP/1.0 200 - Swift - - 5 - txf482c8029eed45ddaaff8-0068c570b7 - 0.0315 VW - 1757769911.214136839 1757769911.245675325 0 - (txn: txb14e584e165c48a4b1876-0068c570b7) cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb14e584e165c48a4b1876-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb14e584e165c48a4b1876-0068c570b7" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb14e584e165c48a4b1876-0068c570b7" "proxy-server 1824535" 0.0206 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/2/a/5_oc_ascii/5_o_non_ascii%C2%A3" 201 - "PUT http://localhost/v1/a/5_oc_ascii/5_o_non_ascii%C2%A3" "txb14e584e165c48a4b1876-0068c570b7" "proxy-server 1824535" 0.0134 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 PUT /v1/a/5_oc_ascii/5_o_non_ascii%25C2%25A3 HTTP/1.0 201 - Swift - 5 - dcddb75469b4b4875094e14561e573d8 txb14e584e165c48a4b1876-0068c570b7 - 0.0334 VW - 1757769911.229445457 1757769911.262853622 0 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "DELETE /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 204 - "DELETE http://localhost/sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" "txda162a6dc5194e3f96944-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "DELETE /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 204 - "DELETE http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" "txda162a6dc5194e3f96944-0068c570b7" "proxy-server 1824535" 0.0144 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "DELETE /sdb1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 204 - "DELETE http://localhost/sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" "txda162a6dc5194e3f96944-0068c570b7" "object-server 1824535" 0.0004 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "DELETE /sda1/3/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" 204 - "DELETE http://localhost/v1/a/5_vc_non_ascii%C2%A3/00f5_o_non_ascii%C2%A3/1757769910.85626" "txda162a6dc5194e3f96944-0068c570b7" "proxy-server 1824535" 0.0123 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 DELETE /v1/a/5_vc_non_ascii%25C2%25A3/00f5_o_non_ascii%25C2%25A3/1757769910.85626 HTTP/1.0 204 - Swift - - - - txda162a6dc5194e3f96944-0068c570b7 - 0.0216 VW - 1757769911.263500214 1757769911.285085678 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6588f09c52134159ab9cb-0068c570b7" "proxy-server 1824535" 0.0015 "-" 1824535 -test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_pipeline test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_pipeline ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1343f1abfc1844c9a6405-0068c570b6" "proxy-server 1824502" 0.0055 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:10 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txbc83d052a72b480a90758-0068c570b6" "proxy-server 1824502" 0.0065 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/c/o.large" 201 - "PUT http://localhost/sdb1/2/a/c/o.large" "txe5858093cd3a432f9b5e9-0068c570b6" "object-server 1824502" 0.0004 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/c/o.large" 201 - "PUT http://localhost/sda1/2/a/c/o.large" "txe5858093cd3a432f9b5e9-0068c570b6" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/2/a/c/o.large" 201 - "PUT http://localhost/v1/a/c/o.large" "txe5858093cd3a432f9b5e9-0068c570b6" "proxy-server 1824502" 0.0218 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/2/a/c/o.large" 201 - "PUT http://localhost/v1/a/c/o.large" "txe5858093cd3a432f9b5e9-0068c570b6" "proxy-server 1824502" 0.0208 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/11 PUT /v1/a/c/o.large HTTP/1.0 201 - - t 1048576 - - txe5858093cd3a432f9b5e9-0068c570b6 - 0.0473 - - 1757769910.980304718 1757769911.027610064 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf72006af36504b0b9bd17-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txf1fc5801f28a4b24b45fb-0068c570b7" "proxy-server 1824502" 0.0025 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/2/a/c/o.large" 200 1048576 "GET http://localhost/v1/a/c/o.large" "tx0d1f7eb2add64a9d95536-0068c570b7" "proxy-server 1824502" 0.0006 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/2/a/c/o.large" 200 1048576 "GET http://localhost/v1/a/c/o.large" "tx0d1f7eb2add64a9d95536-0068c570b7" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: (1824502) wsgi starting up on http://127.0.0.1:35271 proxy DEBUG: (1824502) accepted ('127.0.0.1', 41892) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx06ca379bdec645d78a360-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/zero" 201 - "PUT http://127.0.0.1:39613/sdb1/3/a/zero" "tx06ca379bdec645d78a360-0068c570b7" "container-server 1824502" 0.0010 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/zero" 201 - "PUT http://127.0.0.1:44059/sda1/3/a/zero" "tx06ca379bdec645d78a360-0068c570b7" "container-server 1824502" 0.0010 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/3/a/zero" 201 - "PUT http://localhost/v1/a/zero" "tx06ca379bdec645d78a360-0068c570b7" "proxy-server 1824502" 0.0080 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/3/a/zero" 201 - "PUT http://localhost/v1/a/zero" "tx06ca379bdec645d78a360-0068c570b7" "proxy-server 1824502" 0.0127 "-" 1824502 0 proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:25:11] "PUT /v1/a/zero HTTP/1.1" 201 174 0.019845 (txn: tx06ca379bdec645d78a360-0068c570b7) proxy DEBUG: (1824502) accepted ('127.0.0.1', 41908) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf5734aab6d194453bdd10-0068c570b7" "proxy-server 1824502" 0.0019 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/3/a/zero" 204 - "HEAD http://localhost/v1/a/zero" "tx45c8b31c436741998e612-0068c570b7" "proxy-server 1824502" 0.0012 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/3/a/zero/go-get-it" 201 - "PUT http://localhost/sda1/1/a/zero/go-get-it" "txdc7fa6124ad44a5682665-0068c570b7" "object-server 1824502" 0.0005 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/3/a/zero/go-get-it" 201 - "PUT http://localhost/sdb1/1/a/zero/go-get-it" "txdc7fa6124ad44a5682665-0068c570b7" "object-server 1824502" 0.0005 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/zero/go-get-it" 201 - "PUT http://localhost/v1/a/zero/go-get-it" "txdc7fa6124ad44a5682665-0068c570b7" "proxy-server 1824502" 0.0111 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/zero/go-get-it" 201 - "PUT http://localhost/v1/a/zero/go-get-it" "txdc7fa6124ad44a5682665-0068c570b7" "proxy-server 1824502" 0.0107 "-" 1824502 0 proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:25:11] "PUT /v1/a/zero/go-get-it HTTP/1.1" 201 206 0.023610 (txn: txdc7fa6124ad44a5682665-0068c570b7) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx75371cc20b784b02ba878-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/3/a/zero" 204 - "HEAD http://localhost/v1/a/zero" "tx36de25feb95745f296c95-0068c570b7" "proxy-server 1824502" 0.0024 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/1/a/zero/go-get-it" 200 1309 "GET http://localhost/v1/a/zero/go-get-it" "txdd40caef06bf452bb8696-0068c570b7" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy INFO: 127.0.0.1 - - [14/Sep/2025 03:25:11] "GET /v1/a/zero/go-get-it HTTP/1.1" 200 1729 0.018759 (txn: txdd40caef06bf452bb8696-0068c570b7) proxy DEBUG: (1824502) timed out ('127.0.0.1', 41908) (txn: txdd40caef06bf452bb8696-0068c570b7) proxy INFO: (1824502) wsgi exited, is_accepting=True proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txeb10fd0abd21471bb2364-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txe7ea4e050e614e26b461a-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/c/o.beans" 201 - "PUT http://localhost/sda1/1/a/c/o.beans" "tx2382aece6b8847dc88b1a-0068c570b7" "object-server 1824502" 0.0005 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/c/o.beans" 201 - "PUT http://localhost/sdb1/1/a/c/o.beans" "tx2382aece6b8847dc88b1a-0068c570b7" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/c/o.beans" 201 - "PUT http://localhost/v1/a/c/o.beans" "tx2382aece6b8847dc88b1a-0068c570b7" "proxy-server 1824502" 0.0154 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/c/o.beans" 201 - "PUT http://localhost/v1/a/c/o.beans" "tx2382aece6b8847dc88b1a-0068c570b7" "proxy-server 1824502" 0.0167 "-" 1824502 0test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_ranges test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_ranges ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/3/a/5_vc_non_ascii%C2%A3" 200 195 "GET http://localhost/v1/a/5_vc_non_ascii%C2%A3?prefix=0135_o_non_ascii%C2%A3%2Fsub%2F&format=json&states=listing" "tx6588f09c52134159ab9cb-0068c570b7" "proxy-server 1824535" 0.0122 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/11 GET /v1/a/5_vc_non_ascii%25C2%25A3%3Fprefix%3D0135_o_non_ascii%25C2%25A3%252Fsub%252F%26format%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 195 - tx6588f09c52134159ab9cb-0068c570b7 - 0.0367 - - 1757769911.290837526 1757769911.327507973 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc07b39373a044ec0b8c16-0068c570b7" "proxy-server 1824535" 0.0014 "-" 1824535 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/5_oc_asciiwhoops" 201 - "PUT http://127.0.0.1:44669/sdb1/2/a/5_oc_asciiwhoops" "txc07b39373a044ec0b8c16-0068c570b7" "container-server 1824535" 0.0011 "-" 1824535 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/5_oc_asciiwhoops" 201 - "PUT http://127.0.0.1:38699/sda1/2/a/5_oc_asciiwhoops" "txc07b39373a044ec0b8c16-0068c570b7" "container-server 1824535" 0.0052 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/2/a/5_oc_asciiwhoops" 201 - "PUT http://localhost/v1/a/5_oc_asciiwhoops" "txc07b39373a044ec0b8c16-0068c570b7" "proxy-server 1824535" 0.0217 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/2/a/5_oc_asciiwhoops" 201 - "PUT http://localhost/v1/a/5_oc_asciiwhoops" "txc07b39373a044ec0b8c16-0068c570b7" "proxy-server 1824535" 0.0322 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/11 PUT /v1/a/5_oc_asciiwhoops HTTP/1.0 201 - - t - - - txc07b39373a044ec0b8c16-0068c570b7 - 0.0562 - - 1757769911.329519510 1757769911.385768175 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb8673f12b6894b15b0ade-0068c570b7" "proxy-server 1824535" 0.0063 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txb8673f12b6894b15b0ade-0068c570b7 - 0.0092 VW - 1757769911.391618252 1757769911.400857925 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/2/a/5_oc_asciiwhoops" 204 - "HEAD http://localhost/v1/a/5_oc_asciiwhoops" "tx925df5d551334584aca54-0068c570b7" "proxy-server 1824535" 0.0013 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a/5_oc_asciiwhoops HTTP/1.0 204 - Swift - - - - tx925df5d551334584aca54-0068c570b7 - 0.0083 VW - 1757769911.401426315 1757769911.409762383 0 - obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/1/a/5_oc_asciiwhoops/foo" 404 70 "GET http://localhost/v1/a/5_oc_asciiwhoops/foo?symlink=get" "tx1ba1d43506d747c7bd992-0068c570b7" "proxy-server 1824535" 0.0003 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/1/a/5_oc_asciiwhoops/foo" 404 70 "GET http://localhost/v1/a/5_oc_asciiwhoops/foo?symlink=get" "tx1ba1d43506d747c7bd992-0068c570b7" "proxy-server 1824535" 0.0045 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 GET /v1/a/5_oc_asciiwhoops/foo%3Fsymlink%3Dget HTTP/1.0 404 - Swift - - 70 - tx1ba1d43506d747c7bd992-0068c570b7 - 0.0141 VW - 1757769911.410315037 1757769911.424397469 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/2/a/5_oc_asciiwhoops/foo" 201 - "PUT http://localhost/sda1/1/a/5_oc_asciiwhoops/foo" "txf6b04893e64944dc818bc-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/2/a/5_oc_asciiwhoops/foo" 201 - "PUT http://localhost/sdb1/1/a/5_oc_asciiwhoops/foo" "txf6b04893e64944dc818bc-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/5_oc_asciiwhoops/foo" 201 - "PUT http://localhost/v1/a/5_oc_asciiwhoops/foo" "txf6b04893e64944dc818bc-0068c570b7" "proxy-server 1824535" 0.0173 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/5_oc_asciiwhoops/foo" 201 - "PUT http://localhost/v1/a/5_oc_asciiwhoops/foo" "txf6b04893e64944dc818bc-0068c570b7" "proxy-server 1824535" 0.0170 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/11 PUT /v1/a/5_oc_asciiwhoops/foo HTTP/1.0 201 - - t 5 - - txf6b04893e64944dc818bc-0068c570b7 - 0.0300 - - 1757769911.424850941 1757769911.454885006 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf855a029e1364c4c85e02-0068c570b7" "proxy-server 1824535" 0.0062 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - txf855a029e1364c4c85e02-0068c570b7 - 0.0090 VW - 1757769911.456670046 1757769911.465636492 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/2/a/5_oc_asciiwhoops" 204 - "HEAD http://localhost/v1/a/5_oc_asciiwhoops" "tx4e40a12971654388ac924-0068c570b7" "proxy-server 1824535" 0.0024 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a/5_oc_asciiwhoops HTTP/1.0 204 - Swift - - - - tx4e40a12971654388ac924-0068c570b7 - 0.0093 VW - 1757769911.466147423 1757769911.475467443 0 - obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/1/a/5_oc_asciiwhoops/foo" 200 5 "GET http://localhost/v1/a/5_oc_asciiwhoops/foo?symlink=get" "tx5c6fed2962eb4e999ef18-0068c570b7" "proxy-server 1824535" 0.0006 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/1/a/5_oc_asciiwhoops/foo" 200 5 "GET http://localhost/v1/a/5_oc_asciiwhoops/foo?symlink=get" "tx5c6fed2962eb4e999ef18-0068c570b7" "proxy-server 1824535" 0.0007 "-" 1824535 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx91f289afcc7b47ed8bb2a-0068c570b7" "proxy-server 1824535" 0.0003 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/2/a/none" 404 - "HEAD http://localhost/v1/a/none" "tx91f289afcc7b47ed8bb2a-0068c570b7" "proxy-server 1824535" 0.0003 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 GET /v1/a/5_oc_asciiwhoops/foo%3Fsymlink%3Dget HTTP/1.0 499 - Swift - - 5 - tx5c6fed2962eb4e999ef18-0068c570b7 - 0.0327 VW - 1757769911.476000786 1757769911.508655310 0 - (txn: tx46b7d95d3f3f45f5992e8-0068c570b7) proxy INFO: - - 13/Sep/2025/13/25/11 PUT /v1/a/none/003foo/1757769911.42543 HTTP/1.0 404 - Swift - - 70 dcddb75469b4b4875094e14561e573d8 tx46b7d95d3f3f45f5992e8-0068c570b7 - 0.0182 VW - 1757769911.490922451 1757769911.509113550 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx40865f67d07c48e4926b3-0068c570b7" "proxy-server 1824535" 0.0015 "-" 1824535 - proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - Swift - - - - tx40865f67d07c48e4926b3-0068c570b7 - 0.0127 VW - 1757769911.510622740 1757769911.523365736 - - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/2/a/5_oc_asciiwhoops" 204 - "HEAD http://localhost/v1/a/5_oc_asciiwhoops" "tx22b13a9c559c4b2186bd0-0068c570b7" "proxy-server 1824535" 0.0058 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 HEAD /v1/a/5_oc_asciiwhoops HTTP/1.0 204 - Swift - - - - tx22b13a9c559c4b2186bd0-0068c570b7 - 0.0086 VW - 1757769911.523914337 1757769911.532538414 0 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txcc1e7c748fb74030a5719-0068c570b7" "proxy-server 1824535" 0.0004 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/2/a/none" 404 - "GET http://localhost/v1/a/none?prefix=003foo%2F&marker=&reverse=on&format=json&states=listing" "txcc1e7c748fb74030a5719-0068c570b7" "proxy-server 1824535" 0.0004 "-" 1824535 0 proxy INFO: - - 13/Sep/2025/13/25/11 GET /v1/a/none%3Fprefix%3D003foo%252F%26marker%3D%26reverse%3Don%26format%3Djson%26states%3Dlisting HTTP/1.0 404 - Swift - - 70 - txcc1e7c748fb74030a5719-0068c570b7 - 0.0142 VW - 1757769911.533142090 1757769911.547299623 0 -test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_version_container_utf_object test.unit.proxy.test_server.TestSocketObjectVersions.test_version_manifest_utf8_version_container_utf_object ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/11 PUT /v1/a/c/o.beans HTTP/1.0 201 - - t 5800 - - tx2382aece6b8847dc88b1a-0068c570b7 - 0.0452 - - 1757769911.446740627 1757769911.491936922 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txeb82208085314337b9665-0068c570b7" "proxy-server 1824502" 0.0140 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx00d596f99ae74471a4a5b-0068c570b7" "proxy-server 1824502" 0.0081 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/1/a/c/o.beans" 206 191 "GET http://localhost/v1/a/c/o.beans" "tx9ce2cfd3fe32471db22c5-0068c570b7" "proxy-server 1824502" 0.0088 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe0e1ee5cc86248d386894-0068c570b7" "proxy-server 1824502" 0.0064 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx5096cb3048294e559b30d-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/1/a/c/o.beans" 200 5800 "GET http://localhost/v1/a/c/o.beans" "tx85529c99d892403d90dfa-0068c570b7" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txec49fd70131d4f3eac729-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txb417ac48de854c18bf23c-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/1/a/c/o.beans" 206 1076 "GET http://localhost/v1/a/c/o.beans" "tx686aabfa3e2a4e9aae9dd-0068c570b7" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa76d05f240bc43a68f902-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx800e7c075fb64bf6a0506-0068c570b7" "proxy-server 1824502" 0.0137 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/1/a/c/o.smurfs" 201 - "PUT http://localhost/sdb1/3/a/c/o.smurfs" "txa37e553c994f4049bc945-0068c570b7" "object-server 1824502" 0.0005 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sdb1/3/a/c/o.smurfs" 201 - "PUT http://localhost/v1/a/c/o.smurfs" "txa37e553c994f4049bc945-0068c570b7" "proxy-server 1824502" 0.0098 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/1/a/c/o.smurfs" 201 - "PUT http://localhost/sda1/3/a/c/o.smurfs" "txa37e553c994f4049bc945-0068c570b7" "object-server 1824502" 0.0005 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "PUT /sda1/3/a/c/o.smurfs" 201 - "PUT http://localhost/v1/a/c/o.smurfs" "txa37e553c994f4049bc945-0068c570b7" "proxy-server 1824502" 0.0300 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/11 PUT /v1/a/c/o.smurfs HTTP/1.0 201 - - t 53000 - - txa37e553c994f4049bc945-0068c570b7 - 0.0623 - - 1757769911.612917185 1757769911.675249100 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf19292f31a7044b7a13ec-0068c570b7" "proxy-server 1824502" 0.0055 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txf958a20299784075a624a-0068c570b7" "proxy-server 1824502" 0.0107 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/3/a/c/o.smurfs" 206 501 "GET http://localhost/v1/a/c/o.smurfs" "tx3baab18bdbbb4ada997d7-0068c570b7" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy ERROR: Trying to read object during GET (retrying) 127.0.0.1:47595/sda1 (txn: tx3baab18bdbbb4ada997d7-0068c570b7) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/3/a/c/o.smurfs" 206 201 "GET http://localhost/v1/a/c/o.smurfs" "tx3baab18bdbbb4ada997d7-0068c570b7" "proxy-server 1824502" 0.0089 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9cb956130c8d4080bc2b4-0068c570b7" "proxy-server 1824502" 0.0055 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txdd3e738c58c448aeaa65a-0068c570b7" "proxy-server 1824502" 0.0014 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/3/a/c/o.smurfs" 206 1898 "GET http://localhost/v1/a/c/o.smurfs" "tx2c503c1c6a244c90be7ef-0068c570b7" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy ERROR: Trying to read object during GET (retrying) 127.0.0.1:47595/sda1 (txn: tx2c503c1c6a244c90be7ef-0068c570b7) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/3/a/c/o.smurfs" 206 1081 "GET http://localhost/v1/a/c/o.smurfs" "tx2c503c1c6a244c90be7ef-0068c570b7" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy ERROR: Trying to read next part of object multi-part GET (retrying) 127.0.0.1:50123/sdb1 (txn: tx2c503c1c6a244c90be7ef-0068c570b7) proxy INFO: Client disconnected on read of '/a/c/o.smurfs' (txn: tx2c503c1c6a244c90be7ef-0068c570b7) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2e8cf06422f248f7af0b2-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txc1bdc12296414a76873dc-0068c570b7" "proxy-server 1824502" 0.0014 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/3/a/c/o.smurfs" 206 1898 "GET http://localhost/v1/a/c/o.smurfs" "txc3483991615d474aaff19-0068c570b7" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy ERROR: Trying to read object during GET (retrying) 127.0.0.1:50123/sdb1 (txn: txc3483991615d474aaff19-0068c570b7) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/3/a/c/o.smurfs" 206 1600 "GET http://localhost/v1/a/c/o.smurfs" "txc3483991615d474aaff19-0068c570b7" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txfbec92fac92d454599604-0068c570b7" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx4abe3f89508a4a659caf4-0068c570b7" "proxy-server 1824502" 0.0025 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/3/a/c/o.smurfs" 206 1898 "GET http://localhost/v1/a/c/o.smurfs" "tx7f4780a66e154a19a5783-0068c570b7" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy ERROR: Trying to read next part of object multi-part GET (retrying) 127.0.0.1:47595/sda1 (txn: tx7f4780a66e154a19a5783-0068c570b7) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/3/a/c/o.smurfs" 206 1280 "GET http://localhost/v1/a/c/o.smurfs" "tx7f4780a66e154a19a5783-0068c570b7" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa6952bc321634cf18d298-0068c570b7" "proxy-server 1824502" 0.0054 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx30db636c3db741ad89826-0068c570b7" "proxy-server 1824502" 0.0095 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sda1/3/a/c/o.smurfs" 206 1898 "GET http://localhost/v1/a/c/o.smurfs" "tx00eb1792011f41468eb0b-0068c570b7" "proxy-server 1824502" 0.0006 "-" 1824502 0test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_ranges_resuming test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_ranges_resuming ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_respects_read_affinity test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_respects_read_affinity ... ok proxy ERROR: Trying to read object during GET (retrying) 127.0.0.1:47595/sda1 (txn: tx00eb1792011f41468eb0b-0068c570b7) obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "GET /sdb1/3/a/c/o.smurfs" 206 1031 "GET http://localhost/v1/a/c/o.smurfs" "tx00eb1792011f41468eb0b-0068c570b7" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0z2=1, r1=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o.jpg' (txn: tx4b6c4a84ff6141029ccb5-0068c570b7) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1z1=1, r0z2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0z2=1, r0z0=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o.jpg' (txn: tx5ff5ff42aa5e40838cdc8-0068c570b7) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1z1=1, r0z2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0z2=1, r0z0=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o.jpg' (txn: tx173becec2487462db79f3-0068c570b7) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r1z1=1, r0z2=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'affinity', 'read_affinity': 'r0z2=1, r0=2', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o.jpg' (txn: tx957f838fa95a4a988b321-0068c570b7) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txcf87afa9665a414498067-0068c570b7" "proxy-server 1824502" 0.0014 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx1058f34a819b4bb2aa0cc-0068c570b7" "proxy-server 1824502" 0.0014 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sdb1/1/a/c/o.bottles" 201 - "PUT http://localhost/sdb1/2/a/c/o.bottles" "tx1b4ded035e334a01bce0f-0068c570b7" "object-server 1824502" 0.0006 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sdb1/2/a/c/o.bottles" 201 - "PUT http://localhost/v1/a/c/o.bottles" "tx1b4ded035e334a01bce0f-0068c570b7" "proxy-server 1824502" 0.0161 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sda1/1/a/c/o.bottles" 201 - "PUT http://localhost/sda1/2/a/c/o.bottles" "tx1b4ded035e334a01bce0f-0068c570b7" "object-server 1824502" 0.0005 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sda1/2/a/c/o.bottles" 201 - "PUT http://localhost/v1/a/c/o.bottles" "tx1b4ded035e334a01bce0f-0068c570b7" "proxy-server 1824502" 0.0228 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 PUT /v1/a/c/o.bottles HTTP/1.0 201 - - t 6260 - - tx1b4ded035e334a01bce0f-0068c570b7 - 0.0478 - - 1757769911.974209785 1757769912.021993399 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx338a73f30e4d4f2a99f89-0068c570b8" "proxy-server 1824502" 0.0055 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txabdaf25bd66e4559b482a-0068c570b8" "proxy-server 1824502" 0.0067 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "GET /sdb1/2/a/c/o.bottles" 200 6260 "GET http://localhost/v1/a/c/o.bottles" "txe622ee94c22f4efa93005-0068c570b8" "proxy-server 1824502" 0.0006 "-" 1824502 0 obj2 WARNING: Quarantined object /tmp/tmpsnqg2uij/tmp_test_proxy_server_chunked/sdb1/objects/2/88f/b4ad81e7ca6a01735f59b6ebb3d5d88f/1757769911.99569.data: Bytes read: 6160, does not match metadata: 6260 (txn: txe622ee94c22f4efa93005-0068c570b8) proxy ERROR: Trying to read object during GET (retrying) 127.0.0.1:50123/sdb1 (txn: txe622ee94c22f4efa93005-0068c570b8) obj1 WARNING: Quarantined object /tmp/tmpsnqg2uij/tmp_test_proxy_server_chunked/sda1/objects/2/88f/b4ad81e7ca6a01735f59b6ebb3d5d88f/1757769911.99569.data: metadata content-length 6260 does not match actual object size 6160 (txn: txe622ee94c22f4efa93005-0068c570b8) obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "GET /sda1/2/a/c/o.bottles" 404 70 "GET http://localhost/v1/a/c/o.bottles" "txe622ee94c22f4efa93005-0068c570b8" "proxy-server 1824502" 0.0008 "-" 1824502 0 proxy INFO: Client disconnected on read of '/a/c/o.bottles' (txn: txe622ee94c22f4efa93005-0068c570b8) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 GET /v1/a/c/o.bottles HTTP/1.0 500 - - t - 6160 - txe622ee94c22f4efa93005-0068c570b8 - 0.0387 - - 1757769912.028789997 1757769912.067518950 0 -test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_short_read test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_short_read ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_short_read_resuming test.unit.proxy.test_server.TestReplicatedObjectController.test_GET_short_read_resuming ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_HEAD test.unit.proxy.test_server.TestReplicatedObjectController.test_HEAD ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_HEAD_absolute_uri test.unit.proxy.test_server.TestReplicatedObjectController.test_HEAD_absolute_uri ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_HEAD_calls_authorize test.unit.proxy.test_server.TestReplicatedObjectController.test_HEAD_calls_authorize ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_HEAD_newest test.unit.proxy.test_server.TestReplicatedObjectController.test_HEAD_newest ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "DELETE /sdb1/2/a/5_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/sda1/1/a/5_oc_asciiwhoops/foo" "txa78da93eed3749bb96340-0068c570b7" "object-server 1824535" 0.0005 "-" 1824535 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "DELETE /sda1/2/a/5_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/sdb1/1/a/5_oc_asciiwhoops/foo" "txa78da93eed3749bb96340-0068c570b7" "object-server 1824535" 0.0004 "-" 1824535 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "DELETE /sdb1/1/a/5_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/v1/a/5_oc_asciiwhoops/foo" "txa78da93eed3749bb96340-0068c570b7" "proxy-server 1824535" 0.0057 "-" 1824535 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:11 +0000] "DELETE /sda1/1/a/5_oc_asciiwhoops/foo" 204 - "DELETE http://localhost/v1/a/5_oc_asciiwhoops/foo" "txa78da93eed3749bb96340-0068c570b7" "proxy-server 1824535" 0.0161 "-" 1824535 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/11 DELETE /v1/a/5_oc_asciiwhoops/foo HTTP/1.0 204 - - t - - - txa78da93eed3749bb96340-0068c570b7 - 0.0197 - - 1757769911.554909468 1757769911.574621677 0 - test.unit.proxy.test_server.TestReplicatedObjectController.test_OPTIONS test.unit.proxy.test_server.TestReplicatedObjectController.test_OPTIONS ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_POST test.unit.proxy.test_server.TestReplicatedObjectController.test_POST ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx00d3ba98c4444e6b84b00-0068c570b8" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txc727669034ac46ac99913-0068c570b8" "proxy-server 1824502" 0.0013 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sdb1/1/a/c/o.bottles" 201 - "PUT http://localhost/sdb1/2/a/c/o.bottles" "txf1fe13f70bda46d494a7b-0068c570b8" "object-server 1824502" 0.0046 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sda1/1/a/c/o.bottles" 201 - "PUT http://localhost/sda1/2/a/c/o.bottles" "txf1fe13f70bda46d494a7b-0068c570b8" "object-server 1824502" 0.0004 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sda1/2/a/c/o.bottles" 201 - "PUT http://localhost/v1/a/c/o.bottles" "txf1fe13f70bda46d494a7b-0068c570b8" "proxy-server 1824502" 0.0183 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sdb1/2/a/c/o.bottles" 201 - "PUT http://localhost/v1/a/c/o.bottles" "txf1fe13f70bda46d494a7b-0068c570b8" "proxy-server 1824502" 0.0238 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 PUT /v1/a/c/o.bottles HTTP/1.0 201 - - t 6260 - - txf1fe13f70bda46d494a7b-0068c570b8 - 0.0476 - - 1757769912.079596758 1757769912.127202034 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txecd3f6406b17405cba74d-0068c570b8" "proxy-server 1824502" 0.0055 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx11e87d66eb364ad8b433b-0068c570b8" "proxy-server 1824502" 0.0069 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "GET /sda1/2/a/c/o.bottles" 200 6260 "GET http://localhost/v1/a/c/o.bottles" "tx1c2152c2fd1449d09ea8c-0068c570b8" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 GET /v1/a/c/o.bottles HTTP/1.0 200 - - t - 6260 - tx1c2152c2fd1449d09ea8c-0068c570b8 - 0.0271 - - 1757769912.128878832 1757769912.155933380 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 500 b'' Trying to HEAD /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx298d9249477b45448acb5-0068c570b8) proxy-ut ERROR: ERROR 500 b'' Trying to HEAD /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txc18b8ebfa6064d88adce9-0068c570b8) proxy-ut ERROR: ERROR 500 b'' Trying to HEAD /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txc18b8ebfa6064d88adce9-0068c570b8) proxy-ut ERROR: ERROR 500 b'' Trying to HEAD /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txc18b8ebfa6064d88adce9-0068c570b8) proxy-ut ERROR: Object HEAD returning 503 for [500, 500, 500] (txn: txc18b8ebfa6064d88adce9-0068c570b8) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Trying to HEAD /v1/a/c/o: Timeout (Nones) (txn: tx0a931c128a054ead9bc35-0068c570b8) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Trying to HEAD /v1/a/c/o: Timeout (Nones) (txn: tx0a931c128a054ead9bc35-0068c570b8) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Trying to HEAD /v1/a/c/o: Timeout (Nones) (txn: tx0a931c128a054ead9bc35-0068c570b8) proxy-ut ERROR: Object HEAD returning 503 for [] (txn: tx0a931c128a054ead9bc35-0068c570b8) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa4c50cccbff5419b90726-0068c570b8" "proxy-server 1824502" 0.0013 "-" 1824502 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - - t - - - txa4c50cccbff5419b90726-0068c570b8 - 0.0082 - - 1757769912.235500574 1757769912.243680000 - - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx512a21d9ca454984a89c9-0068c570b8" "proxy-server 1824502" 0.0055 "-" 1824502 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - - t - - - tx512a21d9ca454984a89c9-0068c570b8 - 0.0081 - - 1757769912.244784117 1757769912.252868414 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx81d005c71dc54f5aaf90c-0068c570b8) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txf44bb08b40474880a3202-0068c570b8) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txf44bb08b40474880a3202-0068c570b8) proxy-ut ERROR: Object POST returning 503 for (202, 503, 503) (txn: txf44bb08b40474880a3202-0068c570b8) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx165be0f0e4d5426aa47ee-0068c570b8) proxy-ut ERROR: Object POST returning 503 for (202, 404, 503) (txn: tx165be0f0e4d5426aa47ee-0068c570b8) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx93fcb37543e4405c91ff8-0068c570b8) proxy-ut ERROR: ERROR 500 Trying to POST /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx93fcb37543e4405c91ff8-0068c570b8) proxy-ut ERROR: Object POST returning 503 for (404, 503, 503) (txn: tx93fcb37543e4405c91ff8-0068c570b8) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_backend_headers test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_backend_headers ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_calls_authorize test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_calls_authorize ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_converts_delete_after_to_delete_at test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_converts_delete_after_to_delete_at ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_authorize test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_authorize ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_count test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_count ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_key_len test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_key_len ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_size test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_size ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_val_len test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_meta_val_len ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_x_container_headers_with_more_container_replicas test.unit.proxy.test_server.TestReplicatedObjectController.test_POST_x_container_headers_with_more_container_replicas ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_GET_unicode_metadata test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_GET_unicode_metadata ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 500 b'' Trying to GET /v1/a/c/o.jpg From Object Server 10.0.0.2:3002/sdc (txn: txae057ecc799841d48a988-0068c570b8) proxy-ut ERROR: ERROR 500 b'' Trying to GET /v1/a/c/o.jpg From Object Server 10.0.0.2:3002/sdc (txn: tx809967a1b0c94ef6aee43-0068c570b8) proxy-ut ERROR: Object PUT returning 503 for [204, 500, 404] (txn: tx809967a1b0c94ef6aee43-0068c570b8) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3a7db563bca14ea4b7516-0068c570b8" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx9a8b3a68765447af990df-0068c570b8" "proxy-server 1824502" 0.0069 "-" 1824502 0 obj2 WARNING: Quarantined object /tmp/tmpsnqg2uij/tmp_test_proxy_server_chunked/sdb1/objects/0/852/28fc504cad626c115ff58b825cf47852/1757769910.85049.data: metadata content-length 0 does not match actual object size 6160 (txn: tx8066c13ec987457baaaae-0068c570b8) obj1 WARNING: Quarantined object /tmp/tmpsnqg2uij/tmp_test_proxy_server_chunked/sda1/objects/0/852/28fc504cad626c115ff58b825cf47852/1757769910.85049.data: metadata content-length 0 does not match actual object size 6160 (txn: tx8066c13ec987457baaaae-0068c570b8) cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sda1/1/a/c/o.zerobyte" 201 - "PUT http://localhost/sdb1/0/a/c/o.zerobyte" "tx8066c13ec987457baaaae-0068c570b8" "object-server 1824502" 0.0005 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sdb1/1/a/c/o.zerobyte" 201 - "PUT http://localhost/sda1/0/a/c/o.zerobyte" "tx8066c13ec987457baaaae-0068c570b8" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sdb1/0/a/c/o.zerobyte" 201 - "PUT http://localhost/v1/a/c/o.zerobyte" "tx8066c13ec987457baaaae-0068c570b8" "proxy-server 1824502" 0.0229 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sda1/0/a/c/o.zerobyte" 201 - "PUT http://localhost/v1/a/c/o.zerobyte" "tx8066c13ec987457baaaae-0068c570b8" "proxy-server 1824502" 0.0222 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 PUT /v1/a/c/o.zerobyte HTTP/1.0 201 - - t - - - tx8066c13ec987457baaaae-0068c570b8 - 0.0493 - - 1757769912.739578485 1757769912.788907051 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa37c5d8bc18d4401b48ea-0068c570b8" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txaa952911084b4ce99b981-0068c570b8" "proxy-server 1824502" 0.0026 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "GET /sda1/0/a/c/o.zerobyte" 200 - "GET http://localhost/v1/a/c/o.zerobyte" "txc5d4491e9ee347cc9ff4f-0068c570b8" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 GET /v1/a/c/o.zerobyte HTTP/1.0 200 - - t - - - txc5d4491e9ee347cc9ff4f-0068c570b8 - 0.0294 - - 1757769912.789726019 1757769912.819161177 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txabbf679d99164e4c851ff-0068c570b8" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx14ac421a14374812a6ec3-0068c570b8" "proxy-server 1824502" 0.0049 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sda1/1/a/c/o.last_modified" 201 - "PUT http://localhost/sda1/0/a/c/o.last_modified" "tx939b4b356b7448da839a7-0068c570b8" "object-server 1824502" 0.0004 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sdb1/1/a/c/o.last_modified" 201 - "PUT http://localhost/sdb1/0/a/c/o.last_modified" "tx939b4b356b7448da839a7-0068c570b8" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sdb1/0/a/c/o.last_modified" 201 - "PUT http://localhost/v1/a/c/o.last_modified" "tx939b4b356b7448da839a7-0068c570b8" "proxy-server 1824502" 0.0188 "-" 1824502 0test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_POST_last_modified test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_POST_last_modified ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_POST_requires_container_exist test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_POST_requires_container_exist ... ok obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "PUT /sda1/0/a/c/o.last_modified" 201 - "PUT http://localhost/v1/a/c/o.last_modified" "tx939b4b356b7448da839a7-0068c570b8" "proxy-server 1824502" 0.0202 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 PUT /v1/a/c/o.last_modified HTTP/1.0 201 - - t - - - tx939b4b356b7448da839a7-0068c570b8 - 0.0478 - - 1757769912.825679779 1757769912.873474836 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx3f7a3ec3bfb840ed8a69e-0068c570b8" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx72d963f980a64d3ebaf1e-0068c570b8" "proxy-server 1824502" 0.0024 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/0/a/c/o.last_modified" 200 - "HEAD http://localhost/v1/a/c/o.last_modified" "tx538285d8929d4847ae4d8-0068c570b8" "proxy-server 1824502" 0.0005 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 HEAD /v1/a/c/o.last_modified HTTP/1.0 200 - - t - - - tx538285d8929d4847ae4d8-0068c570b8 - 0.0247 - - 1757769912.886802673 1757769912.911512613 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf2f3040d125246759a31d-0068c570b8" "proxy-server 1824502" 0.0055 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx1bc9f357938540eb8c1c9-0068c570b8" "proxy-server 1824502" 0.0103 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "GET /sda1/0/a/c/o.last_modified" 304 - "GET http://localhost/v1/a/c/o.last_modified" "tx0bf74753b0754532b4adf-0068c570b8" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 GET /v1/a/c/o.last_modified HTTP/1.0 304 - - t - - - tx0bf74753b0754532b4adf-0068c570b8 - 0.0242 - - 1757769912.913034916 1757769912.937246799 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx07398630efe549269bd04-0068c570b8" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx05b63255f19d4e5d98c37-0068c570b8" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:12 +0000] "GET /sdb1/0/a/c/o.last_modified" 200 - "GET http://localhost/v1/a/c/o.last_modified" "tx96bb80437be8415fb0e6f-0068c570b8" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/12 GET /v1/a/c/o.last_modified HTTP/1.0 200 - - t - - - tx96bb80437be8415fb0e6f-0068c570b8 - 0.0240 - - 1757769912.938534737 1757769912.962553263 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:13 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9bba6e6ad730414591c8d-0068c570b9" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:13 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txbe588eb12005497f8f4e8-0068c570b9" "proxy-server 1824502" 0.0013 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/1/a/c/o.last_modified" 201 - "POST http://localhost/sda1/0/a/c/o.last_modified" "txc64e9f5da281409d9e5ad-0068c570b9" "object-server 1824502" 0.0005 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/1/a/c/o.last_modified" 201 - "POST http://localhost/sdb1/0/a/c/o.last_modified" "txc64e9f5da281409d9e5ad-0068c570b9" "object-server 1824502" 0.0004 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "POST /sda1/0/a/c/o.last_modified" 202 76 "POST http://localhost/v1/a/c/o.last_modified" "txc64e9f5da281409d9e5ad-0068c570b9" "proxy-server 1824502" 0.0058 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "POST /sdb1/0/a/c/o.last_modified" 202 76 "POST http://localhost/v1/a/c/o.last_modified" "txc64e9f5da281409d9e5ad-0068c570b9" "proxy-server 1824502" 0.0121 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 POST /v1/a/c/o.last_modified HTTP/1.0 202 - - t - 76 - txc64e9f5da281409d9e5ad-0068c570b9 - 0.0423 - - 1757769913.969154835 1757769914.011420012 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0ddf491767ee444fbb088-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx252a7de44ae6459bb8c9d-0068c570ba" "proxy-server 1824502" 0.0025 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/0/a/c/o.last_modified" 200 - "HEAD http://localhost/v1/a/c/o.last_modified" "txd22182517c944bd2aa183-0068c570ba" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 HEAD /v1/a/c/o.last_modified HTTP/1.0 200 - - t - - - txd22182517c944bd2aa183-0068c570ba - 0.0125 - - 1757769914.012837410 1757769914.025287867 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd018e8c527344e5e8cbeb-0068c570ba" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx9f3a9d890fd9418d9a4eb-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "GET /sdb1/0/a/c/o.last_modified" 304 - "GET http://localhost/v1/a/c/o.last_modified" "tx0dfe477a5740494188efe-0068c570ba" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 GET /v1/a/c/o.last_modified HTTP/1.0 304 - - t - - - tx0dfe477a5740494188efe-0068c570ba - 0.0111 - - 1757769914.026823282 1757769914.037940502 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txafea4471c9bf4a93b1586-0068c570ba" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txd593e2711da845bdbda54-0068c570ba" "proxy-server 1824502" 0.0015 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "GET /sda1/0/a/c/o.last_modified" 200 - "GET http://localhost/v1/a/c/o.last_modified" "tx2c97b6a9930c44b2b321d-0068c570ba" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 GET /v1/a/c/o.last_modified HTTP/1.0 200 - - t - - - tx2c97b6a9930c44b2b321d-0068c570ba - 0.0129 - - 1757769914.039303541 1757769914.052184820 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx420d09edf0bb4b1ab9ca2-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx4743ad225cf44a6b91d61-0068c570ba" "proxy-server 1824502" 0.0097 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/1/a/c/o.jpg" 201 - "PUT http://localhost/sdb1/2/a/c/o.jpg" "tx3929d7984d5a442bbdd82-0068c570ba" "object-server 1824502" 0.0006 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/2/a/c/o.jpg" 201 - "PUT http://localhost/v1/a/c/o.jpg" "tx3929d7984d5a442bbdd82-0068c570ba" "proxy-server 1824502" 0.0136 "-" 1824502 0test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_auto_content_type test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_auto_content_type ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_autodetect_content_type test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_autodetect_content_type ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_bad_content_type test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_bad_content_type ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_bad_message_length test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_bad_message_length ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_calls_authorize test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_calls_authorize ... ok cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/1/a/c/o.jpg" 201 - "PUT http://localhost/sda1/2/a/c/o.jpg" "tx3929d7984d5a442bbdd82-0068c570ba" "object-server 1824502" 0.0005 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/2/a/c/o.jpg" 201 - "PUT http://localhost/v1/a/c/o.jpg" "tx3929d7984d5a442bbdd82-0068c570ba" "proxy-server 1824502" 0.0256 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 PUT /v1/a/c/o.jpg HTTP/1.0 201 - - t - - - tx3929d7984d5a442bbdd82-0068c570ba - 0.0623 - - 1757769914.068399429 1757769914.130707741 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx91611c51337f4ddf83069-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx143e5a8bd6a44f8ea8002-0068c570ba" "proxy-server 1824502" 0.0102 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "GET /sda1/2/a/c/o.jpg" 200 - "GET http://localhost/v1/a/c/o.jpg" "tx57913438542c4318a6073-0068c570ba" "proxy-server 1824502" 0.0084 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 GET /v1/a/c/o.jpg HTTP/1.0 200 - - t - - - tx57913438542c4318a6073-0068c570ba - 0.0364 - - 1757769914.131739378 1757769914.168146372 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbc5d9f54da614aeb982e6-0068c570ba" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx10b8f36300594719ad485-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/1/a/c/o.html" 201 - "PUT http://localhost/sdb1/1/a/c/o.html" "tx721385c2c1be40fda2d6c-0068c570ba" "object-server 1824502" 0.0005 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/1/a/c/o.html" 201 - "PUT http://localhost/sda1/1/a/c/o.html" "tx721385c2c1be40fda2d6c-0068c570ba" "object-server 1824502" 0.0004 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/1/a/c/o.html" 201 - "PUT http://localhost/v1/a/c/o.html" "tx721385c2c1be40fda2d6c-0068c570ba" "proxy-server 1824502" 0.0183 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/1/a/c/o.html" 201 - "PUT http://localhost/v1/a/c/o.html" "tx721385c2c1be40fda2d6c-0068c570ba" "proxy-server 1824502" 0.0181 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 PUT /v1/a/c/o.html HTTP/1.0 201 - - t - - - tx721385c2c1be40fda2d6c-0068c570ba - 0.0472 - - 1757769914.169554949 1757769914.216792583 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdd3c2bad293244d5bc863-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txa4a057d44fb244e6bd383-0068c570ba" "proxy-server 1824502" 0.0024 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "GET /sdb1/1/a/c/o.html" 200 - "GET http://localhost/v1/a/c/o.html" "tx612a410a57db4510b805e-0068c570ba" "proxy-server 1824502" 0.0023 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 GET /v1/a/c/o.html HTTP/1.0 200 - - t - - - tx612a410a57db4510b805e-0068c570ba - 0.0308 - - 1757769914.217596769 1757769914.248436213 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd059a01bc7f249b1b66b1-0068c570ba" "proxy-server 1824502" 0.0037 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txc67f813d13f744bf86dca-0068c570ba" "proxy-server 1824502" 0.0058 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/1/a/c/o.css" 201 - "PUT http://localhost/sdb1/0/a/c/o.css" "tx9ff937c6df454b049c64f-0068c570ba" "object-server 1824502" 0.0004 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/1/a/c/o.css" 201 - "PUT http://localhost/sda1/0/a/c/o.css" "tx9ff937c6df454b049c64f-0068c570ba" "object-server 1824502" 0.0005 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/0/a/c/o.css" 201 - "PUT http://localhost/v1/a/c/o.css" "tx9ff937c6df454b049c64f-0068c570ba" "proxy-server 1824502" 0.0233 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/0/a/c/o.css" 201 - "PUT http://localhost/v1/a/c/o.css" "tx9ff937c6df454b049c64f-0068c570ba" "proxy-server 1824502" 0.0246 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 PUT /v1/a/c/o.css HTTP/1.0 201 - - t - - - tx9ff937c6df454b049c64f-0068c570ba - 0.0471 - - 1757769914.249855995 1757769914.296968699 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx183fd1b9a8e7475a85b8a-0068c570ba" "proxy-server 1824502" 0.0014 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx3288d6a2e36a4b0b95470-0068c570ba" "proxy-server 1824502" 0.0085 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "GET /sdb1/0/a/c/o.css" 200 - "GET http://localhost/v1/a/c/o.css" "tx0818b43443084b948da0f-0068c570ba" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 GET /v1/a/c/o.css HTTP/1.0 200 - - t - - - tx0818b43443084b948da0f-0068c570ba - 0.0314 - - 1757769914.297752380 1757769914.329186201 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx34ab8a8678c0457bbc513-0068c570ba" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx7f02ad85558e4859a6261-0068c570ba" "proxy-server 1824502" 0.0070 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 PUT /v1/a/c/o.chunked HTTP/1.0 400 - - t - 38 - txe88436ce4c6e495a849bb-0068c570ba - 0.0185 - - 1757769914.375572205 1757769914.394073009 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx3d256cb9b1bc4274b2c95-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o.jpg: Timeout (Nones) (txn: tx5dca325238574e33bfddb-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 989, in connect conn = FakeConn(status, etag, body=body, timestamp=timestamp, headers=headers, expect_headers=expect_headers, connection_id=i, give_send=kwargs.get('give_send'), give_expect=kwargs.get('give_expect')) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 788, in __init__ status = FakeStatus(status) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 692, in __init__ raise status Exception (txn: txf1a7c88df0f54a2ba6c41-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Timeout (Nones) (txn: txd1101ddd538a432f91b22-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1808, in _make_connection resp = conn.getexpect() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 840, in getexpect expect_status = self._status.get_expect_status() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 743, in get_expect_status raise expect_status Exception (txn: tx74baa5f4ddd14324ba83b-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Trying to get final status of PUT to /v1/a/c/o.jpg: Timeout (Nones) (txn: tx4172cc19f7364b76bccb1-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Trying to get final status of PUT to /v1/a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 525, in _get_conn_response resp = putter.await_response( self.app.node_timeout, not final_phase) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1741, in await_response self.resp = self.conn.getresponse() ~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 834, in getresponse self.status = self._status.get_response_status() ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~^^ File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 734, in get_response_status raise self.status Exception (txn: tx489f7099e7c44631a3f75-0068c570ba) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda, error: ERROR Insufficient Storage (txn: tx6a33c11fa18a4792a67b8-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx150aa731451d4779b958e-0068c570ba) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx150aa731451d4779b958e-0068c570ba) proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: tx150aa731451d4779b958e-0068c570ba) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx0e3fb351cf5b449fb48cd-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx0e3fb351cf5b449fb48cd-0068c570ba)test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_connect_exceptions test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_connect_exceptions ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_error_limiting test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_error_limiting ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_error_limiting_last_node test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_error_limiting_last_node ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_expect_header_nonzero_content_length test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_expect_header_nonzero_content_length ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_expect_header_zero_content_length test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_expect_header_zero_content_length ... ok proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: tx0e3fb351cf5b449fb48cd-0068c570ba) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx57c63c753b154833b6d0d-0068c570ba) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx825387379dbe40ad888e1-0068c570ba) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx1541fa67d9da4ab3b23f9-0068c570ba) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx9aaae87f810c4464a1925-0068c570ba) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx2d09b932c4904d2ea53cf-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txd45ce4b1cd3d4b76aceac-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txd45ce4b1cd3d4b76aceac-0068c570ba) proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: txd45ce4b1cd3d4b76aceac-0068c570ba) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: tx3bcf2c49ae614d9f93ac5-0068c570ba) proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o.jpg From Object Server 10.0.0.0:3000/sda (txn: tx3bcf2c49ae614d9f93ac5-0068c570ba)test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_getresponse_exceptions test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_getresponse_exceptions ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_max_size test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_max_size ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_too_large test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_too_large ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_unsup_xfr_encoding test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_unsup_xfr_encoding ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_using_both test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_using_both ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_using_both_with_crazy_meta test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_using_both_with_crazy_meta ... ok proxy-ut ERROR: ERROR 503 b'' Trying to GET /v1/a/c/o.jpg From Object Server 10.0.0.1:3001/sdb (txn: tx3bcf2c49ae614d9f93ac5-0068c570ba) proxy-ut ERROR: Object PUT returning 503 for [503, 503, 503] (txn: tx3bcf2c49ae614d9f93ac5-0068c570ba) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txbe38e9f09a454f388e3bc-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx6d6df079976342d3b6cb9-0068c570ba" "proxy-server 1824502" 0.0014 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 PUT /v1/a/c/o.chunked HTTP/1.0 413 - - t - 26 - tx480e3288010240f98ba00-0068c570ba - 0.0252 - - 1757769914.722304583 1757769914.747535706 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx54fc9c44b182445f9e65d-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx2af5bc90f3a44bd4b9836-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 PUT /v1/a/c/o.chunked HTTP/1.0 501 - - t - 78 - tx2e50bc3039a7497dac046-0068c570ba - 0.0170 - - 1757769914.757153511 1757769914.774125099 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5f514688edde4ed8836b7-0068c570ba" "proxy-server 1824502" 0.0072 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx0a6fc21e986d467fa7f30-0068c570ba" "proxy-server 1824502" 0.0014 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/1/a/c/o.chunked" 201 - "PUT http://localhost/sda1/1/a/c/o.chunked" "tx635ffaf906604ca28e268-0068c570ba" "object-server 1824502" 0.0054 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/1/a/c/o.chunked" 201 - "PUT http://localhost/sdb1/1/a/c/o.chunked" "tx635ffaf906604ca28e268-0068c570ba" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/1/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "tx635ffaf906604ca28e268-0068c570ba" "proxy-server 1824502" 0.0167 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/1/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "tx635ffaf906604ca28e268-0068c570ba" "proxy-server 1824502" 0.0164 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 PUT /v1/a/c/o.chunked HTTP/1.0 201 - - t 33 - - tx635ffaf906604ca28e268-0068c570ba - 0.0473 - - 1757769914.787869930 1757769914.835217953 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4bc8b634fc9d44a8a7783-0068c570ba" "proxy-server 1824502" 0.0055 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txf31128eff8e44982b7812-0068c570ba" "proxy-server 1824502" 0.0066 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "GET /sda1/1/a/c/o.chunked" 200 33 "GET http://localhost/v1/a/c/o.chunked" "txe06080029a574ca7b6409-0068c570ba" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 GET /v1/a/c/o.chunked HTTP/1.0 200 - - t - 33 - txe06080029a574ca7b6409-0068c570ba - 0.0253 - - 1757769914.836178541 1757769914.861431122 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1d6cf14f7d524d7a87355-0068c570ba" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx87e1968b861a4caca45c4-0068c570ba" "proxy-server 1824502" 0.0072 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/1/a/c/o.chunked" 201 - "PUT http://localhost/sda1/1/a/c/o.chunked" "tx21cad15a5ac34b37aea56-0068c570ba" "object-server 1824502" 0.0004 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/1/a/c/o.chunked" 201 - "PUT http://localhost/sdb1/1/a/c/o.chunked" "tx21cad15a5ac34b37aea56-0068c570ba" "object-server 1824502" 0.0005 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sdb1/1/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "tx21cad15a5ac34b37aea56-0068c570ba" "proxy-server 1824502" 0.0167 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "PUT /sda1/1/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "tx21cad15a5ac34b37aea56-0068c570ba" "proxy-server 1824502" 0.0163 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 PUT /v1/a/c/o.chunked HTTP/1.0 201 - - t 33 - - tx21cad15a5ac34b37aea56-0068c570ba - 0.0389 - - 1757769914.875311613 1757769914.914252758 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx6f7b0d1fda2047ceafa32-0068c570ba" "proxy-server 1824502" 0.0012 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx5f7fd3ce1def4bac994f4-0068c570ba" "proxy-server 1824502" 0.0075 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "GET /sda1/1/a/c/o.chunked" 200 33 "GET http://localhost/v1/a/c/o.chunked" "tx05ae8e79254143aa993c9-0068c570ba" "proxy-server 1824502" 0.0007 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/14 GET /v1/a/c/o.chunked HTTP/1.0 200 - - t - 33 - tx05ae8e79254143aa993c9-0068c570ba - 0.0263 - - 1757769914.919282913 1757769914.945534945 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txed980e0f572847b29dcaf-0068c570ba" "proxy-server 1824502" 0.0012 "-" 1824502 -test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_using_content_length test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_using_content_length ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_using_transfer_encoding test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_message_length_using_transfer_encoding ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_no_etag_fallocate test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_no_etag_fallocate ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_not_autodetect_content_type test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_not_autodetect_content_type ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_all_containers_error test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_all_containers_error ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_container_does_not_exist test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_container_does_not_exist ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_container_exist_on_handoff test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_container_exist_on_handoff ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_primary_containers_timeout test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_primary_containers_timeout ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:14 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txc246a510f3fb471089c43-0068c570ba" "proxy-server 1824502" 0.0013 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/1/a/c/o.content-length" 201 - "PUT http://localhost/sda1/0/a/c/o.content-length" "tx4d27f33f2cad46ca9d67d-0068c570ba" "object-server 1824502" 0.0005 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/1/a/c/o.content-length" 201 - "PUT http://localhost/sdb1/0/a/c/o.content-length" "tx4d27f33f2cad46ca9d67d-0068c570ba" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/0/a/c/o.content-length" 201 - "PUT http://localhost/v1/a/c/o.content-length" "tx4d27f33f2cad46ca9d67d-0068c570ba" "proxy-server 1824502" 0.0174 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/0/a/c/o.content-length" 201 - "PUT http://localhost/v1/a/c/o.content-length" "tx4d27f33f2cad46ca9d67d-0068c570ba" "proxy-server 1824502" 0.0270 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 PUT /v1/a/c/o.content-length HTTP/1.0 201 - - t 20 - - tx4d27f33f2cad46ca9d67d-0068c570ba - 0.0551 - - 1757769914.959395647 1757769915.014459133 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx7ba737c0a14048bbaa9fd-0068c570bb" "proxy-server 1824502" 0.0014 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx2089af77081045c7ababd-0068c570bb" "proxy-server 1824502" 0.0071 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/1/a/c/o.chunked" 201 - "PUT http://localhost/sda1/1/a/c/o.chunked" "txbb0fb99e0cf64006a4580-0068c570bb" "object-server 1824502" 0.0004 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/1/a/c/o.chunked" 201 - "PUT http://localhost/sdb1/1/a/c/o.chunked" "txbb0fb99e0cf64006a4580-0068c570bb" "object-server 1824502" 0.0004 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/1/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "txbb0fb99e0cf64006a4580-0068c570bb" "proxy-server 1824502" 0.0077 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/1/a/c/o.chunked" 201 - "PUT http://localhost/v1/a/c/o.chunked" "txbb0fb99e0cf64006a4580-0068c570bb" "proxy-server 1824502" 0.0072 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 PUT /v1/a/c/o.chunked HTTP/1.0 201 - - t 33 - - txbb0fb99e0cf64006a4580-0068c570bb - 0.0296 - - 1757769915.023368359 1757769915.053015709 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx74c9e000932f43148c97d-0068c570bb" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx5fc2e784ea2e4869800e2-0068c570bb" "proxy-server 1824502" 0.0024 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/1/a/c/o" 201 - "PUT http://localhost/sda1/2/a/c/o" "txbc0badef871e49c5aa38e-0068c570bb" "object-server 1824502" 0.0004 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/1/a/c/o" 201 - "PUT http://localhost/sdb1/2/a/c/o" "txbc0badef871e49c5aa38e-0068c570bb" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/2/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "txbc0badef871e49c5aa38e-0068c570bb" "proxy-server 1824502" 0.0074 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/2/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "txbc0badef871e49c5aa38e-0068c570bb" "proxy-server 1824502" 0.0068 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 PUT /v1/a/c/o HTTP/1.0 201 - - t 25 - - txbc0badef871e49c5aa38e-0068c570bb - 0.0200 - - 1757769915.059540272 1757769915.079566240 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.1:1001/sdb (txn: txeef18e85539540c88ed2d-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.0:1000/sda (txn: txeef18e85539540c88ed2d-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.2:1002/sdc (txn: txeef18e85539540c88ed2d-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.3:1003/sda (txn: txeef18e85539540c88ed2d-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /a/c From Container Server 10.0.0.4:1004/sda (txn: txeef18e85539540c88ed2d-0068c570bb) proxy-ut ERROR: Container HEAD returning 503 for [503, 503, 503, 503, 503] (txn: txeef18e85539540c88ed2d-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx0eb6be2685f44e45bb05a-0068c570bb) proxy-ut ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx0eb6be2685f44e45bb05a-0068c570bb) proxy-ut ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx0eb6be2685f44e45bb05a-0068c570bb) proxy-ut ERROR: Container HEAD returning 503 for [] (txn: tx0eb6be2685f44e45bb05a-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_primary_timeout_container_exist test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_object_to_primary_timeout_container_exist ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_respects_write_affinity test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_respects_write_affinity ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_respects_write_affinity_with_507s test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_respects_write_affinity_with_507s ... ok proxy-ut ERROR: ERROR with Container server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx269456382aed4a0ebe642-0068c570bb) proxy-ut ERROR: ERROR with Container server 10.0.0.0:1000/sda re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx269456382aed4a0ebe642-0068c570bb) proxy-ut ERROR: ERROR with Container server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/a/c: Timeout (Nones) (txn: tx269456382aed4a0ebe642-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 1 (one): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r0', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for policy 0 (zero): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': 'r1', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda, error: test proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx14b4f9e1bc11465bb2029-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txf1f1cf9d129c4fddb4f89-0068c570bb) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txa097ee8115c346a8a64a0-0068c570bb)test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_send_exceptions test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_send_exceptions ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_equal_replicas test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_equal_replicas ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_fewer_container_replicas test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_fewer_container_replicas ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_many_object_replicas test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_many_object_replicas ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_more_container_replicas test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_container_headers_with_more_container_replicas ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_delete_at_with_fewer_container_replicas test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_delete_at_with_fewer_container_replicas ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_delete_at_with_more_container_replicas test.unit.proxy.test_server.TestReplicatedObjectController.test_PUT_x_delete_at_with_more_container_replicas ... ok proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txa097ee8115c346a8a64a0-0068c570bb) proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: txa097ee8115c346a8a64a0-0068c570bb) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o.jpg: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 984, in connect raise HTTPException() http.client.HTTPException (txn: txafd62559168b46dca1e95-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o.jpg From Object Server 10.0.0.0:3000/sda (txn: txafd62559168b46dca1e95-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to PUT /v1/a/c/o.jpg From Object Server 10.0.0.1:3001/sdb (txn: txafd62559168b46dca1e95-0068c570bb) proxy-ut ERROR: Object PUT returning 503 for [503, 503, 503] (txn: txafd62559168b46dca1e95-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut WARNING: expiring_objects_container_divisor is deprecated proxy-ut WARNING: expiring_objects_account_name is deprecated; you need to migrate to the standard .expiring_objects account proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: tx502ee0579a5146ca9ba86-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: tx87a8330caf28456bb9fef-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.2:1002/sdc (txn: tx87a8330caf28456bb9fef-0068c570bb) proxy-ut ERROR: Account HEAD returning 503 for [503, 503] (txn: tx87a8330caf28456bb9fef-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.1:1001/sdb (txn: tx179e0347ded444fcaa225-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.2:1002/sdc (txn: tx179e0347ded444fcaa225-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account From Account Server 10.0.0.0:1000/sda (txn: tx179e0347ded444fcaa225-0068c570bb) proxy-ut ERROR: Account HEAD returning 503 for [503, 503, 503] (txn: tx179e0347ded444fcaa225-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account/container From Container Server 10.0.0.1:1001/sdb (txn: tx5f8693491108441ea7e59-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account/container From Container Server 10.0.0.0:1000/sda (txn: tx5f8693491108441ea7e59-0068c570bb) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account/container From Container Server 10.0.0.2:1002/sdc (txn: tx5f8693491108441ea7e59-0068c570bb) proxy-ut ERROR: Container HEAD returning 503 for [503, 503, 503] (txn: tx5f8693491108441ea7e59-0068c570bb) proxy-ut DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: tx3483724ea13d431f905fa-0068c570bb) proxy-ut DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: tx3483724ea13d431f905fa-0068c570bb) proxy-ut DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: tx3483724ea13d431f905fa-0068c570bb) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: tx3483724ea13d431f905fa-0068c570bb) proxy-ut DEBUG: Node is error limited: 10.0.0.0:1000/sda (txn: txbbc182af116740f7b38fe-0068c570bb) proxy-ut DEBUG: Node is error limited: 10.0.0.2:1002/sdc (txn: txbbc182af116740f7b38fe-0068c570bb)test.unit.proxy.test_server.TestReplicatedObjectController.test_acc_or_con_missing_returns_404 test.unit.proxy.test_server.TestReplicatedObjectController.test_acc_or_con_missing_returns_404 ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_cache_set_error test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_cache_set_error ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_can_skip_cache test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_can_skip_cache ... ok proxy-ut DEBUG: Node is error limited: 10.0.0.1:1001/sdb (txn: txbbc182af116740f7b38fe-0068c570bb) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: txbbc182af116740f7b38fe-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx9f5b710f67814988b2e1e-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx0e2c8dcd4127424e9d28b-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx9829a21b33d6424b958f2-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txd6cdbd5e537d4d449bf47-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx696c715fec7d41c786cd3-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txfe128db5650743038f3f5-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx9e644ba5e7af409d8657e-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx9e644ba5e7af409d8657e-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx0d3a1f0c322d456ab30d0-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx0d3a1f0c322d456ab30d0-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txc590b709f0ce4aaea5811-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txc590b709f0ce4aaea5811-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txc2c8cdba9fea40759357b-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txc2c8cdba9fea40759357b-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx3e2f91abfe5e4e59881d8-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx3e2f91abfe5e4e59881d8-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txd9c2c367e8f74dea9bbc4-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txd9c2c367e8f74dea9bbc4-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txf0066fadfa35409faa2c3-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txf0066fadfa35409faa2c3-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx58a773b57d4442a89863e-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx58a773b57d4442a89863e-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx06dde713e03d4b15b40d4-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx06dde713e03d4b15b40d4-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx78230bfc42404761ba137-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx78230bfc42404761ba137-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx8f9cbb9e06264d72b77f4-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx8f9cbb9e06264d72b77f4-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx8580c452c7a1450da685b-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx8580c452c7a1450da685b-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx5d517c4752e942e0b08f6-0068c570bb) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: tx5d517c4752e942e0b08f6-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txcf51e2f701744959a7fd4-0068c570bb) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: txcf51e2f701744959a7fd4-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txfa8d2ee502c34daf97b4b-0068c570bb) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: txfa8d2ee502c34daf97b4b-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txde316fb0e6fe4790a43fb-0068c570bb) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: txde316fb0e6fe4790a43fb-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx1f28dfa3d21a44b998a85-0068c570bb) proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: tx1f28dfa3d21a44b998a85-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx7a3df0df15b8432383998-0068c570bb)test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_errors test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_errors ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_no_cache test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_no_cache ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_empty_cache test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_empty_cache ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_live_cache test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_live_cache ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_live_infocache test.unit.proxy.test_server.TestReplicatedObjectController.test_backend_headers_update_shard_container_with_live_infocache ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_bad_metadata test.unit.proxy.test_server.TestReplicatedObjectController.test_bad_metadata ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_best_response_sets_etag test.unit.proxy.test_server.TestReplicatedObjectController.test_best_response_sets_etag ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_best_response_sets_headers test.unit.proxy.test_server.TestReplicatedObjectController.test_best_response_sets_headers ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_method test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_method ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_path test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_path ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_path_no_controller test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_path_no_controller ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_utf8 test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_utf8 ... ok proxy-ut WARNING: Failed to get container shard listing from /v1/a/c?format=json&states=updating&includes=o: 404 (txn: tx7a3df0df15b8432383998-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx602110e304964333aea5b-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx2b80a995a74d4efb964fa-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx056f4ebd2a374f1396c93-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx0f4736f1b11d4aa5b7fd0-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txa02c55777089497ebc5d1-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating&includes=o {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txaf8b9dee640d43798e1bd-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txdf335fa5e8a14a35aff99-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txdf335fa5e8a14a35aff99-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx91f682b7de4c445ab06eb-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx91f682b7de4c445ab06eb-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx0c69732af6834f3796f6b-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx0c69732af6834f3796f6b-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx26facfccd19a42beb291d-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx26facfccd19a42beb291d-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: tx83c494f609fa462a9b5c8-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: tx83c494f609fa462a9b5c8-0068c570bb) proxy-ut DEBUG: Get listing from /v1/a/c?format=json&states=updating {'X-Backend-Record-Type': 'shard', 'X-Backend-Record-Shard-Format': 'namespace'} (txn: txf8064d1a024f440fad426-0068c570bb) proxy-ut INFO: Caching updating shards for shard-updating-v2/a/c (3 shards) (txn: txf8064d1a024f440fad426-0068c570bb) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 LICK /v1/a HTTP/1.0 405 - - t - 91 - tx0a9897dc9ea44e679544a-0068c570bb - 0.0004 - - 1757769915.775039673 1757769915.775400400 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 GET invalid HTTP/1.0 404 - - - - 70 - - - 0.0002 - - 1757769915.781615734 1757769915.781840086 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 GET /v1 HTTP/1.0 412 - - t - 7 - - - 0.0002 - - 1757769915.787939548 1757769915.788155079 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 GET /v1/a%2580%3Fformat%3Djson HTTP/1.0 412 - - t - 29 - - - 0.0002 - - 1757769915.794221640 1757769915.794462204 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_version test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_bad_version ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_chunked_put test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_chunked_put ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_head_account test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_head_account ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_unhandled_exception test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_unhandled_exception ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 GET /v0 HTTP/1.0 412 - - - - 7 - - - 0.0002 - - 1757769915.803659678 1757769915.803876877 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf4fbcd52511345d19cb9d-0068c570bb" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx81dab6cdcb604e79aeede-0068c570bb" "proxy-server 1824502" 0.0024 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/1/a/c/o/chunky" 201 - "PUT http://localhost/sdb1/2/a/c/o/chunky" "txe8c3fcb3625a4223b681d-0068c570bb" "object-server 1824502" 0.0004 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/1/a/c/o/chunky" 201 - "PUT http://localhost/sda1/2/a/c/o/chunky" "txe8c3fcb3625a4223b681d-0068c570bb" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/2/a/c/o/chunky" 201 - "PUT http://localhost/v1/a/c/o/chunky" "txe8c3fcb3625a4223b681d-0068c570bb" "proxy-server 1824502" 0.0091 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/2/a/c/o/chunky" 201 - "PUT http://localhost/v1/a/c/o/chunky" "txe8c3fcb3625a4223b681d-0068c570bb" "proxy-server 1824502" 0.0104 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 PUT /v1/a/c/o/chunky HTTP/1.0 201 - - t 21 - - txe8c3fcb3625a4223b681d-0068c570bb - 0.0355 - - 1757769915.813832283 1757769915.849299192 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx84aa2c4f5b244c188593f-0068c570bb" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx078284008d2f4d8dbab8f-0068c570bb" "proxy-server 1824502" 0.0022 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "GET /sda1/2/a/c/o/chunky" 200 21 "GET http://localhost/v1/a/c/o/chunky" "txc6c1bca89dfa4f03bfb99-0068c570bb" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 GET /v1/a/c/o/chunky HTTP/1.0 200 - - t - 21 - txc6c1bca89dfa4f03bfb99-0068c570bb - 0.0124 - - 1757769915.850561857 1757769915.862936020 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1e26ab190f5c40af8fda3-0068c570bb" "proxy-server 1824502" 0.0012 "-" 1824502 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 204 - - t - - - tx1e26ab190f5c40af8fda3-0068c570bb - 0.0038 - - 1757769915.869064808 1757769915.872852564 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 HEAD /v1/a%3Fformat%3Djson HTTP/1.0 500 - - t - - - - - 0.0001 - - 1757769915.879431009 1757769915.879518032 - - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txd445e163cc9948448ce88-0068c570bb" "proxy-server 1824502" 0.0013 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://127.0.0.1:39613/sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txd445e163cc9948448ce88-0068c570bb" "container-server 1824502" 0.0010 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://127.0.0.1:44059/sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txd445e163cc9948448ce88-0068c570bb" "container-server 1824502" 0.0009 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txd445e163cc9948448ce88-0068c570bb" "proxy-server 1824502" 0.0080 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txd445e163cc9948448ce88-0068c570bb" "proxy-server 1824502" 0.0133 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 PUT /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test HTTP/1.0 201 - - t - - - txd445e163cc9948448ce88-0068c570bb - 0.0205 - - 1757769915.886478662 1757769915.906937361 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "GET /sda1/1/a" 200 729 "GET http://localhost/v1/a?format=json" "txa55b9a7a53874b5999076-0068c570bb" "proxy-server 1824502" 0.0021 "-" 1824502 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 GET /v1/a%3Fformat%3Djson HTTP/1.0 200 - - t - 87 - txa55b9a7a53874b5999076-0068c570bb - 0.0050 - - 1757769915.908311129 1757769915.913353205 - - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "GET /sdb1/1/a" 200 729 "GET http://localhost/v1/a?format=json" "tx5a6a381127c04dffa0bbc-0068c570bb" "proxy-server 1824502" 0.0021 "-" 1824502 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 GET /v1/a%3Fformat%3Djson HTTP/1.0 200 - - t - 729 - tx5a6a381127c04dffa0bbc-0068c570bb - 0.0091 - - 1757769915.914917707 1757769915.924045086 - - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "GET /sdb1/1/a" 200 729 "GET http://localhost/v1/a?format=json" "tx39c5a9b24506463fb2631-0068c570bb" "proxy-server 1824502" 0.0015 "-" 1824502 - proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 GET /v1/a%3Fformat%3Djson HTTP/1.0 200 - - t - 963 - tx39c5a9b24506463fb2631-0068c570bb - 0.0088 - - 1757769915.925637722 1757769915.934463978 - - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txdbc8c4e23e6344f2a1cbc-0068c570bb" "proxy-server 1824502" 0.0054 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 204 - "HEAD http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txec3280c79987404681748-0068c570bb" "proxy-server 1824502" 0.0084 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txf677869282234f70bda09-0068c570bb" "object-server 1824502" 0.0005 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txf677869282234f70bda09-0068c570bb" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txf677869282234f70bda09-0068c570bb" "proxy-server 1824502" 0.0069 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "PUT /sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 201 - "PUT http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txf677869282234f70bda09-0068c570bb" "proxy-server 1824502" 0.0084 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 PUT /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test HTTP/1.0 201 - - t - - - txf677869282234f70bda09-0068c570bb - 0.0329 - - 1757769915.940343380 1757769915.973231554 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9a3b2df1713b40f1b04fd-0068c570bb" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "GET /sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 200 328 "GET http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test?format=json&states=listing" "tx9a3b2df1713b40f1b04fd-0068c570bb" "proxy-server 1824502" 0.0035 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/15 GET /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 74 - tx9a3b2df1713b40f1b04fd-0068c570bb - 0.0109 - - 1757769915.974723577 1757769915.985634804 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:15 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx1a4a4f5341ef4b02b5a7e-0068c570bb" "proxy-server 1824502" 0.0014 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 200 328 "GET http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test?format=json&states=listing" "tx1a4a4f5341ef4b02b5a7e-0068c570bb" "proxy-server 1824502" 0.0118 "-" 1824502 0test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_utf8_all_the_way_down test.unit.proxy.test_server.TestReplicatedObjectController.test_chunked_put_utf8_all_the_way_down ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_client_disconnect test.unit.proxy.test_server.TestReplicatedObjectController.test_client_disconnect ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_client_timeout test.unit.proxy.test_server.TestReplicatedObjectController.test_client_timeout ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/16 GET /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 328 - tx1a4a4f5341ef4b02b5a7e-0068c570bb - 0.0261 - - 1757769915.989220858 1757769916.015357018 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx18280a8cfe2041e990e60-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sda1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 200 328 "GET http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test?format=json&states=listing" "tx18280a8cfe2041e990e60-0068c570bc" "proxy-server 1824502" 0.0022 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/16 GET /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test%3Fformat%3Djson%26states%3Dlisting HTTP/1.0 200 - - t - 417 - tx18280a8cfe2041e990e60-0068c570bc - 0.0222 - - 1757769916.017159939 1757769916.039316654 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5995e96c3f28489d80092-0068c570bc" "proxy-server 1824502" 0.0015 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 204 - "HEAD http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "tx7532b8cf29964e39abdf7-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sdb1/3/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" 200 - "GET http://localhost/v1/a/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test/%E1%BC%B8%CE%BF%E1%BD%BA%20%E1%BC%B0%CE%BF%E1%BD%BB%CE%87%20%CF%84%E1%BD%B0%20%CF%80%E1%BD%B1%CE%BD%CF%84%CA%BC%20%E1%BC%82%CE%BD%20%E1%BC%90%CE%BE%E1%BD%B5%CE%BA%CE%BF%CE%B9%20%CF%83%CE%B1%CF%86%E1%BF%86.Test" "txf290a65fd350422fac335-0068c570bc" "proxy-server 1824502" 0.0006 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/16 GET /v1/a/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test/%25E1%25BC%25B8%25CE%25BF%25E1%25BD%25BA%2520%25E1%25BC%25B0%25CE%25BF%25E1%25BD%25BB%25CE%2587%2520%25CF%2584%25E1%25BD%25B0%2520%25CF%2580%25E1%25BD%25B1%25CE%25BD%25CF%2584%25CA%25BC%2520%25E1%25BC%2582%25CE%25BD%2520%25E1%25BC%2590%25CE%25BE%25E1%25BD%25B5%25CE%25BA%25CE%25BF%25CE%25B9%2520%25CF%2583%25CE%25B1%25CF%2586%25E1%25BF%2586.Test HTTP/1.0 200 - - t - - - txf290a65fd350422fac335-0068c570bc - 0.0296 - - 1757769916.041355848 1757769916.070927620 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut WARNING: Client disconnected without sending enough data (txn: tx35641be5d79943ac9d740-0068c570bc) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut WARNING: ERROR Client read timeout (0.05s) (txn: tx2b43f67dc45a402695542-0068c570bc) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx85dfe746e7d7439dac7be-0068c570bc" "proxy-server 1824502" 0.0014 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "PUT /sdb1/1/a/108f4958387a42128b604788bd568a8c" 201 - "PUT http://127.0.0.1:44059/sda1/0/a/108f4958387a42128b604788bd568a8c" "tx85dfe746e7d7439dac7be-0068c570bc" "container-server 1824502" 0.0011 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "PUT /sda1/1/a/108f4958387a42128b604788bd568a8c" 201 - "PUT http://127.0.0.1:39613/sdb1/0/a/108f4958387a42128b604788bd568a8c" "tx85dfe746e7d7439dac7be-0068c570bc" "container-server 1824502" 0.0052 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "PUT /sdb1/0/a/108f4958387a42128b604788bd568a8c" 201 - "PUT http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "tx85dfe746e7d7439dac7be-0068c570bc" "proxy-server 1824502" 0.0278 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "PUT /sda1/0/a/108f4958387a42128b604788bd568a8c" 201 - "PUT http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "tx85dfe746e7d7439dac7be-0068c570bc" "proxy-server 1824502" 0.0239 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/16 PUT /v1/a/108f4958387a42128b604788bd568a8c HTTP/1.0 201 - - t - - - tx85dfe746e7d7439dac7be-0068c570bc - 0.0542 - - 1757769916.586835623 1757769916.641024590 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx9ee9723c86dc4ebb9b80a-0068c570bc" "proxy-server 1824502" 0.0019 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "txf4a47da82d8647cdadecf-0068c570bc" "proxy-server 1824502" 0.0014 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "PUT /sda1/0/a/108f4958387a42128b604788bd568a8c/conditionals" 201 - "PUT http://localhost/sda1/2/a/108f4958387a42128b604788bd568a8c/conditionals" "tx7a7a4a0cc59640218db78-0068c570bc" "object-server 1824502" 0.0005 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "PUT /sdb1/0/a/108f4958387a42128b604788bd568a8c/conditionals" 201 - "PUT http://localhost/sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" "tx7a7a4a0cc59640218db78-0068c570bc" "object-server 1824502" 0.0005 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "PUT /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 201 - "PUT http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx7a7a4a0cc59640218db78-0068c570bc" "proxy-server 1824502" 0.0163 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "PUT /sda1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 201 - "PUT http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx7a7a4a0cc59640218db78-0068c570bc" "proxy-server 1824502" 0.0160 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/16 PUT /v1/a/108f4958387a42128b604788bd568a8c/conditionals HTTP/1.0 201 - - t 52 - - tx7a7a4a0cc59640218db78-0068c570bc - 0.0482 - - 1757769916.642524719 1757769916.690696001 0 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txa7a9e8a60d3b4284aedd7-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "txeac2d42694224febbb734-0068c570bc" "proxy-server 1824502" 0.0060 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 200 52 "GET http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx7ca1b3071ed7439c882cc-0068c570bc" "proxy-server 1824502" 0.0007 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txabdde51df70244bfb5cb4-0068c570bc" "proxy-server 1824502" 0.0080 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "txa884fa8a60ed4ff8a5b0d-0068c570bc" "proxy-server 1824502" 0.0061 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sda1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 412 - "GET http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx493782f44ea844f893445-0068c570bc" "proxy-server 1824502" 0.0007 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 412 - "GET http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx493782f44ea844f893445-0068c570bc" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5461946b109741e38c165-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "tx11c68263ff0b48d39cfce-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 200 52 "GET http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx0b90bf6f7351406282fdb-0068c570bc" "proxy-server 1824502" 0.0007 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx12d21ee17ca8430b9573a-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "tx5eaae09d0d614a628b86d-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 304 - "GET http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx2e58d16f09534fe5b224d-0068c570bc" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx725aaf7f21544195b0504-0068c570bc" "proxy-server 1824502" 0.0012 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "txe7e63691d3bd426894a80-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 200 52 "GET http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx304acbddcd494660a40e2-0068c570bc" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txf0be50d3618b4bd698037-0068c570bc" "proxy-server 1824502" 0.0093 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "tx7e6a93e64fda4df2a8e2d-0068c570bc" "proxy-server 1824502" 0.0036 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "GET /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 304 - "GET http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "txc506d5efcb9a4a8daf166-0068c570bc" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc375bd6eda024650a1b5b-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "txa4eee8440bf14246b8869-0068c570bc" "proxy-server 1824502" 0.0097 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 200 52 "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx0d5706cd3dc84bde8f2cd-0068c570bc" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx70c7bb0a8d314e76b7c85-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "txbf8cf22404544920ade5c-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 412 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx0717c31d6db74b09b80ab-0068c570bc" "proxy-server 1824502" 0.0006 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 412 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx0717c31d6db74b09b80ab-0068c570bc" "proxy-server 1824502" 0.0005 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc347c956825b452aa21dc-0068c570bc" "proxy-server 1824502" 0.0036 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "tx57c30c72fa454c48846ed-0068c570bc" "proxy-server 1824502" 0.0014 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 200 52 "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "txd89ad919746e414b8eaca-0068c570bc" "proxy-server 1824502" 0.0006 "-" 1824502 0test.unit.proxy.test_server.TestReplicatedObjectController.test_conditional_GET_replication test.unit.proxy.test_server.TestReplicatedObjectController.test_conditional_GET_replication ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_conditional_range_get test.unit.proxy.test_server.TestReplicatedObjectController.test_conditional_range_get ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_custom_mime_types_files test.unit.proxy.test_server.TestReplicatedObjectController.test_custom_mime_types_files ... ok acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx229f189418f54dfdbdd7a-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "tx907abb15c5e3474e863c5-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sda1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 304 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "txcabb7c04e44b41ee92bf6-0068c570bc" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:16 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb90c0574dabd46fc90514-0068c570bc" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sda1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "tx33dc6b90840144e5b55e1-0068c570bc" "proxy-server 1824502" 0.0135 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 200 52 "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx85006b058e9c4c7cbc5a3-0068c570bd" "proxy-server 1824502" 0.0006 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx45407d4a41c14d509e604-0068c570bd" "proxy-server 1824502" 0.0055 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sdb1/0/a/108f4958387a42128b604788bd568a8c" 204 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c" "tx80eff8eeb5444d7789c4b-0068c570bd" "proxy-server 1824502" 0.0014 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sdb1/2/a/108f4958387a42128b604788bd568a8c/conditionals" 304 - "HEAD http://localhost/v1/a/108f4958387a42128b604788bd568a8c/conditionals" "tx13753808af484580aa4f3-0068c570bd" "proxy-server 1824502" 0.0005 "-" 1824502 0 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8a4335310c8e42a8a99d9-0068c570bd" "proxy-server 1824502" 0.0013 "-" 1824502 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sdb1/1/a/con" 201 - "PUT http://127.0.0.1:39613/sdb1/0/a/con" "tx8a4335310c8e42a8a99d9-0068c570bd" "container-server 1824502" 0.0092 "-" 1824502 0 acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sda1/1/a/con" 201 - "PUT http://127.0.0.1:44059/sda1/0/a/con" "tx8a4335310c8e42a8a99d9-0068c570bd" "container-server 1824502" 0.0010 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sda1/0/a/con" 201 - "PUT http://localhost/v1/a/con" "tx8a4335310c8e42a8a99d9-0068c570bd" "proxy-server 1824502" 0.0161 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sdb1/0/a/con" 201 - "PUT http://localhost/v1/a/con" "tx8a4335310c8e42a8a99d9-0068c570bd" "proxy-server 1824502" 0.0255 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/17 PUT /v1/a/con HTTP/1.0 201 - - t - - - tx8a4335310c8e42a8a99d9-0068c570bd - 0.0412 - - 1757769917.053427458 1757769917.094594240 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0168f3290de64f2ea82b6-0068c570bd" "proxy-server 1824502" 0.0061 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sda1/0/a/con" 204 - "HEAD http://localhost/v1/a/con" "tx3ffd3b9e595b4b04bb7b2-0068c570bd" "proxy-server 1824502" 0.0012 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sda1/0/a/con/o" 201 - "PUT http://localhost/sda1/2/a/con/o" "tx7078fa8724ff436190003-0068c570bd" "object-server 1824502" 0.0005 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sdb1/0/a/con/o" 201 - "PUT http://localhost/sdb1/2/a/con/o" "tx7078fa8724ff436190003-0068c570bd" "object-server 1824502" 0.0004 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sda1/2/a/con/o" 201 - "PUT http://localhost/v1/a/con/o" "tx7078fa8724ff436190003-0068c570bd" "proxy-server 1824502" 0.0144 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sdb1/2/a/con/o" 201 - "PUT http://localhost/v1/a/con/o" "tx7078fa8724ff436190003-0068c570bd" "proxy-server 1824502" 0.0300 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/17 PUT /v1/a/con/o HTTP/1.0 201 - - t 10 - - tx7078fa8724ff436190003-0068c570bd - 0.0488 - - 1757769917.100323439 1757769917.149150372 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txe37c170f40d94cba8e5c8-0068c570bd" "proxy-server 1824502" 0.0014 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sda1/0/a/con" 204 - "HEAD http://localhost/v1/a/con" "tx77b61df129c1464b8251b-0068c570bd" "proxy-server 1824502" 0.0109 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "GET /sdb1/2/a/con/o" 304 - "GET http://localhost/v1/a/con/o" "tx9f41d29c79ab49afa07e6-0068c570bd" "proxy-server 1824502" 0.0067 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/17 GET /v1/a/con/o HTTP/1.0 304 - - t - - - tx9f41d29c79ab49afa07e6-0068c570bd - 0.0297 - - 1757769917.150536299 1757769917.180196047 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) test DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx3a5f4e3c973c4370b24d1-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txab5ad38abfbe47c29f15b-0068c570bd) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txab5ad38abfbe47c29f15b-0068c570bd) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txab5ad38abfbe47c29f15b-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx399556eeb5cd43619f001-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx399556eeb5cd43619f001-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx399556eeb5cd43619f001-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx399556eeb5cd43619f001-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx21c6d85d41244f438a519-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx21c6d85d41244f438a519-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx21c6d85d41244f438a519-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx21c6d85d41244f438a519-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx318eb46df3084743a6645-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx318eb46df3084743a6645-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx318eb46df3084743a6645-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx318eb46df3084743a6645-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx2650961cf9af49b6a0f68-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx2650961cf9af49b6a0f68-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx2650961cf9af49b6a0f68-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx2650961cf9af49b6a0f68-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx1a3c31755fca46ca936a4-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx1a3c31755fca46ca936a4-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx1a3c31755fca46ca936a4-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx1a3c31755fca46ca936a4-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx992727afcb6b42a699a8e-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx992727afcb6b42a699a8e-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx992727afcb6b42a699a8e-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx992727afcb6b42a699a8e-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx593ba3160d1546c784b69-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx593ba3160d1546c784b69-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx593ba3160d1546c784b69-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx593ba3160d1546c784b69-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txb390e9de1c954959a44ad-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txb390e9de1c954959a44ad-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txb390e9de1c954959a44ad-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txb390e9de1c954959a44ad-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx75ccc196618d4f5083b2e-0068c570bd) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda (txn: tx75ccc196618d4f5083b2e-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx75ccc196618d4f5083b2e-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx75ccc196618d4f5083b2e-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx75ccc196618d4f5083b2e-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx75ccc196618d4f5083b2e-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txfa3dfe0ccda849f2be97a-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txfa3dfe0ccda849f2be97a-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txfa3dfe0ccda849f2be97a-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503] (txn: txfa3dfe0ccda849f2be97a-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx69c9c241ea134e8bb910b-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx69c9c241ea134e8bb910b-0068c570bd) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.1:3001/sdb (txn: tx69c9c241ea134e8bb910b-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx69c9c241ea134e8bb910b-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx69c9c241ea134e8bb910b-0068c570bd) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.2:3002/sdc (txn: tx69c9c241ea134e8bb910b-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx69c9c241ea134e8bb910b-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503] (txn: tx69c9c241ea134e8bb910b-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx83174d5d900e421580308-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx83174d5d900e421580308-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx83174d5d900e421580308-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx83174d5d900e421580308-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx03049f0e4bd34cba9be6c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx03049f0e4bd34cba9be6c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx03049f0e4bd34cba9be6c-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx03049f0e4bd34cba9be6c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx6a4fa8b231e043fa8e522-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx6a4fa8b231e043fa8e522-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx6a4fa8b231e043fa8e522-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx6a4fa8b231e043fa8e522-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txa059f8cf80b34ed4964b9-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txa059f8cf80b34ed4964b9-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txa059f8cf80b34ed4964b9-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: txa059f8cf80b34ed4964b9-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx391a28b69b8a4df98bcc3-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx391a28b69b8a4df98bcc3-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx391a28b69b8a4df98bcc3-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx391a28b69b8a4df98bcc3-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx663e4fa277014c01b1fa7-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx663e4fa277014c01b1fa7-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx663e4fa277014c01b1fa7-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx663e4fa277014c01b1fa7-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx5a9d8c72af43466fb67d5-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx5a9d8c72af43466fb67d5-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx5a9d8c72af43466fb67d5-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx5a9d8c72af43466fb67d5-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txee086fae30be4408a5068-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txee086fae30be4408a5068-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txee086fae30be4408a5068-0068c570bd)test.unit.proxy.test_server.TestReplicatedObjectController.test_error_limiting test.unit.proxy.test_server.TestReplicatedObjectController.test_error_limiting ... ok proxy-ut ERROR: Object GET returning 503 for [] (txn: txee086fae30be4408a5068-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txa280e2f7337b4f4d8a592-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txa280e2f7337b4f4d8a592-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txa280e2f7337b4f4d8a592-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: txa280e2f7337b4f4d8a592-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txbff0a77cdd0241fa920a7-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txbff0a77cdd0241fa920a7-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txbff0a77cdd0241fa920a7-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: txbff0a77cdd0241fa920a7-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx955b179ab9a14b668de5d-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx955b179ab9a14b668de5d-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx955b179ab9a14b668de5d-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx955b179ab9a14b668de5d-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx0a76e9163d2c4502b1c5d-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx0a76e9163d2c4502b1c5d-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx0a76e9163d2c4502b1c5d-0068c570bd) proxy-ut ERROR: Object PUT returning 503, 0/2 required connections (txn: tx0a76e9163d2c4502b1c5d-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txf06a2cc4654d4fed9bae7-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txf06a2cc4654d4fed9bae7-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txf06a2cc4654d4fed9bae7-0068c570bd) proxy-ut ERROR: Object PUT returning 503, 0/2 required connections (txn: txf06a2cc4654d4fed9bae7-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx75de41a61706463cb4976-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx75de41a61706463cb4976-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx75de41a61706463cb4976-0068c570bd) proxy-ut ERROR: Object GET returning 503 for (503, 503, 503) (txn: tx75de41a61706463cb4976-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx50830700c38a486c87b57-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx50830700c38a486c87b57-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx50830700c38a486c87b57-0068c570bd) proxy-ut ERROR: Object GET returning 503 for (503, 503, 503) (txn: tx50830700c38a486c87b57-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txc1444952f7a84ddcba988-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txc1444952f7a84ddcba988-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txc1444952f7a84ddcba988-0068c570bd) proxy-ut ERROR: Object GET returning 503 for (503, 503, 503) (txn: txc1444952f7a84ddcba988-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx7d9b20f7ca71437198164-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx7d9b20f7ca71437198164-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx7d9b20f7ca71437198164-0068c570bd) proxy-ut ERROR: Object GET returning 503 for (503, 503, 503) (txn: tx7d9b20f7ca71437198164-0068c570bd) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txf61725fc62834cdcb9744-0068c570bd) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txf61725fc62834cdcb9744-0068c570bd) proxy-ut ERROR: ERROR with Account server 10.0.0.0:1000/sda re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txb9e95a0421f649dfbd7d4-0068c570bd) proxy-ut ERROR: ERROR with Account server 10.0.0.1:1001/sdb re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txb9e95a0421f649dfbd7d4-0068c570bd) proxy-ut ERROR: ERROR with Account server 10.0.0.2:1002/sdc re: Trying to HEAD /v1/account: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/base.py", line 1532, in _make_node_request possible_source = conn.getresponse() File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 831, in getresponse raise Exception('test') Exception: test (txn: txb9e95a0421f649dfbd7d4-0068c570bd) proxy-ut ERROR: Account HEAD returning 503 for [] (txn: txb9e95a0421f649dfbd7d4-0068c570bd) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx85a5a1fbafa34b54a2a18-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txd3aaea86b9f24d23876bf-0068c570bd) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txd3aaea86b9f24d23876bf-0068c570bd) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txd3aaea86b9f24d23876bf-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txbab9f833b6c148928919e-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txbab9f833b6c148928919e-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txbab9f833b6c148928919e-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txbab9f833b6c148928919e-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx5dcbc6e0581a4dc7aecc7-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx5dcbc6e0581a4dc7aecc7-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx5dcbc6e0581a4dc7aecc7-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx5dcbc6e0581a4dc7aecc7-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx030ec56d60434817a6cc8-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx030ec56d60434817a6cc8-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx030ec56d60434817a6cc8-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx030ec56d60434817a6cc8-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx76b353c2d5ef4436be8f7-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx76b353c2d5ef4436be8f7-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx76b353c2d5ef4436be8f7-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx76b353c2d5ef4436be8f7-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txb566e3150f904fb6b4059-0068c570bd)test.unit.proxy.test_server.TestReplicatedObjectController.test_error_limiting_survives_ring_reload test.unit.proxy.test_server.TestReplicatedObjectController.test_error_limiting_survives_ring_reload ... ok proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txb566e3150f904fb6b4059-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txb566e3150f904fb6b4059-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txb566e3150f904fb6b4059-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txcea1252f3306416d9a1ee-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txcea1252f3306416d9a1ee-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txcea1252f3306416d9a1ee-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txcea1252f3306416d9a1ee-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: tx7aff723f50bb48dbb6824-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx7aff723f50bb48dbb6824-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx7aff723f50bb48dbb6824-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: tx7aff723f50bb48dbb6824-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txceb48592c1ed47cb9979a-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txceb48592c1ed47cb9979a-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txceb48592c1ed47cb9979a-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txceb48592c1ed47cb9979a-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.0:3000/sda (txn: txdb340e18d93540ae8875b-0068c570bd) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda (txn: txdb340e18d93540ae8875b-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txdb340e18d93540ae8875b-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txdb340e18d93540ae8875b-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txdb340e18d93540ae8875b-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503, 503] (txn: txdb340e18d93540ae8875b-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx2235d1d8ca734d1f89d4c-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: tx2235d1d8ca734d1f89d4c-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: tx2235d1d8ca734d1f89d4c-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503] (txn: tx2235d1d8ca734d1f89d4c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txf376208fd1cb4caa83971-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.1:3001/sdb (txn: txf376208fd1cb4caa83971-0068c570bd) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.1:3001/sdb (txn: txf376208fd1cb4caa83971-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txf376208fd1cb4caa83971-0068c570bd) proxy-ut ERROR: ERROR 503 b'' Trying to GET /a/c/o From Object Server 10.0.0.2:3002/sdc (txn: txf376208fd1cb4caa83971-0068c570bd) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.2:3002/sdc (txn: txf376208fd1cb4caa83971-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txf376208fd1cb4caa83971-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [503, 503] (txn: txf376208fd1cb4caa83971-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx7ec05516ffc142278444c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx7ec05516ffc142278444c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx7ec05516ffc142278444c-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx7ec05516ffc142278444c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx9cc41df15f1741e29312a-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx9cc41df15f1741e29312a-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx9cc41df15f1741e29312a-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx9cc41df15f1741e29312a-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx37fef01c4f4349dd8ae29-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx37fef01c4f4349dd8ae29-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx37fef01c4f4349dd8ae29-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx37fef01c4f4349dd8ae29-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx250bc4df7d384bd0aeed3-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx250bc4df7d384bd0aeed3-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx250bc4df7d384bd0aeed3-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx250bc4df7d384bd0aeed3-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx4829b27e59344615a522c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx4829b27e59344615a522c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx4829b27e59344615a522c-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx4829b27e59344615a522c-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx30c3b9d6747346a8ada83-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx30c3b9d6747346a8ada83-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx30c3b9d6747346a8ada83-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx30c3b9d6747346a8ada83-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txd67e790a83fc44d5a4a85-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txd67e790a83fc44d5a4a85-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txd67e790a83fc44d5a4a85-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: txd67e790a83fc44d5a4a85-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txf95dcd9c89464cffac67d-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txf95dcd9c89464cffac67d-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txf95dcd9c89464cffac67d-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: txf95dcd9c89464cffac67d-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txd12badc25e2946d4921d6-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txd12badc25e2946d4921d6-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txd12badc25e2946d4921d6-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: txd12badc25e2946d4921d6-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: tx18d9f690da484afda1438-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: tx18d9f690da484afda1438-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: tx18d9f690da484afda1438-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: tx18d9f690da484afda1438-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda (txn: txc8ab5cad3a734cd9aaf81-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb (txn: txc8ab5cad3a734cd9aaf81-0068c570bd) proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc (txn: txc8ab5cad3a734cd9aaf81-0068c570bd) proxy-ut ERROR: Object GET returning 503 for [] (txn: txc8ab5cad3a734cd9aaf81-0068c570bd) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app)test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_calls_sort_nodes test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_calls_sort_nodes ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_gives_extra_if_error_limited_inline test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_gives_extra_if_error_limited_inline ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_skips_error_limited test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_skips_error_limited ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_with_replication_network test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_with_replication_network ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_without_replication_network test.unit.proxy.test_server.TestReplicatedObjectController.test_iter_nodes_without_replication_network ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_leak_1 test.unit.proxy.test_server.TestReplicatedObjectController.test_leak_1 ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_mismatched_etags test.unit.proxy.test_server.TestReplicatedObjectController.test_mismatched_etags ... ok proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut WARNING: Handoff requested (5) proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb proxy-ut WARNING: Handoff requested (5) proxy-ut WARNING: Handoff requested (6) proxy-ut DEBUG: Node is error limited: 10.0.0.1:3001/sdb proxy-ut DEBUG: Node is error limited: 10.0.0.3:3003/sdd proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut DEBUG: Node is error limited: 10.0.0.2:3002/sdc proxy-ut WARNING: Handoff requested (7) proxy-ut WARNING: Handoff requested (8) proxy-ut WARNING: Handoff requested (9) proxy-ut WARNING: Handoff requested (10) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda, error: test proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut WARNING: Handoff requested (4) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Node will be error limited for 60.00s: 10.0.0.0:3000/sda, error: test proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut DEBUG: Node is error limited: 10.0.0.0:3000/sda proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb8d87b456d944d0f8afac-0068c570bd" "proxy-server 1824502" 0.0045 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txe3300ab9d1e343dbb386f-0068c570bd" "proxy-server 1824502" 0.0026 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sdb1/1/a/c/test_leak_1" 201 - "PUT http://localhost/sdb1/1/a/c/test_leak_1" "tx8e448bd3d19a4492b6e43-0068c570bd" "object-server 1824502" 0.0005 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sda1/1/a/c/test_leak_1" 201 - "PUT http://localhost/sda1/1/a/c/test_leak_1" "tx8e448bd3d19a4492b6e43-0068c570bd" "object-server 1824502" 0.0004 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sdb1/1/a/c/test_leak_1" 201 - "PUT http://localhost/v1/a/c/test_leak_1" "tx8e448bd3d19a4492b6e43-0068c570bd" "proxy-server 1824502" 0.0139 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:17 +0000] "PUT /sda1/1/a/c/test_leak_1" 201 - "PUT http://localhost/v1/a/c/test_leak_1" "tx8e448bd3d19a4492b6e43-0068c570bd" "proxy-server 1824502" 0.0137 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/17 PUT /v1/a/c/test_leak_1 HTTP/1.0 201 - - t 131072 - - tx8e448bd3d19a4492b6e43-0068c570bd - 0.0321 - - 1757769917.783687592 1757769917.815769434 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:18 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx4a768fe913d242f08b0e5-0068c570be" "proxy-server 1824502" 0.0014 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:18 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txdbfcc9f5dcd24256a2003-0068c570be" "proxy-server 1824502" 0.0031 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:18 +0000] "GET /sda1/1/a/c/test_leak_1" 200 131072 "GET http://localhost/v1/a/c/test_leak_1" "txced1de7941ac4de3a5a57-0068c570be" "proxy-server 1824502" 0.0008 "-" 1824502 0 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/18 GET /v1/a/c/test_leak_1 HTTP/1.0 200 - - t - 131072 - txced1de7941ac4de3a5a57-0068c570be - 0.0157 - - 1757769918.266067266 1757769918.281815529 0 - proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.2:3002/sdc re: Expect: 100-continue on /a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx0bc1e992e26b4a2398bec-0068c570be) proxy-ut ERROR: Object servers returned 2 mismatched etags (txn: tx0bc1e992e26b4a2398bec-0068c570be) proxy-ut ERROR: ERROR 503 b'' Trying to HEAD /account/container From Container Server 10.0.0.2:1002/sdc (txn: tx35c503df1a6f4258aa062-0068c570be) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.1:3001/sdb (txn: txc06fa25f91c04ca0b3499-0068c570be) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.2:3002/sdc (txn: txc06fa25f91c04ca0b3499-0068c570be)test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_first_two_time_out_etags_match test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_first_two_time_out_etags_match ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_one_time_out_one_etag_mismatch test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_one_time_out_one_etag_mismatch ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_one_time_out_two_etag_mismatch test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_one_time_out_two_etag_mismatch ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_only_first_time_out test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_only_first_time_out ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_three_time_out test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_three_time_out ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_two_time_out test.unit.proxy.test_server.TestReplicatedObjectController.test_node_read_timeout_retry_two_time_out ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_node_request_setting test.unit.proxy.test_server.TestReplicatedObjectController.test_node_request_setting ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_node_write_timeout test.unit.proxy.test_server.TestReplicatedObjectController.test_node_write_timeout ... ok proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.0:3000/sda (txn: txe53ff96968ad4ab79021a-0068c570bf) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.2:3002/sdc (txn: tx769a106f358644a896112-0068c570bf) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx769a106f358644a896112-0068c570bf) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.2:3002/sdc (txn: txab636180099f4a978964f-0068c570bf) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.2:3002/sdc (txn: txd4645894a8cb49e5a3ded-0068c570bf) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.0:3000/sda (txn: txd4645894a8cb49e5a3ded-0068c570bf) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.1:3001/sdb (txn: txd4645894a8cb49e5a3ded-0068c570bf) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: txd4645894a8cb49e5a3ded-0068c570bf) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.0:3000/sda (txn: txe180f2f0c5ee4616b34a8-0068c570c0) proxy-ut ERROR: Trying to read object during GET (retrying) 10.0.0.1:3001/sdb (txn: txe180f2f0c5ee4616b34a8-0068c570c0) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut ERROR: ERROR with Object server 10.0.0.0:3000/sda re: Expect: 100-continue on /a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx7fce2adeb46d40018b7c1-0068c570c1) proxy-ut ERROR: ERROR with Object server 10.0.0.1:3001/sdb re: Expect: 100-continue on /a/c/o: Traceback (most recent call last): File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 722, in _connect_put_node putter = self._make_putter(node, part, req, headers) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 972, in _make_putter putter = Putter.connect( node, part, req.swift_entity_path, headers, self.app.watchdog, ...<4 lines>... logger=self.logger, chunked=te.endswith(',chunked')) File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1839, in connect conn, expect_resp, final_resp, connect_duration = cls._make_connection( ~~~~~~~~~~~~~~~~~~~~^ node, part, path, headers, conn_timeout, node_timeout) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/build/reproducible-path/swift-2.36.0/swift/proxy/controllers/obj.py", line 1803, in _make_connection conn = http_connect(ip, port, node['device'], part, 'PUT', path, headers) File "/build/reproducible-path/swift-2.36.0/test/unit/__init__.py", line 963, in connect i, status = next(conn_id_and_code_iter) ~~~~^^^^^^^^^^^^^^^^^^^^^^^ StopIteration (txn: tx7fce2adeb46d40018b7c1-0068c570c1) proxy-ut ERROR: Object PUT returning 503, 1/2 required connections (txn: tx7fce2adeb46d40018b7c1-0068c570c1) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx89b124bcfefa4ce48571a-0068c570c1" "proxy-server 1824502" 0.0055 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "HEAD /sda1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "tx25c143b16d0c46e590315-0068c570c1" "proxy-server 1824502" 0.0014 "-" 1824502 0 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "PUT /sda1/1/a/c/o" 201 - "PUT http://localhost/sda1/2/a/c/o" "txe4a87f018f534fb3b57b0-0068c570c1" "object-server 1824502" 0.0005 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "PUT /sda1/2/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "txe4a87f018f534fb3b57b0-0068c570c1" "proxy-server 1824502" 0.0169 "-" 1824502 0 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "PUT /sdb1/1/a/c/o" 201 - "PUT http://localhost/sdb1/2/a/c/o" "txe4a87f018f534fb3b57b0-0068c570c1" "object-server 1824502" 0.0005 "-" 1824502 0 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "PUT /sdb1/2/a/c/o" 201 - "PUT http://localhost/v1/a/c/o" "txe4a87f018f534fb3b57b0-0068c570c1" "proxy-server 1824502" 0.0197 "-" 1824502 0test.unit.proxy.test_server.TestReplicatedObjectController.test_policy_IO test.unit.proxy.test_server.TestReplicatedObjectController.test_policy_IO ... ok proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/21 PUT /v1/a/c/o HTTP/1.0 201 - - t 12 - - txe4a87f018f534fb3b57b0-0068c570c1 - 0.0560 - - 1757769921.871750593 1757769921.927789927 0 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx191c601fb590488fb3167-0068c570c1" "proxy-server 1824502" 0.0096 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "HEAD /sdb1/1/a/c" 204 - "HEAD http://localhost/v1/a/c" "txec10b225b6204510a5127-0068c570c1" "proxy-server 1824502" 0.0089 "-" 1824502 0 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "GET /sda1/2/a/c/o" 200 12 "GET http://localhost/v1/a/c/o" "txa760682ff93245b093053-0068c570c1" "proxy-server 1824502" 0.0007 "-" 1824502 0 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb2fe3c7a1d834bf997be1-0068c570c1" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:21 +0000] "HEAD /sda1/2/a/c1" 204 - "HEAD http://localhost/v1/a/c1" "tx530c5d69b8024d0c984e9-0068c570c1" "proxy-server 1824502" 0.0056 "-" 1824502 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sda1/2/a/c1/o" 201 - "PUT http://localhost/sdc1/1/a/c1/o" "txe2912ba803534f91af0a3-0068c570c1" "object-server 1824502" 0.0005 "-" 1824502 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sdb1/2/a/c1/o" 201 - "PUT http://localhost/sdd1/1/a/c1/o" "txe2912ba803534f91af0a3-0068c570c1" "object-server 1824502" 0.0004 "-" 1824502 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sdd1/1/a/c1/o" 201 - "PUT http://localhost/v1/a/c1/o" "txe2912ba803534f91af0a3-0068c570c1" "proxy-server 1824502" 0.0114 "-" 1824502 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sdc1/1/a/c1/o" 201 - "PUT http://localhost/v1/a/c1/o" "txe2912ba803534f91af0a3-0068c570c1" "proxy-server 1824502" 0.0133 "-" 1824502 1 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/22 PUT /v1/a/c1/o HTTP/1.0 201 - - t 12 - - txe2912ba803534f91af0a3-0068c570c1 - 0.0383 - - 1757769921.975677729 1757769922.013945580 1 - acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx5b75d1c897cb48189688b-0068c570c2" "proxy-server 1824502" 0.0013 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/2/a/c1" 204 - "HEAD http://localhost/v1/a/c1" "txf7b75214072a4e12b8197-0068c570c2" "proxy-server 1824502" 0.0076 "-" 1824502 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "GET /sdd1/1/a/c1/o" 200 12 "GET http://localhost/v1/a/c1/o" "tx3ec420b411fd4afd85d0f-0068c570c2" "proxy-server 1824502" 0.0006 "-" 1824502 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txc501b92718a847fcb8a33-0068c570c2" "proxy-server 1824502" 0.0095 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/1/a/c2" 204 - "HEAD http://localhost/v1/a/c2" "txf01b2cd8233d4798845ab-0068c570c2" "proxy-server 1824502" 0.0013 "-" 1824502 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sdb1/1/a/c2/o" 201 - "PUT http://localhost/sde1/0/a/c2/o" "tx09bf5e2039c343889c7f3-0068c570c2" "object-server 1824502" 0.0005 "-" 1824502 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sda1/1/a/c2/o" 201 - "PUT http://localhost/sdf1/0/a/c2/o" "tx09bf5e2039c343889c7f3-0068c570c2" "object-server 1824502" 0.0083 "-" 1824502 2 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sdf1/0/a/c2/o" 201 - "PUT http://localhost/v1/a/c2/o" "tx09bf5e2039c343889c7f3-0068c570c2" "proxy-server 1824502" 0.0240 "-" 1824502 2 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sde1/0/a/c2/o" 201 - "PUT http://localhost/v1/a/c2/o" "tx09bf5e2039c343889c7f3-0068c570c2" "proxy-server 1824502" 0.0237 "-" 1824502 2 proxy INFO: 127.0.0.1 127.0.0.1 13/Sep/2025/13/25/22 PUT /v1/a/c2/o HTTP/1.0 201 - - t 12 - - tx09bf5e2039c343889c7f3-0068c570c2 - 0.0714 - - 1757769922.062513828 1757769922.133919954 2 - acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx2d3bd5452b244b27bf5cf-0068c570c2" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sda1/1/a/c2" 204 - "HEAD http://localhost/v1/a/c2" "tx8a08b83efe634ad384283-0068c570c2" "proxy-server 1824502" 0.0117 "-" 1824502 2 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "GET /sdf1/0/a/c2/o" 200 12 "GET http://localhost/v1/a/c2/o" "tx0fe96b31243240fe847fc-0068c570c2" "proxy-server 1824502" 0.0006 "-" 1824502 2 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) acct1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sda1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8c6d56957e454220b53ba-0068c570c2" "proxy-server 1824502" 0.0013 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sda1/2/a/c1" 204 - "HEAD http://localhost/v1/a/c1" "tx8c6d56957e454220b53ba-0068c570c2" "proxy-server 1824502" 0.0077 "-" 1824502 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx8bdb759ad58e472b838dd-0068c570c2" "proxy-server 1824502" 0.0095 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/2/a/c1" 204 - "HEAD http://localhost/v1/a/c1" "tx0b58521086fb4bccbcc8a-0068c570c2" "proxy-server 1824502" 0.0096 "-" 1824502 1 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sdb1/2/a/c1/wrong-o" 201 - "PUT http://localhost/sdf1/1/a/c1/wrong-o" "txa5cba9c155a74fc8b2191-0068c570c2" "object-server 1824502" 0.0005 "-" 1824502 2 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sdf1/1/a/c1/wrong-o" 201 - "PUT http://localhost/v1/a/c1/wrong-o" "txa5cba9c155a74fc8b2191-0068c570c2" "proxy-server 1824502" 0.0137 "-" 1824502 2 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sda1/2/a/c1/wrong-o" 201 - "PUT http://localhost/sde1/1/a/c1/wrong-o" "txa5cba9c155a74fc8b2191-0068c570c2" "object-server 1824502" 0.0004 "-" 1824502 2 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "PUT /sde1/1/a/c1/wrong-o" 201 - "PUT http://localhost/v1/a/c1/wrong-o" "txa5cba9c155a74fc8b2191-0068c570c2" "proxy-server 1824502" 0.0244 "-" 1824502 2 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "txb2f6265d0e074b4194b2b-0068c570c2" "proxy-server 1824502" 0.0012 "-" 1824502 - cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/2/a/c1" 204 - "HEAD http://localhost/v1/a/c1" "tx5372348e91dc41a2a119c-0068c570c2" "proxy-server 1824502" 0.0026 "-" 1824502 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "GET /sdc1/1/a/c1/wrong-o" 404 70 "GET http://localhost/v1/a/c1/wrong-o" "tx9b33df77dc5741e4b66c5-0068c570c2" "proxy-server 1824502" 0.0003 "-" 1824502 1 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "GET /sdd1/1/a/c1/wrong-o" 404 70 "GET http://localhost/v1/a/c1/wrong-o" "tx9b33df77dc5741e4b66c5-0068c570c2" "proxy-server 1824502" 0.0003 "-" 1824502 1 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx96cd856a38004339a237c-0068c570c2" "proxy-server 1824502" 0.0053 "-" 1824502 - cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sda1/2/a/c1" 204 - "HEAD http://localhost/v1/a/c1" "tx9d1ec19cd5c94249a1b4d-0068c570c2" "proxy-server 1824502" 0.0077 "-" 1824502 1 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "GET /sde1/1/a/c1/wrong-o" 200 5 "GET http://localhost/v1/a/c1/wrong-o" "tx63e01256972b408c8d77e-0068c570c2" "proxy-server 1824502" 0.0006 "-" 1824502 2 acct2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sdb1/1/a" 204 - "HEAD http://localhost/v1/a?format=json" "tx0e51f9c538da4a749cf27-0068c570c2" "proxy-server 1824502" 0.0054 "-" 1824502 -test.unit.proxy.test_server.TestReplicatedObjectController.test_policy_IO_override test.unit.proxy.test_server.TestReplicatedObjectController.test_policy_IO_override ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_proxy_passes_content_length_on_head test.unit.proxy.test_server.TestReplicatedObjectController.test_proxy_passes_content_length_on_head ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_proxy_passes_content_type test.unit.proxy.test_server.TestReplicatedObjectController.test_proxy_passes_content_type ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_response_get_accept_ranges_header test.unit.proxy.test_server.TestReplicatedObjectController.test_response_get_accept_ranges_header ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_response_head_accept_ranges_header test.unit.proxy.test_server.TestReplicatedObjectController.test_response_head_accept_ranges_header ... ok test.unit.proxy.test_server.TestReplicatedObjectController.test_x_container_headers_db_states test.unit.proxy.test_server.TestReplicatedObjectController.test_x_container_headers_db_states ... ok cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "HEAD /sda1/2/a/c1" 204 - "HEAD http://localhost/v1/a/c1" "txfed41cb7761f4d26a4c7f-0068c570c2" "proxy-server 1824502" 0.0013 "-" 1824502 1 cont1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "DELETE /sda1/2/a/c1/wrong-o" 204 - "DELETE http://localhost/sdf1/1/a/c1/wrong-o" "tx4c655b001de5499f81f70-0068c570c2" "object-server 1824502" 0.0004 "-" 1824502 2 cont2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "DELETE /sdb1/2/a/c1/wrong-o" 204 - "DELETE http://localhost/sde1/1/a/c1/wrong-o" "tx4c655b001de5499f81f70-0068c570c2" "object-server 1824502" 0.0086 "-" 1824502 2 obj1 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "DELETE /sde1/1/a/c1/wrong-o" 204 - "DELETE http://localhost/v1/a/c1/wrong-o" "tx4c655b001de5499f81f70-0068c570c2" "proxy-server 1824502" 0.0169 "-" 1824502 2 obj2 INFO: 127.0.0.1 - - [13/Sep/2025:13:25:22 +0000] "DELETE /sdf1/1/a/c1/wrong-o" 204 - "DELETE http://localhost/v1/a/c1/wrong-o" "tx4c655b001de5499f81f70-0068c570c2" "proxy-server 1824502" 0.0264 "-" 1824502 2 proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx4875ef4f1e3448608826d-0068c570c2) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx4875ef4f1e3448608826d-0068c570c2) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx4875ef4f1e3448608826d-0068c570c2) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut INFO: Client disconnected on read of '/a/c/o' (txn: tx42195e8acae04625836cc-0068c570c2) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) proxy-ut DEBUG: Loaded override config for (default): ProxyOverrideOptions({}, {'sorting_method': 'shuffle', 'read_affinity': '', 'write_affinity': '', 'write_affinity_node_count': '2 * replicas', 'write_affinity_handoff_delete_count': None, 'rebalance_missing_suppression_count': 1, 'concurrent_gets': False, 'concurrency_timeout': 0.5, 'concurrent_ec_extra_requests': 0}, app) ---------------------------------------------------------------------- Ran 9702 tests in 103.277s OK (skipped=11) + stestr slowest Test id Runtime (s) ---------------------------------------------------------------------------------------------------------------------------- ----------- test.unit.container.test_backend.TestContainerBrokerBeforeXSync.test_merge_shard_ranges_state 8.736 test.unit.container.test_backend.TestContainerBroker.test_reclaim_deadlock 6.139 test.unit.container.test_backend.TestContainerBrokerBeforeMetadata.test_merge_shard_ranges_state 5.704 test.unit.proxy.controllers.test_container.TestGetShardedContainerLegacy.test_GET_sharded_container_shard_errors_no_memcache 5.666 test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_copy_encrypted_to_encrypted 5.532 test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_copy_encrypted_to_unencrypted 5.226 test.unit.container.test_backend.TestContainerBrokerBeforeSPI.test_merge_shard_ranges_state 5.092 test.unit.common.middleware.crypto.test_encryption.TestCryptoPipelineChanges.test_copy_unencrypted_to_encrypted 4.319 test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteAcl.test_object_multi_DELETE_lots_of_keys 4.151 test.unit.common.middleware.s3api.test_multi_delete.TestS3ApiMultiDeleteNoAcl.test_object_multi_DELETE_lots_of_keys 3.710 + rm -rf .stestr make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' dh_install -O--buildsystem=pybuild debian/rules override_dh_installdocs make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' dh_installdocs dh_installdocs -A AUTHORS dh_installdocs: warning: Not using auto-detected swift as main doc package for swift-doc: With -A/--all, this would cause file-conflicts. make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' debian/rules override_dh_sphinxdoc make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' LC_ALL=C.UTF-8 PYTHONPATH=. python3 -m sphinx doc/source /build/reproducible-path/swift-2.36.0/debian/swift-doc/usr/share/doc/swift-doc/base Running Sphinx v8.2.3 loading translations [en]... done [openstackdocstheme] version: 3.2.0 [openstackdocstheme] connecting html-page-context event handler making output directory... done Converting `source_suffix = '.rst'` to `source_suffix = {'.rst': 'restructuredtext'}`. [openstackdocstheme] using theme from /usr/lib/python3/dist-packages/openstackdocstheme/theme [openstackdocstheme] cannot find git top directory, assuming "." building [mo]: targets for 0 po files that are out of date writing output... building [html]: targets for 127 source files that are out of date updating environment: [new config] 127 added, 0 changed, 0 removed reading sources... [ 1%] account reading sources... [ 2%] admin/index reading sources... [ 2%] admin/objectstorage-EC reading sources... [ 3%] admin/objectstorage-account-reaper reading sources... [ 4%] admin/objectstorage-arch reading sources... [ 5%] admin/objectstorage-auditors reading sources... [ 6%] admin/objectstorage-characteristics reading sources... [ 6%] admin/objectstorage-components reading sources... [ 7%] admin/objectstorage-features reading sources... [ 8%] admin/objectstorage-intro reading sources... [ 9%] admin/objectstorage-large-objects reading sources... [ 9%] admin/objectstorage-monitoring reading sources... [ 10%] admin/objectstorage-replication reading sources... [ 11%] admin/objectstorage-ringbuilder reading sources... [ 12%] admin/objectstorage-tenant-specific-image-storage reading sources... [ 13%] admin/objectstorage-troubleshoot reading sources... [ 13%] admin_guide reading sources... [ 14%] apache_deployment_guide reading sources... [ 15%] api/authentication reading sources... [ 16%] api/bulk-delete reading sources... [ 17%] api/container_quotas reading sources... [ 17%] api/discoverability reading sources... [ 18%] api/form_post_middleware reading sources... [ 19%] api/large_objects reading sources... [ 20%] api/object-expiration reading sources... [ 20%] api/object_api_v1_overview reading sources... [ 21%] api/object_versioning reading sources... [ 22%] api/pagination reading sources... [ 23%] api/pseudo-hierarchical-folders-directories reading sources... [ 24%] api/serialized-response-formats reading sources... [ 24%] api/static-website reading sources... [ 25%] api/temporary_url_middleware reading sources... [ 26%] api/use_content-encoding_metadata reading sources... [ 27%] api/use_the_content-disposition_metadata reading sources... [ 28%] associated_projects reading sources... [ 28%] audit_watchers reading sources... [ 29%] config/account_server_config reading sources... [ 30%] config/container_server_config reading sources... [ 31%] config/global_memcache_config reading sources... [ 31%] config/index reading sources... [ 32%] config/object_server_config reading sources... [ 33%] config/proxy_server_config reading sources... [ 34%] config/swift_common_config reading sources... [ 35%] container reading sources... [ 35%] contributor/contributing reading sources... [ 36%] contributor/review_guidelines reading sources... [ 37%] cors reading sources... [ 38%] crossdomain reading sources... [ 39%] db reading sources... [ 39%] deployment_guide reading sources... [ 40%] development_auth reading sources... [ 41%] development_guidelines reading sources... [ 42%] development_middleware reading sources... [ 43%] development_ondisk_backends reading sources... [ 43%] development_saio reading sources... [ 44%] development_watchers reading sources... [ 45%] first_contribution_swift reading sources... [ 46%] getting_started reading sources... [ 46%] index reading sources... [ 47%] install/controller-install reading sources... [ 48%] install/controller-install-debian reading sources... [ 49%] install/controller-install-rdo reading sources... [ 50%] install/controller-install-ubuntu reading sources... [ 50%] install/environment-networking reading sources... [ 51%] install/finalize-installation reading sources... [ 52%] install/finalize-installation-rdo reading sources... [ 53%] install/finalize-installation-ubuntu-debian reading sources... [ 54%] install/get_started reading sources... [ 54%] install/index reading sources... [ 55%] install/initial-rings reading sources... [ 56%] install/next-steps reading sources... [ 57%] install/storage-install reading sources... [ 57%] install/storage-install-rdo reading sources... [ 58%] install/storage-install-ubuntu-debian reading sources... [ 59%] install/verify reading sources... [ 60%] logs reading sources... [ 61%] metrics/account_auditor reading sources... [ 61%] metrics/account_reaper reading sources... [ 62%] metrics/account_replicator reading sources... [ 63%] metrics/account_server reading sources... [ 64%] metrics/all reading sources... [ 65%] metrics/container_auditor reading sources... [ 65%] metrics/container_replicator reading sources... [ 66%] metrics/container_server reading sources... [ 67%] metrics/container_sync reading sources... [ 68%] metrics/container_updater reading sources... [ 69%] metrics/labels reading sources... [ 69%] metrics/object_auditor reading sources... [ 70%] metrics/object_expirer reading sources... [ 71%] metrics/object_reconstructor reading sources... [ 72%] metrics/object_replicator reading sources... [ 72%] metrics/object_server reading sources... [ 73%] metrics/object_updater reading sources... [ 74%] metrics/proxy_server reading sources... [ 75%] middleware reading sources... [ 76%] misc reading sources... [ 76%] object reading sources... [ 77%] ops_runbook/diagnose reading sources... [ 78%] ops_runbook/index reading sources... [ 79%] ops_runbook/maintenance reading sources... [ 80%] ops_runbook/procedures reading sources... [ 80%] ops_runbook/troubleshooting reading sources... [ 81%] overview_acl reading sources... [ 82%] overview_architecture reading sources... [ 83%] overview_auth reading sources... [ 83%] overview_backing_store reading sources... [ 84%] overview_container_sharding reading sources... [ 85%] overview_container_sync reading sources... [ 86%] overview_encryption reading sources... [ 87%] overview_erasure_code reading sources... [ 87%] overview_expiring_objects reading sources... [ 88%] overview_global_cluster reading sources... [ 89%] overview_large_objects reading sources... [ 90%] overview_policies reading sources... [ 91%] overview_reaper reading sources... [ 91%] overview_replication reading sources... [ 92%] overview_ring reading sources... [ 93%] overview_ring_format reading sources... [ 94%] overview_wsgi_management reading sources... [ 94%] policies_saio reading sources... [ 95%] proxy reading sources... [ 96%] ratelimit reading sources... [ 97%] replication_network reading sources... [ 98%] ring reading sources... [ 98%] ring_background reading sources... [ 99%] ring_partpower reading sources... [100%] s3_compat looking for now-outdated files... none found pickling environment... done checking consistency... /build/reproducible-path/swift-2.36.0/doc/source/api/object_api_v1_overview.rst: document is referenced in multiple toctrees: ['index', 'index'], selecting: index <- api/object_api_v1_overview done preparing documents... done copying assets... copying downloadable files... [100%] ../../../../etc/proxy-server.conf-sample copying static files... Writing evaluated template result to /build/reproducible-path/swift-2.36.0/debian/swift-doc/usr/share/doc/swift-doc/base/_static/language_data.js Writing evaluated template result to /build/reproducible-path/swift-2.36.0/debian/swift-doc/usr/share/doc/swift-doc/base/_static/documentation_options.js Writing evaluated template result to /build/reproducible-path/swift-2.36.0/debian/swift-doc/usr/share/doc/swift-doc/base/_static/basic.css copying static files: done copying extra files... copying extra files: done copying assets: done writing output... [ 1%] account /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/account.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'account' writing output... [ 2%] admin/index /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/index.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/index' writing output... [ 2%] admin/objectstorage-EC /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-EC.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-EC' writing output... [ 3%] admin/objectstorage-account-reaper /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-account-reaper.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-account-reaper' writing output... [ 4%] admin/objectstorage-arch /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-arch.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-arch' writing output... [ 5%] admin/objectstorage-auditors /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-auditors.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-auditors' writing output... [ 6%] admin/objectstorage-characteristics /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-characteristics.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-characteristics' writing output... [ 6%] admin/objectstorage-components /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-components.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-components' writing output... [ 7%] admin/objectstorage-features /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-features.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-features' writing output... [ 8%] admin/objectstorage-intro /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-intro.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-intro' writing output... [ 9%] admin/objectstorage-large-objects /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-large-objects.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-large-objects' writing output... [ 9%] admin/objectstorage-monitoring /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-monitoring.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-monitoring' writing output... [ 10%] admin/objectstorage-replication /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-replication.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-replication' writing output... [ 11%] admin/objectstorage-ringbuilder /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-ringbuilder.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-ringbuilder' writing output... [ 12%] admin/objectstorage-tenant-specific-image-storage /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-tenant-specific-image-storage.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-tenant-specific-image-storage' writing output... [ 13%] admin/objectstorage-troubleshoot /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin/objectstorage-troubleshoot.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin/objectstorage-troubleshoot' writing output... [ 13%] admin_guide /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/admin_guide.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'admin_guide' writing output... [ 14%] apache_deployment_guide /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/apache_deployment_guide.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'apache_deployment_guide' writing output... [ 15%] api/authentication /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/authentication.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/authentication' writing output... [ 16%] api/bulk-delete /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/bulk-delete.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/bulk-delete' writing output... [ 17%] api/container_quotas /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/container_quotas.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/container_quotas' writing output... [ 17%] api/discoverability /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/discoverability.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/discoverability' writing output... [ 18%] api/form_post_middleware /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/form_post_middleware.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/form_post_middleware' writing output... [ 19%] api/large_objects /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/large_objects.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/large_objects' writing output... [ 20%] api/object-expiration /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/object-expiration.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/object-expiration' writing output... [ 20%] api/object_api_v1_overview /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/object_api_v1_overview.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/object_api_v1_overview' writing output... [ 21%] api/object_versioning /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/object_versioning.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/object_versioning' writing output... [ 22%] api/pagination /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/pagination.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/pagination' writing output... [ 23%] api/pseudo-hierarchical-folders-directories /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/pseudo-hierarchical-folders-directories.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/pseudo-hierarchical-folders-directories' writing output... [ 24%] api/serialized-response-formats /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/serialized-response-formats.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/serialized-response-formats' writing output... [ 24%] api/static-website /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/static-website.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/static-website' writing output... [ 25%] api/temporary_url_middleware /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/temporary_url_middleware.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/temporary_url_middleware' writing output... [ 26%] api/use_content-encoding_metadata /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/use_content-encoding_metadata.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/use_content-encoding_metadata' writing output... [ 27%] api/use_the_content-disposition_metadata /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/api/use_the_content-disposition_metadata.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'api/use_the_content-disposition_metadata' writing output... [ 28%] associated_projects /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/associated_projects.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'associated_projects' writing output... [ 28%] audit_watchers /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/audit_watchers.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'audit_watchers' writing output... [ 29%] config/account_server_config /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/config/account_server_config.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'config/account_server_config' writing output... [ 30%] config/container_server_config /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/config/container_server_config.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'config/container_server_config' writing output... [ 31%] config/global_memcache_config /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/config/global_memcache_config.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'config/global_memcache_config' writing output... [ 31%] config/index /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/config/index.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'config/index' writing output... [ 32%] config/object_server_config /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/config/object_server_config.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'config/object_server_config' writing output... [ 33%] config/proxy_server_config /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/config/proxy_server_config.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'config/proxy_server_config' writing output... [ 34%] config/swift_common_config /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/config/swift_common_config.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'config/swift_common_config' writing output... [ 35%] container /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/container.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'container' writing output... [ 35%] contributor/contributing /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/contributor/contributing.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'contributor/contributing' writing output... [ 36%] contributor/review_guidelines /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/contributor/review_guidelines.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'contributor/review_guidelines' writing output... [ 37%] cors /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/cors.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'cors' writing output... [ 38%] crossdomain /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/crossdomain.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'crossdomain' writing output... [ 39%] db /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/db.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'db' writing output... [ 39%] deployment_guide /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/deployment_guide.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'deployment_guide' writing output... [ 40%] development_auth /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/development_auth.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'development_auth' writing output... [ 41%] development_guidelines /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/development_guidelines.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'development_guidelines' writing output... [ 42%] development_middleware /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/development_middleware.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'development_middleware' writing output... [ 43%] development_ondisk_backends /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/development_ondisk_backends.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'development_ondisk_backends' writing output... [ 43%] development_saio /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/development_saio.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'development_saio' writing output... [ 44%] development_watchers /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/development_watchers.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'development_watchers' writing output... [ 45%] first_contribution_swift /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/first_contribution_swift.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'first_contribution_swift' writing output... [ 46%] getting_started /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/getting_started.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'getting_started' writing output... [ 46%] index /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/index.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'index' writing output... [ 47%] install/controller-install /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/controller-install.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/controller-install' writing output... [ 48%] install/controller-install-debian /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/controller-install-debian.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/controller-install-debian' writing output... [ 49%] install/controller-install-rdo /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/controller-install-rdo.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/controller-install-rdo' writing output... [ 50%] install/controller-install-ubuntu /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/controller-install-ubuntu.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/controller-install-ubuntu' writing output... [ 50%] install/environment-networking /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/environment-networking.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/environment-networking' writing output... [ 51%] install/finalize-installation /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/finalize-installation.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/finalize-installation' writing output... [ 52%] install/finalize-installation-rdo /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/finalize-installation-rdo.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/finalize-installation-rdo' writing output... [ 53%] install/finalize-installation-ubuntu-debian /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/finalize-installation-ubuntu-debian.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/finalize-installation-ubuntu-debian' writing output... [ 54%] install/get_started /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/get_started.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/get_started' writing output... [ 54%] install/index /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/index.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/index' writing output... [ 55%] install/initial-rings /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/initial-rings.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/initial-rings' writing output... [ 56%] install/next-steps /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/next-steps.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/next-steps' writing output... [ 57%] install/storage-install /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/storage-install.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/storage-install' writing output... [ 57%] install/storage-install-rdo /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/storage-install-rdo.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/storage-install-rdo' writing output... [ 58%] install/storage-install-ubuntu-debian /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/storage-install-ubuntu-debian.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/storage-install-ubuntu-debian' writing output... [ 59%] install/verify /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/install/verify.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'install/verify' writing output... [ 60%] logs /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/logs.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'logs' writing output... [ 61%] metrics/account_auditor /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/account_auditor.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/account_auditor' writing output... [ 61%] metrics/account_reaper /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/account_reaper.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/account_reaper' writing output... [ 62%] metrics/account_replicator /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/account_replicator.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/account_replicator' writing output... [ 63%] metrics/account_server /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/account_server.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/account_server' writing output... [ 64%] metrics/all /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/all.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/all' writing output... [ 65%] metrics/container_auditor /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/container_auditor.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/container_auditor' writing output... [ 65%] metrics/container_replicator /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/container_replicator.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/container_replicator' writing output... [ 66%] metrics/container_server /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/container_server.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/container_server' writing output... [ 67%] metrics/container_sync /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/container_sync.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/container_sync' writing output... [ 68%] metrics/container_updater /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/container_updater.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/container_updater' writing output... [ 69%] metrics/labels /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/labels.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/labels' writing output... [ 69%] metrics/object_auditor /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/object_auditor.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/object_auditor' writing output... [ 70%] metrics/object_expirer /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/object_expirer.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/object_expirer' writing output... [ 71%] metrics/object_reconstructor /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/object_reconstructor.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/object_reconstructor' writing output... [ 72%] metrics/object_replicator /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/object_replicator.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/object_replicator' writing output... [ 72%] metrics/object_server /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/object_server.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/object_server' writing output... [ 73%] metrics/object_updater /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/object_updater.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/object_updater' writing output... [ 74%] metrics/proxy_server /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/metrics/proxy_server.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'metrics/proxy_server' writing output... [ 75%] middleware /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/middleware.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'middleware' writing output... [ 76%] misc /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/misc.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'misc' writing output... [ 76%] object /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/object.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'object' writing output... [ 77%] ops_runbook/diagnose /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/ops_runbook/diagnose.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'ops_runbook/diagnose' writing output... [ 78%] ops_runbook/index /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/ops_runbook/index.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'ops_runbook/index' writing output... [ 79%] ops_runbook/maintenance /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/ops_runbook/maintenance.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'ops_runbook/maintenance' writing output... [ 80%] ops_runbook/procedures /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/ops_runbook/procedures.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'ops_runbook/procedures' writing output... [ 80%] ops_runbook/troubleshooting /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/ops_runbook/troubleshooting.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'ops_runbook/troubleshooting' writing output... [ 81%] overview_acl /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_acl.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_acl' writing output... [ 82%] overview_architecture /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_architecture.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_architecture' writing output... [ 83%] overview_auth /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_auth.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_auth' writing output... [ 83%] overview_backing_store /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_backing_store.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_backing_store' writing output... [ 84%] overview_container_sharding /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_container_sharding.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_container_sharding' writing output... [ 85%] overview_container_sync /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_container_sync.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_container_sync' writing output... [ 86%] overview_encryption /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_encryption.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_encryption' writing output... [ 87%] overview_erasure_code /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_erasure_code.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_erasure_code' writing output... [ 87%] overview_expiring_objects /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_expiring_objects.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_expiring_objects' writing output... [ 88%] overview_global_cluster /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_global_cluster.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_global_cluster' writing output... [ 89%] overview_large_objects /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_large_objects.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_large_objects' writing output... [ 90%] overview_policies /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_policies.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_policies' writing output... [ 91%] overview_reaper /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_reaper.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_reaper' writing output... [ 91%] overview_replication /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_replication.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_replication' writing output... [ 92%] overview_ring /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_ring.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_ring' writing output... [ 93%] overview_ring_format /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_ring_format.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_ring_format' writing output... [ 94%] overview_wsgi_management /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/overview_wsgi_management.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'overview_wsgi_management' writing output... [ 94%] policies_saio /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/policies_saio.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'policies_saio' writing output... [ 95%] proxy /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/proxy.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'proxy' writing output... [ 96%] ratelimit /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/ratelimit.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'ratelimit' writing output... [ 97%] replication_network /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/replication_network.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'replication_network' writing output... [ 98%] ring /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/ring.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'ring' writing output... [ 98%] ring_background /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/ring_background.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'ring_background' writing output... [ 99%] ring_partpower /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/ring_partpower.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'ring_partpower' writing output... [100%] s3_compat /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/s3_compat.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 's3_compat' WARNING: [openstackdocstheme] cannot get gitsha from git repository generating indices... genindex /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') py-modindex [openstackdocstheme] could not determine last_updated for 'py-modindex' done writing additional pages... search done copying images... [ 4%] admin/figures/objectstorage-arch.png copying images... [ 8%] admin/figures/objectstorage-nodes.png copying images... [ 12%] admin/figures/objectstorage.png copying images... [ 17%] admin/figures/objectstorage-buildingblocks.png copying images... [ 21%] admin/figures/objectstorage-ring.png copying images... [ 25%] admin/figures/objectstorage-zones.png copying images... [ 29%] admin/figures/objectstorage-accountscontainers.png copying images... [ 33%] admin/figures/objectstorage-partitions.png copying images... [ 38%] admin/figures/objectstorage-replication.png copying images... [ 42%] admin/figures/objectstorage-usecase.png copying images... [ 46%] images/sharding_unsharded.svg copying images... [ 50%] images/sharding_scan_basic.svg copying images... [ 54%] images/sharding_db_states.svg copying images... [ 58%] images/sharding_cleave_basic.svg copying images... [ 62%] images/sharding_scan_load.svg copying images... [ 67%] images/sharding_cleave1_load.svg copying images... [ 71%] images/sharding_cleave2_load.svg copying images... [ 75%] images/ec_overview.png copying images... [ 79%] images/reload_process_tree_1.svg copying images... [ 83%] images/reload_process_tree_2.svg copying images... [ 88%] images/reload_process_tree_3.svg copying images... [ 92%] images/reload_process_tree_4.svg copying images... [ 96%] images/reload_process_tree_5.svg copying images... [100%] images/reload_process_tree_6.svg dumping search index in English (code: en)... done dumping object inventory... done build succeeded, 1 warning. The HTML pages are in debian/swift-doc/usr/share/doc/swift-doc/base. LC_ALL=C.UTF-8 PYTHONPATH=. python3 -m sphinx api-ref/source /build/reproducible-path/swift-2.36.0/debian/swift-doc/usr/share/doc/swift-doc/api-ref Running Sphinx v8.2.3 loading translations [en]... done [openstackdocstheme] version: 3.2.0 [openstackdocstheme] connecting html-page-context event handler making output directory... done [openstackdocstheme] overriding configured project name (Object Storage API Reference) with name extracted from the package (swift); you can disable this behavior with the 'openstackdocs_auto_name' option Converting `source_suffix = '.rst'` to `source_suffix = {'.rst': 'restructuredtext'}`. [openstackdocstheme] using theme from /usr/lib/python3/dist-packages/openstackdocstheme/theme [openstackdocstheme] cannot find git top directory, assuming "." building [mo]: targets for 0 po files that are out of date writing output... building [html]: targets for 1 source files that are out of date updating environment: [new config] 1 added, 0 changed, 0 removed reading sources... [100%] index looking for now-outdated files... none found pickling environment... done checking consistency... done preparing documents... done copying assets... copying static files... Writing evaluated template result to /build/reproducible-path/swift-2.36.0/debian/swift-doc/usr/share/doc/swift-doc/api-ref/_static/language_data.js Writing evaluated template result to /build/reproducible-path/swift-2.36.0/debian/swift-doc/usr/share/doc/swift-doc/api-ref/_static/documentation_options.js Writing evaluated template result to /build/reproducible-path/swift-2.36.0/debian/swift-doc/usr/share/doc/swift-doc/api-ref/_static/basic.css copying static files: done copying extra files... copying extra files: done copying assets: done writing output... [100%] index /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') [openstackdocstheme] Could not get modification time of doc/source/index.rst: [Errno 2] No such file or directory: 'git' [openstackdocstheme] could not determine last_updated for 'index' WARNING: [openstackdocstheme] cannot get gitsha from git repository generating indices... genindex /usr/lib/python3/dist-packages/openstackdocstheme/page_context.py:70: RemovedInSphinx90Warning: Sphinx 9 will drop support for representing paths as strings. Use "pathlib.Path" or "os.fspath" instead. src_file = full_src_file[len(str(app.builder.env.srcdir)):].lstrip('/') done writing additional pages... search done dumping search index in English (code: en)... done dumping object inventory... done Copying assets: api-site.css, api-site.js, combobox.js build succeeded, 1 warning. The HTML pages are in debian/swift-doc/usr/share/doc/swift-doc/api-ref. dh_sphinxdoc dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/api-ref/_static/js/jquery-3.2.1.min.js dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/api-ref/_static/combobox.js dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/api-ref/_static/api-site.js dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/api-ref/_static/js/navigation.js dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/api-ref/_static/js/bootstrap.min.js dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/api-ref/_static/js/docs.js dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/base/_static/js/jquery-3.2.1.min.js dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/base/_static/js/bootstrap.min.js dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/base/_static/js/navigation.js dh_sphinxdoc: warning: ignoring unknown JavaScript code: debian/swift-doc/usr/share/doc/swift-doc/base/_static/js/docs.js make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' debian/rules override_dh_installchangelogs make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' if [ -e /build/reproducible-path/swift-2.36.0/debian/CHANGELOG ] ; then \ dh_installchangelogs /build/reproducible-path/swift-2.36.0/debian/CHANGELOG ; \ else \ dh_installchangelogs ; \ fi make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' dh_installman -O--buildsystem=pybuild dh_installcron -O--buildsystem=pybuild debian/rules override_dh_python3 make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' dh_python3 --shebang=/usr/bin/python3 I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-ring-composer I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-ring-builder-analyzer I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-ring-builder I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-reload I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-recon I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-orphans I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-oldies I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-get-nodes I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-form-signature I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-drive-full-checker I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-dispersion-report I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-dispersion-populate I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-container-deleter I: dh_python3 tools:114: replacing shebang in debian/swift/usr/bin/swift-config I: dh_python3 tools:114: replacing shebang in debian/swift-account/usr/bin/swift-account-server I: dh_python3 tools:114: replacing shebang in debian/swift-account/usr/bin/swift-account-replicator I: dh_python3 tools:114: replacing shebang in debian/swift-account/usr/bin/swift-account-reaper I: dh_python3 tools:114: replacing shebang in debian/swift-account/usr/bin/swift-account-info I: dh_python3 tools:114: replacing shebang in debian/swift-account/usr/bin/swift-account-auditor I: dh_python3 tools:114: replacing shebang in debian/swift-account/usr/bin/swift-account-audit I: dh_python3 tools:114: replacing shebang in debian/swift-account/usr/bin/swift-account-server-uwsgi I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-reconciler-enqueue I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-manage-shard-ranges I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-container-updater I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-container-sync I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-container-sharder I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-container-server I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-container-replicator I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-container-reconciler I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-container-info I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-container-auditor I: dh_python3 tools:114: replacing shebang in debian/swift-container/usr/bin/swift-container-server-uwsgi I: dh_python3 tools:114: replacing shebang in debian/swift-drive-audit/usr/bin/swift-drive-audit I: dh_python3 tools:114: replacing shebang in debian/swift-object/usr/bin/swift-recon-cron I: dh_python3 tools:114: replacing shebang in debian/swift-object/usr/bin/swift-object-updater I: dh_python3 tools:114: replacing shebang in debian/swift-object/usr/bin/swift-object-server I: dh_python3 tools:114: replacing shebang in debian/swift-object/usr/bin/swift-object-replicator I: dh_python3 tools:114: replacing shebang in debian/swift-object/usr/bin/swift-object-relinker I: dh_python3 tools:114: replacing shebang in debian/swift-object/usr/bin/swift-object-reconstructor I: dh_python3 tools:114: replacing shebang in debian/swift-object/usr/bin/swift-object-info I: dh_python3 tools:114: replacing shebang in debian/swift-object/usr/bin/swift-object-auditor I: dh_python3 tools:114: replacing shebang in debian/swift-object/usr/bin/swift-object-server-uwsgi I: dh_python3 tools:114: replacing shebang in debian/swift-object-expirer/usr/bin/swift-object-expirer I: dh_python3 tools:114: replacing shebang in debian/swift-proxy/usr/bin/swift-proxy-server I: dh_python3 tools:114: replacing shebang in debian/swift-proxy/usr/bin/swift-proxy-server-uwsgi make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' debian/rules override_dh_installinit make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' echo "Do nothing" Do nothing set -e ; set -x ; \ for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ; do \ PKG=`echo $FILE | cut -d. -f1` ; \ NAME=`echo $FILE | cut -d. -f2` ; \ dh_installinit --error-handler=true -p$PKG --name=$NAME ;\ done + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ cut -d. -f1 ++ echo swift-account.swift-account-auditor.init + PKG=swift-account ++ cut -d. -f2 ++ echo swift-account.swift-account-auditor.init + NAME=swift-account-auditor + dh_installinit --error-handler=true -pswift-account --name=swift-account-auditor + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-account.swift-account-reaper.init ++ cut -d. -f1 + PKG=swift-account ++ cut -d. -f2 ++ echo swift-account.swift-account-reaper.init + NAME=swift-account-reaper + dh_installinit --error-handler=true -pswift-account --name=swift-account-reaper + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-account.swift-account-replicator.init ++ cut -d. -f1 + PKG=swift-account ++ echo swift-account.swift-account-replicator.init ++ cut -d. -f2 + NAME=swift-account-replicator + dh_installinit --error-handler=true -pswift-account --name=swift-account-replicator + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-account.swift-account.init ++ cut -d. -f1 + PKG=swift-account ++ cut -d. -f2 ++ echo swift-account.swift-account.init + NAME=swift-account + dh_installinit --error-handler=true -pswift-account --name=swift-account + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ cut -d. -f1 ++ echo swift-container.swift-container-auditor.init + PKG=swift-container ++ echo swift-container.swift-container-auditor.init ++ cut -d. -f2 + NAME=swift-container-auditor + dh_installinit --error-handler=true -pswift-container --name=swift-container-auditor + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-container.swift-container-reconciler.init ++ cut -d. -f1 + PKG=swift-container ++ cut -d. -f2 ++ echo swift-container.swift-container-reconciler.init + NAME=swift-container-reconciler + dh_installinit --error-handler=true -pswift-container --name=swift-container-reconciler + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-container.swift-container-replicator.init ++ cut -d. -f1 + PKG=swift-container ++ echo swift-container.swift-container-replicator.init ++ cut -d. -f2 + NAME=swift-container-replicator + dh_installinit --error-handler=true -pswift-container --name=swift-container-replicator + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ cut -d. -f1 ++ echo swift-container.swift-container-sharder.init + PKG=swift-container ++ cut -d. -f2 ++ echo swift-container.swift-container-sharder.init + NAME=swift-container-sharder + dh_installinit --error-handler=true -pswift-container --name=swift-container-sharder + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-container.swift-container-sync.init ++ cut -d. -f1 + PKG=swift-container ++ echo swift-container.swift-container-sync.init ++ cut -d. -f2 + NAME=swift-container-sync + dh_installinit --error-handler=true -pswift-container --name=swift-container-sync + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-container.swift-container-updater.init ++ cut -d. -f1 + PKG=swift-container ++ cut -d. -f2 ++ echo swift-container.swift-container-updater.init + NAME=swift-container-updater + dh_installinit --error-handler=true -pswift-container --name=swift-container-updater + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ cut -d. -f1 ++ echo swift-container.swift-container.init + PKG=swift-container ++ cut -d. -f2 ++ echo swift-container.swift-container.init + NAME=swift-container + dh_installinit --error-handler=true -pswift-container --name=swift-container + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-object-expirer.swift-object-expirer.init ++ cut -d. -f1 + PKG=swift-object-expirer ++ echo swift-object-expirer.swift-object-expirer.init ++ cut -d. -f2 + NAME=swift-object-expirer + dh_installinit --error-handler=true -pswift-object-expirer --name=swift-object-expirer + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-object.swift-object-auditor.init ++ cut -d. -f1 + PKG=swift-object ++ cut -d. -f2 ++ echo swift-object.swift-object-auditor.init + NAME=swift-object-auditor + dh_installinit --error-handler=true -pswift-object --name=swift-object-auditor + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-object.swift-object-reconstructor.init ++ cut -d. -f1 + PKG=swift-object ++ echo swift-object.swift-object-reconstructor.init ++ cut -d. -f2 + NAME=swift-object-reconstructor + dh_installinit --error-handler=true -pswift-object --name=swift-object-reconstructor + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ cut -d. -f1 ++ echo swift-object.swift-object-replicator.init + PKG=swift-object ++ cut -d. -f2 ++ echo swift-object.swift-object-replicator.init + NAME=swift-object-replicator + dh_installinit --error-handler=true -pswift-object --name=swift-object-replicator + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ echo swift-object.swift-object-updater.init ++ cut -d. -f1 + PKG=swift-object ++ cut -d. -f2 ++ echo swift-object.swift-object-updater.init + NAME=swift-object-updater + dh_installinit --error-handler=true -pswift-object --name=swift-object-updater + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ cut -d. -f1 ++ echo swift-object.swift-object.init + PKG=swift-object ++ echo swift-object.swift-object.init ++ cut -d. -f2 + NAME=swift-object + dh_installinit --error-handler=true -pswift-object --name=swift-object + for FILE in swift-account.swift-account-auditor.init swift-account.swift-account-reaper.init swift-account.swift-account-replicator.init swift-account.swift-account.init swift-container.swift-container-auditor.init swift-container.swift-container-reconciler.init swift-container.swift-container-replicator.init swift-container.swift-container-sharder.init swift-container.swift-container-sync.init swift-container.swift-container-updater.init swift-container.swift-container.init swift-object-expirer.swift-object-expirer.init swift-object.swift-object-auditor.init swift-object.swift-object-reconstructor.init swift-object.swift-object-replicator.init swift-object.swift-object-updater.init swift-object.swift-object.init swift-proxy.swift-proxy.init ++ cut -d. -f1 ++ echo swift-proxy.swift-proxy.init + PKG=swift-proxy ++ cut -d. -f2 ++ echo swift-proxy.swift-proxy.init + NAME=swift-proxy + dh_installinit --error-handler=true -pswift-proxy --name=swift-proxy make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' debian/rules override_dh_installsystemd make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' echo "Do nothing" Do nothing set -e ; set -x ; \ for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ; do \ PKG=`echo $FILE | cut -d. -f1` ; \ NAME=`echo $FILE | cut -d. -f2` ; \ dh_installsystemd -p$PKG --name=$NAME ;\ done + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-account.swift-account-auditor.service ++ cut -d. -f1 + PKG=swift-account ++ cut -d. -f2 ++ echo swift-account.swift-account-auditor.service + NAME=swift-account-auditor + dh_installsystemd -pswift-account --name=swift-account-auditor + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-account.swift-account-auditor@.service ++ cut -d. -f1 + PKG=swift-account ++ echo swift-account.swift-account-auditor@.service ++ cut -d. -f2 + NAME=swift-account-auditor@ + dh_installsystemd -pswift-account --name=swift-account-auditor@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-account.swift-account-reaper.service + PKG=swift-account ++ cut -d. -f2 ++ echo swift-account.swift-account-reaper.service + NAME=swift-account-reaper + dh_installsystemd -pswift-account --name=swift-account-reaper + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-account.swift-account-reaper@.service ++ cut -d. -f1 + PKG=swift-account ++ echo swift-account.swift-account-reaper@.service ++ cut -d. -f2 + NAME=swift-account-reaper@ + dh_installsystemd -pswift-account --name=swift-account-reaper@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-account.swift-account-replicator.service ++ cut -d. -f1 + PKG=swift-account ++ echo swift-account.swift-account-replicator.service ++ cut -d. -f2 + NAME=swift-account-replicator + dh_installsystemd -pswift-account --name=swift-account-replicator + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-account.swift-account-replicator@.service ++ cut -d. -f1 + PKG=swift-account ++ echo swift-account.swift-account-replicator@.service ++ cut -d. -f2 + NAME=swift-account-replicator@ + dh_installsystemd -pswift-account --name=swift-account-replicator@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-account.swift-account.service ++ cut -d. -f1 + PKG=swift-account ++ cut -d. -f2 ++ echo swift-account.swift-account.service + NAME=swift-account + dh_installsystemd -pswift-account --name=swift-account + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-container.swift-container-auditor.service + PKG=swift-container ++ echo swift-container.swift-container-auditor.service ++ cut -d. -f2 + NAME=swift-container-auditor + dh_installsystemd -pswift-container --name=swift-container-auditor + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-container.swift-container-auditor@.service ++ cut -d. -f1 + PKG=swift-container ++ cut -d. -f2 ++ echo swift-container.swift-container-auditor@.service + NAME=swift-container-auditor@ + dh_installsystemd -pswift-container --name=swift-container-auditor@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-container.swift-container-reconciler.service + PKG=swift-container ++ echo swift-container.swift-container-reconciler.service ++ cut -d. -f2 + NAME=swift-container-reconciler + dh_installsystemd -pswift-container --name=swift-container-reconciler + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-container.swift-container-replicator.service + PKG=swift-container ++ cut -d. -f2 ++ echo swift-container.swift-container-replicator.service + NAME=swift-container-replicator + dh_installsystemd -pswift-container --name=swift-container-replicator + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-container.swift-container-replicator@.service + PKG=swift-container ++ cut -d. -f2 ++ echo swift-container.swift-container-replicator@.service + NAME=swift-container-replicator@ + dh_installsystemd -pswift-container --name=swift-container-replicator@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-container.swift-container-sharder.service + PKG=swift-container ++ echo swift-container.swift-container-sharder.service ++ cut -d. -f2 + NAME=swift-container-sharder + dh_installsystemd -pswift-container --name=swift-container-sharder + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-container.swift-container-sharder@.service ++ cut -d. -f1 + PKG=swift-container ++ echo swift-container.swift-container-sharder@.service ++ cut -d. -f2 + NAME=swift-container-sharder@ + dh_installsystemd -pswift-container --name=swift-container-sharder@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-container.swift-container-sync.service + PKG=swift-container ++ echo swift-container.swift-container-sync.service ++ cut -d. -f2 + NAME=swift-container-sync + dh_installsystemd -pswift-container --name=swift-container-sync + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-container.swift-container-sync@.service ++ cut -d. -f1 + PKG=swift-container ++ echo swift-container.swift-container-sync@.service ++ cut -d. -f2 + NAME=swift-container-sync@ + dh_installsystemd -pswift-container --name=swift-container-sync@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-container.swift-container-updater.service ++ cut -d. -f1 + PKG=swift-container ++ echo swift-container.swift-container-updater.service ++ cut -d. -f2 + NAME=swift-container-updater + dh_installsystemd -pswift-container --name=swift-container-updater + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-container.swift-container-updater@.service ++ cut -d. -f1 + PKG=swift-container ++ cut -d. -f2 ++ echo swift-container.swift-container-updater@.service + NAME=swift-container-updater@ + dh_installsystemd -pswift-container --name=swift-container-updater@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-container.swift-container.service ++ cut -d. -f1 + PKG=swift-container ++ echo swift-container.swift-container.service ++ cut -d. -f2 + NAME=swift-container + dh_installsystemd -pswift-container --name=swift-container + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-object-expirer.swift-object-expirer.service ++ cut -d. -f1 + PKG=swift-object-expirer ++ echo swift-object-expirer.swift-object-expirer.service ++ cut -d. -f2 + NAME=swift-object-expirer + dh_installsystemd -pswift-object-expirer --name=swift-object-expirer + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-object.swift-object-auditor.service ++ cut -d. -f1 + PKG=swift-object ++ echo swift-object.swift-object-auditor.service ++ cut -d. -f2 + NAME=swift-object-auditor + dh_installsystemd -pswift-object --name=swift-object-auditor + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-object.swift-object-auditor@.service + PKG=swift-object ++ cut -d. -f2 ++ echo swift-object.swift-object-auditor@.service + NAME=swift-object-auditor@ + dh_installsystemd -pswift-object --name=swift-object-auditor@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-object.swift-object-reconstructor.service ++ cut -d. -f1 + PKG=swift-object ++ cut -d. -f2 ++ echo swift-object.swift-object-reconstructor.service + NAME=swift-object-reconstructor + dh_installsystemd -pswift-object --name=swift-object-reconstructor + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-object.swift-object-reconstructor@.service + PKG=swift-object ++ echo swift-object.swift-object-reconstructor@.service ++ cut -d. -f2 + NAME=swift-object-reconstructor@ + dh_installsystemd -pswift-object --name=swift-object-reconstructor@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-object.swift-object-replicator.service + PKG=swift-object ++ cut -d. -f2 ++ echo swift-object.swift-object-replicator.service + NAME=swift-object-replicator + dh_installsystemd -pswift-object --name=swift-object-replicator + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-object.swift-object-replicator@.service + PKG=swift-object ++ echo swift-object.swift-object-replicator@.service ++ cut -d. -f2 + NAME=swift-object-replicator@ + dh_installsystemd -pswift-object --name=swift-object-replicator@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-object.swift-object-updater.service + PKG=swift-object ++ cut -d. -f2 ++ echo swift-object.swift-object-updater.service + NAME=swift-object-updater + dh_installsystemd -pswift-object --name=swift-object-updater + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-object.swift-object-updater@.service ++ cut -d. -f1 + PKG=swift-object ++ cut -d. -f2 ++ echo swift-object.swift-object-updater@.service + NAME=swift-object-updater@ + dh_installsystemd -pswift-object --name=swift-object-updater@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-object.swift-object.service + PKG=swift-object ++ echo swift-object.swift-object.service ++ cut -d. -f2 + NAME=swift-object + dh_installsystemd -pswift-object --name=swift-object + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ cut -d. -f1 ++ echo swift-object.swift-object@.service + PKG=swift-object ++ cut -d. -f2 ++ echo swift-object.swift-object@.service + NAME=swift-object@ + dh_installsystemd -pswift-object --name=swift-object@ + for FILE in swift-account.swift-account-auditor.service swift-account.swift-account-auditor@.service swift-account.swift-account-reaper.service swift-account.swift-account-reaper@.service swift-account.swift-account-replicator.service swift-account.swift-account-replicator@.service swift-account.swift-account.service swift-container.swift-container-auditor.service swift-container.swift-container-auditor@.service swift-container.swift-container-reconciler.service swift-container.swift-container-replicator.service swift-container.swift-container-replicator@.service swift-container.swift-container-sharder.service swift-container.swift-container-sharder@.service swift-container.swift-container-sync.service swift-container.swift-container-sync@.service swift-container.swift-container-updater.service swift-container.swift-container-updater@.service swift-container.swift-container.service swift-object-expirer.swift-object-expirer.service swift-object.swift-object-auditor.service swift-object.swift-object-auditor@.service swift-object.swift-object-reconstructor.service swift-object.swift-object-reconstructor@.service swift-object.swift-object-replicator.service swift-object.swift-object-replicator@.service swift-object.swift-object-updater.service swift-object.swift-object-updater@.service swift-object.swift-object.service swift-object.swift-object@.service swift-proxy.swift-proxy.service ++ echo swift-proxy.swift-proxy.service ++ cut -d. -f1 + PKG=swift-proxy ++ cut -d. -f2 ++ echo swift-proxy.swift-proxy.service + NAME=swift-proxy + dh_installsystemd -pswift-proxy --name=swift-proxy make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' dh_installsystemduser -O--buildsystem=pybuild dh_installlogrotate -O--buildsystem=pybuild dh_lintian -O--buildsystem=pybuild dh_perl -O--buildsystem=pybuild dh_link -O--buildsystem=pybuild dh_strip_nondeterminism -O--buildsystem=pybuild dh_compress -O--buildsystem=pybuild dh_fixperms -O--buildsystem=pybuild debian/rules override_dh_missing make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' dh_missing --fail-missing make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' dh_installdeb -O--buildsystem=pybuild debian/rules override_dh_gencontrol make[1]: Entering directory '/build/reproducible-path/swift-2.36.0' make[1]: pyversions: No such file or directory py3versions: no X-Python3-Version in control file, using supported versions debian/rules:69: warning: overriding recipe for target 'override_dh_installinit' /usr/share/openstack-pkg-tools/pkgos.make:44: warning: ignoring old recipe for target 'override_dh_installinit' debian/rules:77: warning: overriding recipe for target 'override_dh_installsystemd' /usr/share/openstack-pkg-tools/pkgos.make:41: warning: ignoring old recipe for target 'override_dh_installsystemd' debian/rules:85: warning: overriding recipe for target 'gen-init-configurations' /usr/share/openstack-pkg-tools/pkgos.make:20: warning: ignoring old recipe for target 'gen-init-configurations' if dpkg-vendor --derives-from ubuntu ; then \ dh_gencontrol -- -T/build/reproducible-path/swift-2.36.0/debian/ubuntu_control_vars ; \ else \ dh_gencontrol -- -T/build/reproducible-path/swift-2.36.0/debian/debian_control_vars ; \ fi dpkg-gencontrol: warning: package swift-doc: substitution variable ${sphinxdoc:Built-Using} unused, but is defined make[1]: Leaving directory '/build/reproducible-path/swift-2.36.0' dh_md5sums -O--buildsystem=pybuild dh_builddeb -O--buildsystem=pybuild dpkg-deb: building package 'python3-swift' in '../python3-swift_2.36.0-2_all.deb'. dpkg-deb: building package 'swift' in '../swift_2.36.0-2_all.deb'. dpkg-deb: building package 'swift-account' in '../swift-account_2.36.0-2_all.deb'. dpkg-deb: building package 'swift-doc' in '../swift-doc_2.36.0-2_all.deb'. dpkg-deb: building package 'swift-drive-audit' in '../swift-drive-audit_2.36.0-2_all.deb'. dpkg-deb: building package 'swift-container' in '../swift-container_2.36.0-2_all.deb'. dpkg-deb: building package 'swift-object' in '../swift-object_2.36.0-2_all.deb'. dpkg-deb: building package 'swift-object-expirer' in '../swift-object-expirer_2.36.0-2_all.deb'. dpkg-deb: building package 'swift-proxy' in '../swift-proxy_2.36.0-2_all.deb'. dpkg-genbuildinfo --build=binary -O../swift_2.36.0-2_arm64.buildinfo dpkg-genchanges --build=binary -O../swift_2.36.0-2_arm64.changes dpkg-genchanges: info: binary-only upload (no source code included) dpkg-source --after-build . dpkg-source: info: using options from swift-2.36.0/debian/source/options: --extend-diff-ignore=^[^/]*[.]egg-info/ --extend-diff-ignore=^[.]gitreview$ dpkg-buildpackage: info: binary-only upload (no source included) dpkg-genchanges: info: not including original source code in upload I: copying local configuration I: user script /srv/workspace/pbuilder/1784759/tmp/hooks/B01_cleanup starting I: user script /srv/workspace/pbuilder/1784759/tmp/hooks/B01_cleanup finished I: unmounting dev/ptmx filesystem I: unmounting dev/pts filesystem I: unmounting dev/shm filesystem I: unmounting proc filesystem I: unmounting sys filesystem I: cleaning the build env I: removing directory /srv/workspace/pbuilder/1784759 and its subdirectories I: Current time: Sun Sep 14 03:27:35 +14 2025 I: pbuilder-time-stamp: 1757770055